1
|
Townsend PH, Jones A, Patel AD, Race E. Rhythmic Temporal Cues Coordinate Cross-frequency Phase-amplitude Coupling during Memory Encoding. J Cogn Neurosci 2024; 36:2100-2116. [PMID: 38991125 DOI: 10.1162/jocn_a_02217] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 07/13/2024]
Abstract
Accumulating evidence suggests that rhythmic temporal cues in the environment influence the encoding of information into long-term memory. Here, we test the hypothesis that these mnemonic effects of rhythm reflect the coupling of high-frequency (gamma) oscillations to entrained lower-frequency oscillations synchronized to the beat of the rhythm. In Study 1, we first test this hypothesis in the context of global effects of rhythm on memory, when memory is superior for visual stimuli presented in rhythmic compared with arrhythmic patterns at encoding [Jones, A., & Ward, E. V. Rhythmic temporal structure at encoding enhances recognition memory, Journal of Cognitive Neuroscience, 31, 1549-1562, 2019]. We found that rhythmic presentation of visual stimuli during encoding was associated with greater phase-amplitude coupling (PAC) between entrained low-frequency (delta) oscillations and higher-frequency (gamma) oscillations. In Study 2, we next investigated cross-frequency PAC in the context of local effects of rhythm on memory encoding, when memory is superior for visual stimuli presented in-synchrony compared with out-of-synchrony with a background auditory beat [Hickey, P., Merseal, H., Patel, A. D., & Race, E. Memory in time: Neural tracking of low-frequency rhythm dynamically modulates memory formation. Neuroimage, 213, 116693, 2020]. We found that the mnemonic effect of rhythm in this context was again associated with increased cross-frequency PAC between entrained low-frequency (delta) oscillations and higher-frequency (gamma) oscillations. Furthermore, the magnitude of gamma power modulations positively scaled with the subsequent memory benefit for in- versus out-of-synchrony stimuli. Together, these results suggest that the influence of rhythm on memory encoding may reflect the temporal coordination of higher-frequency gamma activity by entrained low-frequency oscillations.
Collapse
Affiliation(s)
- Paige Hickey Townsend
- Massachusetts General Hospital, Charlestown, MA
- Athinoula A. Martinos Center for Biomedical Imaging, Charlestown, MA
| | | | - Aniruddh D Patel
- Tufts University, Medford, MA
- Canadian Institute for Advanced Research
| | | |
Collapse
|
2
|
Baykan C, Zhu X, Zinchenko A, Shi Z. Blocked versus interleaved: How range contexts modulate time perception and its EEG signatures. Psychophysiology 2024; 61:e14585. [PMID: 38594873 DOI: 10.1111/psyp.14585] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/29/2023] [Revised: 03/21/2024] [Accepted: 03/28/2024] [Indexed: 04/11/2024]
Abstract
Accurate time perception is a crucial element in a wide range of cognitive tasks, including decision-making, memory, and motor control. One commonly observed phenomenon is that when given a range of time intervals to consider, people's estimates often cluster around the midpoint of those intervals. Previous studies have suggested that the range of these intervals can also influence our judgments, but the neural mechanisms behind this "range effect" are not yet understood. We used both behavioral tests and electroencephalographic (EEG) measures to understand how the range of sample time intervals affects the accuracy of people's subsequent time estimates. Study participants were exposed to two different setups: In the "blocked-range" (BR) session, short and long intervals were presented in separate blocks, whereas in the "interleaved-range" (IR) session, intervals of various lengths were presented randomly. Our findings indicated that the BR context led to more accurate time estimates compared to the IR context. In terms of EEG data, the BR context resulted in quicker buildup of contingent negative variation (CNV), which also reached higher amplitude levels and dissolved more rapidly during the encoding stage. We also observed an enhanced amplitude in the offset P2 component of the EEG signal. Overall, our results suggest that the variability in time intervals, as defined by their range, influences the neural processes that underlie time estimation.
Collapse
Affiliation(s)
- Cemre Baykan
- General and Experimental Psychology, Department of Psychology, Ludwig-Maximilians-Universität München, Munich, Germany
- General and Biological Psychology, Department of Psychology, Philipps-Universität Marburg, Marburg, Germany
| | - Xiuna Zhu
- General and Experimental Psychology, Department of Psychology, Ludwig-Maximilians-Universität München, Munich, Germany
| | - Artyom Zinchenko
- General and Experimental Psychology, Department of Psychology, Ludwig-Maximilians-Universität München, Munich, Germany
| | - Zhuanghua Shi
- General and Experimental Psychology, Department of Psychology, Ludwig-Maximilians-Universität München, Munich, Germany
| |
Collapse
|
3
|
Ren R, An W, Yu Y, Tang X, Ejima Y, Wu J, Yang J. Tactile temporal predictions: The influence of conditional probability. Iperception 2024; 15:20416695241264736. [PMID: 39055288 PMCID: PMC11268028 DOI: 10.1177/20416695241264736] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/26/2024] [Accepted: 06/12/2024] [Indexed: 07/27/2024] Open
Abstract
Predicting the timing of incoming information allows brain to optimize information processing in dynamic environments. However, the effects of temporal predictions on tactile perception are not well established. In this study, two experiments were conducted to determine how temporal predictions interact with conditional probabilities in tactile perceptual processing. In Experiment 1, we explored the range of the interval between preceding ready cues and imperative targets in which temporal prediction effects can be observed. This prediction effect was observed for intervals of 500 and 1,000 ms. In Experiment 2, we investigated the benefits of temporal predictions on tactile perception while manipulating the conditional probability (setting the stimulus onset earlier or later than the predicted moment in short and long intervals). Our results revealed that this effect became stronger as the probability of the stimulus at the predicted time point increased under short-interval conditions. Together, our results show that the difficulty of transferring processing resources increases in temporally dynamic environments, suggesting a greater subjective cost associated with maladaptive responses to temporally uncertain events.
Collapse
Affiliation(s)
- Rongxia Ren
- Graduate School of Interdisciplinary Science and Engineering in Health Systems, Okayama University, Okayama, Japan
| | - Weichao An
- Graduate School of Interdisciplinary Science and Engineering in Health Systems, Okayama University, Okayama, Japan
| | - Yinghua Yu
- Graduate School of Interdisciplinary Science and Engineering in Health Systems, Okayama University, Okayama, Japan
| | - Xiaoyu Tang
- School of Psychology, Liaoning Collaborative Innovation Center of Children and Adolescents Healthy Personality Assessment and Cultivation, Liaoning Normal University, Dalian, China
| | - Yoshimichi Ejima
- Graduate School of Interdisciplinary Science and Engineering in Health Systems, Okayama University, Okayama, Japan
| | - Jinglong Wu
- Graduate School of Interdisciplinary Science and Engineering in Health Systems, Okayama University, Okayama, Japan
| | - Jiajia Yang
- Graduate School of Interdisciplinary Science and Engineering in Health Systems, Okayama University, Okayama, Japan
| |
Collapse
|
4
|
Kim Y, Lee JH, Park JC, Kwon J, Kim H, Seo J, Min BK. Neuromodulation of inhibitory control using phase-lagged transcranial alternating current stimulation. J Neuroeng Rehabil 2024; 21:93. [PMID: 38816860 PMCID: PMC11138099 DOI: 10.1186/s12984-024-01385-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/04/2024] [Accepted: 05/15/2024] [Indexed: 06/01/2024] Open
Abstract
BACKGROUND Transcranial alternating current stimulation (tACS) is a prominent non-invasive brain stimulation method for modulating neural oscillations and enhancing human cognitive function. This study aimed to investigate the effects of individualized theta tACS delivered in-phase and out-of-phase between the dorsal anterior cingulate cortex (dACC) and left dorsolateral prefrontal cortex (lDLPFC) during inhibitory control performance. METHODS The participants engaged in a Stroop task with phase-lagged theta tACS over individually optimized high-density electrode montages targeting the dACC and lDLPFC. We analyzed task performance, event-related potentials, and prestimulus electroencephalographic theta and alpha power. RESULTS We observed significantly reduced reaction times following out-of-phase tACS, accompanied by reduced frontocentral N1 and N2 amplitudes, enhanced parieto-occipital P1 amplitudes, and pronounced frontocentral late sustained potentials. Out-of-phase stimulation also resulted in significantly higher prestimulus frontocentral theta and alpha activity. CONCLUSIONS These findings suggest that out-of-phase theta tACS potently modulates top-down inhibitory control, supporting the feasibility of phase-lagged tACS to enhance inhibitory control performance.
Collapse
Affiliation(s)
- Yukyung Kim
- Department of Brain and Cognitive Engineering, Korea University, Seoul, 02841, Korea
| | - Je-Hyeop Lee
- Department of Brain and Cognitive Engineering, Korea University, Seoul, 02841, Korea
- BK21 Four Institute of Precision Public Health, Korea University, Seoul, 02841, Korea
| | - Je-Choon Park
- Department of Brain and Cognitive Engineering, Korea University, Seoul, 02841, Korea
| | - Jeongwook Kwon
- Department of Brain and Cognitive Engineering, Korea University, Seoul, 02841, Korea
| | - Hyoungkyu Kim
- Center for Neuroscience Imaging Research, Institute for Basic Science, Sungkyunkwan University, Suwon, 16419, Korea
- Institute of Brain and Cognitive Engineering, Korea University, Seoul, 02841, Korea
| | - Jeehye Seo
- BK21 Four Institute of Precision Public Health, Korea University, Seoul, 02841, Korea
- Institute of Brain and Cognitive Engineering, Korea University, Seoul, 02841, Korea
| | - Byoung-Kyong Min
- Department of Brain and Cognitive Engineering, Korea University, Seoul, 02841, Korea.
- BK21 Four Institute of Precision Public Health, Korea University, Seoul, 02841, Korea.
- Institute of Brain and Cognitive Engineering, Korea University, Seoul, 02841, Korea.
| |
Collapse
|
5
|
Korolczuk I, Burle B, Coull JT, Ogińska H, Ociepka M, Senderecka M, Śmigasiewicz K. Temporal unpredictability increases error monitoring as revealed by EEG-EMG investigation. Psychophysiology 2024; 61:e14442. [PMID: 37724801 DOI: 10.1111/psyp.14442] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/27/2023] [Revised: 09/01/2023] [Accepted: 09/03/2023] [Indexed: 09/21/2023]
Abstract
Reacting in an unpredictable context increases error monitoring as evidenced by greater error-related negativity (ERN), an electrophysiological marker linked to an evaluation of response outcomes. We investigated whether ERN also increased when participants evaluated their responses to events that appeared in unpredictable versus predictable moments in time. We complemented electroencephalographic (EEG) analysis of cortical activity by measuring performance monitoring processes at the peripheral level using electromyography (EMG). Specifically, we used EMG data to quantify how temporal unpredictability would affect motor time (MT), the interval between the onset of muscle activity, and the mechanical response. MT increases following errors, indexing online error detection, and an attempt to stop incorrect actions. In our temporally cued version of the stop-signal task, symbolic cues predicted (temporally predictable condition) or not (temporally unpredictable condition) the onset of a target. In 25% of trials, an auditory signal occurred shortly after the target presentation, informing participants that they should inhibit their response completely. Response times were slower, and fewer inhibitory errors were made during temporally unpredictable than predictable trials, indicating enhanced control of unwanted actions when target onset time was unknown. Importantly, the ERN to inhibitory errors was greater in temporally unpredictable relative to temporally predictable conditions. Similarly, EMG data revealed prolonged MT when reactions to temporally unpredictable targets had not been stopped. Taken together, our results show that a temporally unpredictable environment increases the control of unwanted actions, both at cortical and peripheral levels, suggesting a higher subjective cost of maladaptive responses to temporally uncertain events.
Collapse
Affiliation(s)
- I Korolczuk
- Department of Pathophysiology, Medical University of Lublin, Lublin, Poland
- Laboratoire de Neurosciences Cognitives, Aix-Marseille University & CNRS, Marseille, France
| | - B Burle
- Laboratoire de Neurosciences Cognitives, Aix-Marseille University & CNRS, Marseille, France
| | - J T Coull
- Laboratoire de Neurosciences Cognitives, Aix-Marseille University & CNRS, Marseille, France
| | - H Ogińska
- Institute of Applied Psychology, Jagiellonian University, Kraków, Poland
| | - M Ociepka
- Institute of Philosophy, Jagiellonian University, Kraków, Poland
- Doctoral School in the Social Sciences, Jagiellonian University, Kraków, Poland
| | - M Senderecka
- Institute of Philosophy, Jagiellonian University, Kraków, Poland
| | - K Śmigasiewicz
- Laboratoire de Neurosciences Cognitives, Aix-Marseille University & CNRS, Marseille, France
| |
Collapse
|
6
|
Millon EM, Haddad AE, Chang HYM, Najafizadeh L, Shors TJ. The Feeling of Time Passing Is Associated with Recurrent Sustained Activity and Theta Rhythms Across the Cortex. Brain Connect 2024; 14:39-47. [PMID: 38019079 DOI: 10.1089/brain.2023.0010] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/30/2023] Open
Abstract
Introduction: We are constantly estimating how much time has passed, and yet know little about the brain mechanisms through which this process occurs. In this pilot study, we evaluated so-called subjective time estimation with the temporal bisection task, while recording brain activity from electroencephalography (EEG). Methods: Nine adult participants were trained to distinguish between two durations of visual stimuli as either "short" (400 msec) or "long" (1600 msec). They were then presented with stimulus durations in between the long and short stimuli. EEG data from 128 electrodes were examined with a novel analytical method that identifies segments of sustained cortical activity during the task. Results: Participants tended to categorize intermediate durations as "long" more frequently than "short" and were thus experiencing time as moving faster while overestimating the amount of time passing. Their mean bisection point (during which frequency of selecting short vs. long is equal) was closer to the geometric mean of task stimuli (800 msec) rather than the arithmetic mean (1000 msec). In contrast, sustained brain activity occurred closer to the arithmetic mean. The recurrence rate of this activity was highly related to the bisection point, especially when analyzed within naturally occurring theta oscillations (4-8 Hz) (r = -0.90). Discussion: Sustained activity across the cortex within the theta range may reflect temporal durations, whereas its repeated appearance relates to the subjective feeling of time passing.
Collapse
Affiliation(s)
- Emma M Millon
- Department of Psychology, Behavioral and Systems Neuroscience, Rutgers University, Piscataway, New Jersey, USA
- Current affiliations: Department of Child and Adolescent Psychiatry, NYU Grossman School of Medicine, Department of Integrative Health, NYU Langone Health, New York, USA
| | - Ali E Haddad
- Department of Electrical and Computer Engineering, Rutgers University, Piscataway, New Jersey, USA
- Department of Computer Engineering, University of Basrah, Basrah, Iraq
| | - Han Yan M Chang
- Department of Psychology, Behavioral and Systems Neuroscience, Rutgers University, Piscataway, New Jersey, USA
| | - Laleh Najafizadeh
- Department of Electrical and Computer Engineering, Rutgers University, Piscataway, New Jersey, USA
| | - Tracey J Shors
- Department of Psychology, Behavioral and Systems Neuroscience, Rutgers University, Piscataway, New Jersey, USA
- Center for Collaborative Neuroscience, Rutgers University, Piscataway, New Jersey, USA
| |
Collapse
|
7
|
Ozturk S, Zhang X, Glasgow S, Karnani RR, Imbriano G, Luhmann C, Jin J, Mohanty A. Knowledge of Threat Biases Perceptual Decision Making in Anxiety: Evidence From Signal Detection Theory and Drift Diffusion Modeling. BIOLOGICAL PSYCHIATRY GLOBAL OPEN SCIENCE 2024; 4:145-154. [PMID: 38298800 PMCID: PMC10829620 DOI: 10.1016/j.bpsgos.2023.07.005] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/20/2023] [Revised: 07/06/2023] [Accepted: 07/10/2023] [Indexed: 02/02/2024] Open
Abstract
Background Threat biases are considered key factors in the development and maintenance of anxiety. However, these biases are poorly operationalized and remain unquantified. Furthermore, it is unclear whether and how prior knowledge of threat and its uncertainty induce these biases and how they manifest in anxiety. Method Participants (n = 55) used prestimulus cues to decide whether the subsequently presented stimuli were threatening or neutral. The cues either provided no information about the probability (high uncertainty) or indicated high probability (low uncertainty) of encountering threatening or neutral targets. We used signal detection theory and hierarchical drift diffusion modeling to quantify bias. Results High-uncertainty threat cues improved discrimination of subsequent threatening and neutral stimuli more than neutral cues. However, anxiety was associated with worse discrimination of threatening versus neutral stimuli following high-uncertainty threat cues. Using hierarchical drift diffusion modeling, we found that threat cues biased decision making not only by shifting the starting point of evidence accumulation toward the threat decision but also by increasing the efficiency with which sensory evidence was accumulated for both threat-related and neutral decisions. However, higher anxiety was associated with a greater shift of starting point toward the threat decision but not with the efficiency of evidence accumulation. Conclusions Using computational modeling, these results highlight the biases by which knowledge regarding uncertain threat improves perceptual decision making but impairs it in case of anxiety.
Collapse
Affiliation(s)
- Sekine Ozturk
- Department of Psychology, Stony Brook University, Stony Brook, New York
| | - Xian Zhang
- Department of Psychology, Stony Brook University, Stony Brook, New York
| | - Shannon Glasgow
- Department of Psychology, Stony Brook University, Stony Brook, New York
| | - Ramesh R. Karnani
- Department of Psychology, The University of Hong Kong, Hong Kong SAR, China
| | - Gabriella Imbriano
- Department of Psychiatry and Behavioral Sciences, Stanford University School of Medicine, Stanford, California
| | - Christian Luhmann
- Department of Psychology, Stony Brook University, Stony Brook, New York
| | - Jingwen Jin
- Department of Psychology, The University of Hong Kong, Hong Kong SAR, China
- State Key Laboratory of Brain and Cognitive Sciences, The University of Hong Kong, Hong Kong SAR, China
| | - Aprajita Mohanty
- Department of Psychology, Stony Brook University, Stony Brook, New York
| |
Collapse
|
8
|
Azizi L, Polti I, van Wassenhove V. Spontaneous α Brain Dynamics Track the Episodic "When". J Neurosci 2023; 43:7186-7197. [PMID: 37704373 PMCID: PMC10601376 DOI: 10.1523/jneurosci.0816-23.2023] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/27/2023] [Revised: 07/14/2023] [Accepted: 08/06/2023] [Indexed: 09/15/2023] Open
Abstract
Across species, neurons track time over the course of seconds to minutes, which may feed the sense of time passing. Here, we asked whether neural signatures of time-tracking could be found in humans. Participants stayed quietly awake for a few minutes while being recorded with magnetoencephalography (MEG). They were unaware they would be asked how long the recording lasted (retrospective time) or instructed beforehand to estimate how long it will last (prospective timing). At rest, rhythmic brain activity is nonstationary and displays bursts of activity in the alpha range (α: 7-14 Hz). When participants were not instructed to attend to time, the relative duration of α bursts linearly predicted individuals' retrospective estimates of how long their quiet wakefulness lasted. The relative duration of α bursts was a better predictor than α power or burst amplitude. No other rhythmic or arrhythmic activity predicted retrospective duration. However, when participants timed prospectively, the relative duration of α bursts failed to predict their duration estimates. Consistent with this, the amount of α bursts was discriminant between prospective and retrospective timing. Last, with a control experiment, we demonstrate that the relation between α bursts and retrospective time is preserved even when participants are engaged in a visual counting task. Thus, at the time scale of minutes, we report that the relative time of spontaneous α burstiness predicts conscious retrospective time. We conclude that in the absence of overt attention to time, α bursts embody discrete states of awareness constitutive of episodic timing.SIGNIFICANCE STATEMENT The feeling that time passes is a core component of consciousness and episodic memory. A century ago, brain rhythms called "α" were hypothesized to embody an internal clock. However, rhythmic brain activity is nonstationary and displays on-and-off oscillatory bursts, which would serve irregular ticks to the hypothetical clock. Here, we discovered that in a given lapse of time, the relative bursting time of α rhythms is a good indicator of how much time an individual will report to have elapsed. Remarkably, this relation only holds true when the individual does not attend to time and vanishes when attending to it. Our observations suggest that at the scale of minutes, α brain activity tracks episodic time.
Collapse
Affiliation(s)
- Leila Azizi
- Cognitive Neuroimaging Unit, NeuroSpin, Commissariat à l'énergie atomique et aux énergies alternatives, Institut National de la Santé et de la Recherche Médicale, Université Paris-Saclay, Gif/Yvette 91191, France
| | - Ignacio Polti
- Kavli Institute for Systems Neuroscience, Norwegian University of Science and Technology, Trondheim, Norway 7030
- Department of Psychology, Max Planck Institute for Human Cognitive and Brain Sciences, Leipzig, Germany D-04103
| | - Virginie van Wassenhove
- Cognitive Neuroimaging Unit, NeuroSpin, Commissariat à l'énergie atomique et aux énergies alternatives, Institut National de la Santé et de la Recherche Médicale, Université Paris-Saclay, Gif/Yvette 91191, France
| |
Collapse
|
9
|
Nobre AC, van Ede F. Attention in flux. Neuron 2023; 111:971-986. [PMID: 37023719 DOI: 10.1016/j.neuron.2023.02.032] [Citation(s) in RCA: 5] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/17/2023] [Revised: 02/20/2023] [Accepted: 02/22/2023] [Indexed: 04/08/2023]
Abstract
Selective attention comprises essential infrastructural functions supporting cognition-anticipating, prioritizing, selecting, routing, integrating, and preparing signals to guide adaptive behavior. Most studies have examined its consequences, systems, and mechanisms in a static way, but attention is at the confluence of multiple sources of flux. The world advances, we operate within it, our minds change, and all resulting signals progress through multiple pathways within the dynamic networks of our brains. Our aim in this review is to raise awareness of and interest in three important facets of how timing impacts our understanding of attention. These include the challenges posed to attention by the timing of neural processing and psychological functions, the opportunities conferred to attention by various temporal structures in the environment, and how tracking the time courses of neural and behavioral modulations with continuous measures yields surprising insights into the workings and principles of attention.
Collapse
Affiliation(s)
- Anna C Nobre
- Department of Experimental Psychology, University of Oxford, Oxford OX2 6GG, UK; Oxford Centre for Human Brain Activity, Wellcome Centre for Integrative Neuroimaging, Department of Psychiatry, University of Oxford, Oxford OX3 7JX, UK.
| | - Freek van Ede
- Institute for Brain and Behavior Amsterdam, Department of Experimental and Applied Psychology, Vrije Universiteit Amsterdam, Amsterdam 1081BT, the Netherlands.
| |
Collapse
|
10
|
Fujio K, Obata H, Takeda K, Kawashima N. Cortical oscillations and interareal synchronization as a preparatory activity for postural response. Eur J Neurosci 2023; 57:1516-1528. [PMID: 36878880 DOI: 10.1111/ejn.15956] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/28/2022] [Revised: 02/14/2023] [Accepted: 02/27/2023] [Indexed: 03/08/2023]
Abstract
Neural mechanisms of human standing are expected to be elucidated for preventing fallings. Postural response evoked by sudden external perturbation originates from various areas in the central nervous system. Recent studies have revealed that the corticospinal pathway is one of the key nodes for an appropriate postural response. The corticospinal pathway that mediates the early part of the electromyographic response is modulated with prediction before a perturbation occurs. Temporal prediction explicitly exhibiting an onset timing contributes to enhancing corticospinal excitability. However, how the cortical activities in the sensorimotor area with temporal prediction are processed before the corticospinal pathway enhancement remains unclear. In this study, using electroencephalography, we investigated how temporal prediction affects both neural oscillations and synchronization between sensorimotor and distal areas. Our results revealed that desynchronization of cortical oscillation at α- and β-bands was observed in the sensorimotor and parietooccipital areas (Cz, CPz, Pz and POz), and those are nested in the phase at θ-band frequency. Furthermore, a reduction in the interareal phase synchrony in the α-band was induced after the timing cue for the perturbation onset. The phase synchrony at the low frequency can relay the temporal prediction among the distant areas and initiate the modulation of the local cortical activities. Such modulations contribute to the preparation for sensory processing and motor execution that are necessary for optimal responses.
Collapse
Affiliation(s)
- Kimiya Fujio
- Department of Rehabilitation for Movement Functions, Research Institute of National Rehabilitation Center for Persons with Disabilities, Saitama, Japan
| | - Hiroki Obata
- Department of Humanities and Social Science Laboratory, Institute of Liberal Arts, Kyushu Institute of Technology, Fukuoka, Japan
| | - Kenta Takeda
- Department of Rehabilitation for Movement Functions, Research Institute of National Rehabilitation Center for Persons with Disabilities, Saitama, Japan
| | - Noritaka Kawashima
- Department of Rehabilitation for Movement Functions, Research Institute of National Rehabilitation Center for Persons with Disabilities, Saitama, Japan
| |
Collapse
|
11
|
Meredith Weiss S, Marshall PJ. Anticipation across modalities in children and adults: Relating anticipatory alpha rhythm lateralization, reaction time, and executive function. Dev Sci 2023; 26:e13277. [PMID: 35616474 PMCID: PMC10078525 DOI: 10.1111/desc.13277] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/09/2020] [Revised: 02/14/2022] [Accepted: 04/22/2022] [Indexed: 12/15/2022]
Abstract
The development of the ability to anticipate-as manifested by preparatory actions and neural activation related to the expectation of an upcoming stimulus-may play a key role in the ontogeny of cognitive skills more broadly. This preregistered study examined anticipatory brain potentials and behavioral responses (reaction time; RT) to anticipated target stimuli in relation to individual differences in the ability to use goals to direct action (as indexed by measures of executive function; EF). A cross-sectional investigation was conducted in 40 adults (aged 18-25 years) and 40 children (aged 6-8 years) to examine the association of changes in the amplitude of modality-specific alpha-range rhythms in the electroencephalogram (EEG) during anticipation of lateralized visual, tactile, or auditory stimuli with inter- and intraindividual variation in RT and EF. Children and adults exhibited contralateral anticipatory reductions in the mu rhythm and the visual alpha rhythm for tactile and visual anticipation, respectively, indicating modality and spatially specific attention allocation. Variability in within-subject anticipatory alpha lateralization (the difference between contralateral and ipsilateral alpha power) was related to single-trial RT. This relation was more prominent in adults than in children, and was not apparent for auditory stimuli. Multilevel models indicated that interindividual differences in anticipatory mu rhythm lateralization contributed to the significant association with variability in EF, but this was not the case for visual or auditory alpha rhythms. Exploratory microstate analyses were undertaken to cluster global field power (GFP) into a distribution-free temporal analysis examining developmental differences across samples and in relation to RT and EF. Anticipation is suggested as a developmental bridge construct connecting neuroscience, behavior, and cognition, with anticipatory EEG oscillations being discussed as quantifiable and potentially malleable indicators of stimulus prediction.
Collapse
Affiliation(s)
- Staci Meredith Weiss
- Department of Psychology, Temple University, Philadelphia, Pennsylvania, USA.,Department of Psychology, University of Cambridge, Cambridge, UK
| | - Peter J Marshall
- Department of Psychology, Temple University, Philadelphia, Pennsylvania, USA
| |
Collapse
|
12
|
Foerster FR, Chidharom M, Bonnefond A, Giersch A. Neurocognitive analyses reveal that video game players exhibit enhanced implicit temporal processing. Commun Biol 2022; 5:1082. [PMID: 36221032 PMCID: PMC9553938 DOI: 10.1038/s42003-022-04033-0] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/22/2022] [Accepted: 09/26/2022] [Indexed: 11/25/2022] Open
Abstract
Winning in action video games requires to predict timed events in order to react fast enough. In these games, repeated waiting for enemies may help to develop implicit (incidental) preparation mechanisms. We compared action video game players and non-video game players in a reaction time task involving both implicit time preparations and explicit (conscious) temporal attention cues. Participants were immersed in virtual reality and instructed to respond to a visual target appearing at variable delays after a warning signal. In half of the trials, an explicit cue indicated when the target would occur after the warning signal. Behavioral, oculomotor and EEG data consistently indicate that, compared with non-video game players, video game players better prepare in time using implicit mechanisms. This sheds light on the neglected role of implicit timing and related electrophysiological mechanisms in gaming research. The results further suggest that game-based interventions may help remediate implicit timing disorders found in psychiatric populations.
Collapse
Affiliation(s)
- Francois R Foerster
- Université de Strasbourg, INSERM U1114, Pôle de Psychiatrie, Centre Hospitalier Régional Universitaire de Strasbourg, Strasbourg, France.
| | - Matthieu Chidharom
- Université de Strasbourg, INSERM U1114, Pôle de Psychiatrie, Centre Hospitalier Régional Universitaire de Strasbourg, Strasbourg, France
- Department of Psychology, Lehigh University, Bethlehem, PA, USA
| | - Anne Bonnefond
- Université de Strasbourg, INSERM U1114, Pôle de Psychiatrie, Centre Hospitalier Régional Universitaire de Strasbourg, Strasbourg, France
| | - Anne Giersch
- Université de Strasbourg, INSERM U1114, Pôle de Psychiatrie, Centre Hospitalier Régional Universitaire de Strasbourg, Strasbourg, France
| |
Collapse
|
13
|
Chao ZC, Huang YT, Wu CT. A quantitative model reveals a frequency ordering of prediction and prediction-error signals in the human brain. Commun Biol 2022; 5:1076. [PMID: 36216885 PMCID: PMC9550773 DOI: 10.1038/s42003-022-04049-6] [Citation(s) in RCA: 6] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/26/2022] [Accepted: 09/29/2022] [Indexed: 11/29/2022] Open
Abstract
The human brain is proposed to harbor a hierarchical predictive coding neuronal network underlying perception, cognition, and action. In support of this theory, feedforward signals for prediction error have been reported. However, the identification of feedback prediction signals has been elusive due to their causal entanglement with prediction-error signals. Here, we use a quantitative model to decompose these signals in electroencephalography during an auditory task, and identify their spatio-spectral-temporal signatures across two functional hierarchies. Two prediction signals are identified in the period prior to the sensory input: a low-level signal representing the tone-to-tone transition in the high beta frequency band, and a high-level signal for the multi-tone sequence structure in the low beta band. Subsequently, prediction-error signals dependent on the prior predictions are found in the gamma band. Our findings reveal a frequency ordering of prediction signals and their hierarchical interactions with prediction-error signals supporting predictive coding theory.
Collapse
Affiliation(s)
- Zenas C Chao
- International Research Center for Neurointelligence (WPI-IRCN), UTIAS, The University of Tokyo, Tokyo, Japan.
| | - Yiyuan Teresa Huang
- International Research Center for Neurointelligence (WPI-IRCN), UTIAS, The University of Tokyo, Tokyo, Japan
- School of Occupational Therapy, College of Medicine, National Taiwan University, Taipei, Taiwan
| | - Chien-Te Wu
- International Research Center for Neurointelligence (WPI-IRCN), UTIAS, The University of Tokyo, Tokyo, Japan
- School of Occupational Therapy, College of Medicine, National Taiwan University, Taipei, Taiwan
| |
Collapse
|
14
|
Lo CW, Tung TY, Ke AH, Brennan JR. Hierarchy, Not Lexical Regularity, Modulates Low-Frequency Neural Synchrony During Language Comprehension. NEUROBIOLOGY OF LANGUAGE (CAMBRIDGE, MASS.) 2022; 3:538-555. [PMID: 37215342 PMCID: PMC10158645 DOI: 10.1162/nol_a_00077] [Citation(s) in RCA: 6] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 03/02/2022] [Accepted: 06/20/2022] [Indexed: 05/24/2023]
Abstract
Neural responses appear to synchronize with sentence structure. However, researchers have debated whether this response in the delta band (0.5-3 Hz) really reflects hierarchical information or simply lexical regularities. Computational simulations in which sentences are represented simply as sequences of high-dimensional numeric vectors that encode lexical information seem to give rise to power spectra similar to those observed for sentence synchronization, suggesting that sentence-level cortical tracking findings may reflect sequential lexical or part-of-speech information, and not necessarily hierarchical syntactic information. Using electroencephalography (EEG) data and the frequency-tagging paradigm, we develop a novel experimental condition to tease apart the predictions of the lexical and the hierarchical accounts of the attested low-frequency synchronization. Under a lexical model, synchronization should be observed even when words are reversed within their phrases (e.g., "sheep white grass eat" instead of "white sheep eat grass"), because the same lexical items are preserved at the same regular intervals. Critically, such stimuli are not syntactically well-formed; thus a hierarchical model does not predict synchronization of phrase- and sentence-level structure in the reversed phrase condition. Computational simulations confirm these diverging predictions. EEG data from N = 31 native speakers of Mandarin show robust delta synchronization to syntactically well-formed isochronous speech. Importantly, no such pattern is observed for reversed phrases, consistent with the hierarchical, but not the lexical, accounts.
Collapse
Affiliation(s)
- Chia-Wen Lo
- Research Group Language Cycles, Max Planck Institute for Human Cognitive and Brain Sciences, Leipzig, Germany
- Department of Linguistics, University of Michigan, Ann Arbor, MI, USA
| | - Tzu-Yun Tung
- Department of Linguistics, University of Michigan, Ann Arbor, MI, USA
| | - Alan Hezao Ke
- Department of Linguistics, University of Michigan, Ann Arbor, MI, USA
- Department of Linguistics, Languages and Cultures, Michigan State University, East Lansing, MI, USA
| | | |
Collapse
|
15
|
Gugnowska K, Novembre G, Kohler N, Villringer A, Keller PE, Sammler D. Endogenous sources of interbrain synchrony in duetting pianists. Cereb Cortex 2022; 32:4110-4127. [PMID: 35029645 PMCID: PMC9476614 DOI: 10.1093/cercor/bhab469] [Citation(s) in RCA: 19] [Impact Index Per Article: 9.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/21/2021] [Revised: 11/16/2021] [Accepted: 11/17/2021] [Indexed: 11/12/2022] Open
Abstract
When people interact with each other, their brains synchronize. However, it remains unclear whether interbrain synchrony (IBS) is functionally relevant for social interaction or stems from exposure of individual brains to identical sensorimotor information. To disentangle these views, the current dual-EEG study investigated amplitude-based IBS in pianists jointly performing duets containing a silent pause followed by a tempo change. First, we manipulated the similarity of the anticipated tempo change and measured IBS during the pause, hence, capturing the alignment of purely endogenous, temporal plans without sound or movement. Notably, right posterior gamma IBS was higher when partners planned similar tempi, it predicted whether partners' tempi matched after the pause, and it was modulated only in real, not in surrogate pairs. Second, we manipulated the familiarity with the partner's actions and measured IBS during joint performance with sound. Although sensorimotor information was similar across conditions, gamma IBS was higher when partners were unfamiliar with each other's part and had to attend more closely to the sound of the performance. These combined findings demonstrate that IBS is not merely an epiphenomenon of shared sensorimotor information but can also hinge on endogenous, cognitive processes crucial for behavioral synchrony and successful social interaction.
Collapse
Affiliation(s)
- Katarzyna Gugnowska
- Department of Neurology, Max Planck Institute for Human Cognitive and Brain Sciences, Leipzig 04103, Germany
- Research Group Neurocognition of Music and Language, Max Planck Institute for Empirical Aesthetics, Frankfurt am Main 60322, Germany
| | - Giacomo Novembre
- Neuroscience of Perception and Action Lab, Italian Institute of Technology (IIT), Rome 00161, Italy
| | - Natalie Kohler
- Department of Neurology, Max Planck Institute for Human Cognitive and Brain Sciences, Leipzig 04103, Germany
- Research Group Neurocognition of Music and Language, Max Planck Institute for Empirical Aesthetics, Frankfurt am Main 60322, Germany
| | - Arno Villringer
- Department of Neurology, Max Planck Institute for Human Cognitive and Brain Sciences, Leipzig 04103, Germany
| | - Peter E Keller
- Department of Clinical Medicine, Center for Music in the Brain, Aarhus University, Aarhus 8000, Denmark
- The MARCS Institute for Brain, Behaviour and Development, Western Sydney University, Sydney, NSW 2751, Australia
| | - Daniela Sammler
- Department of Neurology, Max Planck Institute for Human Cognitive and Brain Sciences, Leipzig 04103, Germany
- Research Group Neurocognition of Music and Language, Max Planck Institute for Empirical Aesthetics, Frankfurt am Main 60322, Germany
| |
Collapse
|
16
|
Liang M, Lomayesva S, Isham EA. Dissociable Roles of Theta and Alpha in Sub-Second and Supra-Second Time Reproduction: An Investigation of their Links to Depression and Anxiety. TIMING & TIME PERCEPTION 2022. [DOI: 10.1163/22134468-bja10061] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/19/2022]
Abstract
Abstract
A growing collection of observations has demonstrated the presence of multiple neural oscillations participating in human temporal cognition and psychiatric pathologies such as depression and anxiety. However, there remains a gap in the literature regarding the specific roles of these neural oscillations during interval timing, and how these oscillatory activities might vary with the different levels of mental health. The current study examined the participation of the frontal midline theta and occipital alpha oscillations, both of which are prevalent cortical oscillatory markers frequently reported in working memory and time perception paradigms. Participants performed a time reproduction task in the sub- (400, 600, 800 ms) and supra-second timescales (1600, 1800, 2000 ms) while undergoing scalp EEG recordings. Anxiety and depression levels were measured via self-report mental health inventories. Time–frequency analysis of scalp EEG revealed that both frontal midline and occipital alpha oscillations were engaged during the encoding of the durations. Furthermore, we observed that the correlational relationship between frontal midline theta power and the reproduction performance in the sub-second range was modulated by state anxiety. In contrast, the correlational relationship between occipital alpha and the reproduction performance of supra-second intervals was modulated by depression and trait anxiety. The results offer insights on how alpha and theta oscillations differentially play a role in interval timing and how mental health further differentially relates these neural oscillations to sub- and supra-second timescales.
Collapse
Affiliation(s)
- Mingli Liang
- Department of Psychology, University of Arizona, 1503 E. University Blvd, Tucson, AZ 85721, USA
| | - Sara Lomayesva
- Department of Psychology, University of Arizona, 1503 E. University Blvd, Tucson, AZ 85721, USA
| | - Eve A. Isham
- Department of Psychology, University of Arizona, 1503 E. University Blvd, Tucson, AZ 85721, USA
| |
Collapse
|
17
|
Chaumon M, Rioux PA, Herbst SK, Spiousas I, Kübel SL, Gallego Hiroyasu EM, Runyun ŞL, Micillo L, Thanopoulos V, Mendoza-Duran E, Wagelmans A, Mudumba R, Tachmatzidou O, Cellini N, D'Argembeau A, Giersch A, Grondin S, Gronfier C, Igarzábal FA, Klarsfeld A, Jovanovic L, Laje R, Lannelongue E, Mioni G, Nicolaï C, Srinivasan N, Sugiyama S, Wittmann M, Yotsumoto Y, Vatakis A, Balcı F, van Wassenhove V. The Blursday database as a resource to study subjective temporalities during COVID-19. Nat Hum Behav 2022; 6:1587-1599. [PMID: 35970902 DOI: 10.1038/s41562-022-01419-2] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/20/2021] [Accepted: 06/17/2022] [Indexed: 01/13/2023]
Abstract
The COVID-19 pandemic and associated lockdowns triggered worldwide changes in the daily routines of human experience. The Blursday database provides repeated measures of subjective time and related processes from participants in nine countries tested on 14 questionnaires and 15 behavioural tasks during the COVID-19 pandemic. A total of 2,840 participants completed at least one task, and 439 participants completed all tasks in the first session. The database and all data collection tools are accessible to researchers for studying the effects of social isolation on temporal information processing, time perspective, decision-making, sleep, metacognition, attention, memory, self-perception and mindfulness. Blursday includes quantitative statistics such as sleep patterns, personality traits, psychological well-being and lockdown indices. The database provides quantitative insights on the effects of lockdown (stringency and mobility) and subjective confinement on time perception (duration, passage of time and temporal distances). Perceived isolation affects time perception, and we report an inter-individual central tendency effect in retrospective duration estimation.
Collapse
Affiliation(s)
- Maximilien Chaumon
- Institut du Cerveau, ICM, Inserm U 1127, CNRS UMR 7225, Sorbonne Université, Centre MEG-EEG, Centre de NeuroImagerie Recherche (CENIR), Paris, France.
| | | | - Sophie K Herbst
- Cognitive Neuroimaging Unit, INSERM, CEA, CNRS, Université Paris-Saclay, NeuroSpin, Gif/Yvette, France
| | - Ignacio Spiousas
- Department of Science and Technology, University of Quilmes, Buenos Aires, Argentina.,Consejo Nacional de Investigaciones Científicas y Técnicas, Buenos Aires, Argentina
| | - Sebastian L Kübel
- Max Planck Institute for the Study of Crime, Security and Law, Freiburg, Germany.,Institute for Frontier Areas of Psychology and Mental Health, Freiburg, Germany
| | | | - Şerife Leman Runyun
- Department of Psychology and Center for Translational Medicine, Koç University, Istanbul, Turkey
| | - Luigi Micillo
- Department of General Psychology, University of Padova, Padova, Italy
| | - Vassilis Thanopoulos
- Multisensory and Temporal Processing Laboratory (MultiTimeLab), Department of Psychology, Panteion University of Social and Political Sciences, Athens, Greece.,Department of History and Philosophy of Science, National and Kapodistrian University of Athens, Athens, Greece
| | | | - Anna Wagelmans
- Cognitive Neuroimaging Unit, INSERM, CEA, CNRS, Université Paris-Saclay, NeuroSpin, Gif/Yvette, France
| | - Ramya Mudumba
- Department of Cognitive Science, Indian Institute of Technology Kanpur, Kanpur, India
| | - Ourania Tachmatzidou
- Multisensory and Temporal Processing Laboratory (MultiTimeLab), Department of Psychology, Panteion University of Social and Political Sciences, Athens, Greece
| | - Nicola Cellini
- Department of General Psychology, University of Padova, Padova, Italy
| | - Arnaud D'Argembeau
- Department of Psychology, Psychology and Neuroscience of Cognition, Université de Liège, F.R.S.-FNRS, Liège, Belgium
| | - Anne Giersch
- Université de Strasbourg, Unité mixte INSERM U1114, Département de Psychiatrie, Hôpital civil, Strasbourg, France
| | - Simon Grondin
- École de psychologie, Université Laval, Quebec City, Quebec, Canada
| | - Claude Gronfier
- Waking Team, Lyon Neuroscience Research Center (CRNL), INSERM U1028, CNRS UMR5292, Université Lyon 1, Bron, France
| | | | - André Klarsfeld
- Laboratoire Plasticité du Cerveau, CNRS UMR 8249, ESPCI Paris PSL, Paris, France
| | - Ljubica Jovanovic
- Université de Strasbourg, Unité mixte INSERM U1114, Département de Psychiatrie, Hôpital civil, Strasbourg, France.,School of Psychology, University Park, University of Nottingham, Nottingham, UK
| | - Rodrigo Laje
- Department of Science and Technology, University of Quilmes, Buenos Aires, Argentina.,Consejo Nacional de Investigaciones Científicas y Técnicas, Buenos Aires, Argentina
| | - Elisa Lannelongue
- Cognitive Neuroimaging Unit, INSERM, CEA, CNRS, Université Paris-Saclay, NeuroSpin, Gif/Yvette, France
| | - Giovanna Mioni
- Department of General Psychology, University of Padova, Padova, Italy
| | - Cyril Nicolaï
- Cognitive Neuroimaging Unit, INSERM, CEA, CNRS, Université Paris-Saclay, NeuroSpin, Gif/Yvette, France.,Centre de Recherches Interdisciplinaires, Paris, France
| | - Narayanan Srinivasan
- Department of Cognitive Science, Indian Institute of Technology Kanpur, Kanpur, India
| | - Shogo Sugiyama
- Department of Life Sciences, University of Tokyo, Tokyo, Japan
| | - Marc Wittmann
- Institute for Frontier Areas of Psychology and Mental Health, Freiburg, Germany
| | - Yuko Yotsumoto
- Department of Life Sciences, University of Tokyo, Tokyo, Japan
| | - Argiro Vatakis
- Multisensory and Temporal Processing Laboratory (MultiTimeLab), Department of Psychology, Panteion University of Social and Political Sciences, Athens, Greece
| | - Fuat Balcı
- Department of Psychology and Center for Translational Medicine, Koç University, Istanbul, Turkey.,Department of Biological Sciences, University of Manitoba, Winnipeg, Manitoba, Canada
| | - Virginie van Wassenhove
- Cognitive Neuroimaging Unit, INSERM, CEA, CNRS, Université Paris-Saclay, NeuroSpin, Gif/Yvette, France.
| |
Collapse
|
18
|
Herbst SK, Obleser J, van Wassenhove V. Implicit Versus Explicit Timing-Separate or Shared Mechanisms? J Cogn Neurosci 2022; 34:1447-1466. [PMID: 35579985 DOI: 10.1162/jocn_a_01866] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/04/2022]
Abstract
Time implicitly shapes cognition, but time is also explicitly represented, for instance, in the form of durations. Parsimoniously, the brain could use the same mechanisms for implicit and explicit timing. Yet, the evidence has been equivocal, revealing both joint versus separate signatures of timing. Here, we directly compared implicit and explicit timing using magnetoencephalography, whose temporal resolution allows investigating the different stages of the timing processes. Implicit temporal predictability was induced in an auditory paradigm by a manipulation of the foreperiod. Participants received two consecutive task instructions: discriminate pitch (indirect measure of implicit timing) or duration (direct measure of explicit timing). The results show that the human brain efficiently extracts implicit temporal statistics of sensory environments, to enhance the behavioral and neural responses to auditory stimuli, but that those temporal predictions did not improve explicit timing. In both tasks, attentional orienting in time during predictive foreperiods was indexed by an increase in alpha power over visual and parietal areas. Furthermore, pretarget induced beta power in sensorimotor and parietal areas increased during implicit compared to explicit timing, in line with the suggested role for beta oscillations in temporal prediction. Interestingly, no distinct neural dynamics emerged when participants explicitly paid attention to time, compared to implicit timing. Our work thus indicates that implicit timing shapes the behavioral and sensory response in an automatic way and is reflected in oscillatory neural dynamics, whereas the translation of implicit temporal statistics to explicit durations remains somewhat inconclusive, possibly because of the more abstract nature of this task.
Collapse
|
19
|
Herbst SK, Stefanics G, Obleser J. Endogenous modulation of delta phase by expectation–A replication of Stefanics et al., 2010. Cortex 2022; 149:226-245. [DOI: 10.1016/j.cortex.2022.02.001] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/25/2021] [Revised: 01/31/2022] [Accepted: 02/01/2022] [Indexed: 11/03/2022]
|
20
|
Nürnberger M, Klingner C, Witte OW, Brodoehl S. Mismatch of Visual-Vestibular Information in Virtual Reality: Is Motion Sickness Part of the Brains Attempt to Reduce the Prediction Error? Front Hum Neurosci 2021; 15:757735. [PMID: 34776909 PMCID: PMC8586552 DOI: 10.3389/fnhum.2021.757735] [Citation(s) in RCA: 9] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/12/2021] [Accepted: 10/07/2021] [Indexed: 11/13/2022] Open
Abstract
Visually induced motion sickness (VIMS) is a relevant limiting factor in the use of virtual reality (VR) devices. Understanding the origin of this problem might help to develop strategies to circumvent this limitation. Previous studies have attributed VIMS to a mismatch between visual, and vestibular information, causing ambiguity of the position of the body in relation to its surrounding. Studies using EEG have shown a shift of the power spectrum to lower frequencies while VIMS is experienced. However, little is known about the relationship between the intensity of the VIMS and the changes in these power spectra. Moreover, the effect of different varieties of VIMS on the causal relationship between brain areas is largely unknown. Here, we used EEG to study 14 healthy subjects in a VR environment who were exposed to increasing levels of mismatch between vestibular and visual information. The frequency power and the bivariate transfer entropy as a measure for the information transfer were calculated. We found a direct association between increasing mismatch levels and subjective VIMS. With increasing VIMS, the proportion of slow EEG waves (especially 1–10 Hz) increases, especially in temporo-occipital regions. Furthermore, we found a general decrease in the information flow in most brain areas but especially in brain areas involved in the processing of vestibular signals and the detection of self-motion. We hypothesize that the general shift of frequency power and the decrease in information flow while experiencing high intensity VIMS represent a brain state of a reduced ability to receive, transmit and process information. We further hypothesize that the mechanism of reduced information flow is a general reaction of the brain to an unresolvable mismatch of information. This reaction aims on transforming a currently unstable model with a high prediction error into a stable model in an environment of minimal contradictory information.
Collapse
Affiliation(s)
- Matthias Nürnberger
- Hans Berger Department of Neurology, Jena University Hospital, Friedrich Schiller University Jena, Jena, Germany.,Biomagnetic Center, Jena University Hospital, Friedrich Schiller University Jena, Jena, Germany
| | - Carsten Klingner
- Hans Berger Department of Neurology, Jena University Hospital, Friedrich Schiller University Jena, Jena, Germany.,Biomagnetic Center, Jena University Hospital, Friedrich Schiller University Jena, Jena, Germany
| | - Otto W Witte
- Hans Berger Department of Neurology, Jena University Hospital, Friedrich Schiller University Jena, Jena, Germany
| | - Stefan Brodoehl
- Hans Berger Department of Neurology, Jena University Hospital, Friedrich Schiller University Jena, Jena, Germany.,Biomagnetic Center, Jena University Hospital, Friedrich Schiller University Jena, Jena, Germany
| |
Collapse
|
21
|
Aufschnaiter S, Zhao F, Gaschler R, Kiesel A, Thomaschke R. Investigating time-based expectancy beyond binary timing scenarios: evidence from a paradigm employing three predictive pre-target intervals. PSYCHOLOGICAL RESEARCH 2021; 86:2007-2020. [PMID: 34705100 PMCID: PMC9363376 DOI: 10.1007/s00426-021-01606-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/11/2020] [Accepted: 09/29/2021] [Indexed: 11/29/2022]
Abstract
When the duration of a pre-target interval probabilistically predicts the identity of the target, participants typically form time-based expectancies: they respond faster to frequent interval-target combinations than to infrequent ones. Yet, previous research investigating the cognitive time-processing mechanisms underlying time-based expectancy assessed time-based expectancy always in situations with a binary set of intervals (i.e. short vs. long). Here we aim to test whether time-based expectancy transfers to more complex settings with three different predictive time intervals (short, medium, long) in which each predicts one of three different target stimuli with 80% probability. In three experiments we varied how the medium interval was computed (arithmetic mean, geometric mean, or in between both). Our results showed that participants were able to learn the time-event contingencies for the short and the long as well as for the medium interval, and were, thus able to flexibly redirect their target expectancy two times during the course of a trial. The evidence concerning the impact of the manipulation of the medium intervals’ absolute duration on time-based expectancy was, however, mixed, as time-based expectancy for the medium interval could only be observed in one of three reported experiments. In sum, the findings of the present study suggest a previously unknown cognitive flexibility underlying time-based expectancy and offer important theoretical implications, challenging future research on the timing mechanisms involved in time-based expectancy.
Collapse
Affiliation(s)
- Stefanie Aufschnaiter
- Cognition, Action and Sustainability Unit, Department of Psychology, Albert-Ludwigs-Universitaet Freiburg, Engelbergerstrasse 41, 79085, Freiburg, Germany.
| | - Fang Zhao
- Research Cluster D2L2, University of Hagen, Universitaetsstrasse 27, 58097, Hagen, Germany
| | - Robert Gaschler
- Department of Psychology, University of Hagen, Universitaetsstrasse 33, 58084, Hagen, Germany
| | - Andrea Kiesel
- Cognition, Action and Sustainability Unit, Department of Psychology, Albert-Ludwigs-Universitaet Freiburg, Engelbergerstrasse 41, 79085, Freiburg, Germany
| | - Roland Thomaschke
- Cognition, Action and Sustainability Unit, Department of Psychology, Albert-Ludwigs-Universitaet Freiburg, Engelbergerstrasse 41, 79085, Freiburg, Germany
| |
Collapse
|
22
|
Farrugia N, Lamouroux A, Rocher C, Bouvet J, Lioi G. Beta and Theta Oscillations Correlate With Subjective Time During Musical Improvisation in Ecological and Controlled Settings: A Single Subject Study. Front Neurosci 2021; 15:626723. [PMID: 34177443 PMCID: PMC8222590 DOI: 10.3389/fnins.2021.626723] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/06/2020] [Accepted: 05/13/2021] [Indexed: 11/13/2022] Open
Abstract
In this paper, we describe the results of a single subject study attempting at a better understanding of the subjective mental state during musical improvisation. In a first experiment, we setup an ecological paradigm measuring EEG on a musician in free improvised concerts with an audience, followed by retrospective rating of the mental state of the improviser. We introduce Subjective Temporal Resolution (STR), a retrospective rating assessing the instantaneous quantization of subjective timing of the improviser. We identified high and low STR states using Hidden Markov Models in two performances, and were able to decode those states using supervised learning on instantaneous EEG power spectrum, showing increases in theta and alpha power with high STR values. In a second experiment, we found an increase of theta and beta power when experimentally manipulating STR in a musical improvisation imagery experiment. These results are interpreted with respect to previous research on flow state in creativity, as well as with the temporal processing literature. We suggest that a component of the subjective state of musical improvisation may be reflected in an underlying mechanism related to the subjective quantization of time. We also demonstrate the feasibility of single case studies of musical improvisation using brain activity measurements and retrospective reports, by obtaining consistent results across multiple sessions.
Collapse
Affiliation(s)
| | | | | | - Jules Bouvet
- IMT Atlantique, Lab-STICC, UMR CNRS 6285, Brest, France
| | - Giulia Lioi
- IMT Atlantique, Lab-STICC, UMR CNRS 6285, Brest, France
| |
Collapse
|
23
|
Two sources of uncertainty independently modulate temporal expectancy. Proc Natl Acad Sci U S A 2021; 118:2019342118. [PMID: 33853943 DOI: 10.1073/pnas.2019342118] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/18/2022] Open
Abstract
The environment is shaped by two sources of temporal uncertainty: the discrete probability of whether an event will occur and-if it does-the continuous probability of when it will happen. These two types of uncertainty are fundamental to every form of anticipatory behavior including learning, decision-making, and motor planning. It remains unknown how the brain models the two uncertainty parameters and how they interact in anticipation. It is commonly assumed that the discrete probability of whether an event will occur has a fixed effect on event expectancy over time. In contrast, we first demonstrate that this pattern is highly dynamic and monotonically increases across time. Intriguingly, this behavior is independent of the continuous probability of when an event will occur. The effect of this continuous probability on anticipation is commonly proposed to be driven by the hazard rate (HR) of events. We next show that the HR fails to account for behavior and propose a model of event expectancy based on the probability density function of events. Our results hold for both vision and audition, suggesting independence of the representation of the two uncertainties from sensory input modality. These findings enrich the understanding of fundamental anticipatory processes and have provocative implications for many aspects of behavior and its neural underpinnings.
Collapse
|
24
|
Kulkarni M, Hannula DE. Temporal Regularity May Not Improve Memory for Item-Specific Detail. Front Psychol 2021; 12:623402. [PMID: 33776845 PMCID: PMC7991072 DOI: 10.3389/fpsyg.2021.623402] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/30/2020] [Accepted: 02/15/2021] [Indexed: 11/16/2022] Open
Abstract
Regularities in event timing allow for the allocation of attention to critical time-points when an event is most likely to occur, leading to improved visual perception. Results from recent studies indicate that similar benefits may extend to memory for scenes and objects. Here, we investigated whether benefits of temporal regularity are evident when detailed, item-specific representations are necessary for successful recognition memory performance. In Experiments 1 and 2, pictures of objects were presented with either predictable or randomized event timing, in separate encoding blocks. In the test phase, old and new objects were presented, intermixed with perceptually similar exemplars of encoded objects. In Experiment 3 we attempted to replicate previously reported memory enhancements for scenes. In contrast to predictions, temporal regularity did not affect response times (RT) or improve recognition memory accuracy in any of our experiments. These results suggest that any effects of temporal expectation on memory are subtle and may be sensitive to minor changes in task parameters. In sum, indirect upregulation of attention through imposed temporal structure may not be sufficient to have downstream effects on memory performance.
Collapse
Affiliation(s)
| | - Deborah E. Hannula
- Department of Psychology, University of Wisconsin – Milwaukee, Milwaukee, WI, United States
| |
Collapse
|
25
|
Forseth KJ, Hickok G, Rollo PS, Tandon N. Language prediction mechanisms in human auditory cortex. Nat Commun 2020; 11:5240. [PMID: 33067457 PMCID: PMC7567874 DOI: 10.1038/s41467-020-19010-6] [Citation(s) in RCA: 32] [Impact Index Per Article: 8.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/22/2019] [Accepted: 08/12/2020] [Indexed: 01/31/2023] Open
Abstract
Spoken language, both perception and production, is thought to be facilitated by an ensemble of predictive mechanisms. We obtain intracranial recordings in 37 patients using depth probes implanted along the anteroposterior extent of the supratemporal plane during rhythm listening, speech perception, and speech production. These reveal two predictive mechanisms in early auditory cortex with distinct anatomical and functional characteristics. The first, localized to bilateral Heschl's gyri and indexed by low-frequency phase, predicts the timing of acoustic events. The second, localized to planum temporale only in language-dominant cortex and indexed by high-gamma power, shows a transient response to acoustic stimuli that is uniquely suppressed during speech production. Chronometric stimulation of Heschl's gyrus selectively disrupts speech perception, while stimulation of planum temporale selectively disrupts speech production. This work illuminates the fundamental acoustic infrastructure-both architecture and function-for spoken language, grounding cognitive models of speech perception and production in human neurobiology.
Collapse
Affiliation(s)
- K J Forseth
- Vivian L. Smith Department of Neurosurgery, McGovern Medical School, Houston, TX, USA
| | - G Hickok
- Department of Cognitive Sciences, University of California, Irvine, CA, USA
| | - P S Rollo
- Vivian L. Smith Department of Neurosurgery, McGovern Medical School, Houston, TX, USA
| | - N Tandon
- Vivian L. Smith Department of Neurosurgery, McGovern Medical School, Houston, TX, USA.
- Memorial Hermann Hospital, Texas Medical Center, Houston, TX, USA.
| |
Collapse
|
26
|
Daume J, Wang P, Maye A, Zhang D, Engel AK. Non-rhythmic temporal prediction involves phase resets of low-frequency delta oscillations. Neuroimage 2020; 224:117376. [PMID: 32949708 DOI: 10.1016/j.neuroimage.2020.117376] [Citation(s) in RCA: 14] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/23/2020] [Revised: 09/07/2020] [Accepted: 09/11/2020] [Indexed: 10/23/2022] Open
Abstract
The phase of neural oscillatory signals aligns to the predicted onset of upcoming stimulation. Whether such phase alignments represent phase resets of underlying neural oscillations or just rhythmically evoked activity, and whether they can be observed in a rhythm-free visual context, however, remains unclear. Here, we recorded the magnetoencephalogram while participants were engaged in a temporal prediction task, judging the visual or tactile reappearance of a uniformly moving stimulus. The prediction conditions were contrasted with a control condition to dissociate phase adjustments of neural oscillations from stimulus-driven activity. We observed stronger delta band inter-trial phase consistency (ITPC) in a network of sensory, parietal and frontal brain areas, but no power increase reflecting stimulus-driven or prediction-related evoked activity. Delta ITPC further correlated with prediction performance in the cerebellum and visual cortex. Our results provide evidence that phase alignments of low-frequency neural oscillations underlie temporal predictions in a non-rhythmic visual and crossmodal context.
Collapse
Affiliation(s)
- Jonathan Daume
- Department of Neurophysiology and Pathophysiology, University Medical Center Hamburg-Eppendorf, Hamburg 20246, Germany; Department of Neurosurgery, Cedars-Sinai Medical Center, Los Angeles, CA 90048, USA.
| | - Peng Wang
- Department of Neurophysiology and Pathophysiology, University Medical Center Hamburg-Eppendorf, Hamburg 20246, Germany
| | - Alexander Maye
- Department of Neurophysiology and Pathophysiology, University Medical Center Hamburg-Eppendorf, Hamburg 20246, Germany
| | - Dan Zhang
- Department of Psychology, School of Social Sciences, Tsinghua University, Beijing 100084, China
| | - Andreas K Engel
- Department of Neurophysiology and Pathophysiology, University Medical Center Hamburg-Eppendorf, Hamburg 20246, Germany
| |
Collapse
|
27
|
Zanto TP, Liu H, Pan P, Gazzaley A. Temporal attention is not affected by working memory load. Cortex 2020; 130:351-361. [PMID: 32738582 DOI: 10.1016/j.cortex.2020.06.008] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/20/2020] [Revised: 05/12/2020] [Accepted: 06/09/2020] [Indexed: 10/23/2022]
Abstract
Temporal attention refers to the ability to orient attention in time, which serves to enhance performance such as target detection and discrimination and is a fundamental component of cognitive function. Although some research indicates that temporal attention ability is affected by working memory updating, it is unclear whether temporal attention is also affected by the availability of working memory stores. To address this, participants were presented a dual-task paradigm requiring zero, three, or six digits to be held in working memory while engaged in a temporally cued visual discrimination task. Results show that working memory load did not differentially affect the ability to benefit from predictive temporal cues during the visual discrimination task. This indicates that temporal attention is not affected by available working memory stores. Interestingly, posterior beta band (12-30 Hz) activity was differentially modulated by temporal attention and working memory load, such that it decreased prior to expected targets and increased with load. Analysis across participants indicated that those individuals who exhibited greater temporal attention-based modulation of beta activity (i.e., predictive < neutrally cued) displayed improved discrimination performance, but also yielded lowered working memory accuracy. Thus, the ability to benefit from temporal attention processes while multitasking comes at the cost of lowered secondary task performance. Together, these results indicate that available working memory stores do not affect temporal attention ability. Rather, limitations in divided attention ability result in a performance cost that prioritizes one task over another, which may be indexed by beta band activity.
Collapse
Affiliation(s)
- Theodore P Zanto
- Department of Neurology, University of California San Francisco, San Francisco, CA, USA; Neuroscape, University of California San Francisco, San Francisco, CA, USA.
| | - Helen Liu
- Department of Neurology, University of California San Francisco, San Francisco, CA, USA
| | - Peter Pan
- Department of Neurology, University of California San Francisco, San Francisco, CA, USA
| | - Adam Gazzaley
- Department of Neurology, University of California San Francisco, San Francisco, CA, USA; Neuroscape, University of California San Francisco, San Francisco, CA, USA; Departments of Physiology and Psychiatry, University of California San Francisco, San Francisco, CA, USA
| |
Collapse
|
28
|
Sorati M, Behne DM. Audiovisual Modulation in Music Perception for Musicians and Non-musicians. Front Psychol 2020; 11:1094. [PMID: 32547458 PMCID: PMC7273518 DOI: 10.3389/fpsyg.2020.01094] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/11/2020] [Accepted: 04/29/2020] [Indexed: 11/13/2022] Open
Abstract
In audiovisual music perception, visual information from a musical instrument being played is available prior to the onset of the corresponding musical sound and consequently allows a perceiver to form a prediction about the upcoming audio music. This prediction in audiovisual music perception, compared to auditory music perception, leads to lower N1 and P2 amplitudes and latencies. Although previous research suggests that audiovisual experience, such as previous musical experience may enhance this prediction, a remaining question is to what extent musical experience modifies N1 and P2 amplitudes and latencies. Furthermore, corresponding event-related phase modulations quantified as inter-trial phase coherence (ITPC) have not previously been reported for audiovisual music perception. In the current study, audio video recordings of a keyboard key being played were presented to musicians and non-musicians in audio only (AO), video only (VO), and audiovisual (AV) conditions. With predictive movements from playing the keyboard isolated from AV music perception (AV-VO), the current findings demonstrated that, compared to the AO condition, both groups had a similar decrease in N1 amplitude and latency, and P2 amplitude, along with correspondingly lower ITPC values in the delta, theta, and alpha frequency bands. However, while musicians showed lower ITPC values in the beta-band in AV-VO compared to the AO, non-musicians did not show this pattern. Findings indicate that AV perception may be broadly correlated with auditory perception, and differences between musicians and non-musicians further indicate musical experience to be a specific factor influencing AV perception. Predicting an upcoming sound in AV music perception may involve visual predictory processes, as well as beta-band oscillations, which may be influenced by years of musical training. This study highlights possible interconnectivity in AV perception as well as potential modulation with experience.
Collapse
Affiliation(s)
- Marzieh Sorati
- Department of Psychology, Norwegian University of Science and Technology, Trondheim, Norway
| | - Dawn Marie Behne
- Department of Psychology, Norwegian University of Science and Technology, Trondheim, Norway
| |
Collapse
|
29
|
Xu M, Meng J, Yu H, Jung TP, Ming D. Dynamic Brain Responses Modulated by Precise Timing Prediction in an Opposing Process. Neurosci Bull 2020; 37:70-80. [PMID: 32548801 DOI: 10.1007/s12264-020-00527-1] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/09/2019] [Accepted: 02/11/2020] [Indexed: 01/04/2023] Open
Abstract
The brain function of prediction is fundamental for human beings to shape perceptions efficiently and successively. Through decades of effort, a valuable brain activation map has been obtained for prediction. However, much less is known about how the brain manages the prediction process over time using traditional neuropsychological paradigms. Here, we implemented an innovative paradigm for timing prediction to precisely study the temporal dynamics of neural oscillations. In the experiment recruiting 45 participants, expectation suppression was found for the overall electroencephalographic activity, consistent with previous hemodynamic studies. Notably, we found that N1 was positively associated with predictability while N2 showed a reversed relation to predictability. Furthermore, the matching prediction had a similar profile with no timing prediction, both showing an almost saturated N1 and an absence of N2. The results indicate that the N1 process showed a 'sharpening' effect for predictable inputs, while the N2 process showed a 'dampening' effect. Therefore, these two paradoxical neural effects of prediction, which have provoked wide confusion in accounting for expectation suppression, actually co-exist in the procedure of timing prediction but work in separate time windows. These findings strongly support a recently-proposed opposing process theory.
Collapse
Affiliation(s)
- Minpeng Xu
- College of Precision Instruments and Optoelectronics Engineering, Tianjin University, Tianjin, 300072, China.,Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin, 300072, China
| | - Jiayuan Meng
- College of Precision Instruments and Optoelectronics Engineering, Tianjin University, Tianjin, 300072, China
| | - Haiqing Yu
- College of Precision Instruments and Optoelectronics Engineering, Tianjin University, Tianjin, 300072, China
| | - Tzyy-Ping Jung
- College of Precision Instruments and Optoelectronics Engineering, Tianjin University, Tianjin, 300072, China.,Swartz Center for Computational Neuroscience, University of California, San Diego, CA, 92093, USA
| | - Dong Ming
- College of Precision Instruments and Optoelectronics Engineering, Tianjin University, Tianjin, 300072, China. .,Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin, 300072, China.
| |
Collapse
|
30
|
Alzueta E, Melcón M, Jensen O, Capilla A. The 'Narcissus Effect': Top-down alpha-beta band modulation of face-related brain areas during self-face processing. Neuroimage 2020; 213:116754. [PMID: 32194280 PMCID: PMC7181170 DOI: 10.1016/j.neuroimage.2020.116754] [Citation(s) in RCA: 16] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/28/2019] [Revised: 03/10/2020] [Accepted: 03/14/2020] [Indexed: 12/24/2022] Open
Abstract
Self-related information, such as one's own face, is prioritized by our cognitive system. Whilst recent theoretical developments suggest that this is achieved by an interplay between bottom-up and top-down attentional mechanisms, their underlying neural dynamics are still poorly understood. Furthermore, it is still matter of discussion as to whether these attentional mechanisms are truly self-specific or instead driven by face familiarity. To address these questions, we used EEG to record the brain activity of twenty-five healthy participants whilst identifying their own face, a friend's face and a stranger's face. Time-frequency analysis revealed a greater sustained power decrease in the alpha and beta frequency bands for the self-face, which emerged at late latencies and was maintained even when the face was no longer present. Critically, source analysis showed that this activity was generated in key brain regions for self-face recognition, such as the fusiform gyrus. As in the Myth of Narcissus, our results indicate that one's own face might have the potential to hijack attention. We suggest that this effect is specific to the self and driven by a top-down attentional control mechanism, which might facilitate further processing of personally relevant events.
Collapse
Affiliation(s)
- Elisabet Alzueta
- Departamento de Psicología Biológica y de la Salud, Facultad de Psicología, Universidad Autónoma de Madrid, Madrid, Spain.
| | - María Melcón
- Departamento de Psicología Biológica y de la Salud, Facultad de Psicología, Universidad Autónoma de Madrid, Madrid, Spain
| | - Ole Jensen
- Centre for Human Brain Health, School of Psychology, University of Birmingham, Birmingham, United Kingdom
| | - Almudena Capilla
- Departamento de Psicología Biológica y de la Salud, Facultad de Psicología, Universidad Autónoma de Madrid, Madrid, Spain.
| |
Collapse
|
31
|
Baroni F, Morillon B, Trébuchon A, Liégeois-Chauvel C, Olasagasti I, Giraud AL. Converging intracortical signatures of two separated processing timescales in human early auditory cortex. Neuroimage 2020; 218:116882. [PMID: 32439539 DOI: 10.1016/j.neuroimage.2020.116882] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/17/2019] [Revised: 03/30/2020] [Accepted: 04/23/2020] [Indexed: 11/15/2022] Open
Abstract
Neural oscillations in auditory cortex are argued to support parsing and representing speech constituents at their corresponding temporal scales. Yet, how incoming sensory information interacts with ongoing spontaneous brain activity, what features of the neuronal microcircuitry underlie spontaneous and stimulus-evoked spectral fingerprints, and what these fingerprints entail for stimulus encoding, remain largely open questions. We used a combination of human invasive electrophysiology, computational modeling and decoding techniques to assess the information encoding properties of brain activity and to relate them to a plausible underlying neuronal microarchitecture. We analyzed intracortical auditory EEG activity from 10 patients while they were listening to short sentences. Pre-stimulus neural activity in early auditory cortical regions often exhibited power spectra with a shoulder in the delta range and a small bump in the beta range. Speech decreased power in the beta range, and increased power in the delta-theta and gamma ranges. Using multivariate machine learning techniques, we assessed the spectral profile of information content for two aspects of speech processing: detection and discrimination. We obtained better phase than power information decoding, and a bimodal spectral profile of information content with better decoding at low (delta-theta) and high (gamma) frequencies than at intermediate (beta) frequencies. These experimental data were reproduced by a simple rate model made of two subnetworks with different timescales, each composed of coupled excitatory and inhibitory units, and connected via a negative feedback loop. Modeling and experimental results were similar in terms of pre-stimulus spectral profile (except for the iEEG beta bump), spectral modulations with speech, and spectral profile of information content. Altogether, we provide converging evidence from both univariate spectral analysis and decoding approaches for a dual timescale processing infrastructure in human auditory cortex, and show that it is consistent with the dynamics of a simple rate model.
Collapse
Affiliation(s)
- Fabiano Baroni
- Department of Fundamental Neuroscience, University of Geneva, Geneva, Switzerland; School of Engineering, École Polytechnique Fédérale de Lausanne, Lausanne, Switzerland.
| | - Benjamin Morillon
- Aix Marseille Université, Institut National de la Santé et de la Recherche Médicale (INSERM), Institut de Neurosciences des Systémes (INS), Marseille, France
| | - Agnès Trébuchon
- Aix Marseille Université, Institut National de la Santé et de la Recherche Médicale (INSERM), Institut de Neurosciences des Systémes (INS), Marseille, France; Clinical Neurophysiology and Epileptology Department, Timone Hospital, Assistance Publique Hôpitaux de Marseille, Marseille, France
| | - Catherine Liégeois-Chauvel
- Aix Marseille Université, Institut National de la Santé et de la Recherche Médicale (INSERM), Institut de Neurosciences des Systémes (INS), Marseille, France; Department of Neurological Surgery, University of Pittsburgh, PA, 15213, USA
| | - Itsaso Olasagasti
- Department of Fundamental Neuroscience, University of Geneva, Geneva, Switzerland
| | - Anne-Lise Giraud
- Department of Fundamental Neuroscience, University of Geneva, Geneva, Switzerland
| |
Collapse
|
32
|
Boettcher SEP, Stokes MG, Nobre AC, van Ede F. One Thing Leads to Another: Anticipating Visual Object Identity Based on Associative-Memory Templates. J Neurosci 2020; 40:4010-4020. [PMID: 32284338 PMCID: PMC7219293 DOI: 10.1523/jneurosci.2751-19.2020] [Citation(s) in RCA: 9] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/19/2019] [Revised: 02/19/2020] [Accepted: 03/09/2020] [Indexed: 11/21/2022] Open
Abstract
Probabilistic associations between stimuli afford memory templates that guide perception through proactive anticipatory mechanisms. A great deal of work has examined the behavioral consequences and human electrophysiological substrates of anticipation following probabilistic memory cues that carry spatial or temporal information to guide perception. However, less is understood about the electrophysiological substrates linked to anticipating the sensory content of events based on recurring associations between successive events. Here, we demonstrate behavioral and electrophysiological signatures of using associative-memory templates to guide perception, while equating spatial and temporal anticipation (experiments 1 and 2), as well as target probability and response demands (experiment 2). By recording the electroencephalogram in the two experiments (N = 55; 24 females), we show that two markers in human electrophysiology implicated in spatial and temporal anticipation also contribute to the anticipation of perceptual identity, as follows: attenuation of alpha-band oscillations and the contingent negative variation (CNV). Together, our results show that memory-guided identity templates proactively impact perception and are associated with anticipatory states of attenuated alpha oscillations and the CNV. Furthermore, by isolating object-identity anticipation from spatial and temporal anticipation, our results suggest a role for alpha attenuation and the CNV in specific visual content anticipation beyond general changes in neural excitability or readiness.SIGNIFICANCE STATEMENT Probabilistic associations between stimuli afford memory templates that guide perception through proactive anticipatory mechanisms. The current work isolates the behavioral benefits and electrophysiological signatures of memory-guided identity-based anticipation, while equating anticipation of space, time, motor responses, and task relevance. Our results show that anticipation of the specific identity of a forthcoming percept impacts performance and is associated with states of attenuated alpha oscillations and the contingent negative variation, extending previous work implicating these neural substrates in spatial and temporal preparatory attention. Together, this work bridges fields of attention, memory, and perception, providing new insights into the neural mechanisms that support complex attentional templates.
Collapse
Affiliation(s)
- Sage E P Boettcher
- Department of Experimental Psychology, University of Oxford, Oxford OX2 6GG, United Kingdom
- Oxford Centre for Human Brain Activity, Wellcome Centre for Integrative Neuroimaging, Department of Psychiatry, University of Oxford, Oxford OX3 7JX, United Kingdom
| | - Mark G Stokes
- Department of Experimental Psychology, University of Oxford, Oxford OX2 6GG, United Kingdom
| | - Anna C Nobre
- Department of Experimental Psychology, University of Oxford, Oxford OX2 6GG, United Kingdom
- Oxford Centre for Human Brain Activity, Wellcome Centre for Integrative Neuroimaging, Department of Psychiatry, University of Oxford, Oxford OX3 7JX, United Kingdom
| | - Freek van Ede
- Oxford Centre for Human Brain Activity, Wellcome Centre for Integrative Neuroimaging, Department of Psychiatry, University of Oxford, Oxford OX3 7JX, United Kingdom
| |
Collapse
|
33
|
Kononowicz TW, Sander T, Van Rijn H, van Wassenhove V. Precision Timing with α-β Oscillatory Coupling: Stopwatch or Motor Control? J Cogn Neurosci 2020; 32:1624-1636. [PMID: 32378998 DOI: 10.1162/jocn_a_01570] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/04/2022]
Abstract
Precise timing is crucial for many behaviors ranging from conversational speech to athletic performance. The precision of motor timing has been suggested to result from the strength of phase-amplitude coupling (PAC) between the phase of alpha oscillations (α, 8-12 Hz) and the power of beta activity (β, 14-30 Hz), herein referred to as α-β PAC. The amplitude of β oscillations has been proposed to code for temporally relevant information and the locking of β power to the phase of α oscillations to maintain timing precision. Motor timing precision has at least two sources of variability: variability of timekeeping mechanism and variability of motor control. It is ambiguous to which of these two factors α-β PAC should be ascribed: α-β PAC could index precision of stopwatch-like internal timekeeping mechanisms, or α-β PAC could index motor control precision. To disentangle these two hypotheses, we tested how oscillatory coupling at different stages of a time reproduction task related to temporal precision. Human participants encoded and subsequently reproduced a time interval while magnetoencephalography was recorded. The data show a robust α-β PAC during both the encoding and reproduction of a temporal interval, a pattern that cannot be predicted by motor control accounts. Specifically, we found that timing precision resulted from the trade-off between the strength of α-β PAC during the encoding and during the reproduction of intervals. These results support the hypothesis that α-β PAC codes for the precision of temporal representations in the human brain.
Collapse
Affiliation(s)
- Tadeusz W Kononowicz
- Cognitive Neuroimaging Unit, CEA DRF/Joliot, INSERM, Université Paris-Sud, Université Paris-Saclay, NeuroSpin center, 91191 Gif/Yvette, France
| | | | | | - Virginie van Wassenhove
- Cognitive Neuroimaging Unit, CEA DRF/Joliot, INSERM, Université Paris-Sud, Université Paris-Saclay, NeuroSpin center, 91191 Gif/Yvette, France
| |
Collapse
|
34
|
Spatial attention affects the early processing of neutral versus fearful faces when they are task-irrelevant: a classifier study of the EEG C1 component. COGNITIVE AFFECTIVE & BEHAVIORAL NEUROSCIENCE 2020; 19:123-137. [PMID: 30341623 DOI: 10.3758/s13415-018-00650-7] [Citation(s) in RCA: 15] [Impact Index Per Article: 3.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/20/2023]
Abstract
EEG studies suggest that the emotional content of visual stimuli is processed rapidly. In particular, the C1 component, which occurs up to 100 ms after stimulus onset and likely reflects activity in primary visual cortex V1, has been reported to be sensitive to emotional faces. However, difficulties replicating these results have been reported. We hypothesized that the nature of the task and attentional condition are key to reconcile the conflicting findings. We report three experiments of EEG activity during the C1 time range elicited by peripherally presented neutral and fearful faces under various attentional conditions: the faces were spatially attended or unattended and were either task-relevant or not. Using traditional event-related potential analysis, we found that the early activity changed depending on facial expression, attentional condition, and task. In addition, we trained classifiers to discriminate the different conditions from the EEG signals. Although the classifiers were not able to discriminate between facial expressions in any condition, they uncovered differences between spatially attended and unattended faces but solely when these were task-irrelevant. In addition, this effect was only present for neutral faces. Our study provides further indication that attention and task are key parameters when measuring early differences between emotional and neutral visual stimuli.
Collapse
|
35
|
van Wassenhove V, Herbst SK. Jones, M. R. Time Will Tell: A Theory of Dynamic Attending. Perception 2020. [DOI: 10.1177/0301006620910321] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/15/2022]
|
36
|
Meng J, Xu M, Zhou P, He F, Ming D. EEG Complexity and Functional Connectivity During Precise Timing Prediction .. ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2020; 2019:2909-2912. [PMID: 31946499 DOI: 10.1109/embc.2019.8856764] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/10/2022]
Abstract
Predictive timing in millisecond-scale is crucial for human beings to efficiently accomplish ongoing perceptions and actions. It is believed that the predictive timing process is an implementation of the predictive coding model in time domain, which can flexibly deal with both the matching and mismatching predictions. However, it's still far from being understood how the neural signature differs between the two conditions during precise timing prediction. As the brain is a complex system, it is necessary to use nonlinear measures and functional connectivity to investigate the brain function of timing prediction. Here, we probe into the EEG signatures during predictive timing process by the sample entropy (SampEn), Lempel-Ziv complexity (LZC) and partial directed coherence methods. Significant lower EEG complexity and stronger brain functional connectivity were observed when the stimulus matches the timing prediction. The current observation may shed light on the modeling of the precise predictive timing process.
Collapse
|
37
|
Grabenhorst M, Michalareas G, Maloney LT, Poeppel D. The anticipation of events in time. Nat Commun 2019; 10:5802. [PMID: 31862912 PMCID: PMC6925136 DOI: 10.1038/s41467-019-13849-0] [Citation(s) in RCA: 14] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/03/2019] [Accepted: 11/25/2019] [Indexed: 11/09/2022] Open
Abstract
Humans anticipate events signaled by sensory cues. It is commonly assumed that two uncertainty parameters modulate the brain's capacity to predict: the hazard rate (HR) of event probability and the uncertainty in time estimation which increases with elapsed time. We investigate both assumptions by presenting event probability density functions (PDFs) in each of three sensory modalities. We show that perceptual systems use the reciprocal PDF and not the HR to model event probability density. We also demonstrate that temporal uncertainty does not necessarily grow with elapsed time but can also diminish, depending on the event PDF. Previous research identified neuronal activity related to event probability in multiple levels of the cortical hierarchy (sensory (V4), association (LIP), motor and other areas) proposing the HR as an elementary neuronal computation. Our results-consistent across vision, audition, and somatosensation-suggest that the neurobiological implementation of event anticipation is based on a different, simpler and more stable computation than HR: the reciprocal PDF of events in time.
Collapse
Affiliation(s)
- Matthias Grabenhorst
- Neuroscience Department, Max-Planck-Institute for Empirical Aesthetics, Grüneburgweg 14, 60322, Frankfurt, Germany.
| | - Georgios Michalareas
- Neuroscience Department, Max-Planck-Institute for Empirical Aesthetics, Grüneburgweg 14, 60322, Frankfurt, Germany
| | - Laurence T Maloney
- Department of Psychology, Center for Neural Science, 6 Washington Place, New York, NY, 10003, USA
| | - David Poeppel
- Neuroscience Department, Max-Planck-Institute for Empirical Aesthetics, Grüneburgweg 14, 60322, Frankfurt, Germany.,Department of Psychology, Center for Neural Science, 6 Washington Place, New York, NY, 10003, USA
| |
Collapse
|
38
|
Benedetto A, Morrone MC. Visual sensitivity and bias oscillate phase-locked to saccadic eye movements. J Vis 2019; 19:15. [DOI: 10.1167/19.14.15] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/24/2022] Open
Affiliation(s)
- Alessandro Benedetto
- Dipartimento di Ricerca Traslazionale e delle Nuove Tecnologie in Medicina e Chirurgia, Università di Pisa, Pisa, Italy
| | - Maria Concetta Morrone
- Dipartimento di Ricerca Traslazionale e delle Nuove Tecnologie in Medicina e Chirurgia, Università di Pisa, Pisa, Italy
| |
Collapse
|
39
|
Nobre AC, Stokes MG. Premembering Experience: A Hierarchy of Time-Scales for Proactive Attention. Neuron 2019; 104:132-146. [PMID: 31600510 PMCID: PMC6873797 DOI: 10.1016/j.neuron.2019.08.030] [Citation(s) in RCA: 69] [Impact Index Per Article: 13.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/19/2019] [Revised: 08/07/2019] [Accepted: 08/20/2019] [Indexed: 12/30/2022]
Abstract
Memories are about the past, but they serve the future. Memory research often emphasizes the former aspect: focusing on the functions that re-constitute (re-member) experience and elucidating the various types of memories and their interrelations, timescales, and neural bases. Here we highlight the prospective nature of memory in guiding selective attention, focusing on functions that use previous experience to anticipate the relevant events about to unfold-to "premember" experience. Memories of various types and timescales play a fundamental role in guiding perception and performance adaptively, proactively, and dynamically. Consonant with this perspective, memories are often recorded according to expected future demands. Using working memory as an example, we consider how mnemonic content is selected and represented for future use. This perspective moves away from the traditional representational account of memory toward a functional account in which forward-looking memory traces are informationally and computationally tuned for interacting with incoming sensory signals to guide adaptive behavior.
Collapse
Affiliation(s)
- Anna C Nobre
- Department of Experimental Psychology, University of Oxford, Oxford, UK; Oxford Centre for Human Brain Activity, Wellcome Centre for Integrative Neuroimaging, Department of Psychiatry, University of Oxford, Oxford, UK.
| | - Mark G Stokes
- Department of Experimental Psychology, University of Oxford, Oxford, UK; Oxford Centre for Human Brain Activity, Wellcome Centre for Integrative Neuroimaging, Department of Psychiatry, University of Oxford, Oxford, UK
| |
Collapse
|
40
|
Herbst SK, Obleser J. Implicit temporal predictability enhances pitch discrimination sensitivity and biases the phase of delta oscillations in auditory cortex. Neuroimage 2019; 203:116198. [PMID: 31539590 DOI: 10.1016/j.neuroimage.2019.116198] [Citation(s) in RCA: 30] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/18/2019] [Revised: 08/23/2019] [Accepted: 09/14/2019] [Indexed: 10/26/2022] Open
Abstract
Can human listeners use implicit temporal contingencies in auditory input to form temporal predictions, and if so, how are these predictions represented endogenously? To assess this question, we implicitly manipulated temporal predictability in an auditory pitch discrimination task: unbeknownst to participants, the pitch of the standard tone could either be deterministically predictive of the temporal onset of the target tone, or convey no predictive information. Predictive and non-predictive conditions were presented interleaved in one stream, and separated by variable inter-stimulus intervals such that there was no dominant stimulus rhythm throughout. Even though participants were unaware of the implicit temporal contingencies, pitch discrimination sensitivity (the slope of the psychometric function) increased when the onset of the target tone was predictable in time (N = 49, 28 female, 21 male). Concurrently recorded EEG data (N = 24) revealed that standard tones that conveyed temporal predictions evoked a more negative N1 component than non-predictive standards. We observed no significant differences in oscillatory power or phase coherence between conditions during the foreperiod. Importantly, the phase angle of delta oscillations (1-3 Hz) in auditory areas in the post-standard and pre-target time windows predicted behavioral pitch discrimination sensitivity. This suggests that temporal predictions are encoded in delta oscillatory phase during the foreperiod interval. In sum, we show that auditory perception benefits from implicit temporal contingencies, and provide evidence for a role of slow neural oscillations in the endogenous representation of temporal predictions, in absence of exogenously driven entrainment to rhythmic input.
Collapse
Affiliation(s)
- Sophie K Herbst
- Department of Psychology, University of Lübeck, Ratzeburger Allee 160, 23552, Lübeck, Germany; NeuroSpin, CEA, DRF/Joliot; INSERM Cognitive Neuroimaging Unit; Université Paris-Sud, Université Paris-Saclay; Bât 145Gif s/ Yvette, 91190 France.
| | - Jonas Obleser
- Department of Psychology, University of Lübeck, Ratzeburger Allee 160, 23552, Lübeck, Germany
| |
Collapse
|
41
|
Shalev N, Bauer AKR, Nobre AC. The tempos of performance. Curr Opin Psychol 2019; 29:254-260. [PMID: 31302478 PMCID: PMC6996131 DOI: 10.1016/j.copsyc.2019.06.003] [Citation(s) in RCA: 11] [Impact Index Per Article: 2.2] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/01/2018] [Revised: 06/05/2019] [Accepted: 06/10/2019] [Indexed: 11/19/2022]
Abstract
Human performance fluctuates over time. Rather than random, the complex time course of variation reflects, among other factors, influences from regular periodic processes operating at multiple time scales. In this review, we consider evidence for how our performance ebbs and flows over fractions of seconds as we engage with sensory objects, over minutes as we perform tasks, and over hours according to homeostatic factors. We propose that rhythms of performance at these multiple tempos arise from the interplay among three sources of influence: intrinsic fluctuations in brain activity, periodicity of external stimulation, and the anticipation of the temporal structure of external stimulation by the brain.
Collapse
Affiliation(s)
- Nir Shalev
- Department of Experimental Psychology, Oxford Centre for Human Brain Activity, Department of Psychiatry, and Wellcome Centre for Integrative Neuroimaging, University of Oxford, United Kingdom.
| | - Anna-Katharina R Bauer
- Department of Experimental Psychology, Oxford Centre for Human Brain Activity, Department of Psychiatry, and Wellcome Centre for Integrative Neuroimaging, University of Oxford, United Kingdom
| | - Anna C Nobre
- Department of Experimental Psychology, Oxford Centre for Human Brain Activity, Department of Psychiatry, and Wellcome Centre for Integrative Neuroimaging, University of Oxford, United Kingdom
| |
Collapse
|
42
|
Benedetto A, Morrone MC, Tomassini A. The Common Rhythm of Action and Perception. J Cogn Neurosci 2019; 32:187-200. [PMID: 31210564 DOI: 10.1162/jocn_a_01436] [Citation(s) in RCA: 31] [Impact Index Per Article: 6.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/14/2022]
Abstract
Research in the last decade has undermined the idea of perception as a continuous process, providing strong empirical support for its rhythmic modulation. More recently, it has been revealed that the ongoing motor processes influence the rhythmic sampling of sensory information. In this review, we will focus on a growing body of evidence suggesting that oscillation-based mechanisms may structure the dynamic interplay between the motor and sensory system and provide a unified temporal frame for their effective coordination. We will describe neurophysiological data, primarily collected in animals, showing phase-locking of neuronal oscillations to the onset of (eye) movements. These data are complemented by novel evidence in humans, which demonstrate the behavioral relevance of these oscillatory modulations and their domain-general nature. Finally, we will discuss the possible implications of these modulations for action-perception coupling mechanisms.
Collapse
|
43
|
Barios JA, Ezquerro S, Bertomeu-Motos A, Nann M, Badesa FJ, Fernandez E, Soekadar SR, Garcia-Aracil N. Synchronization of Slow Cortical Rhythms During Motor Imagery-Based Brain–Machine Interface Control. Int J Neural Syst 2019; 29:1850045. [DOI: 10.1142/s0129065718500454] [Citation(s) in RCA: 13] [Impact Index Per Article: 2.6] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/18/2022]
Abstract
Modulation of sensorimotor rhythm (SMR) power, a rhythmic brain oscillation physiologically linked to motor imagery, is a popular Brain–Machine Interface (BMI) paradigm, but its interplay with slower cortical rhythms, also involved in movement preparation and cognitive processing, is not entirely understood. In this study, we evaluated the changes in phase and power of slow cortical activity in delta and theta bands, during a motor imagery task controlled by an SMR-based BMI system. In Experiment I, EEG of 20 right-handed healthy volunteers was recorded performing a motor-imagery task using an SMR-based BMI controlling a visual animation, and during task-free intervals. In Experiment II, 10 subjects were evaluated along five daily sessions, while BMI-controlling same visual animation, a buzzer, and a robotic hand exoskeleton. In both experiments, feedback received from the controlled device was proportional to SMR power (11–14[Formula: see text]Hz) detected by a real-time EEG-based system. Synchronization of slow EEG frequencies along the trials was evaluated using inter-trial-phase coherence (ITPC). Results: cortical oscillations of EEG in delta and theta frequencies synchronized at the onset and at the end of both active and task-free trials; ITPC was significantly modulated by feedback sensory modality received during the tasks; and ITPC synchronization progressively increased along the training. These findings suggest that phase-locking of slow rhythms and resetting by sensory afferences might be a functionally relevant mechanism in cortical control of motor function. We propose that analysis of phase synchronization of slow cortical rhythms might also improve identification of temporal edges in BMI tasks and might help to develop physiological markers for identification of context task switching and practice-related changes in brain function, with potentially important implications for design and monitoring of motor imagery-based BMI systems, an emerging tool in neurorehabilitation of stroke.
Collapse
Affiliation(s)
- Juan A. Barios
- Biomedical Neuroengineering Research Group (nBio), Systems Engineering and Automation, Department of Miguel Hernández University, Avda. de la Universidad s/n 03202 Elche, Spain
| | - Santiago Ezquerro
- Biomedical Neuroengineering Research Group (nBio), Systems Engineering and Automation, Department of Miguel Hernández University, Avda. de la Universidad s/n 03202 Elche, Spain
| | - Arturo Bertomeu-Motos
- Biomedical Neuroengineering Research Group (nBio), Systems Engineering and Automation, Department of Miguel Hernández University, Avda. de la Universidad s/n 03202 Elche, Spain
| | - Marius Nann
- University Hospital of Tuebingen, Applied Neurotechnology Lab, Department of Psychiatry and Psychotherapy, Calwerstr. 14, 72076 Tuebingen, Germany
| | - Fco. Javier Badesa
- Biomedical Neuroengineering Research Group (nBio), Systems Engineering and Automation, Department of Miguel Hernández University, Avda. de la Universidad s/n 03202 Elche, Spain
| | - Eduardo Fernandez
- Biomedical Neuroengineering Research Group (nBio), Systems Engineering and Automation, Department of Miguel Hernández University, Avda. de la Universidad s/n 03202 Elche, Spain
| | - Surjo R. Soekadar
- University Hospital of Tuebingen, Applied Neurotechnology Lab, Department of Psychiatry and Psychotherapy, Calwerstr. 14, 72076 Tuebingen, Germany
- Clinical Neurotechnology Laboratory, Neuroscience Research Center (NWFZ), Department of Psychiatry and Psychotherapy, Charite University Medicine Berlin, Berlin, Germany
| | - Nicolas Garcia-Aracil
- Biomedical Neuroengineering Research Group (nBio), Systems Engineering and Automation, Department of Miguel Hernández University, Avda. de la Universidad s/n 03202 Elche, Spain
| |
Collapse
|
44
|
Abstract
We often temporally prepare our attention for an upcoming event such as a starter pistol. In such cases, our attention should be properly allocated around the expected moment of the event to process relevant sensory input efficiently. In this study, we examined the dynamic changes of attention levels near the expected moment by measuring contrast sensitivity to a target that was temporally cued by a five-second countdown. We found that the overall attention level decreased rapidly after the expected moment, while it stayed relatively constant before it. Results were not consistent with the predictions of existing explanations of temporal attention such as the hazard rate or the stimulus-driven oscillations. A control experiment ruled out the possibility that the observed pattern was due to biased time perception. In a further experiment with a wider range of cue-stimulus-intervals, we observed that attention level increased until the last 500 ms of the interval range, and thereafter, started to decrease. Based on the performances of a generative computational model, we suggest that our results reflect the nature of temporal attention that takes into account the subjectively estimated hazard rate and the probability of relevant events occurring in the near future.
Collapse
|
45
|
Monier F, Droit-Volet S, Coull JT. The beneficial effect of synchronized action on motor and perceptual timing in children. Dev Sci 2019; 22:e12821. [PMID: 30803107 DOI: 10.1111/desc.12821] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/16/2018] [Revised: 12/29/2018] [Accepted: 02/15/2019] [Indexed: 11/28/2022]
Abstract
We examined the role of action in motor and perceptual timing across development. Adults and children aged 5 or 8 years old learned the duration of a rhythmic interval with or without concurrent action. We compared the effects of sensorimotor versus visual learning on subsequent timing behaviour in three different tasks: rhythm reproduction (Experiment 1), rhythm discrimination (Experiment 2) and interval discrimination (Experiment 3). Sensorimotor learning consisted of sensorimotor synchronization (tapping) to an isochronous visual rhythmic stimulus (ISI = 800 ms), whereas visual learning consisted of simply observing this rhythmic stimulus. Results confirmed our hypothesis that synchronized action during learning systematically benefitted subsequent timing performance, particularly for younger children. Action-related improvements in accuracy were observed for both motor and perceptual timing in 5 years olds and for perceptual timing in the two older age groups. Benefits on perceptual timing tasks indicate that action shapes the cognitive representation of interval duration. Moreover, correlations with neuropsychological scores indicated that while timing performance in the visual learning condition depended on motor and memory capacity, sensorimotor learning facilitated an accurate representation of time independently of individual differences in motor and memory skill. Overall, our findings support the idea that action helps children to construct an independent and flexible representation of time, which leads to coupled sensorimotor coding for action and time.
Collapse
Affiliation(s)
- Florie Monier
- CNRS UMR 6024, Université Clermont Auvergne, Clermont-Ferrand, France
| | | | - Jennifer T Coull
- Laboratoire de Neurosciences Cognitives (LNC) UMR 7291, Aix-Marseille Université & CNRS, Marseille, France
| |
Collapse
|
46
|
The Strength of Alpha-Beta Oscillatory Coupling Predicts Motor Timing Precision. J Neurosci 2019; 39:3277-3291. [PMID: 30792271 DOI: 10.1523/jneurosci.2473-18.2018] [Citation(s) in RCA: 11] [Impact Index Per Article: 2.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/25/2018] [Revised: 11/23/2018] [Accepted: 12/16/2018] [Indexed: 11/21/2022] Open
Abstract
Precise timing makes the difference between harmony and cacophony, but how the brain achieves precision during timing is unknown. In this study, human participants (7 females, 5 males) generated a time interval while being recorded with magnetoencephalography. Building on the proposal that the coupling of neural oscillations provides a temporal code for information processing in the brain, we tested whether the strength of oscillatory coupling was sensitive to self-generated temporal precision. On a per individual basis, we show the presence of alpha-beta phase-amplitude coupling whose strength was associated with the temporal precision of self-generated time intervals, not with their absolute duration. Our results provide evidence that active oscillatory coupling engages α oscillations in maintaining the precision of an endogenous temporal motor goal encoded in β power; the when of self-timed actions. We propose that oscillatory coupling indexes the variance of neuronal computations, which translates into the precision of an individual's behavioral performance.SIGNIFICANCE STATEMENT Which neural mechanisms enable precise volitional timing in the brain is unknown, yet accurate and precise timing is essential in every realm of life. In this study, we build on the hypothesis that neural oscillations, and their coupling across time scales, are essential for the coding and for the transmission of information in the brain. We show the presence of alpha-beta phase-amplitude coupling (α-β PAC) whose strength was associated with the temporal precision of self-generated time intervals, not with their absolute duration. α-β PAC indexes the temporal precision with which information is represented in an individual's brain. Our results link large-scale neuronal variability on the one hand, and individuals' timing precision, on the other.
Collapse
|
47
|
Denison RN, Yuval-Greenberg S, Carrasco M. Directing Voluntary Temporal Attention Increases Fixational Stability. J Neurosci 2019; 39:353-363. [PMID: 30459223 PMCID: PMC6325259 DOI: 10.1523/jneurosci.1926-18.2018] [Citation(s) in RCA: 38] [Impact Index Per Article: 7.6] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/26/2018] [Revised: 11/07/2018] [Accepted: 11/13/2018] [Indexed: 11/21/2022] Open
Abstract
Our visual input is constantly changing, but not all moments are equally relevant. Visual temporal attention, the prioritization of visual information at specific points in time, increases perceptual sensitivity at behaviorally relevant times. The dynamic processes underlying this increase are unclear. During fixation, humans make small eye movements called microsaccades, and inhibiting microsaccades improves perception of brief stimuli. Here, we investigated whether temporal attention changes the pattern of microsaccades in anticipation of brief stimuli. Human observers (female and male) judged stimuli presented within a short sequence. Observers were given either an informative precue to attend to one of the stimuli, which was likely to be probed, or an uninformative (neutral) precue. We found strong microsaccadic inhibition before the stimulus sequence, likely due to its predictable onset. Critically, this anticipatory inhibition was stronger when the first target in the sequence (T1) was precued (task-relevant) than when the precue was uninformative. Moreover, the timing of the last microsaccade before T1 and the first microsaccade after T1 shifted such that both occurred earlier when T1 was precued than when the precue was uninformative. Finally, the timing of the nearest pre- and post-T1 microsaccades affected task performance. Directing voluntary temporal attention therefore affects microsaccades, helping to stabilize fixation at the most relevant moments over and above the effect of predictability. Just as saccading to a relevant stimulus can be an overt correlate of the allocation of spatial attention, precisely timed gaze stabilization can be an overt correlate of the allocation of temporal attention.SIGNIFICANCE STATEMENT We pay attention at moments in time when a relevant event is likely to occur. Such temporal attention improves our visual perception, but how it does so is not well understood. Here, we discovered a new behavioral correlate of voluntary, or goal-directed, temporal attention. We found that the pattern of small fixational eye movements called microsaccades changes around behaviorally relevant moments in a way that stabilizes the position of the eyes. Microsaccades during a brief visual stimulus can impair perception of that stimulus. Therefore, such fixation stabilization may contribute to the improvement of visual perception at attended times. This link suggests that, in addition to cortical areas, subcortical areas mediating eye movements may be recruited with temporal attention.
Collapse
Affiliation(s)
- Rachel N Denison
- Department of Psychology and Center for Neural Science, New York University, New York, New York 10003 and
| | - Shlomit Yuval-Greenberg
- School of Psychological Sciences and Sagol School of Neuroscience, Tel Aviv University, Tel Aviv 6997801, Israel
| | - Marisa Carrasco
- Department of Psychology and Center for Neural Science, New York University, New York, New York 10003 and
| |
Collapse
|
48
|
An EEG Experimental Study Evaluating the Performance of Texas Instruments ADS1299. SENSORS 2018; 18:s18113721. [PMID: 30388836 PMCID: PMC6263632 DOI: 10.3390/s18113721] [Citation(s) in RCA: 25] [Impact Index Per Article: 4.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 10/09/2018] [Revised: 10/26/2018] [Accepted: 10/30/2018] [Indexed: 11/17/2022]
Abstract
Texas Instruments ADS1299 is an attractive choice for low cost electroencephalography (EEG) devices owing to its low power consumption and low input referred noise. To date, there have been no rigorous evaluations of its performance. In this EEG experimental study we evaluated the performance of the ADS1299 against a high quality laboratory-based system. Two self-paced lower limb motor tasks were performed by 22 healthy participants. Recorded power across delta, theta, alpha, and beta EEG bands, the power ratio across the motor tasks, pre-movement noise, and signal-to-noise ratio were obtained for evaluation. The amplitude and time of the negative peak in the movement-related cortical potentials (MRCPs) extracted from the EEG data were also obtained. Using linear mixed models, no statistically significant differences (p > 0.05) were found in any of these measures across the two systems. These findings were further supported by evaluation of cosine similarity, waveform differences, and topographic maps. There were statistically significant differences in MRCPs across the motor tasks in both systems. We conclude that the performance of the ADS1299 in combination with wet Ag/AgCl electrodes is analogous to that of a laboratory-based system in a low frequency (<40 Hz) EEG recording.
Collapse
|
49
|
Coull JT, Droit-Volet S. Explicit Understanding of Duration Develops Implicitly through Action. Trends Cogn Sci 2018; 22:923-937. [DOI: 10.1016/j.tics.2018.07.011] [Citation(s) in RCA: 28] [Impact Index Per Article: 4.7] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/25/2018] [Revised: 06/29/2018] [Accepted: 07/16/2018] [Indexed: 01/08/2023]
|
50
|
Proactive Sensing of Periodic and Aperiodic Auditory Patterns. Trends Cogn Sci 2018; 22:870-882. [DOI: 10.1016/j.tics.2018.08.003] [Citation(s) in RCA: 134] [Impact Index Per Article: 22.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/02/2018] [Revised: 08/12/2018] [Accepted: 08/13/2018] [Indexed: 11/18/2022]
|