1
|
Guo L, Bao M, Chen Z, Chen L. Contingent magnetic variation and beta-band oscillations in sensorimotor temporal decision-making. Brain Res Bull 2024; 215:111021. [PMID: 38942396 DOI: 10.1016/j.brainresbull.2024.111021] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/05/2024] [Revised: 06/07/2024] [Accepted: 06/21/2024] [Indexed: 06/30/2024]
Abstract
The ability to accurately encode the temporal information of sensory events and hence to make prompt action is fundamental to humans' prompt behavioral decision-making. Here we examined the ability of ensemble coding (averaging multiple inter-intervals in a sound sequence) and subsequent immediate reproduction of target duration at half, equal, or double that of the perceived mean interval in a sensorimotor loop. With magnetoencephalography (MEG), we found that the contingent magnetic variation (CMV) in the central scalp varied as a function of the averaging tasks, with a faster rate for buildup amplitudes and shorter peak latencies in the "half" condition as compared to the "double" condition. ERD (event-related desynchronization) -to-ERS (event-related synchronization) latency was shorter in the "half" condition. A robust beta band (15-23 Hz) power suppression and recovery between the final tone and the action of key pressing was found for time reproduction. The beta modulation depth (i.e., the ERD-to-ERS power difference) was larger in motor areas than in primary auditory areas. Moreover, results of phase slope index (PSI) indicated that beta oscillations in the left supplementary motor area (SMA) led those in the right superior temporal gyrus (STG), showing SMA to STG directionality for the processing of sequential (temporal) auditory interval information. Our findings provide the first evidence to show that CMV and beta oscillations predict the coupling between perception and action in time averaging.
Collapse
Affiliation(s)
- Lu Guo
- The Key Laboratory of Noise and Vibration Research, Institute of Acoustics, Chinese Academy of Sciences, Beijing 100190, China; State Key Laboratory of Acoustics,Institute of Acoustics, Chinese Academy of Sciences, Beijing 100190, China
| | - Ming Bao
- School of Materials Science and Intelligent Engineering, Nanjing University, Suzhou 215163, China.
| | - Zhifei Chen
- School of Materials Science and Intelligent Engineering, Nanjing University, Suzhou 215163, China
| | - Lihan Chen
- School of Psychological and Cognitive Sciences and Beijing Key Laboratory of Behavior and Mental Health, Peking University, Beijing 100871, China; Key Laboratory of Machine Perception (Ministry of Education), Peking University, Beijing 100871, China; National Engineering Laboratory for Big Data Analysis and Applications, Peking University, Beijing 100871, China; State Key Laboratory of General Artificial Intelligence, Peking University, Beijing, 100871, China.
| |
Collapse
|
2
|
Tian S, Cheng YA, Luo H. Rhythm Facilitates Auditory Working Memory via Beta-Band Encoding and Theta-Band Maintenance. Neurosci Bull 2024:10.1007/s12264-024-01289-w. [PMID: 39215886 DOI: 10.1007/s12264-024-01289-w] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/29/2024] [Accepted: 05/04/2024] [Indexed: 09/04/2024] Open
Abstract
Rhythm, as a prominent characteristic of auditory experiences such as speech and music, is known to facilitate attention, yet its contribution to working memory (WM) remains unclear. Here, human participants temporarily retained a 12-tone sequence presented rhythmically or arrhythmically in WM and performed a pitch change-detection task. Behaviorally, while having comparable accuracy, rhythmic tone sequences showed a faster response time and lower response boundaries in decision-making. Electroencephalographic recordings revealed that rhythmic sequences elicited enhanced non-phase-locked beta-band (16 Hz-33 Hz) and theta-band (3 Hz-5 Hz) neural oscillations during sensory encoding and WM retention periods, respectively. Importantly, the two-stage neural signatures were correlated with each other and contributed to behavior. As beta-band and theta-band oscillations denote the engagement of motor systems and WM maintenance, respectively, our findings imply that rhythm facilitates auditory WM through intricate oscillation-based interactions between the motor and auditory systems that facilitate predictive attention to auditory sequences.
Collapse
Affiliation(s)
- Suizi Tian
- School of Psychological and Cognitive Sciences and Beijing Key Laboratory of Behavior and Mental Health, Peking University, Beijing, 100871, China
- PKU-IDG/McGovern Institute for Brain Research, Peking University, Beijing, 100871, China
| | - Yu-Ang Cheng
- Department of Cognitive, Linguistic and Psychological Sciences, Brown University, Providence, RI, 02912, USA
| | - Huan Luo
- School of Psychological and Cognitive Sciences and Beijing Key Laboratory of Behavior and Mental Health, Peking University, Beijing, 100871, China.
- PKU-IDG/McGovern Institute for Brain Research, Peking University, Beijing, 100871, China.
| |
Collapse
|
3
|
Greatrex D, Hawkins S. Rhythmic variance influences the speed but not the accuracy of complex averaging decisions. Atten Percept Psychophys 2024; 86:2104-2123. [PMID: 39110404 DOI: 10.3758/s13414-024-02930-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 06/25/2024] [Indexed: 09/19/2024]
Abstract
When a rhythm makes an event predictable, that event is perceived faster, and typically more accurately. However, the experiments showing this used simple tasks, and most manipulated temporal expectancy by using periodic or aperiodic precursors unrelated to stimulus and task. Three experiments tested the generality of these observations in a complex task in which rhythm was intrinsic to, rather than a precursor of, the information needed to respond: listeners averaged the laterality of a stream of noise bursts. We varied presentation rate, degree of periodicity, and average lateralisation. Decisions following a probe tone were fastest after periodic stimuli, and slowest after the most aperiodic stimuli. Without a probe tone, listeners responded sooner during periodic sequences, thus hearing less information. Periodicity did not benefit accuracy overall. This gain in speed but not accuracy for less information is not reported for simpler tasks. Neural entrainment supplemented by cognitive factors provide a tentative explanation. When the task is inherently complex and demands high attention over long durations, both expected-periodic and unexpected-aperiodic stimuli can increase response amplitude, enhancing stimulus representation, but periodicity increases confidence to respond early. Drift diffusion modelling supports this proposal: aperiodicity modulated the decision threshold, but not the drift rate or non-decision time. Together, these new data and the literature point towards task-dependent effects of temporal expectation on decision-making, showing interactions between rhythmic variance, task complexity, and sources of expectation about stimuli. We suggest the implications are worth exploring to extend understanding of rhythmicity on decision-making to everyday situations.
Collapse
Affiliation(s)
- David Greatrex
- Centre for Music and Science, Faculty of Music, University of Cambridge, CB3 9DP, Cambridge, United Kingdom.
| | - Sarah Hawkins
- Centre for Music and Science, Faculty of Music, University of Cambridge, CB3 9DP, Cambridge, United Kingdom
| |
Collapse
|
4
|
Uemura M, Katagiri Y, Imai E, Kawahara Y, Otani Y, Ichinose T, Kondo K, Kowa H. Dorsal Anterior Cingulate Cortex Coordinates Contextual Mental Imagery for Single-Beat Manipulation during Rhythmic Sensorimotor Synchronization. Brain Sci 2024; 14:757. [PMID: 39199452 PMCID: PMC11352649 DOI: 10.3390/brainsci14080757] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/15/2024] [Revised: 07/17/2024] [Accepted: 07/23/2024] [Indexed: 09/01/2024] Open
Abstract
Flexible pulse-by-pulse regulation of sensorimotor synchronization is crucial for voluntarily showing rhythmic behaviors synchronously with external cueing; however, the underpinning neurophysiological mechanisms remain unclear. We hypothesized that the dorsal anterior cingulate cortex (dACC) plays a key role by coordinating both proactive and reactive motor outcomes based on contextual mental imagery. To test our hypothesis, a missing-oddball task in finger-tapping paradigms was conducted in 33 healthy young volunteers. The dynamic properties of the dACC were evaluated by event-related deep-brain activity (ER-DBA), supported by event-related potential (ERP) analysis and behavioral evaluation based on signal detection theory. We found that ER-DBA activation/deactivation reflected a strategic choice of motor control modality in accordance with mental imagery. Reverse ERP traces, as omission responses, confirmed that the imagery was contextual. We found that mental imagery was updated only by environmental changes via perceptual evidence and response-based abductive reasoning. Moreover, stable on-pulse tapping was achievable by maintaining proactive control while creating an imagery of syncopated rhythms from simple beat trains, whereas accuracy was degraded with frequent erroneous tapping for missing pulses. We conclude that the dACC voluntarily regulates rhythmic sensorimotor synchronization by utilizing contextual mental imagery based on experience and by creating novel rhythms.
Collapse
Affiliation(s)
- Maho Uemura
- Department of Rehabilitation Science, Kobe University Graduate School of Health Sciences, Kobe 654-0142, Japan; (Y.O.); (H.K.)
- School of Music, Mukogawa Women’s University, Nishinomiya 663-8558, Japan;
| | - Yoshitada Katagiri
- Department of Bioengineering, School of Engineering, The University of Tokyo, Tokyo 113-8655, Japan;
| | - Emiko Imai
- Department of Biophysics, Kobe University Graduate School of Health Sciences, Kobe 654-0142, Japan;
| | - Yasuhiro Kawahara
- Department of Human life and Health Sciences, Division of Arts and Sciences, The Open University of Japan, Chiba 261-8586, Japan;
| | - Yoshitaka Otani
- Department of Rehabilitation Science, Kobe University Graduate School of Health Sciences, Kobe 654-0142, Japan; (Y.O.); (H.K.)
- Faculty of Rehabilitation, Kobe International University, Kobe 658-0032, Japan
| | - Tomoko Ichinose
- School of Music, Mukogawa Women’s University, Nishinomiya 663-8558, Japan;
| | | | - Hisatomo Kowa
- Department of Rehabilitation Science, Kobe University Graduate School of Health Sciences, Kobe 654-0142, Japan; (Y.O.); (H.K.)
| |
Collapse
|
5
|
Kunimura H, Oda H, Kawasaki T, Gao H, Fukuda S, Hiraoka K. Effect of Spatial and Temporal Prediction on Tactile Sensitivity. Brain Sci 2024; 14:749. [PMID: 39199444 PMCID: PMC11352973 DOI: 10.3390/brainsci14080749] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/04/2024] [Revised: 07/22/2024] [Accepted: 07/23/2024] [Indexed: 09/01/2024] Open
Abstract
The purpose of the present study was to examine whether spatial or temporal prediction of the tactile stimulus contributes to tactile sensitivity. To investigate the effect of spatial prediction on tactile sensitivity, electrical stimuli were provided for the digit nerve in one of five fingers, and advanced notice of the stimulating finger was provided before the stimulus in some trials but not in others. There was no significant effect of spatial prediction on the intensity at the perceptual threshold of the digit nerve stimulus. This indicates that spatial prediction of the tactile stimulus does not influence tactile sensitivity. To examine the effect of temporal prediction, an auditory warning cue was provided 0, 1, or 10 s before the electrical stimulus to the digit nerve. The stimulus intensity at the perceptual threshold in the trials with the 1 s warning cue was lower than those with the 0 s warning cue. This indicates that temporal prediction enhances tactile sensitivity. The stimulus intensity at the perceptual threshold in the trials with the 1 s warning cue was lower than those with the 10 s warning cue. This means that the contribution of temporal prediction to the tactile sensitivity is greater as the warning cue is closer to the time of the stimulus. This finding may be explained by a defense mechanism activated when humans predict that a tactile stimulus is coming soon.
Collapse
Affiliation(s)
- Hiroshi Kunimura
- Graduate School of Rehabilitation Science, Osaka Metropolitan University, 3-7-30 Habikino, Habikino City 583-8555, Osaka, Japan
| | - Hitoshi Oda
- Graduate School of Rehabilitation Science, Osaka Metropolitan University, 3-7-30 Habikino, Habikino City 583-8555, Osaka, Japan
| | - Taku Kawasaki
- Graduate School of Rehabilitation Science, Osaka Metropolitan University, 3-7-30 Habikino, Habikino City 583-8555, Osaka, Japan
| | - Han Gao
- Graduate School of Rehabilitation Science, Osaka Metropolitan University, 3-7-30 Habikino, Habikino City 583-8555, Osaka, Japan
| | - Shiho Fukuda
- Graduate School of Rehabilitation Science, Osaka Metropolitan University, 3-7-30 Habikino, Habikino City 583-8555, Osaka, Japan
| | - Koichi Hiraoka
- School of Medicine, Osaka Metropolitan University, 3-7-30 Habikino, Habikino City 583-8555, Osaka, Japan
| |
Collapse
|
6
|
Momtaz S, Bidelman GM. Effects of Stimulus Rate and Periodicity on Auditory Cortical Entrainment to Continuous Sounds. eNeuro 2024; 11:ENEURO.0027-23.2024. [PMID: 38253583 PMCID: PMC10913036 DOI: 10.1523/eneuro.0027-23.2024] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/23/2023] [Revised: 01/14/2024] [Accepted: 01/16/2024] [Indexed: 01/24/2024] Open
Abstract
The neural mechanisms underlying the exogenous coding and neural entrainment to repetitive auditory stimuli have seen a recent surge of interest. However, few studies have characterized how parametric changes in stimulus presentation alter entrained responses. We examined the degree to which the brain entrains to repeated speech (i.e., /ba/) and nonspeech (i.e., click) sounds using phase-locking value (PLV) analysis applied to multichannel human electroencephalogram (EEG) data. Passive cortico-acoustic tracking was investigated in N = 24 normal young adults utilizing EEG source analyses that isolated neural activity stemming from both auditory temporal cortices. We parametrically manipulated the rate and periodicity of repetitive, continuous speech and click stimuli to investigate how speed and jitter in ongoing sound streams affect oscillatory entrainment. Neuronal synchronization to speech was enhanced at 4.5 Hz (the putative universal rate of speech) and showed a differential pattern to that of clicks, particularly at higher rates. PLV to speech decreased with increasing jitter but remained superior to clicks. Surprisingly, PLV entrainment to clicks was invariant to periodicity manipulations. Our findings provide evidence that the brain's neural entrainment to complex sounds is enhanced and more sensitized when processing speech-like stimuli, even at the syllable level, relative to nonspeech sounds. The fact that this specialization is apparent even under passive listening suggests a priority of the auditory system for synchronizing to behaviorally relevant signals.
Collapse
Affiliation(s)
- Sara Momtaz
- School of Communication Sciences & Disorders, University of Memphis, Memphis, Tennessee 38152
- Boys Town National Research Hospital, Boys Town, Nebraska 68131
| | - Gavin M Bidelman
- Department of Speech, Language and Hearing Sciences, Indiana University, Bloomington, Indiana 47408
- Program in Neuroscience, Indiana University, Bloomington, Indiana 47405
| |
Collapse
|
7
|
Aharoni M, Breska A, Müller MM, Schröger E. Mechanisms of sustained perceptual entrainment after stimulus offset. Eur J Neurosci 2024; 59:1047-1060. [PMID: 37150801 DOI: 10.1111/ejn.16032] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/12/2021] [Revised: 04/21/2023] [Accepted: 04/22/2023] [Indexed: 05/09/2023]
Abstract
Temporal alignment of neural activity to rhythmic stimulation has been suggested to result from a resonating internal neural oscillator mechanism, but can also be explained by interval-based temporal prediction. Here, we investigate behavioural and brain responses in the post-stimulation period to compare an oscillatory versus an interval-based account. Hickok et al.'s (2015) behavioural paradigm yielded results that relate to a neural oscillatory entrainment mechanism. We adapted the paradigm to an event-related potential (ERP) suitable design: a periodic sequence was followed, in half of the trials, by near-threshold targets embedded in noise. The targets were played in various phases in relation to the preceding sequences' period. Participants had to detect whether targets were played or not, and their EEG was recorded. Both behavioural results and the P300 component of the ERP were not only partially consistent with an oscillatory mechanism but also partially consistent with an interval-based attentional gain mechanism. Instead, data obtained in the post-entrainment period can best be explained with a combination of both mechanisms.
Collapse
Affiliation(s)
- Moran Aharoni
- Edmund and Lilly Safra Center for Brain Science, The Hebrew University of Jerusalem, Jerusalem, Israel
- Wilhelm Wundt Institute for Psychology, Leipzig University, Leipzig, Germany
| | - Assaf Breska
- Max Planck Institute for Biological Cybernetics, Tübingen, Germany
| | - Matthias M Müller
- Wilhelm Wundt Institute for Psychology, Leipzig University, Leipzig, Germany
| | - Erich Schröger
- Wilhelm Wundt Institute for Psychology, Leipzig University, Leipzig, Germany
| |
Collapse
|
8
|
Kobayashi K, Shiba Y, Honda S, Nakajima S, Fujii S, Mimura M, Noda Y. Short-Term Effect of Auditory Stimulation on Neural Activities: A Scoping Review of Longitudinal Electroencephalography and Magnetoencephalography Studies. Brain Sci 2024; 14:131. [PMID: 38391706 PMCID: PMC10887208 DOI: 10.3390/brainsci14020131] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/03/2023] [Revised: 12/24/2023] [Accepted: 01/24/2024] [Indexed: 02/24/2024] Open
Abstract
Explored through EEG/MEG, auditory stimuli function as a suitable research probe to reveal various neural activities, including event-related potentials, brain oscillations and functional connectivity. Accumulating evidence in this field stems from studies investigating neuroplasticity induced by long-term auditory training, specifically cross-sectional studies comparing musicians and non-musicians as well as longitudinal studies with musicians. In contrast, studies that address the neural effects of short-term interventions whose duration lasts from minutes to hours are only beginning to be featured. Over the past decade, an increasing body of evidence has shown that short-term auditory interventions evoke rapid changes in neural activities, and oscillatory fluctuations can be observed even in the prestimulus period. In this scoping review, we divided the extracted neurophysiological studies into three groups to discuss neural activities with short-term auditory interventions: the pre-stimulus period, during stimulation, and a comparison of before and after stimulation. We show that oscillatory activities vary depending on the context of the stimuli and are greatly affected by the interplay of bottom-up and top-down modulational mechanisms, including attention. We conclude that the observed rapid changes in neural activitiesin the auditory cortex and the higher-order cognitive part of the brain are causally attributed to short-term auditory interventions.
Collapse
Affiliation(s)
- Kanon Kobayashi
- Department of Neuropsychiatry, Keio University School of Medicine, 35 Shinanomachi, Shinjuku-ku, Tokyo 160-8582, Japan
| | - Yasushi Shiba
- Faculty of Medicine, University of Tokyo, Tokyo 113-8655, Japan
| | - Shiori Honda
- Department of Neuropsychiatry, Keio University School of Medicine, 35 Shinanomachi, Shinjuku-ku, Tokyo 160-8582, Japan
| | - Shinichiro Nakajima
- Department of Neuropsychiatry, Keio University School of Medicine, 35 Shinanomachi, Shinjuku-ku, Tokyo 160-8582, Japan
| | - Shinya Fujii
- Faculty of Environment and Information Studies, Keio University, Fujisawa 252-0816, Japan
| | - Masaru Mimura
- Department of Neuropsychiatry, Keio University School of Medicine, 35 Shinanomachi, Shinjuku-ku, Tokyo 160-8582, Japan
| | - Yoshihiro Noda
- Department of Neuropsychiatry, Keio University School of Medicine, 35 Shinanomachi, Shinjuku-ku, Tokyo 160-8582, Japan
| |
Collapse
|
9
|
Bonnet P, Bonnefond M, Kösem A. What is a Rhythm for the Brain? The Impact of Contextual Temporal Variability on Auditory Perception. J Cogn 2024; 7:15. [PMID: 38250558 PMCID: PMC10798173 DOI: 10.5334/joc.344] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/08/2023] [Accepted: 01/02/2024] [Indexed: 01/23/2024] Open
Abstract
Temporal predictions can be formed and impact perception when sensory timing is fully predictable: for instance, the discrimination of a target sound is enhanced if it is presented on the beat of an isochronous rhythm. However, natural sensory stimuli, like speech or music, are not entirely predictable, but still possess statistical temporal regularities. We investigated whether temporal expectations can be formed in non-fully predictable contexts, and how the temporal variability of sensory contexts affects auditory perception. Specifically, we asked how "rhythmic" an auditory stimulation needs to be in order to observe temporal predictions effects on auditory discrimination performances. In this behavioral auditory oddball experiment, participants listened to auditory sound sequences where the temporal interval between each sound was drawn from gaussian distributions with distinct standard deviations. Participants were asked to discriminate sounds with a deviant pitch in the sequences. Auditory discrimination performances, as measured with deviant sound discrimination accuracy and response times, progressively declined as the temporal variability of the sound sequence increased. Moreover, both global and local temporal statistics impacted auditory perception, suggesting that temporal statistics are promptly integrated to optimize perception. Altogether, these results suggests that temporal predictions can be set up quickly based on the temporal statistics of past sensory events and are robust to a certain amount of temporal variability. Therefore, temporal predictions can be built on sensory stimulations that are not purely periodic nor temporally deterministic.
Collapse
Affiliation(s)
- Pierre Bonnet
- Lyon Neuroscience Research Center (CRNL), Computation, Cognition and Neurophysiology team (Cophy), Inserm U1028, Université Claude Bernard Lyon1, CNRS UMR 5292, 69000 Lyon, France
| | - Mathilde Bonnefond
- Lyon Neuroscience Research Center (CRNL), Computation, Cognition and Neurophysiology team (Cophy), Inserm U1028, Université Claude Bernard Lyon1, CNRS UMR 5292, 69000 Lyon, France
| | - Anne Kösem
- Lyon Neuroscience Research Center (CRNL), Computation, Cognition and Neurophysiology team (Cophy), Inserm U1028, Université Claude Bernard Lyon1, CNRS UMR 5292, 69000 Lyon, France
| |
Collapse
|
10
|
Ten Oever S, Martin AE. Interdependence of "What" and "When" in the Brain. J Cogn Neurosci 2024; 36:167-186. [PMID: 37847823 DOI: 10.1162/jocn_a_02067] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/19/2023]
Abstract
From a brain's-eye-view, when a stimulus occurs and what it is are interrelated aspects of interpreting the perceptual world. Yet in practice, the putative perceptual inferences about sensory content and timing are often dichotomized and not investigated as an integrated process. We here argue that neural temporal dynamics can influence what is perceived, and in turn, stimulus content can influence the time at which perception is achieved. This computational principle results from the highly interdependent relationship of what and when in the environment. Both brain processes and perceptual events display strong temporal variability that is not always modeled; we argue that understanding-and, minimally, modeling-this temporal variability is key for theories of how the brain generates unified and consistent neural representations and that we ignore temporal variability in our analysis practice at the peril of both data interpretation and theory-building. Here, we review what and when interactions in the brain, demonstrate via simulations how temporal variability can result in misguided interpretations and conclusions, and outline how to integrate and synthesize what and when in theories and models of brain computation.
Collapse
Affiliation(s)
- Sanne Ten Oever
- Max Planck Institute for Psycholinguistics, Nijmegen, The Netherlands
- Donders Centre for Cognitive Neuroimaging, Nijmegen, The Netherlands
- Maastricht University, The Netherlands
| | - Andrea E Martin
- Max Planck Institute for Psycholinguistics, Nijmegen, The Netherlands
- Donders Centre for Cognitive Neuroimaging, Nijmegen, The Netherlands
| |
Collapse
|
11
|
Bouwer FL, Háden GP, Honing H. Probing Beat Perception with Event-Related Potentials (ERPs) in Human Adults, Newborns, and Nonhuman Primates. ADVANCES IN EXPERIMENTAL MEDICINE AND BIOLOGY 2024; 1455:227-256. [PMID: 38918355 DOI: 10.1007/978-3-031-60183-5_13] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/27/2024]
Abstract
The aim of this chapter is to give an overview of how the perception of rhythmic temporal regularity such as a regular beat in music can be studied in human adults, human newborns, and nonhuman primates using event-related brain potentials (ERPs). First, we discuss different aspects of temporal structure in general, and musical rhythm in particular, and we discuss the possible mechanisms underlying the perception of regularity (e.g., a beat) in rhythm. Additionally, we highlight the importance of dissociating beat perception from the perception of other types of structure in rhythm, such as predictable sequences of temporal intervals, ordinal structure, and rhythmic grouping. In the second section of the chapter, we start with a discussion of auditory ERPs elicited by infrequent and frequent sounds: ERP responses to regularity violations, such as mismatch negativity (MMN), N2b, and P3, as well as early sensory responses to sounds, such as P1 and N1, have been shown to be instrumental in probing beat perception. Subsequently, we discuss how beat perception can be probed by comparing ERP responses to sounds in regular and irregular sequences, and by comparing ERP responses to sounds in different metrical positions in a rhythm, such as on and off the beat or on strong and weak beats. Finally, we will discuss previous research that has used the aforementioned ERPs and paradigms to study beat perception in human adults, human newborns, and nonhuman primates. In doing so, we consider the possible pitfalls and prospects of the technique, as well as future perspectives.
Collapse
Affiliation(s)
- Fleur L Bouwer
- Cognitive Psychology Unit, Institute of Psychology, Leiden Institute for Brain and Cognition, Leiden University, Leiden, The Netherlands.
- Department of Psychology, Brain & Cognition, University of Amsterdam, Amsterdam, The Netherlands.
| | - Gábor P Háden
- Institute of Cognitive Neuroscience and Psychology, Budapest, Hungary
- Department of Telecommunications and Media Informatics, Faculty of Electrical Engineering and Informatics, Budapest University of Technology and Economics, Budapest, Hungary
| | - Henkjan Honing
- Music Cognition group (MCG), Institute for Logic, Language and Computation (ILLC), Amsterdam Brain and Cognition (ABC), University of Amsterdam, Amsterdam, The Netherlands
| |
Collapse
|
12
|
Coull JT, Korolczuk I, Morillon B. The Motor of Time: Coupling Action to Temporally Predictable Events Heightens Perception. ADVANCES IN EXPERIMENTAL MEDICINE AND BIOLOGY 2024; 1455:199-213. [PMID: 38918353 DOI: 10.1007/978-3-031-60183-5_11] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/27/2024]
Abstract
Timing and motor function share neural circuits and dynamics, which underpin their close and synergistic relationship. For instance, the temporal predictability of a sensory event optimizes motor responses to that event. Knowing when an event is likely to occur lowers response thresholds, leading to faster and more efficient motor behavior though in situations of response conflict can induce impulsive and inappropriate responding. In turn, through a process of active sensing, coupling action to temporally predictable sensory input enhances perceptual processing. Action not only hones perception of the event's onset or duration, but also boosts sensory processing of its non-temporal features such as pitch or shape. The effects of temporal predictability on motor behavior and sensory processing involve motor and left parietal cortices and are mediated by changes in delta and beta oscillations in motor areas of the brain.
Collapse
Affiliation(s)
- Jennifer T Coull
- Centre for Research in Psychology and Neuroscience (UMR 7077), Aix-Marseille Université & CNRS, Marseille, France.
| | - Inga Korolczuk
- Department of Pathophysiology, Medical University of Lublin, Lublin, Poland
| | - Benjamin Morillon
- Aix Marseille Université, INSERM, INS, Institut de Neurosciences des Systèmes, Marseille, France
| |
Collapse
|
13
|
Jones A, Silas J, Anderson W, Ward EV. Null effects of temporal prediction on recognition memory but evidence for differential neural activity at encoding. A registered report. Cortex 2023; 169:130-145. [PMID: 37871519 DOI: 10.1016/j.cortex.2023.09.006] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/25/2023] [Revised: 08/21/2023] [Accepted: 09/26/2023] [Indexed: 10/25/2023]
Abstract
Previous research has demonstrated that rhythmic presentation of stimuli during encoding boosts subsequent recognition and is associated with distinct neural activity compared with when stimuli are presented in an arrhythmic manner. However, it is unclear whether the effect is driven by automatic entrainment to rhythm or non-rhythmic temporal prediction. This registered report presents an Electroencephalographic (EEG) study aimed at establishing the cognitive and neural mechanisms of the effect of temporal prediction on recognition. In a blocked design, stimulus onset during encoding was systematically manipulated in four conditions prior to recognition testing: rhythmic fixed (RF), rhythmic variable (RV), arrhythmic fixed (AF), and arrhythmic variable (AV). By orthogonally varying rhythm and temporal position we were able to assess their independent contributions to recognition enhancement. Our behavioural results did not replicate previous findings that show a difference in recognition memory based on temporal predictability at encoding. However, event-related potential (ERP) component analysis did show an early (N1) interaction effect of temporal position and rhythm, and later (N2 and Dm) effects driven by temporal position only. Taken together, we observed effects of temporal prediction at encoding, but these differences did not translate to later effects of memory, suggesting that effects of temporal prediction on recognition are less robust than previously thought.
Collapse
|
14
|
Meng J, Zhao Y, Wang K, Sun J, Yi W, Xu F, Xu M, Ming D. Rhythmic temporal prediction enhances neural representations of movement intention for brain-computer interface. J Neural Eng 2023; 20:066004. [PMID: 37875107 DOI: 10.1088/1741-2552/ad0650] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/23/2023] [Accepted: 10/24/2023] [Indexed: 10/26/2023]
Abstract
Objective.Detecting movement intention is a typical use of brain-computer interfaces (BCI). However, as an endogenous electroencephalography (EEG) feature, the neural representation of movement is insufficient for improving motor-based BCI. This study aimed to develop a new movement augmentation BCI encoding paradigm by incorporating the cognitive function of rhythmic temporal prediction, and test the feasibility of this new paradigm in optimizing detections of movement intention.Methods.A visual-motion synchronization task was designed with two movement intentions (left vs. right) and three rhythmic temporal prediction conditions (1000 ms vs. 1500 ms vs. no temporal prediction). Behavioural and EEG data of 24 healthy participants were recorded. Event-related potentials (ERPs), event-related spectral perturbation induced by left- and right-finger movements, the common spatial pattern (CSP) and support vector machine, Riemann tangent space algorithm and logistic regression were used and compared across the three temporal prediction conditions, aiming to test the impact of temporal prediction on movement detection.Results.Behavioural results showed significantly smaller deviation time for 1000 ms and 1500 ms conditions. ERP analyses revealed 1000 ms and 1500 ms conditions led to rhythmic oscillations with a time lag in contralateral and ipsilateral areas of movement. Compared with no temporal prediction, 1000 ms condition exhibited greater beta event-related desynchronization (ERD) lateralization in motor area (P< 0.001) and larger beta ERD in frontal area (P< 0.001). 1000 ms condition achieved an averaged left-right decoding accuracy of 89.71% using CSP and 97.30% using Riemann tangent space, both significantly higher than no temporal prediction. Moreover, movement and temporal information can be decoded simultaneously, achieving 88.51% four-classification accuracy.Significance.The results not only confirm the effectiveness of rhythmic temporal prediction in enhancing detection ability of motor-based BCI, but also highlight the dual encodings of movement and temporal information within a single BCI paradigm, which is promising to expand the range of intentions that can be decoded by the BCI.
Collapse
Affiliation(s)
- Jiayuan Meng
- The Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin 300072, People's Republic of China
- Haihe Laboratory of Brain-computer Interaction and Human-machine Integration, Tianjin 300392, People's Republic of China
| | - Yingru Zhao
- The Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin 300072, People's Republic of China
| | - Kun Wang
- The Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin 300072, People's Republic of China
- Haihe Laboratory of Brain-computer Interaction and Human-machine Integration, Tianjin 300392, People's Republic of China
| | - Jinsong Sun
- The Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin 300072, People's Republic of China
| | - Weibo Yi
- Beijing Machine and Equipment Institute, Beijing, People's Republic of China
| | - Fangzhou Xu
- International School for Optoelectronic Engineering, Qilu University of Technology (Shandong Academy of Sciences), Jinan, People's Republic of China
| | - Minpeng Xu
- The Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin 300072, People's Republic of China
- Haihe Laboratory of Brain-computer Interaction and Human-machine Integration, Tianjin 300392, People's Republic of China
- International School for Optoelectronic Engineering, Qilu University of Technology (Shandong Academy of Sciences), Jinan, People's Republic of China
| | - Dong Ming
- The Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin 300072, People's Republic of China
- Haihe Laboratory of Brain-computer Interaction and Human-machine Integration, Tianjin 300392, People's Republic of China
| |
Collapse
|
15
|
Doelling KB, Arnal LH, Assaneo MF. Adaptive oscillators support Bayesian prediction in temporal processing. PLoS Comput Biol 2023; 19:e1011669. [PMID: 38011225 PMCID: PMC10703266 DOI: 10.1371/journal.pcbi.1011669] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/09/2023] [Revised: 12/07/2023] [Accepted: 11/07/2023] [Indexed: 11/29/2023] Open
Abstract
Humans excel at predictively synchronizing their behavior with external rhythms, as in dance or music performance. The neural processes underlying rhythmic inferences are debated: whether predictive perception relies on high-level generative models or whether it can readily be implemented locally by hard-coded intrinsic oscillators synchronizing to rhythmic input remains unclear and different underlying computational mechanisms have been proposed. Here we explore human perception for tone sequences with some temporal regularity at varying rates, but with considerable variability. Next, using a dynamical systems perspective, we successfully model the participants behavior using an adaptive frequency oscillator which adjusts its spontaneous frequency based on the rate of stimuli. This model better reflects human behavior than a canonical nonlinear oscillator and a predictive ramping model-both widely used for temporal estimation and prediction-and demonstrate that the classical distinction between absolute and relative computational mechanisms can be unified under this framework. In addition, we show that neural oscillators may constitute hard-coded physiological priors-in a Bayesian sense-that reduce temporal uncertainty and facilitate the predictive processing of noisy rhythms. Together, the results show that adaptive oscillators provide an elegant and biologically plausible means to subserve rhythmic inference, reconciling previously incompatible frameworks for temporal inferential processes.
Collapse
Affiliation(s)
- Keith B. Doelling
- Institut Pasteur, Université Paris Cité, Inserm UA06, Institut de l’Audition, Paris, France
- Center for Language Music and Emotion, New York University, New York, New York, United States of America
| | - Luc H. Arnal
- Institut Pasteur, Université Paris Cité, Inserm UA06, Institut de l’Audition, Paris, France
| | - M. Florencia Assaneo
- Instituto de Neurobiología, Universidad Nacional Autónoma de México, Santiago de Querétaro, México
| |
Collapse
|
16
|
Heynckes M, Hoffmann K, Formisano E, De Martino F, De Weerd P. Predictability awareness rather than mere predictability enhances the perceptual benefits for targets in auditory rhythms over targets following temporal cues. PLoS One 2023; 18:e0284755. [PMID: 37889894 PMCID: PMC10610080 DOI: 10.1371/journal.pone.0284755] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/10/2022] [Accepted: 04/08/2023] [Indexed: 10/29/2023] Open
Abstract
Sounds following a cue or embedded in a periodic rhythm are processed more effectively than sounds that are part of an aperiodic rhythm. One might also expect that a sound embedded in a periodic rhythm is processed more effectively than a sound following a single temporal cue. Such a finding would follow the theory that the entrainment of neural rhythmic activity by periodic stimuli renders the prediction of upcoming stimuli more efficient. We conducted a psychophysical experiment in which we tested the behavioral elements of this idea. Targets in periodic and aperiodic rhythms, if they occurred, always appeared at the same moment in time, and thus were fully predictable. In a first condition, participants remained unaware of this. In a second condition, an explicit instruction on the temporal location of the targets embedded in rhythms was provided. We assessed sensitivity and reaction times to the target stimuli in a difficult temporal detection task, and contrasted performance in this task to that obtained for targets temporally cued by a single preceding cue. Irrespective of explicit information about target predictability, target detection performance was always better in the periodic and temporal cue conditions, compared to the aperiodic condition. However, we found that the mere predictability of an acoustic target within a periodic rhythm did not allow participants to detect the target any better than in a condition where the target's timing was predicted by a single temporal cue. Only when participants were made aware of the specific moment in the periodic rhythm where the target could occur, did sensitivity increase. This finding suggests that a periodic rhythm is not automatically sufficient to provide perceptual benefits compared to a condition predictable yet not rhythmic condition (a cue). In some conditions, as shown here, these benefits may only occur in interaction with other factors such as explicit instruction and directed attention.
Collapse
Affiliation(s)
- Miriam Heynckes
- Department of Cognitive Neuroscience, Faculty of Psychology and Neuroscience, Maastricht University, Maastricht, The Netherlands
| | - Kim Hoffmann
- Department of Cognitive Neuroscience, Faculty of Psychology and Neuroscience, Maastricht University, Maastricht, The Netherlands
| | - Elia Formisano
- Department of Cognitive Neuroscience, Faculty of Psychology and Neuroscience, Maastricht University, Maastricht, The Netherlands
- Maastricht Centre for Systems Biology, Maastricht University, Maastricht, The Netherlands
| | - Federico De Martino
- Department of Cognitive Neuroscience, Faculty of Psychology and Neuroscience, Maastricht University, Maastricht, The Netherlands
| | - Peter De Weerd
- Department of Cognitive Neuroscience, Faculty of Psychology and Neuroscience, Maastricht University, Maastricht, The Netherlands
| |
Collapse
|
17
|
Cappotto D, Luo D, Lai HW, Peng F, Melloni L, Schnupp JWH, Auksztulewicz R. "What" and "when" predictions modulate auditory processing in a mutually congruent manner. Front Neurosci 2023; 17:1180066. [PMID: 37781257 PMCID: PMC10540699 DOI: 10.3389/fnins.2023.1180066] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/05/2023] [Accepted: 08/04/2023] [Indexed: 10/03/2023] Open
Abstract
Introduction Extracting regularities from ongoing stimulus streams to form predictions is crucial for adaptive behavior. Such regularities exist in terms of the content of the stimuli and their timing, both of which are known to interactively modulate sensory processing. In real-world stimulus streams such as music, regularities can occur at multiple levels, both in terms of contents (e.g., predictions relating to individual notes vs. their more complex groups) and timing (e.g., pertaining to timing between intervals vs. the overall beat of a musical phrase). However, it is unknown whether the brain integrates predictions in a manner that is mutually congruent (e.g., if "beat" timing predictions selectively interact with "what" predictions falling on pulses which define the beat), and whether integrating predictions in different timing conditions relies on dissociable neural correlates. Methods To address these questions, our study manipulated "what" and "when" predictions at different levels - (local) interval-defining and (global) beat-defining - within the same stimulus stream, while neural activity was recorded using electroencephalogram (EEG) in participants (N = 20) performing a repetition detection task. Results Our results reveal that temporal predictions based on beat or interval timing modulated mismatch responses to violations of "what" predictions happening at the predicted time points, and that these modulations were shared between types of temporal predictions in terms of the spatiotemporal distribution of EEG signals. Effective connectivity analysis using dynamic causal modeling showed that the integration of "what" and "when" predictions selectively increased connectivity at relatively late cortical processing stages, between the superior temporal gyrus and the fronto-parietal network. Discussion Taken together, these results suggest that the brain integrates different predictions with a high degree of mutual congruence, but in a shared and distributed cortical network. This finding contrasts with recent studies indicating separable mechanisms for beat-based and memory-based predictive processing.
Collapse
Affiliation(s)
- Drew Cappotto
- Department of Neuroscience, City University of Hong Kong, Kowloon, Hong Kong SAR, China
- Ear Institute, University College London, London, United Kingdom
| | - Dan Luo
- Department of Neuroscience, City University of Hong Kong, Kowloon, Hong Kong SAR, China
| | - Hiu Wai Lai
- Department of Neuroscience, City University of Hong Kong, Kowloon, Hong Kong SAR, China
| | - Fei Peng
- Department of Neuroscience, City University of Hong Kong, Kowloon, Hong Kong SAR, China
| | - Lucia Melloni
- Department of Neuroscience, Max Planck Institute for Empirical Aesthetics, Frankfurt am Main, Germany
- Department of Neurology, NYU Grossman School of Medicine, New York, NY, United States
| | | | - Ryszard Auksztulewicz
- Department of Neuroscience, City University of Hong Kong, Kowloon, Hong Kong SAR, China
- Department of Neuroscience, Max Planck Institute for Empirical Aesthetics, Frankfurt am Main, Germany
- Department of Education and Psychology, Freie Universität Berlin, Berlin, Germany
| |
Collapse
|
18
|
Matthews TE, Stupacher J, Vuust P. The Pleasurable Urge to Move to Music Through the Lens of Learning Progress. J Cogn 2023; 6:55. [PMID: 37720891 PMCID: PMC10503533 DOI: 10.5334/joc.320] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/09/2022] [Accepted: 08/17/2023] [Indexed: 09/19/2023] Open
Abstract
Interacting with music is a uniquely pleasurable activity that is ubiquitous across human cultures. Current theories suggest that a prominent driver of musical pleasure responses is the violation and confirmation of temporal predictions. For example, the pleasurable urge to move to music (PLUMM), which is associated with the broader concept of groove, is higher for moderately complex rhythms compared to simple and complex rhythms. This inverted U-shaped relation between PLUMM and rhythmic complexity is thought to result from a balance between predictability and uncertainty. That is, moderately complex rhythms lead to strongly weighted prediction errors which elicit an urge to move to reinforce the predictive model (i.e., the meter). However, the details of these processes and how they bring about positive affective responses are currently underspecified. We propose that the intrinsic motivation for learning progress drives PLUMM and informs the music humans choose to listen to, dance to, and create. Here, learning progress reflects the rate of prediction error minimization over time. Accordingly, reducible prediction errors signal the potential for learning progress, producing a pleasurable, curious state characterized by the mobilization of attentional and memory resources. We discuss this hypothesis in the context of current psychological and neuroscientific research on musical pleasure and PLUMM. We propose a theoretical neuroscientific model focusing on the roles of dopamine and norepinephrine within a feedback loop linking prediction-based learning, curiosity, and memory. This perspective provides testable predictions that will motivate future research to further illuminate the fundamental relation between predictions, movement, and reward.
Collapse
Affiliation(s)
- Tomas E. Matthews
- Center for Music in the Brain, Department of Clinical Medicine, Aarhus University Hospital, Nørrebrogade 44, Building 1A, 8000 Aarhus C, Denmark
- Royal Academy of Music, Skovgaardsgade 2C, DK-8000 Aarhus C, Denmark
| | - Jan Stupacher
- Center for Music in the Brain, Department of Clinical Medicine, Aarhus University Hospital, Nørrebrogade 44, Building 1A, 8000 Aarhus C, Denmark
- Royal Academy of Music, Skovgaardsgade 2C, DK-8000 Aarhus C, Denmark
| | - Peter Vuust
- Center for Music in the Brain, Department of Clinical Medicine, Aarhus University Hospital, Nørrebrogade 44, Building 1A, 8000 Aarhus C, Denmark
- Royal Academy of Music, Skovgaardsgade 2C, DK-8000 Aarhus C, Denmark
| |
Collapse
|
19
|
Su Z, Zhou X, Wang L. Dissociated amplitude and phase effects of alpha oscillation in a nested structure of rhythm- and sequence-based temporal expectation. Cereb Cortex 2023; 33:9741-9755. [PMID: 37415070 DOI: 10.1093/cercor/bhad240] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/10/2023] [Revised: 06/14/2023] [Accepted: 06/15/2023] [Indexed: 07/08/2023] Open
Abstract
The human brain can utilize various information to form temporal expectations and optimize perceptual performance. Here we show dissociated amplitude and phase effects of prestimulus alpha oscillation in a nested structure of rhythm- and sequence-based expectation. A visual stream of rhythmic stimuli was presented in a fixed sequence such that their temporal positions could be predicted by either the low-frequency rhythm, the sequence, or the combination. The behavioral modeling indicated that rhythmic and sequence information additively led to increased accumulation speed of sensory evidence and alleviated threshold for the perceptual discrimination of the expected stimulus. The electroencephalographical results showed that the alpha amplitude was modulated mainly by rhythmic information, with the amplitude fluctuating with the phase of the low-frequency rhythm (i.e. phase-amplitude coupling). The alpha phase, however, was affected by both rhythmic and sequence information. Importantly, rhythm-based expectation improved the perceptual performance by decreasing the alpha amplitude, whereas sequence-based expectation did not further decrease the amplitude on top of rhythm-based expectation. Moreover, rhythm-based and sequence-based expectations collaboratively improved the perceptual performance by biasing the alpha oscillation toward the optimal phase. Our findings suggested flexible coordination of multiscale brain oscillations in dealing with a complex environment.
Collapse
Affiliation(s)
- Zhongbin Su
- Shanghai Key Laboratory of Psychotic Disorders, Shanghai Mental Health Center, Shanghai Jiao Tong University School of Medicine, Shanghai 200030, China
- Institute of Psychology and Behavioral Science, Shanghai Jiao Tong University, Shanghai 200030, China
- Beijing Key Laboratory of Behavior and Mental Health, School of Psychological and Cognitive Sciences, Peking University, Beijing 100871, China
| | - Xiaolin Zhou
- Shanghai Key Laboratory of Mental Health and Psychological Crisis Intervention, School of Psychology and Cognitive Science, East China Normal University, Shanghai 200062, China
- PKU-IDG/McGovern Institute for Brain Research, Peking University, Beijing 100871, China
| | - Lihui Wang
- Shanghai Key Laboratory of Psychotic Disorders, Shanghai Mental Health Center, Shanghai Jiao Tong University School of Medicine, Shanghai 200030, China
- Institute of Psychology and Behavioral Science, Shanghai Jiao Tong University, Shanghai 200030, China
- Shanghai Center for Brain Science and Brain-Inspired Intelligence Technology, Shanghai 201602, China
| |
Collapse
|
20
|
Nobre AC, van Ede F. Attention in flux. Neuron 2023; 111:971-986. [PMID: 37023719 DOI: 10.1016/j.neuron.2023.02.032] [Citation(s) in RCA: 5] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/17/2023] [Revised: 02/20/2023] [Accepted: 02/22/2023] [Indexed: 04/08/2023]
Abstract
Selective attention comprises essential infrastructural functions supporting cognition-anticipating, prioritizing, selecting, routing, integrating, and preparing signals to guide adaptive behavior. Most studies have examined its consequences, systems, and mechanisms in a static way, but attention is at the confluence of multiple sources of flux. The world advances, we operate within it, our minds change, and all resulting signals progress through multiple pathways within the dynamic networks of our brains. Our aim in this review is to raise awareness of and interest in three important facets of how timing impacts our understanding of attention. These include the challenges posed to attention by the timing of neural processing and psychological functions, the opportunities conferred to attention by various temporal structures in the environment, and how tracking the time courses of neural and behavioral modulations with continuous measures yields surprising insights into the workings and principles of attention.
Collapse
Affiliation(s)
- Anna C Nobre
- Department of Experimental Psychology, University of Oxford, Oxford OX2 6GG, UK; Oxford Centre for Human Brain Activity, Wellcome Centre for Integrative Neuroimaging, Department of Psychiatry, University of Oxford, Oxford OX3 7JX, UK.
| | - Freek van Ede
- Institute for Brain and Behavior Amsterdam, Department of Experimental and Applied Psychology, Vrije Universiteit Amsterdam, Amsterdam 1081BT, the Netherlands.
| |
Collapse
|
21
|
Criscuolo A, Schwartze M, Henry MJ, Obermeier C, Kotz SA. Individual neurophysiological signatures of spontaneous rhythm processing. Neuroimage 2023; 273:120090. [PMID: 37028735 DOI: 10.1016/j.neuroimage.2023.120090] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/22/2022] [Revised: 03/14/2023] [Accepted: 04/04/2023] [Indexed: 04/08/2023] Open
Abstract
When sensory input conveys rhythmic regularity, we can form predictions about the timing of upcoming events. Although rhythm processing capacities differ considerably between individuals, these differences are often obscured by participant- and trial-level data averaging procedures in M/EEG research. Here, we systematically assessed neurophysiological variability displayed by individuals listening to isochronous (1.54Hz) equitone sequences interspersed with unexpected (amplitude-attenuated) deviant tones. Our approach aimed at revealing time-varying adaptive neural mechanisms for sampling the acoustic environment at multiple timescales. Rhythm tracking analyses confirmed that individuals encode temporal regularities and form temporal expectations, as indicated in delta-band (1.54Hz) power and its anticipatory phase alignment to expected tone onsets. Zooming into tone- and participant-level data, we further characterized intra- and inter-individual variabilities in phase-alignment across auditory sequences. Further, individual modelling of beta-band tone-locked responses showed that a subset of auditory sequences was sampled rhythmically by superimposing binary (strong-weak; S-w), ternary (S-w-w) and mixed accentuation patterns. In these sequences, neural responses to standard and deviant tones were modulated by a binary accentuation pattern, thus pointing towards a mechanism of dynamic attending. Altogether, the current results point toward complementary roles of delta- and beta-band activity in rhythm processing and further highlight diverse and adaptive mechanisms to track and sample the acoustic environment at multiple timescales, even in the absence of task-specific instructions.
Collapse
Affiliation(s)
- A Criscuolo
- Department of Neuropsychology & Psychopharmacology, Faculty of Psychology and Neuroscience, Maastricht University, Maastricht 6200 MD, the Netherlands
| | - M Schwartze
- Department of Neuropsychology & Psychopharmacology, Faculty of Psychology and Neuroscience, Maastricht University, Maastricht 6200 MD, the Netherlands
| | - M J Henry
- Max Planck Institute for Empirical Aesthetics, Frankfurt am Main, Germany; Department of Psychology, Toronto Metropolitan University, Canada
| | - C Obermeier
- BG Klinikum Bergmannstrost Halle, Halle 06112, Germany; Department of Neuropsychology, Max Planck Institute for Human Cognitive and Brain Sciences, Leipzig 04103, Germany
| | - S A Kotz
- Department of Neuropsychology & Psychopharmacology, Faculty of Psychology and Neuroscience, Maastricht University, Maastricht 6200 MD, the Netherlands; Department of Neuropsychology, Max Planck Institute for Human Cognitive and Brain Sciences, Leipzig 04103, Germany.
| |
Collapse
|
22
|
Schmidt-Kassow M, White TN, Abel C, Kaiser J. Pre-stimulus beta power varies as a function of auditory-motor synchronization and temporal predictability. Front Neurosci 2023; 17:1128197. [PMID: 36992854 PMCID: PMC10042076 DOI: 10.3389/fnins.2023.1128197] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/20/2022] [Accepted: 02/22/2023] [Indexed: 03/11/2023] Open
Abstract
IntroductionAuditory-motor interactions can support the preparation for expected sensory input. We investigated the periodic modulation of beta activity in the electroencephalogram to assess the role of active auditory-motor synchronization. Pre-stimulus beta activity (13–30 Hz) has been interpreted as a neural signature of the preparation for expected sensory input.MethodsIn the current study, participants silently counted frequency deviants in sequences of pure tones either during a physically inactive control condition or while pedaling on a cycling ergometer. Tones were presented either rhythmically (at 1 Hz) or arrhythmically with variable intervals. In addition to the pedaling conditions with rhythmic (auditory-motor synchronization, AMS) or arrhythmic stimulation, a self-generated stimulus condition was used in which tones were presented in sync with the participants’ spontaneous pedaling. This condition served to explore whether sensory predictions are driven primarily by the auditory or by the motor system.ResultsPre-stimulus beta power increased for rhythmic compared to arrhythmic stimulus presentation in both sitting and pedaling conditions but was strongest in the AMS condition. Furthermore, beta power in the AMS condition correlated with motor performance, i.e., the better participants synchronized with the rhythmic stimulus sequence, the higher was pre-stimulus beta power. Additionally, beta power was increased for the self-generated stimulus condition compared with arrhythmic pedaling, but there was no difference between the self-generated and the AMS condition.DiscussionThe current data pattern indicates that pre-stimulus beta power is not limited to neuronal entrainment (i.e., periodic stimulus presentation) but represents a more general correlate of temporal anticipation. Its association with the precision of AMS supports the role of active behavior for auditory predictions.
Collapse
Affiliation(s)
- Maren Schmidt-Kassow
- Institute of Medical Psychology, Goethe University Frankfurt, Frankfurt, Germany
- Department of Psychiatry, Psychosomatic Medicine and Psychotherapy, University Hospital, Goethe University Frankfurt, Frankfurt, Germany
- *Correspondence: Maren Schmidt-Kassow,
| | | | - Cornelius Abel
- Max Planck Institute for Empirical Aesthetics, Frankfurt, Germany
| | - Jochen Kaiser
- Institute of Medical Psychology, Goethe University Frankfurt, Frankfurt, Germany
| |
Collapse
|
23
|
It's time for attentional control: Temporal expectation in the attentional blink. Conscious Cogn 2023; 107:103461. [PMID: 36584439 DOI: 10.1016/j.concog.2022.103461] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/04/2022] [Revised: 12/11/2022] [Accepted: 12/20/2022] [Indexed: 12/29/2022]
Abstract
The attentional blink (AB) reveals a limitation in conscious processing of sequential targets. Although it is widely held that the AB derives from a structural bottleneck of central capacity, how the central processing is constrained is still unclear. As the AB reflects the dilemma of deploying attentional resources in the time dimension, research on temporal allocation provides an important avenue for understanding the mechanism. Here we reviewed studies regarding the role of temporal expectation in modulating the AB performance primarily based on two temporal processing strategies: interval-based and rhythm-based timings. We showed that both temporal expectations can help to organize limited resources among multiple attentional episodes, thereby mitigating the AB effect. As it turns out, scrutinizing on the AB from a temporal perspective is a promising way to comprehend the mechanisms behind the AB and conscious cognition. We also highlighted some unresolved issues and discussed potential directions for future research.
Collapse
|
24
|
Zhang M, Li F, Wang D, Ba X, Liu Z. Mapping Research Trends from 20 Years of Publications in Rhythmic Auditory Stimulation. INTERNATIONAL JOURNAL OF ENVIRONMENTAL RESEARCH AND PUBLIC HEALTH 2022; 20:215. [PMID: 36612537 PMCID: PMC9819413 DOI: 10.3390/ijerph20010215] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 10/19/2022] [Revised: 12/05/2022] [Accepted: 12/07/2022] [Indexed: 06/17/2023]
Abstract
This study aims to create an all-around insight into the evolutions, status, and global trends of rhythmic auditory stimulation (RAS) research via enhanced bibliometric methods for the 2001-2020 time period. Articles concerning RAS were extracted from the Web of Science database. CiteSpace, Bibliometrix, VOSviewer, and Graphpad Prism were employed to analyze publication patterns and research trends. A total of 586 publications related to RAS between 2001 and 2020 were retrieved from the Web of Science database. The researcher Goswami U. made the greatest contribution to this field. The University of Toronto was the institution that published the most articles. Motor dysfunction, sensory perception, and cognition are the three major domains of RAS research. Neural tracking, working memory, and neural basis may be the latest research frontiers. This study reveals the publication patterns and topic trends of RAS based on the records published between 2001 and 2020. The insights obtained provided useful references for the future research and applications of RAS.
Collapse
Affiliation(s)
- Meiqi Zhang
- Department of Physical Education and Health Education, Springfield College, Springfield, MA 01109, USA
- Yale/VA Learning-Based Recovery Center, Yale University, New Haven, CT 06510, USA
| | - Fang Li
- Department of Neurology, The First Affiliated Hospital of Jinzhou Medical University, Jinzhou 121001, China
| | - Dongyu Wang
- Department of Neurology, The Center Hospital of Jinzhou, Jinzhou 121001, China
| | - Xiaohong Ba
- Department of Neurology, The First Affiliated Hospital of Jinzhou Medical University, Jinzhou 121001, China
| | - Zhan Liu
- Department of Physical Education and Health Education, Springfield College, Springfield, MA 01109, USA
| |
Collapse
|
25
|
Loyola-Navarro R, Moënne-Loccoz C, Vergara RC, Hyafil A, Aboitiz F, Maldonado PE. Voluntary self-initiation of the stimuli onset improves working memory and accelerates visual and attentional processing. Heliyon 2022; 8:e12215. [PMID: 36578387 PMCID: PMC9791366 DOI: 10.1016/j.heliyon.2022.e12215] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/01/2022] [Revised: 08/25/2022] [Accepted: 11/30/2022] [Indexed: 12/14/2022] Open
Abstract
The ability of an organism to voluntarily control the stimuli onset modulates perceptual and attentional functions. Since stimulus encoding is an essential component of working memory (WM), we conjectured that controlling the initiation of the perceptual process would positively modulate WM. To corroborate this proposition, we tested twenty-five healthy subjects in a modified-Sternberg WM task under three stimuli presentation conditions: an automatic presentation of the stimuli, a self-initiated presentation of the stimuli (through a button press), and a self-initiated presentation with random-delay stimuli onset. Concurrently, we recorded the subjects' electroencephalographic signals during WM encoding. We found that the self-initiated condition was associated with better WM accuracy, and earlier latencies of N1, P2 and P3 evoked potential components representing visual, attentional and mental review of the stimuli processes, respectively. Our work demonstrates that self-initiated stimuli enhance WM performance and accelerate early visual and attentional processes deployed during WM encoding. We also found that self-initiated stimuli correlate with an increased attentional state compared to the other two conditions, suggesting a role for temporal stimuli predictability. Our study remarks on the relevance of self-control of the stimuli onset in sensory, attentional and memory updating processing for WM.
Collapse
Affiliation(s)
- Rocio Loyola-Navarro
- Departamento de Neurociencia, Universidad de Chile, Santiago, Chile
- Biomedical Neuroscience Institute (BNI), Santiago, Chile
- Departamento de Educación Diferencial, Universidad Metropolitana de Ciencias de la Educación, Santiago, Chile
- Center for Advanced Research in Education, Institute of Education, Universidad de Chile, Santiago, Chile
| | - Cristóbal Moënne-Loccoz
- Departamento de Ciencias de la Salud, Pontificia Universidad Católica de Chile, Santiago, Chile
- Centro Nacional de Inteligencia Artificial (CENIA), Santiago, Chile
| | - Rodrigo C. Vergara
- Departamento de Kinesiología, Universidad Metropolitana de Ciencias de la Educación, Santiago, Chile
- Centro Nacional de Inteligencia Artificial (CENIA), Santiago, Chile
- Centro de Investigación en Educación, Universidad Metropolitana de Ciencias de la Educación (CIE-UMCE), Santiago, Chile
| | | | - Francisco Aboitiz
- Escuela de Medicina, Pontificia Universidad Católica de Chile, Santiago, Chile
| | - Pedro E. Maldonado
- Departamento de Neurociencia, Universidad de Chile, Santiago, Chile
- Biomedical Neuroscience Institute (BNI), Santiago, Chile
- Centro Nacional de Inteligencia Artificial (CENIA), Santiago, Chile
| |
Collapse
|
26
|
Godøy RI. Thinking rhythm objects. Front Psychol 2022; 13:906479. [PMID: 35910948 PMCID: PMC9335008 DOI: 10.3389/fpsyg.2022.906479] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/28/2022] [Accepted: 06/30/2022] [Indexed: 12/02/2022] Open
Abstract
The focus of this mini-review is on rhythm objects, defined as strongly coherent chunks of combined sound and body motion in music, typically in the duration range of a few seconds, as may for instance be found in a fragment of dance music, in an energetic drum fill, in a flute ornament, or in a cascade of sounds of a rapid harp glissando. Although there has been much research on rhythm in continuous musical sound and its links with behavior, including the neurocognitive aspects of periodicity, synchrony, and entrainment, there has been much less focus on the generation and perception of singular coherent rhythm objects. This mini-review aims to enhance our understanding of such rhythm objects by pointing to relevant literature on coherence-enhancing elements such as coarticulation, i.e., the fusion of motion events into more extended rhythm objects, and intermittent motor control, i.e., the discontinuous, instant-by-instant control and triggering of rhythm objects.
Collapse
Affiliation(s)
- Rolf Inge Godøy
- Department of Musicology, University of Oslo, Oslo, Norway
- RITMO Centre for Interdisciplinary Studies in Rhythm, Time and Motion, University of Oslo, Oslo, Norway
- *Correspondence: Rolf Inge Godøy,
| |
Collapse
|
27
|
Effects of temporally regular versus irregular distractors on goal-directed cognition and behavior. Sci Rep 2022; 12:10020. [PMID: 35705589 PMCID: PMC9200732 DOI: 10.1038/s41598-022-13211-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/03/2022] [Accepted: 05/23/2022] [Indexed: 11/12/2022] Open
Abstract
Human environments comprise plenty of task-irrelevant sensory inputs, which are potentially distracting. Auditory distractors often possess an inherent temporal structure. However, it is largely unknown whether and how the temporal regularity of distractors interferes with goal-directed cognitive processes, such as working memory. Here, we tested a total sample of N = 90 participants across four working memory tasks with sequences of temporally regular versus irregular distractors. Temporal irregularity was operationalized by a final tone onset time that violated an otherwise regular tone sequence (Experiment 1), by a sequence of tones with irregular onset-to-onset delays (Experiment 2), and by sequences of speech items with irregular onset-to-onset delays (Experiments 3 and 4). Across all experiments, temporal regularity of distractors did not modulate participants’ primary performance metric, that is, accuracy in recalling items from working memory. Instead, temporal regularity of distractors modulated secondary performance metrics: for regular versus irregular distractors, recall of the first item from memory was faster (Experiment 3) and the response bias was more conservative (Experiment 4). Taken together, the present results provide evidence that the temporal regularity of task-irrelevant input does not inevitably affect the precision of memory representations (reflected in the primary performance metric accuracy) but rather the response behavior (reflected in secondary performance metrics like response speed and bias). Our findings emphasize that a comprehensive understanding of auditory distraction requires that existing models of attention include often-neglected secondary performance metrics to understand how different features of auditory distraction reach awareness and impact cognition and behavior.
Collapse
|
28
|
Lin WM, Oetringer DA, Bakker‐Marshall I, Emmerzaal J, Wilsch A, ElShafei HA, Rassi E, Haegens S. No behavioural evidence for rhythmic facilitation of perceptual discrimination. Eur J Neurosci 2022. [PMID: 33772897 PMCID: PMC9540985 DOI: 10.1111/ejn.15208 10.1101/2020.12.10.418947] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/04/2022]
Abstract
It has been hypothesized that internal oscillations can synchronize (i.e., entrain) to external environmental rhythms, thereby facilitating perception and behaviour. To date, evidence for the link between the phase of neural oscillations and behaviour has been scarce and contradictory; moreover, it remains an open question whether the brain can use this tentative mechanism for active temporal prediction. In our present study, we conducted a series of auditory pitch discrimination tasks with 181 healthy participants in an effort to shed light on the proposed behavioural benefits of rhythmic cueing and entrainment. In the three versions of our task, we observed no perceptual benefit of purported entrainment: targets occurring in-phase with a rhythmic cue provided no perceptual benefits in terms of discrimination accuracy or reaction time when compared with targets occurring out-of-phase or targets occurring randomly, nor did we find performance differences for targets preceded by rhythmic versus random cues. However, we found a surprising effect of cueing frequency on reaction time, in which participants showed faster responses to cue rhythms presented at higher frequencies. We therefore provide no evidence of entrainment, but instead a tentative effect of covert active sensing in which a faster external rhythm leads to a faster communication rate between motor and sensory cortices, allowing for sensory inputs to be sampled earlier in time.
Collapse
Affiliation(s)
- Wy Ming Lin
- Graduate Training Centre of NeuroscienceUniversity of TübingenTübingenGermany,Donders Institute for Brain, Cognition, and BehaviourRadboud UniversityNijmegenThe Netherlands
| | - Djamari A. Oetringer
- Donders Institute for Brain, Cognition, and BehaviourRadboud UniversityNijmegenThe Netherlands
| | - Iske Bakker‐Marshall
- Donders Institute for Brain, Cognition, and BehaviourRadboud UniversityNijmegenThe Netherlands
| | - Jill Emmerzaal
- Donders Institute for Brain, Cognition, and BehaviourRadboud UniversityNijmegenThe Netherlands
| | - Anna Wilsch
- Department of PsychologyNew York UniversityNew YorkNYUSA
| | - Hesham A. ElShafei
- Donders Institute for Brain, Cognition, and BehaviourRadboud UniversityNijmegenThe Netherlands
| | - Elie Rassi
- Donders Institute for Brain, Cognition, and BehaviourRadboud UniversityNijmegenThe Netherlands
| | - Saskia Haegens
- Donders Institute for Brain, Cognition, and BehaviourRadboud UniversityNijmegenThe Netherlands,Department of PsychiatryColumbia UniversityNew YorkNYUSA,Division of Systems NeuroscienceNew York State Psychiatric InstituteNew YorkNYUSA
| |
Collapse
|
29
|
Lin WM, Oetringer DA, Bakker‐Marshall I, Emmerzaal J, Wilsch A, ElShafei HA, Rassi E, Haegens S. No behavioural evidence for rhythmic facilitation of perceptual discrimination. Eur J Neurosci 2022; 55:3352-3364. [PMID: 33772897 PMCID: PMC9540985 DOI: 10.1111/ejn.15208] [Citation(s) in RCA: 11] [Impact Index Per Article: 5.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/09/2020] [Revised: 03/19/2021] [Accepted: 03/19/2021] [Indexed: 12/14/2022]
Abstract
It has been hypothesized that internal oscillations can synchronize (i.e., entrain) to external environmental rhythms, thereby facilitating perception and behaviour. To date, evidence for the link between the phase of neural oscillations and behaviour has been scarce and contradictory; moreover, it remains an open question whether the brain can use this tentative mechanism for active temporal prediction. In our present study, we conducted a series of auditory pitch discrimination tasks with 181 healthy participants in an effort to shed light on the proposed behavioural benefits of rhythmic cueing and entrainment. In the three versions of our task, we observed no perceptual benefit of purported entrainment: targets occurring in-phase with a rhythmic cue provided no perceptual benefits in terms of discrimination accuracy or reaction time when compared with targets occurring out-of-phase or targets occurring randomly, nor did we find performance differences for targets preceded by rhythmic versus random cues. However, we found a surprising effect of cueing frequency on reaction time, in which participants showed faster responses to cue rhythms presented at higher frequencies. We therefore provide no evidence of entrainment, but instead a tentative effect of covert active sensing in which a faster external rhythm leads to a faster communication rate between motor and sensory cortices, allowing for sensory inputs to be sampled earlier in time.
Collapse
Affiliation(s)
- Wy Ming Lin
- Graduate Training Centre of NeuroscienceUniversity of TübingenTübingenGermany,Donders Institute for Brain, Cognition, and BehaviourRadboud UniversityNijmegenThe Netherlands
| | - Djamari A. Oetringer
- Donders Institute for Brain, Cognition, and BehaviourRadboud UniversityNijmegenThe Netherlands
| | - Iske Bakker‐Marshall
- Donders Institute for Brain, Cognition, and BehaviourRadboud UniversityNijmegenThe Netherlands
| | - Jill Emmerzaal
- Donders Institute for Brain, Cognition, and BehaviourRadboud UniversityNijmegenThe Netherlands
| | - Anna Wilsch
- Department of PsychologyNew York UniversityNew YorkNYUSA
| | - Hesham A. ElShafei
- Donders Institute for Brain, Cognition, and BehaviourRadboud UniversityNijmegenThe Netherlands
| | - Elie Rassi
- Donders Institute for Brain, Cognition, and BehaviourRadboud UniversityNijmegenThe Netherlands
| | - Saskia Haegens
- Donders Institute for Brain, Cognition, and BehaviourRadboud UniversityNijmegenThe Netherlands,Department of PsychiatryColumbia UniversityNew YorkNYUSA,Division of Systems NeuroscienceNew York State Psychiatric InstituteNew YorkNYUSA
| |
Collapse
|
30
|
Ferreri L, Versace R, Victor C, Plancher G. Temporal Predictions in Space: Isochronous Rhythms Promote Forward Projections of the Body. Front Psychol 2022; 13:832322. [PMID: 35602686 PMCID: PMC9115380 DOI: 10.3389/fpsyg.2022.832322] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/09/2021] [Accepted: 03/17/2022] [Indexed: 11/18/2022] Open
Abstract
A regular rhythmic stimulation increases people's ability to anticipate future events in time and to move their body in space. Temporal concepts are usually prescribed to spatial locations through a past-behind and future-ahead mapping. In this study, we tested the hypothesis that a regular rhythmic stimulation could promote the forward-body (i.e., toward the future) projections in the peri-personal space. In a Visual Approach/Avoidance by the Self Task (VAAST), participants (N = 24) observed a visual scene on the screen (i.e., a music studio with a metronome in the middle). They were exposed to 3 s of auditory isochronous or non-isochronous rhythms, after which they were asked to make as quickly as possible a perceptual judgment on the visual scene (i.e., whether the metronome pendulum was pointing to the right or left). The responses could trigger a forward or backward visual flow, i.e., approaching or moving them away from the scene. Results showed a significant interaction between the rhythmic stimulation and the movement projections (p < 0.001): participants were faster for responses triggering forward-body projections (but not backward-body projections) after the exposure to isochronous (but not non-isochronous) rhythm. By highlighting the strong link between isochronous rhythms and forward-body projections, these findings support the idea that temporal predictions driven by a regular auditory stimulation are grounded in a perception-action system integrating temporal and spatial information.
Collapse
Affiliation(s)
| | | | | | - Gaën Plancher
- Laboratoire d’Étude des Mécanismes Cognitifs, Université Lumière Lyon 2, Lyon, France
| |
Collapse
|
31
|
Yao F, Zhou B, Zhuang Y, Wang X. Immediate Temporal Information Modulates the Target Identification in the Attentional Blink. Brain Sci 2022; 12:brainsci12020278. [PMID: 35204041 PMCID: PMC8870607 DOI: 10.3390/brainsci12020278] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/12/2022] [Revised: 02/09/2022] [Accepted: 02/14/2022] [Indexed: 11/23/2022] Open
Abstract
It has been shown that learned temporal information can be exploited to help facilitate the target identification in the attentional blink task. Here, we tested whether similar exploitation also worked on short-term temporal information, even when it did not reliably predict the target onset. In two experiments, we randomly manipulated either the interval between targets (T1 and T2; Experiment 1) or the temporal regularity of stimulus presentation (Experiment 2) in each trial. The results revealed evidence of effects of immediate temporal experience mainly on T2 performances but also occasionally on T1 performances. In general, the accuracy of T2 was enhanced when a longer inter-target interval was explicitly processed in the preceding trial (Experiment 1) or the temporal regularity, regardless of being explicitly or implicitly processed, was present in the stimulus stream, especially after T1 (Experiment 2). These results suggest that, under high temporal uncertainty, both interval and rhythmic cues can still be exploited to regulate the allocation of processing resources, thus, modulating the target identification in the attentional blink task, consistent with the view of flexible attentional allocation, and further highlighting the importance of the interplay between temporal processing and attentional control in the conscious visual perception.
Collapse
Affiliation(s)
- Fangshu Yao
- School of Psychology, Shanghai University of Sport, Shanghai 200438, China; (F.Y.); (Y.Z.)
| | - Bin Zhou
- State Key Laboratory of Brain and Cognitive Science, Institute of Psychology, Chinese Academy of Sciences, Beijing 100101, China
- Correspondence: (B.Z.); (X.W.)
| | - Yiyun Zhuang
- School of Psychology, Shanghai University of Sport, Shanghai 200438, China; (F.Y.); (Y.Z.)
| | - Xiaochun Wang
- School of Psychology, Shanghai University of Sport, Shanghai 200438, China; (F.Y.); (Y.Z.)
- Correspondence: (B.Z.); (X.W.)
| |
Collapse
|
32
|
Herbst SK, Stefanics G, Obleser J. Endogenous modulation of delta phase by expectation–A replication of Stefanics et al., 2010. Cortex 2022; 149:226-245. [DOI: 10.1016/j.cortex.2022.02.001] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/25/2021] [Revised: 01/31/2022] [Accepted: 02/01/2022] [Indexed: 11/03/2022]
|
33
|
Otsuka S, Nakagawa S, Furukawa S. Expectations of the timing and intensity of a stimulus propagate to the auditory periphery through the medial olivocochlear reflex. Cereb Cortex 2022; 32:5121-5131. [PMID: 35094068 PMCID: PMC9667176 DOI: 10.1093/cercor/bhac002] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/28/2021] [Revised: 12/28/2021] [Accepted: 12/29/2021] [Indexed: 12/27/2022] Open
Abstract
Expectations concerning the timing of a stimulus enhance attention at the time at which the event occurs, which confers significant sensory and behavioral benefits. Herein, we show that temporal expectations modulate even the sensory transduction in the auditory periphery via the descending pathway. We measured the medial olivocochlear reflex (MOCR), a sound-activated efferent feedback that controls outer hair cell motility and optimizes the dynamic range of the sensory system. MOCR was noninvasively assessed using otoacoustic emissions. We found that the MOCR was enhanced by a visual cue presented at a fixed interval before a sound but was unaffected if the interval was changing between trials. The MOCR was also observed to be stronger when the learned timing expectation matched with the timing of the sound but remained unvaried when these two factors did not match. This implies that the MOCR can be voluntarily controlled in a stimulus- and goal-directed manner. Moreover, we found that the MOCR was enhanced by the expectation of a strong but not a weak, sound intensity. This asymmetrical enhancement could facilitate antimasking and noise protective effects without disrupting the detection of faint signals. Therefore, the descending pathway conveys temporal and intensity expectations to modulate auditory processing.
Collapse
Affiliation(s)
- Sho Otsuka
- Address correspondence to Sho Otsuka, Center for Frontier Medical Engineering, Chiba University, 1-33 Yayoicho, Inageku, Chiba 263-8522, Japan.
| | - Seiji Nakagawa
- Center for Frontier Medical Engineering, Chiba University, Chiba, Japan
| | - Shigeto Furukawa
- NTT Communication Science Laboratoires, NTT Corporation, Kanagawa, Japan
| |
Collapse
|
34
|
Bouwer FL, Nityananda V, Rouse AA, ten Cate C. Rhythmic abilities in humans and non-human animals: a review and recommendations from a methodological perspective. Philos Trans R Soc Lond B Biol Sci 2021; 376:20200335. [PMID: 34420380 PMCID: PMC8380979 DOI: 10.1098/rstb.2020.0335] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 04/27/2021] [Indexed: 12/15/2022] Open
Abstract
Rhythmic behaviour is ubiquitous in both human and non-human animals, but it is unclear whether the cognitive mechanisms underlying the specific rhythmic behaviours observed in different species are related. Laboratory experiments combined with highly controlled stimuli and tasks can be very effective in probing the cognitive architecture underlying rhythmic abilities. Rhythmic abilities have been examined in the laboratory with explicit and implicit perception tasks, and with production tasks, such as sensorimotor synchronization, with stimuli ranging from isochronous sequences of artificial sounds to human music. Here, we provide an overview of experimental findings on rhythmic abilities in human and non-human animals, while critically considering the wide variety of paradigms used. We identify several gaps in what is known about rhythmic abilities. Many bird species have been tested on rhythm perception, but research on rhythm production abilities in the same birds is lacking. By contrast, research in mammals has primarily focused on rhythm production rather than perception. Many experiments also do not differentiate between possible components of rhythmic abilities, such as processing of single temporal intervals, rhythmic patterns, a regular beat or hierarchical metrical structures. For future research, we suggest a careful choice of paradigm to aid cross-species comparisons, and a critical consideration of the multifaceted abilities that underlie rhythmic behaviour. This article is part of the theme issue 'Synchrony and rhythm interaction: from the brain to behavioural ecology'.
Collapse
Affiliation(s)
- Fleur L. Bouwer
- Department of Experimental and Applied Psychology, Vrije Universiteit Amsterdam, Van der Boechorststraat 7, 1081 BT Amsterdam, The Netherlands
- Institute for Logic, Language and Computation (ILLC), University of Amsterdam, PO Box 94242, 1090 CE Amsterdam, The Netherlands
- Department of Psychology, University of Amsterdam, PO Box 15900, 1001 NK Amsterdam, The Netherlands
| | - Vivek Nityananda
- Biosciences Institute, Faculty of Medical Sciences, Newcastle University, Henry Wellcome Building, Framlington Place, Newcastle upon Tyne NE2 4HH, UK
| | - Andrew A. Rouse
- Department of Psychology, Tufts University, Medford, MA 02155, USA
| | - Carel ten Cate
- Institute of Biology Leiden (IBL), Leiden Institute for Brain and Cognition (LIBC), Leiden University, PO Box 9505, 2300 RA Leiden, The Netherlands
| |
Collapse
|
35
|
The rhythm aftereffect induced by adaptation to the decelerating rhythm. Psychon Bull Rev 2021; 29:467-475. [PMID: 34608603 DOI: 10.3758/s13423-021-02014-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 09/16/2021] [Indexed: 11/08/2022]
Abstract
Rhythm perception can be distorted following prolonged exposure to an isochronous rhythm. It has been suggested that this might arise from the neural adaptation of temporal interval selective neurons. However, the rhythm in our daily life is not always isochronous, and the mechanism that rules the anisochronous rhythm is unclear. Here, we used a sensory adaptation paradigm to investigate whether rhythm perception can be affected by adaptation to the anisochronous rhythm. In Experiments 1 and 2, the direction of tempo change (accelerating vs. decelerating) judgment task and the rhythmic isochronism (isochronous vs. anisochronous) judgment task were used to evaluate participants' perception of rhythms, respectively. We found that after adaptation to a decelerating rhythm, participants tended to perceive the subsequent isochronous rhythm as accelerating. In Experiment 3, visual test rhythms followed the auditory adapting rhythm. In this situation, we did not find any adaptation effects on subsequent rhythm perception. Our results suggest that adaptation to the decelerating rhythm can induce a modality-specific rhythm aftereffect, which is consistent with the temporal order contingent duration aftereffect. It implies a unified timing mechanism for duration and rhythm perception.
Collapse
|
36
|
Barne LC, Cravo AM, de Lange FP, Spaak E. Temporal prediction elicits rhythmic preactivation of relevant sensory cortices. Eur J Neurosci 2021; 55:3324-3339. [PMID: 34322927 PMCID: PMC9545120 DOI: 10.1111/ejn.15405] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/08/2021] [Revised: 07/10/2021] [Accepted: 07/24/2021] [Indexed: 11/28/2022]
Abstract
Being able to anticipate events before they happen facilitates stimulus processing. The anticipation of the contents of events is thought to be implemented by the elicitation of prestimulus templates in sensory cortex. In contrast, the anticipation of the timing of events is typically associated with entrainment of neural oscillations. It is so far unknown whether and in which conditions temporal expectations interact with feature‐based expectations, and, consequently, whether entrainment modulates the generation of content‐specific sensory templates. In this study, we investigated the role of temporal expectations in a sensory discrimination task. We presented participants with rhythmically interleaved visual and auditory streams of relevant and irrelevant stimuli while measuring neural activity using magnetoencephalography. We found no evidence that rhythmic stimulation induced prestimulus feature templates. However, we did observe clear anticipatory rhythmic preactivation of the relevant sensory cortices. This oscillatory activity peaked at behaviourally relevant, in‐phase, intervals. Our results suggest that temporal expectations about stimulus features do not behave similarly to explicitly cued, nonrhythmic, expectations, yet elicit a distinct form of modality‐specific preactivation.
Collapse
Affiliation(s)
- Louise Catheryne Barne
- Center for Mathematics, Computing and Cognition, Universidade Federal do ABC (UFABC), São Bernardo do Campo, Sao Paolo, Brazil.,Donders Institute for Brain, Cognition and Behaviour, Radboud University, Nijmegen, The Netherlands.,Département Traitement de l'Information et Systèmes, ONERA, Salon-de-Provence, France
| | - André Mascioli Cravo
- Center for Mathematics, Computing and Cognition, Universidade Federal do ABC (UFABC), São Bernardo do Campo, Sao Paolo, Brazil
| | - Floris P de Lange
- Donders Institute for Brain, Cognition and Behaviour, Radboud University, Nijmegen, The Netherlands
| | - Eelke Spaak
- Donders Institute for Brain, Cognition and Behaviour, Radboud University, Nijmegen, The Netherlands
| |
Collapse
|
37
|
Reznik D, Guttman N, Buaron B, Zion-Golumbic E, Mukamel R. Action-locked Neural Responses in Auditory Cortex to Self-generated Sounds. Cereb Cortex 2021; 31:5560-5569. [PMID: 34185837 DOI: 10.1093/cercor/bhab179] [Citation(s) in RCA: 12] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/24/2021] [Revised: 05/24/2021] [Accepted: 05/25/2021] [Indexed: 11/14/2022] Open
Abstract
Sensory perception is a product of interactions between the internal state of an organism and the physical attributes of a stimulus. It has been shown across the animal kingdom that perception and sensory-evoked physiological responses are modulated depending on whether or not the stimulus is the consequence of voluntary actions. These phenomena are often attributed to motor signals sent to relevant sensory regions that convey information about upcoming sensory consequences. However, the neurophysiological signature of action-locked modulations in sensory cortex, and their relationship with perception, is still unclear. In the current study, we recorded neurophysiological (using Magnetoencephalography) and behavioral responses from 16 healthy subjects performing an auditory detection task of faint tones. Tones were either generated by subjects' voluntary button presses or occurred predictably following a visual cue. By introducing a constant temporal delay between button press/cue and tone delivery, and applying source-level analysis, we decoupled action-locked and auditory-locked activity in auditory cortex. We show action-locked evoked-responses in auditory cortex following sound-triggering actions and preceding sound onset. Such evoked-responses were not found for button-presses that were not coupled with sounds, or sounds delivered following a predictive visual cue. Our results provide evidence for efferent signals in human auditory cortex that are locked to voluntary actions coupled with future auditory consequences.
Collapse
Affiliation(s)
- Daniel Reznik
- Max Planck Institute for Human Cognitive and Brain Sciences, Psychology Department, Leipzig, 04103, Germany
| | - Noa Guttman
- The Gonda Center for Multidisciplinary Brain Research, Bar-Ilan University, Ramat Gan, 5290002, Israel
| | - Batel Buaron
- Sagol School of Neuroscience and School of Psychological Sciences, Tel-Aviv University, 69978, Israel
| | - Elana Zion-Golumbic
- The Gonda Center for Multidisciplinary Brain Research, Bar-Ilan University, Ramat Gan, 5290002, Israel
| | - Roy Mukamel
- Sagol School of Neuroscience and School of Psychological Sciences, Tel-Aviv University, 69978, Israel
| |
Collapse
|
38
|
Breska A, Ivry RB. The human cerebellum is essential for modulating perceptual sensitivity based on temporal expectations. eLife 2021; 10:66743. [PMID: 34165079 PMCID: PMC8245126 DOI: 10.7554/elife.66743] [Citation(s) in RCA: 12] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/21/2021] [Accepted: 06/23/2021] [Indexed: 11/17/2022] Open
Abstract
A functional benefit of attention is to proactively enhance perceptual sensitivity in space and time. Although attentional orienting has traditionally been associated with cortico-thalamic networks, recent evidence has shown that individuals with cerebellar degeneration (CD) show a reduced reaction time benefit from cues that enable temporal anticipation. The present study examined whether the cerebellum contributes to the proactive attentional modulation in time of perceptual sensitivity. We tested CD participants on a non-speeded, challenging perceptual discrimination task, asking if they benefit from temporal cues. Strikingly, the CD group showed no duration-specific perceptual sensitivity benefit when cued by repeated but aperiodic presentation of the target interval. In contrast, they performed similar to controls when cued by a rhythmic stream. This dissociation further specifies the functional domain of the cerebellum and establishes its role in the attentional adjustment of perceptual sensitivity in time in addition to its well-documented role in motor timing.
Collapse
Affiliation(s)
- Assaf Breska
- Department of Psychology and Helen Wills Neuroscience Institute, University of California, Berkeley, Berkeley, United States
| | - Richard B Ivry
- Department of Psychology and Helen Wills Neuroscience Institute, University of California, Berkeley, Berkeley, United States
| |
Collapse
|
39
|
Cannon J. Expectancy-based rhythmic entrainment as continuous Bayesian inference. PLoS Comput Biol 2021; 17:e1009025. [PMID: 34106918 PMCID: PMC8216548 DOI: 10.1371/journal.pcbi.1009025] [Citation(s) in RCA: 10] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/06/2020] [Revised: 06/21/2021] [Accepted: 04/29/2021] [Indexed: 11/18/2022] Open
Abstract
When presented with complex rhythmic auditory stimuli, humans are able to track underlying temporal structure (e.g., a "beat"), both covertly and with their movements. This capacity goes far beyond that of a simple entrained oscillator, drawing on contextual and enculturated timing expectations and adjusting rapidly to perturbations in event timing, phase, and tempo. Previous modeling work has described how entrainment to rhythms may be shaped by event timing expectations, but sheds little light on any underlying computational principles that could unify the phenomenon of expectation-based entrainment with other brain processes. Inspired by the predictive processing framework, we propose that the problem of rhythm tracking is naturally characterized as a problem of continuously estimating an underlying phase and tempo based on precise event times and their correspondence to timing expectations. We present two inference problems formalizing this insight: PIPPET (Phase Inference from Point Process Event Timing) and PATIPPET (Phase and Tempo Inference). Variational solutions to these inference problems resemble previous "Dynamic Attending" models of perceptual entrainment, but introduce new terms representing the dynamics of uncertainty and the influence of expectations in the absence of sensory events. These terms allow us to model multiple characteristics of covert and motor human rhythm tracking not addressed by other models, including sensitivity of error corrections to inter-event interval and perceived tempo changes induced by event omissions. We show that positing these novel influences in human entrainment yields a range of testable behavioral predictions. Guided by recent neurophysiological observations, we attempt to align the phase inference framework with a specific brain implementation. We also explore the potential of this normative framework to guide the interpretation of experimental data and serve as building blocks for even richer predictive processing and active inference models of timing.
Collapse
Affiliation(s)
- Jonathan Cannon
- Department of Brain and Cognitive Science, Massachusetts Institute of Technology, Cambridge, Massachusetts, United States of America
- * E-mail:
| |
Collapse
|
40
|
Yuan P, Hu R, Zhang X, Wang Y, Jiang Y. Cortical entrainment to hierarchical contextual rhythms recomposes dynamic attending in visual perception. eLife 2021; 10:65118. [PMID: 34086558 PMCID: PMC8177885 DOI: 10.7554/elife.65118] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/23/2020] [Accepted: 05/12/2021] [Indexed: 02/07/2023] Open
Abstract
Temporal regularity is ubiquitous and essential to guiding attention and coordinating behavior within a dynamic environment. Previous researchers have modeled attention as an internal rhythm that may entrain to first-order regularity from rhythmic events to prioritize information selection at specific time points. Using the attentional blink paradigm, here we show that higher-order regularity based on rhythmic organization of contextual features (pitch, color, or motion) may serve as a temporal frame to recompose the dynamic profile of visual temporal attention. Critically, such attentional reframing effect is well predicted by cortical entrainment to the higher-order contextual structure at the delta band as well as its coupling with the stimulus-driven alpha power. These results suggest that the human brain involuntarily exploits multiscale regularities in rhythmic contexts to recompose dynamic attending in visual perception, and highlight neural entrainment as a central mechanism for optimizing our conscious experience of the world in the time dimension.
Collapse
Affiliation(s)
- Peijun Yuan
- State Key Laboratory of Brain and Cognitive Science, CAS Center for Excellence in Brain Science and Intelligence Technology, Institute of Psychology, Chinese Academy of Sciences, Beijing, China.,Department of Psychology, University of Chinese Academy of Sciences, Beijing, China.,Chinese Institute for Brain Research, Beijing, China
| | - Ruichen Hu
- State Key Laboratory of Brain and Cognitive Science, CAS Center for Excellence in Brain Science and Intelligence Technology, Institute of Psychology, Chinese Academy of Sciences, Beijing, China.,Department of Psychology, University of Chinese Academy of Sciences, Beijing, China.,Chinese Institute for Brain Research, Beijing, China
| | - Xue Zhang
- State Key Laboratory of Brain and Cognitive Science, CAS Center for Excellence in Brain Science and Intelligence Technology, Institute of Psychology, Chinese Academy of Sciences, Beijing, China.,Department of Psychology, University of Chinese Academy of Sciences, Beijing, China.,Chinese Institute for Brain Research, Beijing, China
| | - Ying Wang
- State Key Laboratory of Brain and Cognitive Science, CAS Center for Excellence in Brain Science and Intelligence Technology, Institute of Psychology, Chinese Academy of Sciences, Beijing, China.,Department of Psychology, University of Chinese Academy of Sciences, Beijing, China.,Chinese Institute for Brain Research, Beijing, China
| | - Yi Jiang
- State Key Laboratory of Brain and Cognitive Science, CAS Center for Excellence in Brain Science and Intelligence Technology, Institute of Psychology, Chinese Academy of Sciences, Beijing, China.,Department of Psychology, University of Chinese Academy of Sciences, Beijing, China.,Chinese Institute for Brain Research, Beijing, China.,Institute of Artificial Intelligence, Hefei Comprehensive National Science Center, Hefei, China
| |
Collapse
|
41
|
Schultz BG, Brown RM, Kotz SA. Dynamic acoustic salience evokes motor responses. Cortex 2020; 134:320-332. [PMID: 33340879 DOI: 10.1016/j.cortex.2020.10.019] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/17/2019] [Revised: 06/25/2020] [Accepted: 10/08/2020] [Indexed: 11/28/2022]
Abstract
Audio-motor integration is currently viewed as a predictive process in which the brain simulates upcoming sounds based on voluntary actions. This perspective does not consider how our auditory environment may trigger involuntary action in the absence of prediction. We address this issue by examining the relationship between acoustic salience and involuntary motor responses. We investigate how acoustic features in music contribute to the perception of salience, and whether those features trigger involuntary peripheral motor responses. Participants with little-to-no musical training listened to musical excerpts once while remaining still during the recording of their muscle activity with surface electromyography (sEMG), and again while they continuously rated perceived salience within the music using a slider. We show cross-correlations between 1) salience ratings and acoustic features, 2) acoustic features and spontaneous muscle activity, and 3) salience ratings and spontaneous muscle activity. Amplitude, intensity, and spectral centroid were perceived as the most salient features in music, and fluctuations in these features evoked involuntary peripheral muscle responses. Our results suggest an involuntary mechanism for audio-motor integration, which may rely on brainstem-spinal or brainstem-cerebellar-spinal pathways. Based on these results, we argue that a new framework is needed to explain the full range of human sensorimotor capabilities. This goal can be achieved by considering how predictive and reactive audio-motor integration mechanisms could operate independently or interactively to optimize human behavior.
Collapse
Affiliation(s)
- Benjamin G Schultz
- Basic & Applied NeuroDynamics Laboratory, Faculty of Psychology & Neuroscience, Department of Neuropsychology & Psychopharmacology, Maastricht University, the Netherlands
| | - Rachel M Brown
- Basic & Applied NeuroDynamics Laboratory, Faculty of Psychology & Neuroscience, Department of Neuropsychology & Psychopharmacology, Maastricht University, the Netherlands
| | - Sonja A Kotz
- Basic & Applied NeuroDynamics Laboratory, Faculty of Psychology & Neuroscience, Department of Neuropsychology & Psychopharmacology, Maastricht University, the Netherlands.
| |
Collapse
|
42
|
Purpose-Dependent Consequences of Temporal Expectations Serving Perception and Action. J Neurosci 2020; 40:7877-7886. [PMID: 32900836 PMCID: PMC7548698 DOI: 10.1523/jneurosci.1134-20.2020] [Citation(s) in RCA: 13] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/10/2020] [Revised: 08/03/2020] [Accepted: 08/06/2020] [Indexed: 12/05/2022] Open
Abstract
Temporal expectations enable anticipatory brain states that prepare us for upcoming perception and action. We investigated the purpose-dependent nature and consequences of cued temporal expectations on brain and behavior in male and female human volunteers, using two matched visual-motor tasks that stressed either response speed or visual accuracy. We show that the consequences of temporal expectations are fundamentally purpose dependent. Temporal expectations predominantly affected response times when visual demands were low and speed was more important, but perceptual accuracy when visual demands were more challenging. Using magnetoencephalography, we further show how temporal expectations latch onto anticipatory neural states associated with concurrent spatial expectations—modulating task-specific anticipatory neural lateralization of oscillatory brain activity in a modality- and frequency-specific manner. By relating these brain states to behavior, we finally reveal how the behavioral relevance of such anticipatory brain states is similarly purpose dependent. SIGNIFICANCE STATEMENT Knowing when events may occur helps to prepare neural activity for upcoming perception and action. It is becoming increasingly clear that distinct sources of temporal expectations may facilitate performance via distinct mechanisms. Another relevant dimension to consider regards the distinct purposes that temporal expectations may serve. Here, we demonstrate that the consequences of temporal expectations on neurophysiological brain activity and behavior are fundamentally purpose dependent, and show how temporal expectations interact with task-relevant neural states in a modality- and frequency-specific manner. This brings the important insight that the ways in which temporal expectations influence brain and behavior, and how brain activity is related to behavior, are not fixed properties but rather depend on the task at hand.
Collapse
|
43
|
Visual aperiodic temporal prediction increases perceptual sensitivity and reduces response latencies. Acta Psychol (Amst) 2020; 209:103129. [PMID: 32619784 DOI: 10.1016/j.actpsy.2020.103129] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/07/2019] [Revised: 06/17/2020] [Accepted: 06/22/2020] [Indexed: 11/23/2022] Open
Abstract
As a predictive organ, the brain can predict upcoming events to guide perception and action in the process of adaptive behavior. The classical models of oscillatory entrainment explain the facilitating effects that occur after periodic stimulation in behavior but cannot explain aperiodic facilitating effects. In the present study, by comparing the behavior performance of participants in periodic predictable (PP), aperiodic predictable (AP) and aperiodic unpredictable (AU) stimulus streams, we investigated the effect of an aperiodic predictable stream on the perceptual sensitivity and response latencies in the visual modality. The results showed that there was no difference between PP and AP conditions in sensitivity (d') and reaction times (RTs), both of which were significantly different from those in the AU condition. Moreover, a significant correlation between d' and RTs was observed when predictability existed. These results indicate that the aperiodic predictable stimulus streams increases perceptual sensitivity and reduces response latencies in a top-down manner. Individuals proactively and flexibly predict upcoming events based on the temporal structure of visual stimuli in the service of adaptive behavior.
Collapse
|
44
|
Heynckes M, De Weerd P, Valente G, Formisano E, De Martino F. Behavioral effects of rhythm, carrier frequency and temporal cueing on the perception of sound sequences. PLoS One 2020; 15:e0234251. [PMID: 32502187 PMCID: PMC7274376 DOI: 10.1371/journal.pone.0234251] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/03/2019] [Accepted: 05/21/2020] [Indexed: 11/18/2022] Open
Abstract
Regularity of acoustic rhythms allows predicting a target embedded within a stream thereby improving detection performance and reaction times in spectral detection tasks. In two experiments we examine whether temporal regularity enhances perceptual sensitivity and reduces reaction times using a temporal shift detection task. Participants detected temporal shifts embedded at different positions within a sequence of quintet-sounds. Narrowband quintets were centered around carrier frequencies of 200 Hz, 1100 Hz, or 3100 Hz and presented at presentation rates between 1-8 Hz. We compared rhythmic sequences to control conditions where periodicity was reduced or absent and tested whether perceptual benefits depend on the presentation rate, the spectral content of the sounds, and task difficulty. We found that (1) the slowest rate (1 Hz) led to the largest behavioral effect on sensitivity. (2) This sensitivity improvement is carrier-dependent, such that the largest improvement is observed for low-frequency (200 Hz) carriers compared to 1100 Hz and 3100 Hz carriers. (3) Moreover, we show that the predictive value of a temporal cue and that of a temporal rhythm similarly affect perceptual sensitivity. That is, both the cue and the rhythm induce confident temporal expectancies in contrast to an aperiodic rhythm, and thereby allow to effectively prepare and allocate attentional resources in time. (4) Lastly, periodic stimulation reduces reaction times compared to aperiodic stimulation, both at perceptual threshold as well as above threshold. Similarly, a temporal cue allowed participants to optimally prepare and thereby respond fastest. Overall, our results are consistent with the hypothesis that periodicity leads to optimized predictions and processing of forthcoming input and thus to behavioral benefits. Predictable temporally cued sounds provide a similar perceptual benefit to periodic rhythms, despite an additional uncertainty of target position within periodic sequences. Several neural mechanisms may underlie our findings, including the entrainment of oscillatory activity of neural populations.
Collapse
Affiliation(s)
- Miriam Heynckes
- Department of Cognitive Neuroscience, Faculty of Psychology and Neuroscience, Maastricht University, Maastricht, The Netherlands
| | - Peter De Weerd
- Department of Cognitive Neuroscience, Faculty of Psychology and Neuroscience, Maastricht University, Maastricht, The Netherlands
| | - Giancarlo Valente
- Department of Cognitive Neuroscience, Faculty of Psychology and Neuroscience, Maastricht University, Maastricht, The Netherlands
| | - Elia Formisano
- Department of Cognitive Neuroscience, Faculty of Psychology and Neuroscience, Maastricht University, Maastricht, The Netherlands
- Maastricht Centre for Systems Biology, Maastricht University, Maastricht, The Netherlands
| | - Federico De Martino
- Department of Cognitive Neuroscience, Faculty of Psychology and Neuroscience, Maastricht University, Maastricht, The Netherlands
| |
Collapse
|
45
|
Norman LJ, Thaler L. Stimulus uncertainty affects perception in human echolocation: Timing, level, and spectrum. J Exp Psychol Gen 2020; 149:2314-2331. [PMID: 32324025 PMCID: PMC7727089 DOI: 10.1037/xge0000775] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
Abstract
The human brain may use recent sensory experience to create sensory templates that are then compared to incoming sensory input, that is, "knowing what to listen for." This can lead to greater perceptual sensitivity, as long as the relevant properties of the target stimulus can be reliably estimated from past sensory experiences. Echolocation is an auditory skill probably best understood in bats, but humans can also echolocate. Here we investigated for the first time whether echolocation in humans involves the use of sensory templates derived from recent sensory experiences. Our results showed that when there was certainty in the acoustic properties of the echo relative to the emission, either in temporal onset, spectral content or level, people detected the echo more accurately than when there was uncertainty. In addition, we found that people were more accurate when the emission's spectral content was certain but, surprisingly, not when either its level or temporal onset was certain. Importantly, the lack of an effect of temporal onset of the emission is counter to that found previously for tasks using nonecholocation sounds, suggesting that the underlying mechanisms might be different for echolocation and nonecholocation sounds. Importantly, the effects of stimulus certainty were no different for people with and without experience in echolocation, suggesting that stimulus-specific sensory templates can be used in a skill that people have never used before. From an applied perspective our results suggest that echolocation instruction should encourage users to make clicks that are similar to one another in their spectral content. (PsycInfo Database Record (c) 2020 APA, all rights reserved).
Collapse
|
46
|
Lauzon AP, Russo FA, Harris LR. The influence of rhythm on detection of auditory and vibrotactile asynchrony. Exp Brain Res 2020; 238:825-832. [PMID: 32130431 PMCID: PMC7181424 DOI: 10.1007/s00221-019-05720-x] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/08/2019] [Accepted: 12/30/2019] [Indexed: 11/24/2022]
Abstract
The perception of an event is strongly influenced by the context in which it occurs. Here, we examined the effect of a rhythmic context on detection of asynchrony in both the auditory and vibrotactile modalities. Using the method of constant stimuli and a two-alternative forced choice (2AFC), participants were presented with pairs of pure tones played either simultaneously or with various levels of stimulus onset asynchrony (SOA). Target stimuli in both modalities were nested within either: (i) a regularly occurring, predictable rhythm (ii) an irregular, unpredictable rhythm, or (iii) no rhythm at all. Vibrotactile asynchrony detection had higher thresholds and showed greater variability than auditory asynchrony detection in general. Asynchrony detection thresholds for auditory targets but not vibrotactile targets were significantly reduced when the target stimulus was embedded in a regular rhythm as compared to no rhythm. Embedding within an irregular rhythm produced no such improvement. The observed modality asymmetries are interpreted with regard to the superior temporal resolution of the auditory system and specialized brain circuitry supporting auditory-motor coupling.
Collapse
Affiliation(s)
- Andrew P Lauzon
- Department of Psychology, York University, 4700 Keele St, Toronto, ON, M3J 1P3, Canada.
- Centre for Vision Research, York University, Toronto, ON, Canada.
| | - Frank A Russo
- Department of Psychology, Ryerson University, Toronto, ON, Canada
| | - Laurence R Harris
- Department of Psychology, York University, 4700 Keele St, Toronto, ON, M3J 1P3, Canada
- Centre for Vision Research, York University, Toronto, ON, Canada
| |
Collapse
|
47
|
Zalta A, Petkoski S, Morillon B. Natural rhythms of periodic temporal attention. Nat Commun 2020; 11:1051. [PMID: 32103014 PMCID: PMC7044316 DOI: 10.1038/s41467-020-14888-8] [Citation(s) in RCA: 42] [Impact Index Per Article: 10.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/23/2019] [Accepted: 02/06/2020] [Indexed: 12/04/2022] Open
Abstract
That attention is a fundamentally rhythmic process has recently received abundant empirical evidence. The essence of temporal attention, however, is to flexibly focus in time. Whether this function is constrained by an underlying rhythmic neural mechanism is unknown. In six interrelated experiments, we behaviourally quantify the sampling capacities of periodic temporal attention during auditory or visual perception. We reveal the presence of limited attentional capacities, with an optimal sampling rate of ~1.4 Hz in audition and ~0.7 Hz in vision. Investigating the motor contribution to temporal attention, we show that it scales with motor rhythmic precision, maximal at ~1.7 Hz. Critically, motor modulation is beneficial to auditory but detrimental to visual temporal attention. These results are captured by a computational model of coupled oscillators, that reveals the underlying structural constraints governing the temporal alignment between motor and attention fluctuations.
Collapse
Affiliation(s)
- Arnaud Zalta
- Inserm, INS, Inst Neurosci Syst, Aix Marseille University, 13005, Marseille, France
- APHM, INSERM, Inst Neurosci Syst, Service de Pharmacologie Clinique et Pharmacovigilance, Aix Marseille University, 13005, Marseille, France
| | - Spase Petkoski
- Inserm, INS, Inst Neurosci Syst, Aix Marseille University, 13005, Marseille, France
| | - Benjamin Morillon
- Inserm, INS, Inst Neurosci Syst, Aix Marseille University, 13005, Marseille, France.
| |
Collapse
|
48
|
Fiveash A, Schön D, Canette LH, Morillon B, Bedoin N, Tillmann B. A stimulus-brain coupling analysis of regular and irregular rhythms in adults with dyslexia and controls. Brain Cogn 2020; 140:105531. [PMID: 31986324 DOI: 10.1016/j.bandc.2020.105531] [Citation(s) in RCA: 14] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/17/2020] [Accepted: 01/18/2020] [Indexed: 12/26/2022]
Abstract
When listening to temporally regular rhythms, most people are able to extract the beat. Evidence suggests that the neural mechanism underlying this ability is the phase alignment of endogenous oscillations to the external stimulus, allowing for the prediction of upcoming events (i.e., dynamic attending). Relatedly, individuals with dyslexia may have deficits in the entrainment of neural oscillations to external stimuli, especially at low frequencies. The current experiment investigated rhythmic processing in adults with dyslexia and matched controls. Regular and irregular rhythms were presented to participants while electroencephalography was recorded. Regular rhythms contained the beat at 2 Hz; while acoustic energy was maximal at 4 Hz and 8 Hz. These stimuli allowed us to investigate whether the brain responds non-linearly to the beat-level of a rhythmic stimulus, and whether beat-based processing differs between dyslexic and control participants. Both groups showed enhanced stimulus-brain coherence for regular compared to irregular rhythms at the frequencies of interest, with an overrepresentation of the beat-level in the brain compared to the acoustic signal. In addition, we found evidence that controls extracted subtle temporal regularities from irregular stimuli, whereas dyslexics did not. Findings are discussed in relation to dynamic attending theory and rhythmic processing deficits in dyslexia.
Collapse
Affiliation(s)
- Anna Fiveash
- Lyon Neuroscience Research Center, CRNL, INSERM, U1028, CNRS, UMR5292, Lyon F-69000, France; University of Lyon 1, Lyon F-69000, France.
| | - Daniele Schön
- Institut de Neurosciences des Systèmes, Aix-Marseille University, INSERM, Marseille, France
| | - Laure-Hélène Canette
- Lyon Neuroscience Research Center, CRNL, INSERM, U1028, CNRS, UMR5292, Lyon F-69000, France; University of Lyon 1, Lyon F-69000, France; University of Burgundy, LEAD, CNRS, UMR5022, Dijon, France
| | - Benjamin Morillon
- Institut de Neurosciences des Systèmes, Aix-Marseille University, INSERM, Marseille, France
| | - Nathalie Bedoin
- Lyon Neuroscience Research Center, CRNL, INSERM, U1028, CNRS, UMR5292, Lyon F-69000, France; University of Lyon 1, Lyon F-69000, France; University of Lyon 2, CNRS, UMR5596, Lyon, France
| | - Barbara Tillmann
- Lyon Neuroscience Research Center, CRNL, INSERM, U1028, CNRS, UMR5292, Lyon F-69000, France; University of Lyon 1, Lyon F-69000, France
| |
Collapse
|
49
|
Bouwer FL, Honing H, Slagter HA. Beat-based and Memory-based Temporal Expectations in Rhythm: Similar Perceptual Effects, Different Underlying Mechanisms. J Cogn Neurosci 2020; 32:1221-1241. [PMID: 31933432 DOI: 10.1162/jocn_a_01529] [Citation(s) in RCA: 26] [Impact Index Per Article: 6.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/04/2022]
Abstract
Predicting the timing of incoming information allows the brain to optimize information processing in dynamic environments. Behaviorally, temporal expectations have been shown to facilitate processing of events at expected time points, such as sounds that coincide with the beat in musical rhythm. Yet, temporal expectations can develop based on different forms of structure in the environment, not just the regularity afforded by a musical beat. Little is still known about how different types of temporal expectations are neurally implemented and affect performance. Here, we orthogonally manipulated the periodicity and predictability of rhythmic sequences to examine the mechanisms underlying beat-based and memory-based temporal expectations, respectively. Behaviorally and using EEG, we looked at the effects of beat-based and memory-based expectations on auditory processing when rhythms were task-relevant or task-irrelevant. At expected time points, both beat-based and memory-based expectations facilitated target detection and led to attenuation of P1 and N1 responses, even when expectations were task-irrelevant (unattended). For beat-based expectations, we additionally found reduced target detection and enhanced N1 responses for events at unexpected time points (e.g., off-beat), regardless of the presence of memory-based expectations or task relevance. This latter finding supports the notion that periodicity selectively induces rhythmic fluctuations in neural excitability and furthermore indicates that, although beat-based and memory-based expectations may similarly affect auditory processing of expected events, their underlying neural mechanisms may be different.
Collapse
|
50
|
Auksztulewicz R, Myers NE, Schnupp JW, Nobre AC. Rhythmic Temporal Expectation Boosts Neural Activity by Increasing Neural Gain. J Neurosci 2019; 39:9806-9817. [PMID: 31662425 PMCID: PMC6891052 DOI: 10.1523/jneurosci.0925-19.2019] [Citation(s) in RCA: 21] [Impact Index Per Article: 4.2] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/24/2019] [Revised: 09/12/2019] [Accepted: 09/19/2019] [Indexed: 12/02/2022] Open
Abstract
Temporal orienting improves sensory processing, akin to other top-down biases. However, it is unknown whether these improvements reflect increased neural gain to any stimuli presented at expected time points, or specific tuning to task-relevant stimulus aspects. Furthermore, while other top-down biases are selective, the extent of trade-offs across time is less well characterized. Here, we tested whether gain and/or tuning of auditory frequency processing in humans is modulated by rhythmic temporal expectations, and whether these modulations are specific to time points relevant for task performance. Healthy participants (N = 23) of either sex performed an auditory discrimination task while their brain activity was measured using magnetoencephalography/electroencephalography (M/EEG). Acoustic stimulation consisted of sequences of brief distractors interspersed with targets, presented in a rhythmic or jittered way. Target rhythmicity not only improved behavioral discrimination accuracy and M/EEG-based decoding of targets, but also of irrelevant distractors preceding these targets. To explain this finding in terms of increased sensitivity and/or sharpened tuning to auditory frequency, we estimated tuning curves based on M/EEG decoding results, with separate parameters describing gain and sharpness. The effect of rhythmic expectation on distractor decoding was linked to gain increase only, suggesting increased neural sensitivity to any stimuli presented at relevant time points.SIGNIFICANCE STATEMENT Being able to predict when an event may happen can improve perception and action related to this event, likely due to the alignment of neural activity to the temporal structure of stimulus streams. However, it is unclear whether rhythmic increases in neural sensitivity are specific to task-relevant targets, and whether they competitively impair stimulus processing at unexpected time points. By combining magnetoencephalography and encephalographic recordings, neural decoding of auditory stimulus features, and modeling, we found that rhythmic expectation improved neural decoding of both relevant targets and irrelevant distractors presented and expected time points, but did not competitively impair stimulus processing at unexpected time points. Using a quantitative model, these results were linked to nonspecific neural gain increases due to rhythmic expectation.
Collapse
Affiliation(s)
- Ryszard Auksztulewicz
- Department of Biomedical Sciences, City University of Hong Kong, Hong Kong Special Administrative Region of the People's Republic of China,
- Max Planck Institute for Empirical Aesthetics, 60322 Frankfurt am Main, Germany
- Department of Experimental Psychology, University of Oxford, Oxford OX2 6GG, United Kingdom, and
| | - Nicholas E Myers
- Department of Experimental Psychology, University of Oxford, Oxford OX2 6GG, United Kingdom, and
- Oxford Centre for Human Brain Activity, University of Oxford, Oxford OX3 7JX, United Kingdom
| | - Jan W Schnupp
- Department of Biomedical Sciences, City University of Hong Kong, Hong Kong Special Administrative Region of the People's Republic of China
| | - Anna C Nobre
- Department of Experimental Psychology, University of Oxford, Oxford OX2 6GG, United Kingdom, and
- Oxford Centre for Human Brain Activity, University of Oxford, Oxford OX3 7JX, United Kingdom
| |
Collapse
|