1
|
Moratti S, Gundlach C, de Echegaray J, Müller MM. Distinct patterns of spatial attentional modulation of steady-state visual evoked magnetic fields (SSVEFs) in subdivisions of the human early visual cortex. Psychophysiology 2024; 61:e14452. [PMID: 37787386 DOI: 10.1111/psyp.14452] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/12/2023] [Revised: 08/23/2023] [Accepted: 09/15/2023] [Indexed: 10/04/2023]
Abstract
In recent years, steady-state visual evoked potentials (SSVEPs) became an increasingly valuable tool to investigate neural dynamics of competitive attentional interactions and brain-computer interfaces. This is due to their good signal-to-noise ratio, allowing for single-trial analysis, and their ongoing oscillating nature that enables to analyze temporal dynamics of facilitation and suppression. Given the popularity of SSVEPs, it is surprising that only a few studies looked at the cortical sources of these responses. This is in particular the case when searching for studies that assessed the cortical sources of attentional SSVEP amplitude modulations. To address this issue, we used a typical spatial attention task and recorded neuromagnetic fields (MEG) while presenting frequency-tagged stimuli in the left and right visual fields, respectively. Importantly, we controlled for attentional deployment in a baseline period before the shifting cue. Subjects either attended to a central fixation cross or to two peripheral stimuli simultaneously. Results clearly showed that signal sources and attention effects were restricted to the early visual cortex: V1, V2, hMT+, precuneus, occipital-parietal, and inferior-temporal cortex. When subjects attended to central fixation first, shifting attention to one of the peripheral stimuli resulted in a significant activation increase for the to-be-attended stimulus with no activation decrease for the to-be-ignored stimulus in hMT+ and inferio-temporal cortex, but significant SSVEF decreases from V1 to occipito-parietal cortex. When attention was first deployed to both rings, shifting attention away from one ring basically resulted in a significant activation decrease in all areas for the then-to-be-ignored stimulus.
Collapse
Affiliation(s)
- Stephan Moratti
- Department of Experimental Psychology, Complutense University of Madrid, Madrid, Spain
- Center for Cognitive and Computational Neuroscience, Complutense University of Madrid, Madrid, Spain
| | | | - Javier de Echegaray
- Wilhelm Wundt Institute for Psychology, University of Leipzig, Leipzig, Germany
| | - Matthias M Müller
- Wilhelm Wundt Institute for Psychology, University of Leipzig, Leipzig, Germany
| |
Collapse
|
2
|
Phangwiwat T, Punchongham P, Wongsawat Y, Chatnuntawech I, Wang S, Chunharas C, Sprague T, Woodman GF, Itthipuripat S. Sustained attention operates via dissociable neural mechanisms across different eccentric locations. RESEARCH SQUARE 2023:rs.3.rs-3562186. [PMID: 37986807 PMCID: PMC10659535 DOI: 10.21203/rs.3.rs-3562186/v1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/22/2023]
Abstract
In primates, foveal and peripheral vision have distinct neural architectures and functions. However, it has been debated if selective attention operates via the same or different neural mechanisms across eccentricities. We tested these alternative accounts by examining the effects of selective attention on the steady-state visually evoked potential (SSVEP) and the fronto-parietal signal measured via EEG from human subjects performing a sustained visuospatial attention task. With a negligible level of eye movements, both SSVEP and SND exhibited the heterogeneous patterns of attentional modulations across eccentricities. Specifically, the attentional modulations of these signals peaked at the parafoveal locations and such modulations wore off as visual stimuli appeared closer to the fovea or further away towards the periphery. However, with a relatively higher level of eye movements, the heterogeneous patterns of attentional modulations of these neural signals were less robust. These data demonstrate that the top-down influence of covert visuospatial attention on early sensory processing in human cortex depends on eccentricity and the level of saccadic responses. Taken together, the results suggest that sustained visuospatial attention operates differently across different eccentric locations, providing new understanding of how attention augments sensory representations regardless of where the attended stimulus appears.
Collapse
Affiliation(s)
- Tanagrit Phangwiwat
- Department of Computer Engineering, King Mongkut's University of Technology Thonburi
| | - Phond Punchongham
- Department of Computer Engineering, King Mongkut's University of Technology Thonburi
| | - Yodchanan Wongsawat
- Department of Biomedical Engineering, Faculty of Engineering, Mahidol University
| | - Itthi Chatnuntawech
- National Nanotechnology Center, National Science and Technology Development Agency
| | - Sisi Wang
- Department of Experimental and Applied Psychology, Vrije Universiteit Amsterdam
| | - Chaipat Chunharas
- Chula Neuroscience Center, King Chulalongkorn Memorial Hospital, Thai Red Cross Society
| | - Thomas Sprague
- Psychological and Brain Science, 251, University of California Santa Barbara
| | | | - Sirawaj Itthipuripat
- Neuroscience Center for Research and Innovation (NX), Learning Institute, King Mongkut's University of Technology Thonburi
| |
Collapse
|
3
|
Font-Alaminos M, Paraskevoudi N, SanMiguel I. Actions do not clearly impact auditory memory. Front Hum Neurosci 2023; 17:1124784. [PMID: 36923585 PMCID: PMC10009998 DOI: 10.3389/fnhum.2023.1124784] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/15/2022] [Accepted: 01/31/2023] [Indexed: 03/06/2023] Open
Abstract
When memorizing a list of words, those that are read aloud are remembered better than those read silently, a phenomenon known as the production effect. There have been several attempts to understand the production effect, however, actions alone have not been examined as possible contributors. Stimuli that coincide with our own actions are processed differently compared to stimuli presented passively to us. These sensory response modulations may have an impact on how action-revolving inputs are stored in memory. In this study, we investigated whether actions could impact auditory memory. Participants listened to sounds presented either during or in between their actions. We measured electrophysiological responses to the sounds and tested participants' memory of them. Results showed attenuation of sensory responses for action-coinciding sounds. However, we did not find a significant effect on memory performance. The absence of significant behavioral findings suggests that the production effect may be not dependent on the effects of actions per se. We conclude that action alone is not sufficient to improve memory performance, and thus elicit a production effect.
Collapse
Affiliation(s)
- Marta Font-Alaminos
- Institut de Neurociències, Universitat de Barcelona, Barcelona, Spain.,Brainlab-Cognitive Neuroscience Research Group, Departament de Psicologia Clinica i Psicobiologia, Universitat de Barcelona, Barcelona, Spain
| | - Nadia Paraskevoudi
- Institut de Neurociències, Universitat de Barcelona, Barcelona, Spain.,Brainlab-Cognitive Neuroscience Research Group, Departament de Psicologia Clinica i Psicobiologia, Universitat de Barcelona, Barcelona, Spain
| | - Iria SanMiguel
- Institut de Neurociències, Universitat de Barcelona, Barcelona, Spain.,Brainlab-Cognitive Neuroscience Research Group, Departament de Psicologia Clinica i Psicobiologia, Universitat de Barcelona, Barcelona, Spain.,Institut de Recerca Sant Joan de Déu, Esplugues de Llobregat, Spain
| |
Collapse
|
4
|
Paraskevoudi N, SanMiguel I. Sensory suppression and increased neuromodulation during actions disrupt memory encoding of unpredictable self-initiated stimuli. Psychophysiology 2022; 60:e14156. [PMID: 35918912 PMCID: PMC10078310 DOI: 10.1111/psyp.14156] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/14/2021] [Revised: 04/06/2022] [Accepted: 07/01/2022] [Indexed: 11/26/2022]
Abstract
Actions modulate sensory processing by attenuating responses to self- compared to externally generated inputs, which is traditionally attributed to stimulus-specific motor predictions. Yet, suppression has been also found for stimuli merely coinciding with actions, pointing to unspecific processes that may be driven by neuromodulatory systems. Meanwhile, the differential processing for self-generated stimuli raises the possibility of producing effects also on memory for these stimuli; however, evidence remains mixed as to the direction of the effects. Here, we assessed the effects of actions on sensory processing and memory encoding of concomitant, but unpredictable sounds, using a combination of self-generation and memory recognition task concurrently with EEG and pupil recordings. At encoding, subjects performed button presses that half of the time generated a sound (motor-auditory; MA) and listened to passively presented sounds (auditory-only; A). At retrieval, two sounds were presented and participants had to respond which one was present before. We measured memory bias and memory performance by having sequences where either both or only one of the test sounds were presented at encoding, respectively. Results showed worse memory performance - but no differences in memory bias -, attenuated responses, and larger pupil diameter for MA compared to A sounds. Critically, the larger the sensory attenuation and pupil diameter, the worse the memory performance for MA sounds. Nevertheless, sensory attenuation did not correlate with pupil dilation. Collectively, our findings suggest that sensory attenuation and neuromodulatory processes coexist during actions, and both relate to disrupted memory for concurrent, albeit unpredictable sounds.
Collapse
Affiliation(s)
- Nadia Paraskevoudi
- Institut de Neurociències, Universitat de Barcelona, Barcelona, Spain.,Brainlab-Cognitive Neuroscience Research Group, Departament de Psicologia Clinica i Psicobiologia, University of Barcelona, Barcelona, Spain
| | - Iria SanMiguel
- Institut de Neurociències, Universitat de Barcelona, Barcelona, Spain.,Brainlab-Cognitive Neuroscience Research Group, Departament de Psicologia Clinica i Psicobiologia, University of Barcelona, Barcelona, Spain.,Institut de Recerca Sant Joan de Déu, Esplugues de Llobregat, Spain
| |
Collapse
|
5
|
Chen Z, Parkkonen L, Wei J, Dong JR, Ma Y, Carlson S. Prepulse Inhibition of Auditory Cortical Responses in the Caudolateral Superior Temporal Gyrus in Macaca mulatta. Neurosci Bull 2017; 34:291-302. [PMID: 29022224 DOI: 10.1007/s12264-017-0181-7] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/24/2017] [Accepted: 08/05/2017] [Indexed: 11/30/2022] Open
Abstract
Prepulse inhibition (PPI) refers to a decreased response to a startling stimulus when another weaker stimulus precedes it. Most PPI studies have focused on the physiological startle reflex and fewer have reported the PPI of cortical responses. We recorded local field potentials (LFPs) in four monkeys and investigated whether the PPI of auditory cortical responses (alpha, beta, and gamma oscillations and evoked potentials) can be demonstrated in the caudolateral belt of the superior temporal gyrus (STGcb). We also investigated whether the presence of a conspecific, which draws attention away from the auditory stimuli, affects the PPI of auditory cortical responses. The PPI paradigm consisted of Pulse-only and Prepulse + Pulse trials that were presented randomly while the monkey was alone (ALONE) and while another monkey was present in the same room (ACCOMP). The LFPs to the Pulse were significantly suppressed by the Prepulse thus, demonstrating PPI of cortical responses in the STGcb. The PPI-related inhibition of the N1 amplitude of the evoked responses and cortical oscillations to the Pulse were not affected by the presence of a conspecific. In contrast, gamma oscillations and the amplitude of the N1 response to Pulse-only were suppressed in the ACCOMP condition compared to the ALONE condition. These findings demonstrate PPI in the monkey STGcb and suggest that the PPI of auditory cortical responses in the monkey STGcb is a pre-attentive inhibitory process that is independent of attentional modulation.
Collapse
Affiliation(s)
- Zuyue Chen
- Department of Neuroscience and Biomedical Engineering, Aalto University School of Science, 00076, Espoo, Finland.
- Department of Physiology, Faculty of Medicine, University of Helsinki, 00014, Helsinki, Finland.
| | - Lauri Parkkonen
- Department of Neuroscience and Biomedical Engineering, Aalto University School of Science, 00076, Espoo, Finland
| | - Jingkuan Wei
- Laboratory of Primate Neurosciences, Kunming Institute of Zoology, Chinese Academy of Sciences, Kunming, 650223, China
| | - Jin-Run Dong
- Laboratory of Primate Neurosciences, Kunming Institute of Zoology, Chinese Academy of Sciences, Kunming, 650223, China
| | - Yuanye Ma
- Laboratory of Primate Neurosciences, Kunming Institute of Zoology, Chinese Academy of Sciences, Kunming, 650223, China
| | - Synnöve Carlson
- Department of Neuroscience and Biomedical Engineering, Aalto University School of Science, 00076, Espoo, Finland
- Department of Physiology, Faculty of Medicine, University of Helsinki, 00014, Helsinki, Finland
| |
Collapse
|
6
|
The role of mechanical impact in action-related auditory attenuation. COGNITIVE AFFECTIVE & BEHAVIORAL NEUROSCIENCE 2015; 14:1392-406. [PMID: 24723005 DOI: 10.3758/s13415-014-0283-x] [Citation(s) in RCA: 13] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
Abstract
A number of studies have shown that sounds temporally close to one's own finger movements elicit lower-amplitude auditory event-related potentials (ERPs) than do the same tones when they are only listened to. In these studies, the actions have involved making a mechanical contact with an object. In the present study, the role of mechanical contact with an object was investigated in action-related auditory attenuation. In three experiments, participants performed a time-interval production task. In each experiment, in one condition the action involved touching an object, but no mechanical contact was made in the other. The estimated tone-related ERP contributions to the action-tone coincidence ERP waveforms (calculated by subtracting the action-related ERP from the coincidence ERP) were more attenuated when the action involved moving the finger and making a mechanical contact at the end of the movement. However, when participants kept their finger on a piezoelectric element and applied pressure impulses without moving their finger, the action did not result in stronger attenuation of the tone-related auditory ERP estimates. Although these results may suggest that auditory ERP attenuation is stronger for actions resulting in mechanical impact, they also imply that mechanical impact may confound and lead to the overestimation of auditory ERP attenuation in such paradigms, because the impact may result in faint but audible sounds.
Collapse
|
7
|
Horváth J. Action-related auditory ERP attenuation: Paradigms and hypotheses. Brain Res 2015; 1626:54-65. [PMID: 25843932 DOI: 10.1016/j.brainres.2015.03.038] [Citation(s) in RCA: 79] [Impact Index Per Article: 8.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/08/2014] [Revised: 02/22/2015] [Accepted: 03/23/2015] [Indexed: 11/15/2022]
Abstract
A number studies have shown that the auditory N1 event-related potential (ERP) is attenuated when elicited by self-induced or self-generated sounds. Because N1 is a correlate of auditory feature- and event-detection, it was generally assumed that N1-attenuation reflected the cancellation of auditory re-afference, enabled by the internal forward modeling of the predictable sensory consequences of the given action. Focusing on paradigms utilizing non-speech actions, the present review summarizes recent progress on action-related auditory attenuation. Following a critical analysis of the most widely used, contingent paradigm, two further hypotheses on the possible causes of action-related auditory ERP attenuation are presented. The attention hypotheses suggest that auditory ERP attenuation is brought about by a temporary division of attention between the action and the auditory stimulation. The pre-activation hypothesis suggests that the attenuation is caused by the activation of a sensory template during the initiation of the action, which interferes with the incoming stimulation. Although each hypothesis can account for a number of findings, none of them can accommodate the whole spectrum of results. It is suggested that a better understanding of auditory ERP attenuation phenomena could be achieved by systematic investigations of the types of actions, the degree of action-effect contingency, and the temporal characteristics of action-effect contingency representation-buildup and -deactivation. This article is part of a Special Issue entitled SI: Prediction and Attention.
Collapse
Affiliation(s)
- János Horváth
- Institute of Cognitive Neuroscience and Psychology, Research Centre for Natural Sciences, Hungarian Academy of Sciences, HAS, P.O.B. 286, H-1519 Budapest, Hungary.
| |
Collapse
|
8
|
Schröger E, Marzecová A, SanMiguel I. Attention and prediction in human audition: a lesson from cognitive psychophysiology. Eur J Neurosci 2015; 41:641-64. [PMID: 25728182 PMCID: PMC4402002 DOI: 10.1111/ejn.12816] [Citation(s) in RCA: 147] [Impact Index Per Article: 16.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/07/2014] [Revised: 11/27/2014] [Accepted: 12/01/2014] [Indexed: 11/30/2022]
Abstract
Attention is a hypothetical mechanism in the service of perception that facilitates the processing of relevant information and inhibits the processing of irrelevant information. Prediction is a hypothetical mechanism in the service of perception that considers prior information when interpreting the sensorial input. Although both (attention and prediction) aid perception, they are rarely considered together. Auditory attention typically yields enhanced brain activity, whereas auditory prediction often results in attenuated brain responses. However, when strongly predicted sounds are omitted, brain responses to silence resemble those elicited by sounds. Studies jointly investigating attention and prediction revealed that these different mechanisms may interact, e.g. attention may magnify the processing differences between predicted and unpredicted sounds. Following the predictive coding theory, we suggest that prediction relates to predictions sent down from predictive models housed in higher levels of the processing hierarchy to lower levels and attention refers to gain modulation of the prediction error signal sent up to the higher level. As predictions encode contents and confidence in the sensory data, and as gain can be modulated by the intention of the listener and by the predictability of the input, various possibilities for interactions between attention and prediction can be unfolded. From this perspective, the traditional distinction between bottom-up/exogenous and top-down/endogenous driven attention can be revisited and the classic concepts of attentional gain and attentional trace can be integrated.
Collapse
Affiliation(s)
- Erich Schröger
- Institute for Psychology, BioCog - Cognitive and Biological Psychology, University of LeipzigNeumarkt 9-19, D-04109, Leipzig, Germany
| | - Anna Marzecová
- Institute for Psychology, BioCog - Cognitive and Biological Psychology, University of LeipzigNeumarkt 9-19, D-04109, Leipzig, Germany
| | - Iria SanMiguel
- Institute for Psychology, BioCog - Cognitive and Biological Psychology, University of LeipzigNeumarkt 9-19, D-04109, Leipzig, Germany
| |
Collapse
|
9
|
Suppression of the N1 auditory evoked potential for sounds generated by the upper and lower limbs. Biol Psychol 2014; 102:108-17. [DOI: 10.1016/j.biopsycho.2014.06.007] [Citation(s) in RCA: 31] [Impact Index Per Article: 3.1] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/09/2013] [Revised: 06/24/2014] [Accepted: 06/27/2014] [Indexed: 11/20/2022]
|
10
|
Timm J, SanMiguel I, Keil J, Schröger E, Schönwiesner M. Motor Intention Determines Sensory Attenuation of Brain Responses to Self-initiated Sounds. J Cogn Neurosci 2014; 26:1481-9. [DOI: 10.1162/jocn_a_00552] [Citation(s) in RCA: 62] [Impact Index Per Article: 6.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/04/2022]
Abstract
Abstract
One of the functions of the brain is to predict sensory consequences of our own actions. In auditory processing, self-initiated sounds evoke a smaller brain response than passive sound exposure of the same sound sequence. Previous work suggests that this response attenuation reflects a predictive mechanism to differentiate the sensory consequences of one's own actions from other sensory input, which seems to form the basis for the sense of agency (recognizing oneself as the agent of the movement). This study addresses the question whether attenuation of brain responses to self-initiated sounds can be explained by brain activity involved in movement planning rather than movement execution. We recorded ERPs in response to sounds initiated by button presses. In one condition, participants moved a finger to press the button voluntarily, whereas in another condition, we initiated a similar, but involuntary, finger movement by stimulating the corresponding region of the primary motor cortex with TMS. For involuntary movements, no movement intention (and no feeling of agency) could be formed; thus, no motor plans were available to the forward model. A portion of the brain response evoked by the sounds, the N1-P2 complex, was reduced in amplitude following voluntary, self-initiated movements, but not following movements initiated by motor cortex stimulation. Our findings demonstrate that movement intention and the corresponding feeling of agency determine sensory attenuation of brain responses to self-initiated sounds. The present results support the assumptions of a predictive internal forward model account operating before primary motor cortex activation.
Collapse
Affiliation(s)
- Jana Timm
- 1University of Leipzig
- 2University of Montreal
| | | | | | | | | |
Collapse
|
11
|
McLoughlin G, Palmer JA, Rijsdijk F, Makeig S. Genetic overlap between evoked frontocentral theta-band phase variability, reaction time variability, and attention-deficit/hyperactivity disorder symptoms in a twin study. Biol Psychiatry 2014; 75:238-47. [PMID: 24001472 PMCID: PMC4149465 DOI: 10.1016/j.biopsych.2013.07.020] [Citation(s) in RCA: 76] [Impact Index Per Article: 7.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 01/23/2013] [Revised: 07/11/2013] [Accepted: 07/17/2013] [Indexed: 01/10/2023]
Abstract
BACKGROUND Electrophysiological and hemodynamic activity is altered in attention-deficit/hyperactivity disorder (ADHD) during tasks requiring cognitive control. Frontal midline theta oscillations are a cortical correlate of cognitive control influencing behavioral outcomes including reaction times. Reaction time variability (RTV) is consistently increased in ADHD and is known to share genetic effects with the disorder. The etiological relationship between the cognitive control system, RTV, and ADHD is unknown. In a sample of twins selected for ADHD and matched control subjects, we aimed to quantify the strength of the phenotypic, genetic, and environmental relationships between event-related midline theta oscillations, RTV, and ADHD. METHODS Our sample included 134 participants aged 12 to 15 years: 67 twin pairs (34 monozygotic; 33 dizygotic) with concordance or discordance for ADHD symptomatology assessed at 8, 10, and 12 years of age. Our main outcome measures were frontal midline theta activity, derived from both channel and source decomposed electroencephalographic data, and behavioral performance on a response-choice arrow flanker task known to elicit theta activity. RESULTS Variability in stimulus event-related theta phase from frontal midline cortex is strongly related to both RTV and ADHD, both phenotypically and genetically. CONCLUSIONS This is the first finding to confirm the genetic link between the frontal midline cognitive control system and ADHD and the first to identify a genetically related neurophysiological marker of RTV in ADHD. Variability in the timing of the theta signal in ADHD may be part of a dysfunctional brain network that impairs regulation of task-relevant responses in the disorder.
Collapse
Affiliation(s)
- Gráinne McLoughlin
- Swartz Center for Computational Neuroscience, Institute for Neural Computation, La Jolla, California; Department of Psychiatry, University of California San Diego, La Jolla, California.
| | | | | | | |
Collapse
|
12
|
Gramann K, Ferris DP, Gwin J, Makeig S. Imaging natural cognition in action. Int J Psychophysiol 2014; 91:22-9. [PMID: 24076470 PMCID: PMC3983402 DOI: 10.1016/j.ijpsycho.2013.09.003] [Citation(s) in RCA: 118] [Impact Index Per Article: 11.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/02/2013] [Revised: 09/09/2013] [Accepted: 09/13/2013] [Indexed: 11/23/2022]
Abstract
The primary function of the human brain is arguably to optimize the results of our motor actions in an ever-changing environment. Our cognitive processes and supporting brain dynamics are inherently coupled both to our environment and to our physical structure and actions. To investigate human cognition in its most natural forms demands imaging of brain activity while participants perform naturally motivated actions and interactions within a full three-dimensional environment. Transient, distributed brain activity patterns supporting spontaneous motor actions, performed in pursuit of naturally motivated goals, may involve any or all parts of cortex and must be precisely timed at a speed faster than the speed of thought and action. Hemodynamic imaging methods give information about brain dynamics on a much slower scale, and established techniques for imaging brain dynamics in all modalities forbid participants from making natural extensive movements so as to avoid intractable movement-related artifacts. To overcome these limitations, we are developing mobile brain/body imaging (MoBI) approaches to study natural human cognition. By synchronizing lightweight, high-density electroencephalographic (EEG) recording with recordings of participant sensory experience, body and eye movements, and other physiological measures, we can apply advanced data analysis techniques to the recorded signal ensemble. This MoBI approach enables the study of human brain dynamics accompanying active human cognition in its most natural forms. Results from our studies have provided new insights into the brain dynamics supporting natural cognition and can extend theories of human cognition and its evolutionary function - to optimize the results of our behavior to meet ever-changing goals, challenges, and opportunities.
Collapse
Affiliation(s)
- Klaus Gramann
- Biological Psychology and Neuroergonomics, Technical University Berlin, Germany; Center for Advanced Neurological Engineering, University of California, San Diego, USA.
| | - Daniel P Ferris
- Human Neuromechanics Laboratory, University of Michigan, Ann Arbor, USA
| | - Joseph Gwin
- Human Neuromechanics Laboratory, University of Michigan, Ann Arbor, USA
| | - Scott Makeig
- Swartz Center for Computational Neuroscience, University of California, San Diego, USA
| |
Collapse
|
13
|
Timm J, Schönwiesner M, SanMiguel I, Schröger E. Sensation of agency and perception of temporal order. Conscious Cogn 2013; 23:42-52. [PMID: 24362412 DOI: 10.1016/j.concog.2013.11.002] [Citation(s) in RCA: 25] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/23/2013] [Revised: 11/21/2013] [Accepted: 11/23/2013] [Indexed: 11/18/2022]
Abstract
After adaptation to a fixed temporal delay between actions and their sensory consequences, stimuli delivered during the delay are perceived to occur prior to actions. Temporal judgments are also influenced by the sensation of agency (experience of causing our own actions and their sensory consequences). Sensory consequences of voluntary actions are perceived to occur earlier in time than those of involuntary actions. However, it is unclear whether temporal order illusions influence the sensation of agency. Thus, we tested how the illusionary reversal of motor actions and sound events affect the sensation of agency. We observed an absence of the sensation of agency in the auditory modality in a condition in which sounds were falsely perceived as preceding motor acts relative to the perceived temporal order in the control condition. This finding suggests a strong association between the sensation of agency and the temporal order perception of actions and their consequences.
Collapse
Affiliation(s)
- Jana Timm
- Institut für Psychologie, Universität Leipzig, Germany.
| | - Marc Schönwiesner
- International Laboratory for Brain, Music, and Sound Research (BRAMS), Department of Psychology, University of Montreal, Quebec, Canada
| | | | | |
Collapse
|
14
|
Saupe K, Widmann A, Trujillo-Barreto NJ, Schröger E. Sensorial suppression of self-generated sounds and its dependence on attention. Int J Psychophysiol 2013; 90:300-10. [DOI: 10.1016/j.ijpsycho.2013.09.006] [Citation(s) in RCA: 41] [Impact Index Per Article: 3.7] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/04/2013] [Revised: 09/24/2013] [Accepted: 09/25/2013] [Indexed: 11/25/2022]
|
15
|
Temporal characteristics of the influence of punishment on perceptual decision making in the human brain. J Neurosci 2013; 33:3939-52. [PMID: 23447604 DOI: 10.1523/jneurosci.4151-12.2013] [Citation(s) in RCA: 13] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/21/2022] Open
Abstract
Perceptual decision making is the process by which information from sensory systems is combined and used to influence our behavior. In addition to the sensory input, this process can be affected by other factors, such as reward and punishment for correct and incorrect responses. To investigate the temporal dynamics of how monetary punishment influences perceptual decision making in humans, we collected electroencephalography (EEG) data during a perceptual categorization task whereby the punishment level for incorrect responses was parametrically manipulated across blocks of trials. Behaviorally, we observed improved accuracy for high relative to low punishment levels. Using multivariate linear discriminant analysis of the EEG, we identified multiple punishment-induced discriminating components with spatially distinct scalp topographies. Compared with components related to sensory evidence, components discriminating punishment levels appeared later in the trial, suggesting that punishment affects primarily late postsensory, decision-related processing. Crucially, the amplitude of these punishment components across participants was predictive of the size of the behavioral improvements induced by punishment. Finally, trial-by-trial changes in prestimulus oscillatory activity in the alpha and gamma bands were good predictors of the amplitude of these components. We discuss these findings in the context of increased motivation/attention, resulting from increases in punishment, which in turn yields improved decision-related processing.
Collapse
|
16
|
Horváth J. Action-sound coincidence-related attenuation of auditory ERPs is not modulated by affordance compatibility. Biol Psychol 2013; 93:81-7. [DOI: 10.1016/j.biopsycho.2012.12.008] [Citation(s) in RCA: 23] [Impact Index Per Article: 2.1] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/12/2012] [Revised: 11/30/2012] [Accepted: 12/19/2012] [Indexed: 11/28/2022]
|
17
|
Sanmiguel I, Todd J, Schröger E. Sensory suppression effects to self-initiated sounds reflect the attenuation of the unspecific N1 component of the auditory ERP. Psychophysiology 2013; 50:334-43. [DOI: 10.1111/psyp.12024] [Citation(s) in RCA: 81] [Impact Index Per Article: 7.4] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/29/2012] [Accepted: 12/07/2012] [Indexed: 11/28/2022]
Affiliation(s)
- Iria Sanmiguel
- Institute for Psychology; University of Leipzig; Leipzig; Germany
| | | | - Erich Schröger
- Institute for Psychology; University of Leipzig; Leipzig; Germany
| |
Collapse
|
18
|
Timm J, SanMiguel I, Saupe K, Schröger E. The N1-suppression effect for self-initiated sounds is independent of attention. BMC Neurosci 2013; 14:2. [PMID: 23281832 PMCID: PMC3573961 DOI: 10.1186/1471-2202-14-2] [Citation(s) in RCA: 77] [Impact Index Per Article: 7.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/17/2012] [Accepted: 12/29/2012] [Indexed: 11/18/2022] Open
Abstract
BACKGROUND If we initiate a sound by our own motor behavior, the N1 component of the auditory event-related brain potential (ERP) that the sound elicits is attenuated compared to the N1 elicited by the same sound when it is initiated externally. It has been suggested that this N1 suppression results from an internal predictive mechanism that is in the service of discriminating the sensory consequences of one's own actions from other sensory input. As the N1-suppression effect is becoming a popular approach to investigate predictive processing in cognitive and social neuroscience, it is important to exclude an alternative interpretation not related to prediction. According to the attentional account, the N1 suppression is due to a difference in the allocation of attention between self- and externally-initiated sounds. To test this hypothesis, we manipulated the allocation of attention to the sounds in different blocks: Attention was directed either to the sounds, to the own motor acts or to visual stimuli. If attention causes the N1-suppression effect, then manipulating attention should affect the effect for self-initiated sounds. RESULTS We found N1 suppression in all conditions. The N1 per se was affected by attention, but there was no interaction between attention and self-initiation effects. This implies that self-initiation N1 effects are not caused by attention. CONCLUSIONS The present results support the assumption that the N1-suppression effect for self-initiated sounds indicates the operation of an internal predictive mechanism. Furthermore, while attention had an influence on the N1a, N1b, and N1c components, the N1-suppression effect was confined to the N1b and N1c subcomponents suggesting that the major contribution to the auditory N1-suppression effect is circumscribed to late N1 components.
Collapse
Affiliation(s)
- Jana Timm
- Institute of Psychology, University of Leipzig, Seeburgstr. 14-20, Leipzig, D-04103, Germany
| | - Iria SanMiguel
- Institute of Psychology, University of Leipzig, Seeburgstr. 14-20, Leipzig, D-04103, Germany
| | - Katja Saupe
- Institute of Psychology, University of Leipzig, Seeburgstr. 14-20, Leipzig, D-04103, Germany
| | - Erich Schröger
- Institute of Psychology, University of Leipzig, Seeburgstr. 14-20, Leipzig, D-04103, Germany
| |
Collapse
|
19
|
Horváth J, Maess B, Baess P, Tóth A. Action–Sound Coincidences Suppress Evoked Responses of the Human Auditory Cortex in EEG and MEG. J Cogn Neurosci 2012; 24:1919-31. [DOI: 10.1162/jocn_a_00215] [Citation(s) in RCA: 60] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/04/2022]
Abstract
Abstract
The N1 auditory ERP and its magnetic counterpart (N1[m]) are suppressed when elicited by self-induced sounds. Because the N1(m) is a correlate of auditory event detection, this N1 suppression effect is generally interpreted as a reflection of the workings of an internal forward model: The forward model captures the contingency (causal relationship) between the action and the sound, and this is used to cancel the predictable sensory reafference when the action is initiated. In this study, we demonstrated in three experiments using a novel coincidence paradigm that actual contingency between actions and sounds is not a necessary condition for N1 suppression. Participants performed time interval production tasks: They pressed a key to set the boundaries of time intervals. Concurrently, but independently of keypresses, a sequence of pure tones with random onset-to-onset intervals was presented. Tones coinciding with keypresses elicited suppressed N1(m) and P2(m), suggesting that action–stimulus contiguity (temporal proximity) is sufficient to suppress sensory processing related to the detection of auditory events.
Collapse
Affiliation(s)
| | - Burkhard Maess
- 2Max-Planck Institute for Cognitive and Brain Sciences, Leipzig, Germany
| | - Pamela Baess
- 3Aalto University, School of Science and Technology, Espoo, Finland
| | | |
Collapse
|
20
|
Makeig S, Gramann K, Jung TP, Sejnowski TJ, Poizner H. Linking brain, mind and behavior. Int J Psychophysiol 2009; 73:95-100. [PMID: 19414039 DOI: 10.1016/j.ijpsycho.2008.11.008] [Citation(s) in RCA: 206] [Impact Index Per Article: 13.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/12/2008] [Accepted: 11/14/2008] [Indexed: 12/30/2022]
Abstract
Cortical brain areas and dynamics evolved to organize motor behavior in our three-dimensional environment also support more general human cognitive processes. Yet traditional brain imaging paradigms typically allow and record only minimal participant behavior, then reduce the recorded data to single map features of averaged responses. To more fully investigate the complex links between distributed brain dynamics and motivated natural behavior, we propose the development of wearable mobile brain/body imaging (MoBI) systems that continuously capture the wearer's high-density electrical brain and muscle signals, three-dimensional body movements, audiovisual scene and point of regard, plus new data-driven analysis methods to model their interrelationships. The new imaging modality should allow new insights into how spatially distributed brain dynamics support natural human cognition and agency.
Collapse
Affiliation(s)
- Scott Makeig
- Swartz Center for Computation Neuroscience, University of California-San Diego, 9500 Gilman Drive, La Jolla, CA 92093, USA.
| | | | | | | | | |
Collapse
|
21
|
Zwickel J, Grosjean M, Prinz W. A contrast effect between the concurrent production and perception of movement directions. VISUAL COGNITION 2008. [DOI: 10.1080/13506280701653586] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/22/2022]
|
22
|
Crist RE, Wu CT, Karp C, Woldorff MG. Face Processing is Gated by Visual Spatial Attention. Front Hum Neurosci 2008; 1:10. [PMID: 18958224 PMCID: PMC2525978 DOI: 10.3389/neuro.09.010.2007] [Citation(s) in RCA: 22] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/21/2007] [Accepted: 01/09/2008] [Indexed: 11/21/2022] Open
Abstract
Human perception of faces is widely believed to rely on automatic processing by a domain-specific, modular component of the visual system. Scalp-recorded event-related potential (ERP) recordings indicate that faces receive special stimulus processing at around 170 ms poststimulus onset, in that faces evoke an enhanced occipital negative wave, known as the N170, relative to the activity elicited by other visual objects. As predicted by modular accounts of face processing, this early face-specific N170 enhancement has been reported to be largely immune to the influence of endogenous processes such as task strategy or attention. However, most studies examining the influence of attention on face processing have focused on non-spatial attention, such as object-based attention, which tend to have longer-latency effects. In contrast, numerous studies have demonstrated that visual spatial attention can modulate the processing of visual stimuli as early as 80 ms poststimulus – substantially earlier than the N170. These temporal characteristics raise the question of whether this initial face-specific processing is immune to the influence of spatial attention. This question was addressed in a dual-visual-stream ERP study in which the influence of spatial attention on the face-specific N170 could be directly examined. As expected, early visual sensory responses to all stimuli presented in an attended location were larger than responses evoked by those same stimuli when presented in an unattended location. More importantly, a significant face-specific N170 effect was elicited by faces that appeared in an attended location, but not in an unattended one. In summary, early face-specific processing is not automatic, but rather, like other objects, strongly depends on endogenous factors such as the allocation of spatial attention. Moreover, these findings underscore the extensive influence that top-down attention exercises over the processing of visual stimuli, including those of high natural salience.
Collapse
Affiliation(s)
- Roy E Crist
- Center for Cognitive Neuroscience, Duke University Durham, NC, USA
| | | | | | | |
Collapse
|
23
|
Korotkov A, Radovanovic S, Ljubisavljevic M, Lyskov E, Kataeva G, Roudas M, Pakhomov S, Thunberg J, Medvedev S, Johansson H. Comparison of brain activation after sustained non-fatiguing and fatiguing muscle contraction: a positron emission tomography study. Exp Brain Res 2005; 163:65-74. [PMID: 15645226 DOI: 10.1007/s00221-004-2141-5] [Citation(s) in RCA: 26] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/09/2004] [Accepted: 10/13/2004] [Indexed: 10/25/2022]
Abstract
The concept of fatigue refers to a class of acute effects that can impair motor performance, and not to a single mechanism. A great deal is known about the peripheral mechanisms underlying the process of fatigue, but our knowledge of the roles of the central structures in that process is still very limited. During fatigue, it has been shown that peripheral apparatus is capable of generating adequate force while central structures become insufficient/sub-optimal in driving them. This is known as central fatigue, and it can vary between muscles and different tasks. Fatigue induced by submaximal isometric contraction may have a greater central component than fatigue induced by prolonged maximal efforts. We studied the changes in regional cerebral blood flow (rCBF) of brain structures after sustained isometric muscle contractions of different submaximal force levels and of different durations, and compared them with the conditions observed when the sustained muscle contraction becomes fatiguing. Changes in cortical activity, as indicated by changes in rCBF, were measured using positron emission tomography (PET). Twelve subjects were studied under four conditions: (1) rest condition; (2) contraction of the m. biceps brachii at 30% of MVC, sustained for 60 s; (3) contraction at 30% of MVC, sustained for 120 s, and; (4) contraction at 50% of MVC, sustained for 120 s. The level of rCBF in the activated cortical areas gradually increased with the level and duration of muscle contraction. The fatiguing condition was associated with predominantly contralateral activation of the primary motor (MI) and the primary and secondary somatosensory areas (SI and SII), the somatosensory association area (SAA), and the temporal areas AA and AI. The supplementary motor area (SMA) and the cingula were activated bilaterally. The results show increased cortical activation, confirming that increased effort aimed at maintaining force in muscle fatigue is associated with increased activation of cortical neurons. At the same time, the activation spread to several cortical areas and probably reflects changes in both excitatory and inhibitory cortical circuits. It is suggested that further studies aimed at controlling afferent input from the muscle during fatigue may allow a more precise examination of the roles of each particular region involved in the processing of muscle fatigue.
Collapse
Affiliation(s)
- Alexander Korotkov
- Center for Musculoskeletal Research, University of Gävle, Petrus Laestadius väg, Box 7629, 907 13 Umeå, Sweden
| | | | | | | | | | | | | | | | | | | |
Collapse
|
24
|
Abstract
Steady-state evoked potentials can be recorded from the human scalp in response to auditory stimuli presented at rates between 1 and 200 Hz or by periodic modulations of the amplitude and/or frequency of a continuous tone. Responses can be objectively detected using frequency-based analyses. In waking subjects, the responses are particularly prominent at rates near 40 Hz. Responses evoked by more rapidly presented stimuli are less affected by changes in arousal and can be evoked by multiple simultaneous stimuli without significant loss of amplitude. Response amplitude increases as the depth of modulation or the intensity increases. The phase delay of the response increases as the intensity or the carrier frequency decreases. Auditory steady-state responses are generated throughout the auditory nervous system, with cortical regions contributing more than brainstem generators to responses at lower modulation frequencies. These responses are useful for objectively evaluating auditory thresholds, assessing suprathreshold hearing, and monitoring the state of arousal during anesthesia.
Collapse
Affiliation(s)
- Terence W Picton
- Rotman Research Institute, Baycrest Centre for Geriatric Care, University of Toronto, Canada.
| | | | | | | |
Collapse
|
25
|
Jung TP, Makeig S, McKeown MJ, Bell AJ, Lee TW, Sejnowski TJ. Imaging Brain Dynamics Using Independent Component Analysis. PROCEEDINGS OF THE IEEE. INSTITUTE OF ELECTRICAL AND ELECTRONICS ENGINEERS 2001; 89:1107-1122. [PMID: 20824156 PMCID: PMC2932458 DOI: 10.1109/5.939827] [Citation(s) in RCA: 259] [Impact Index Per Article: 11.3] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/03/2023]
Abstract
The analysis of electroencephalographic (EEG) and magnetoencephalographic (MEG) recordings is important both for basic brain research and for medical diagnosis and treatment. Independent component analysis (ICA) is an effective method for removing artifacts and separating sources of the brain signals from these recordings. A similar approach is proving useful for analyzing functional magnetic resonance brain imaging (fMRI) data. In this paper, we outline the assumptions underlying ICA and demonstrate its application to a variety of electrical and hemodynamic recordings from the human brain.
Collapse
Affiliation(s)
- Tzyy-Ping Jung
- University of California at San Diego, La Jolla, CA 92093-0523 USA and also with The Salk Institute for Biological Studies, La Jolla, CA 92037 USA
| | - Scott Makeig
- University of California at San Diego, La Jolla, CA 92093-0523 USA and also with The Salk Institute for Biological Studies, La Jolla, CA 92037 USA
| | - Martin J. McKeown
- Department of Medicine (Neurology), the Brain Imaging and Analysis Center (BIAC), and the Department of Biomedical Engineering, Duke University, Durham, NC 27708 USA
| | - Anthony J. Bell
- University of California at San Diego, La Jolla, CA 92093-0523 USA and also with The Salk Institute for Biological Studies, La Jolla, CA 92037 USA
| | - Te-Won Lee
- University of California at San Diego, La Jolla, CA 92093-0523 USA and also with The Salk Institute for Biological Studies, La Jolla, CA 92037 USA
| | - Terrence J. Sejnowski
- University of California at San Diego, La Jolla, CA 92093-0523 USA and also with The Salk Institute for Biological Studies, La Jolla, CA 92037 USA
| |
Collapse
|
26
|
Müller MM, Hillyard S. Concurrent recording of steady-state and transient event-related potentials as indices of visual-spatial selective attention. Clin Neurophysiol 2000; 111:1544-52. [PMID: 10964063 DOI: 10.1016/s1388-2457(00)00371-0] [Citation(s) in RCA: 122] [Impact Index Per Article: 5.1] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/24/2022]
Abstract
OBJECTIVES The present study investigated the effects of spatial attention on concurrently recorded visual event-related potentials (ERPs) and steady-state visual evoked potentials (SSVEPs) to isoluminant color changes embedded in rapidly flickering stimuli. METHODS EEG was recorded while subjects attended to flickering LEDs in either the right or left visual hemifield and responded by a button press to isoluminant color changes (targets). RESULTS Target isoluminant color changes elicited the typical ERP components P1, N1, N2 and P3, which were enhanced for attended targets compared to unattended targets. Consistent with previous findings, SSVEP amplitude was enlarged for attended flicker stimuli at posterior electrode sites contralateral to the attended visual hemifield. In addition, significant correlations were found between the N1, N2 and the SSVEP attention effects, whereas no such correlations were found between the P1, P3 and SSVEP attention effects. CONCLUSIONS Results suggest that the SSVEP and ERP reflect partially overlapping attentional mechanisms that facilitate the discriminative processing of stimuli at attended locations.
Collapse
Affiliation(s)
- M M Müller
- Department of Psychology, Cognitive Neuroscience and Neuropsychology, Eleanor Rathbone Building, L69 7ZA, Liverpool, UK.
| | | |
Collapse
|
27
|
Functionally independent components of the late positive event-related potential during visual spatial attention. J Neurosci 1999. [PMID: 10087080 DOI: 10.1523/jneurosci.19-07-02665.1999] [Citation(s) in RCA: 227] [Impact Index Per Article: 9.1] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/21/2022] Open
Abstract
Human event-related potentials (ERPs) were recorded from 10 subjects presented with visual target and nontarget stimuli at five screen locations and responding to targets presented at one of the locations. The late positive response complexes of 25-75 ERP average waveforms from the two task conditions were simultaneously analyzed with Independent Component Analysis, a new computational method for blindly separating linearly mixed signals. Three spatially fixed, temporally independent, behaviorally relevant, and physiologically plausible components were identified without reference to peaks in single-channel waveforms. A novel frontoparietal component (P3f) began at approximately 140 msec and peaked, in faster responders, at the onset of the motor command. The scalp distribution of P3f appeared consistent with brain regions activated during spatial orienting in functional imaging experiments. A longer-latency large component (P3b), positive over parietal cortex, was followed by a postmotor potential (Pmp) component that peaked 200 msec after the button press and reversed polarity near the central sulcus. A fourth component associated with a left frontocentral nontarget positivity (Pnt) was evoked primarily by target-like distractors presented in the attended location. When no distractors were presented, responses of five faster-responding subjects contained largest P3f and smallest Pmp components; when distractors were included, a Pmp component appeared only in responses of the five slower-responding subjects. Direct relationships between component amplitudes, latencies, and behavioral responses, plus similarities between component scalp distributions and regional activations reported in functional brain imaging experiments suggest that P3f, Pmp, and Pnt measure the time course and strength of functionally distinct brain processes.
Collapse
|