1
|
Rebouillat B, Barascud N, Kouider S. Partial awareness during voluntary endogenous decision. Conscious Cogn 2024; 125:103769. [PMID: 39413689 DOI: 10.1016/j.concog.2024.103769] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/07/2024] [Revised: 10/08/2024] [Accepted: 10/09/2024] [Indexed: 10/18/2024]
Abstract
Despite our feeling of control over decisions, our ability to consciously access choices before execution remains debated. Recent research reveals prospective access to intention to act, allowing potential vetoes of impending decisions. However, whether the content of impending decision can be accessed remain debated. Here we track neural signals during participants' early deliberation in free decisions. Participants chose freely between two options but sometimes had to reject their current decision just before execution. The initially preferred option, tracked in real time, significantly predicts the upcoming choice, but remain mostly outside of conscious awareness. Participants often display overconfidence in their access to this content. Instead, confidence is associated with a neural marker of self-initiated decision, indicating a qualitative confusion in the confidence evaluation process. Our results challenge the notion of complete agency over choices, suggesting inflated awareness of forthcoming decisions and providing insights into metacognitive processes in free decision-making.
Collapse
Affiliation(s)
- Benjamin Rebouillat
- Laboratoire DysCo, Université Paris 8, Saint-Denis, France; Brain and Consciousness Group (ENS, CNRS), Département d'Études Cognitives, École Normale Supérieure-PSL Research University, Paris, France; Ecole Doctorale Cerveau Cognition Comportement, ENS/ Paris VI / Paris V, Paris 75005, France.
| | - Nicolas Barascud
- Brain and Consciousness Group (ENS, CNRS), Département d'Études Cognitives, École Normale Supérieure-PSL Research University, Paris, France
| | - Sid Kouider
- Brain and Consciousness Group (ENS, CNRS), Département d'Études Cognitives, École Normale Supérieure-PSL Research University, Paris, France
| |
Collapse
|
2
|
Shum YH, Galang CM, Brass M. Using a Veto paradigm to investigate the decision models in explaining Libet-style experiments. Conscious Cogn 2024; 124:103732. [PMID: 39151389 DOI: 10.1016/j.concog.2024.103732] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/08/2023] [Revised: 07/23/2024] [Accepted: 07/24/2024] [Indexed: 08/19/2024]
Abstract
The question of whether free will exists or not has intrigued philosophers for centuries. About 40 years ago, cognitive neuroscientists such as Benjamin Libet have joined the discussion by demonstrating that an ERP component, the readiness potential (RP), precedes the reported time of decision to act by a few hundred milliseconds. Libet et al. (1983) argued that our brains unconsciously prepare the movement before we experience any conscious intention, which led some free will skeptics (e.g., Ebert & Wegner, 2011) to argue that free will does not exist. While Libet's interpretation of his findings initiated an intense philosophical debate, alternative interpretations have been put forward more recently (Bode et al., 2014; Brass et al., 2019; Schurger et al., 2012; 2021). Integration to bound models (ITB) of Libet-style experiments suggest that we accumulate information until an intention threshold is reached, which triggers our experience of intention and execution of voluntary behaviors. The RP, from this perspective reflects the decision process itself rather than the consequence of an unconscious decision. To determine if the ITB model better predicts behavioral patterns in Libet-style experiments, we added a whether-component to the classical Libet task (the Veto Libet task) and compared the behavioral measures in the Veto Libet task with the Classical Libet task. We hypothesized that the signal accumulation in the Veto Libet task would be less steep than in the Classical Libet task, resulting in longer wait times and earlier self-reported intentions to act (i.e., the W). The result in general supported our hypotheses. In addition, these behavioral differences between the Classical Libet task and the Veto Libet task established valuable behavioral correlates for future investigations into the vetoing phenomenon. Finally, this study was also the first application of the Libet task in an online setting, and the behavioral parameters were highly comparable to the previous offline studies, further supporting the possibility of using the online platform to study arbitrary decision-making.
Collapse
Affiliation(s)
- Yu Hei Shum
- Berlin School of Mind and Brain & Department of Psychology, Humboldt-Universität zu Berlin, Germany
| | - Carl Michael Galang
- Berlin School of Mind and Brain & Department of Psychology, Humboldt-Universität zu Berlin, Germany
| | - Marcel Brass
- Berlin School of Mind and Brain & Department of Psychology, Humboldt-Universität zu Berlin, Germany; Department of Experimental Psychology, Ghent University, Belgium
| |
Collapse
|
3
|
Iso-Ahola SE. A theory of the skill-performance relationship. Front Psychol 2024; 15:1296014. [PMID: 38406307 PMCID: PMC10884260 DOI: 10.3389/fpsyg.2024.1296014] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/18/2023] [Accepted: 01/17/2024] [Indexed: 02/27/2024] Open
Abstract
The skill-performance relationship is a cornerstone of a meritocratic society. People are selected for schools, colleges and jobs based on the premise that more skillful individuals perform better. Scientific understanding of the skill-performance relationship demands that the effect of skill on performance is objectively assessed without subjective, social, and political considerations. One of the best areas for this analysis is sports. In many sports settings, the skill-performance relationship can objectively be examined at the technical, behavioral, psychological, and neurological levels. This examination reveals that skill and performance are inextricably intertwined. While skill affects performance, performance in turn defines and affects skill. To disentangle the previously confusing and interchangeable use of these key constructs, the paper presents a theoretical model specifying that ability and effort have their own direct effects on performance, as well as indirect effects on performance through skill possession and skill execution in cognitive and physical domains of human performance. Thus, ability and skill are not the same. Although skill is a key determinant of performance, recent theory and research suggests that successful performers are successful not just because of their skills per se, but because they take advantage of their skills by creating more occurrences of momentum, making them last longer, and using them to bounce back faster from streaks of unsuccessful performance. Thus, momentum is an important mediator of the effects of skill on performance.
Collapse
Affiliation(s)
- Seppo E. Iso-Ahola
- Department of Kinesiology, School of Public Health, University of Maryland, College Park, MD, United States
| |
Collapse
|
4
|
Dominik T, Mele A, Schurger A, Maoz U. Libet's legacy: A primer to the neuroscience of volition. Neurosci Biobehav Rev 2024; 157:105503. [PMID: 38072144 DOI: 10.1016/j.neubiorev.2023.105503] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/03/2023] [Revised: 11/09/2023] [Accepted: 12/04/2023] [Indexed: 12/23/2023]
Abstract
The neuroscience of volition is an emerging subfield of the brain sciences, with hundreds of papers on the role of consciousness in action formation published each year. This makes the state-of-the-art in the discipline poorly accessible to newcomers and difficult to follow even for experts in the field. Here we provide a comprehensive summary of research in this field since its inception that will be useful to both groups. We also discuss important ideas that have received little coverage in the literature so far. We systematically reviewed a set of 2220 publications, with detailed consideration of almost 500 of the most relevant papers. We provide a thorough introduction to the seminal work of Benjamin Libet from the 1960s to 1980s. We also discuss common criticisms of Libet's method, including temporal introspection, the interpretation of the assumed physiological correlates of volition, and various conceptual issues. We conclude with recent advances and potential future directions in the field, highlighting modern methodological approaches to volition, as well as important recent findings.
Collapse
Affiliation(s)
| | - Alfred Mele
- Department of Philosophy, Florida State University, FL, USA
| | | | - Uri Maoz
- Brain Institute, Chapman University, CA, USA
| |
Collapse
|
5
|
Molano-Mazón M, Garcia-Duran A, Pastor-Ciurana J, Hernández-Navarro L, Bektic L, Lombardo D, de la Rocha J, Hyafil A. Rapid, systematic updating of movement by accumulated decision evidence. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2024:2023.11.09.566389. [PMID: 38352370 PMCID: PMC10862760 DOI: 10.1101/2023.11.09.566389] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Indexed: 02/19/2024]
Abstract
Acting in the natural world requires not only deciding among multiple options but also converting decisions into motor commands. How the dynamics of decision formation influence the fine kinematics of response movement remains, however, poorly understood. Here we investigate how the accumulation of decision evidence shapes the response orienting trajectories in a task where freely-moving rats combine prior expectations and auditory information to select between two possible options. Response trajectories and their motor vigor are initially determined by the prior. Rats movements then incorporate sensory information as early as 60 ms after stimulus onset by accelerating or slowing depending on how much the stimulus supports their initial choice. When the stimulus evidence is in strong contradiction, rats change their mind and reverse their initial trajectory. Human subjects performing an equivalent task display a remarkably similar behavior. We encapsulate these results in a computational model that, by mapping the decision variable onto the movement kinematics at discrete time points, captures subjects' choices, trajectories and changes of mind. Our results show that motor responses are not ballistic. Instead, they are systematically and rapidly updated, as they smoothly unfold over time, by the parallel dynamics of the underlying decision process.
Collapse
Affiliation(s)
- Manuel Molano-Mazón
- IDIBAPS, Rosselló 149, Barcelona, 08036, Spain
- Centre de Recerca Matemàtica (CRM), Bellaterra, Spain
- These authors contributed equally
| | | | | | | | | | | | - Jaime de la Rocha
- IDIBAPS, Rosselló 149, Barcelona, 08036, Spain
- These authors contributed equally
| | - Alexandre Hyafil
- Centre de Recerca Matemàtica (CRM), Bellaterra, Spain
- These authors contributed equally
| |
Collapse
|
6
|
Syrov N, Yakovlev L, Kaplan A, Lebedev M. Motor cortex activation during visuomotor transformations: evoked potentials during overt and imagined movements. Cereb Cortex 2024; 34:bhad440. [PMID: 37991276 DOI: 10.1093/cercor/bhad440] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/09/2023] [Revised: 10/24/2023] [Accepted: 10/25/2023] [Indexed: 11/23/2023] Open
Abstract
Despite the prevalence of visuomotor transformations in our motor skills, their mechanisms remain incompletely understood, especially when imagery actions are considered such as mentally picking up a cup or pressing a button. Here, we used a stimulus-response task to directly compare the visuomotor transformation underlying overt and imagined button presses. Electroencephalographic activity was recorded while participants responded to highlights of the target button while ignoring the second, non-target button. Movement-related potentials (MRPs) and event-related desynchronization occurred for both overt movements and motor imagery (MI), with responses present even for non-target stimuli. Consistent with the activity accumulation model where visual stimuli are evaluated and transformed into the eventual motor response, the timing of MRPs matched the response time on individual trials. Activity-accumulation patterns were observed for MI, as well. Yet, unlike overt movements, MI-related MRPs were not lateralized, which appears to be a neural marker for the distinction between generating a mental image and transforming it into an overt action. Top-down response strategies governing this hemispheric specificity should be accounted for in future research on MI, including basic studies and medical practice.
Collapse
Affiliation(s)
- Nikolay Syrov
- Vladimir Zelman Center for Neurobiology and Brain Rehabilitation, Skolkovo Institute of Science and Technology, Bolshoy Boulevard 30, bld. 1. Moscow, 121205, Russia
| | - Lev Yakovlev
- Vladimir Zelman Center for Neurobiology and Brain Rehabilitation, Skolkovo Institute of Science and Technology, Bolshoy Boulevard 30, bld. 1. Moscow, 121205, Russia
| | - Alexander Kaplan
- Vladimir Zelman Center for Neurobiology and Brain Rehabilitation, Skolkovo Institute of Science and Technology, Bolshoy Boulevard 30, bld. 1. Moscow, 121205, Russia
- Faculty of Biology, Lomonosov Moscow State University, 1-12 Leninskie Gory, Moscow, 119991, Russia
| | - Mikhail Lebedev
- Faculty of Mechanics and Mathematics, Lomonosov Moscow State University, 1 Leninskiye Gory, Moscow, 119991, Russia
| |
Collapse
|
7
|
Bogler C, Grujičić B, Haynes JD. Clarifying the nature of stochastic fluctuations and accumulation processes in spontaneous movements. Front Psychol 2023; 14:1271180. [PMID: 37901069 PMCID: PMC10602783 DOI: 10.3389/fpsyg.2023.1271180] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/01/2023] [Accepted: 09/15/2023] [Indexed: 10/31/2023] Open
Abstract
Experiments on choice-predictive brain signals have played an important role in the debate on free will. In a seminal study, Benjamin Libet and colleagues found that a negative-going EEG signal, the readiness potential (RP), can be observed over motor-related brain regions even hundreds of ms before the time of the conscious decision to move. If the early onset of the readiness potential is taken as an indicator of the "brain's decision to move" this could mean that this decision is made early, by unconscious brain activity, rather than later, at the time when the subject believes to have decided. However, an alternative kind of interpretation, involving ongoing stochastic fluctuations, has recently been brought to light. This stochastic decision model (SDM) takes its inspiration from leaky accumulator models of perceptual decision making. It suggests that the RP originates from an accumulation of ongoing stochastic fluctuations. In this view, the decision happens only at a much later stage when an accumulated noisy signal (plus imperative) reaches a threshold. Here, we clarify a number of confusions regarding both the evidence for the stochastic decision model as well as the interpretation that it offers. We will explore several points that we feel are in need of clarification: (a) the empirical evidence for the role of stochastic fluctuations is so far only indirect; (b) the interpretation of animal studies is unclear; (c) a model that is deterministic during the accumulation stage can explain the data in a similar way; (d) the primary focus in the literature has been on the role of random fluctuations whereas the deterministic aspects of the model have been largely ignored; (e) contrary to the original interpretation, the deterministic component of the model is quantitatively the dominant input into the accumulator; and finally (f) there is confusion regarding the role of "imperative" in the SDM and its link to "evidence" in perceptual decision making. Our aim is not to rehabilitate the role of the RP in the free will debate. Rather we aim to address some confusions regarding the evidence for accumulators playing a role in these preparatory brain processes.
Collapse
Affiliation(s)
- Carsten Bogler
- Bernstein Center for Computational Neuroscience, Charité-Universitätsmedizin Berlin, Berlin, Germany
| | - Bojana Grujičić
- Max Planck School of Cognition, Leipzig, Germany
- Berlin School of Mind and Brain, Humboldt-Universität zu Berlin, Berlin, Germany
- Department of Science and Technology Studies, University College London, London, United Kingdom
| | - John-Dylan Haynes
- Bernstein Center for Computational Neuroscience, Charité-Universitätsmedizin Berlin, Berlin, Germany
- Max Planck School of Cognition, Leipzig, Germany
- Berlin School of Mind and Brain, Humboldt-Universität zu Berlin, Berlin, Germany
- Berlin Center for Advanced Neuroimaging, Charité-Universitätsmedizin Berlin, Berlin, Germany
- Clinic of Neurology, Charité-Universitätsmedizin Berlin, Berlin, Germany
- Institute of Psychology, Humboldt-Universität zu Berlin, Berlin, Germany
- Cluster of Excellence “Science of Intelligence”, Berlin Institute of Technology, Berlin, Germany
| |
Collapse
|
8
|
Castro-Toledo FJ, Cerezo P, Gómez-Bellvís AB. Scratching the structure of moral agency: insights from philosophy applied to neuroscience. Front Neurosci 2023; 17:1198001. [PMID: 37539381 PMCID: PMC10396301 DOI: 10.3389/fnins.2023.1198001] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/31/2023] [Accepted: 06/28/2023] [Indexed: 08/05/2023] Open
Abstract
This paper explores the intersection between neuroscience and philosophy, particularly in the areas of moral philosophy and philosophy of mind. While traditional philosophical questions, such as those relating to free will and moral motivation, have been subject to much debate, the rise of neuroscience has led to a reinterpretation of these questions considering empirical evidence. This has led to tensions between those who believe neuroscience can provide definitive answers to very complex philosophical questions and those who are skeptical about the scope of these studies. However, the paper argues that neuroscientists and philosophers can work together to generate major scientific and social advances. To contribute to bridge the gap, in this paper we expose the complexity of moral experience from a philosophical point of view and point to two great challenges and gaps to cover from neurosciences.
Collapse
Affiliation(s)
- Francisco Javier Castro-Toledo
- Plus Ethics, Elche, Spain
- Miguel Hernández University of Elche, Elche, Spain
- The European University of Brain and Technology (NeurotechEU), Elche, Spain
| | | | | |
Collapse
|
9
|
Neural processing of goal and non-goal-directed movements on the smartphone. NEUROIMAGE: REPORTS 2023. [DOI: 10.1016/j.ynirp.2023.100164] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 03/17/2023]
|
10
|
Yurchenko SB. A systematic approach to brain dynamics: cognitive evolution theory of consciousness. Cogn Neurodyn 2023; 17:575-603. [PMID: 37265655 PMCID: PMC10229528 DOI: 10.1007/s11571-022-09863-6] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/29/2022] [Revised: 06/29/2022] [Accepted: 07/21/2022] [Indexed: 12/18/2022] Open
Abstract
The brain integrates volition, cognition, and consciousness seamlessly over three hierarchical (scale-dependent) levels of neural activity for their emergence: a causal or 'hard' level, a computational (unconscious) or 'soft' level, and a phenomenal (conscious) or 'psyche' level respectively. The cognitive evolution theory (CET) is based on three general prerequisites: physicalism, dynamism, and emergentism, which entail five consequences about the nature of consciousness: discreteness, passivity, uniqueness, integrity, and graduation. CET starts from the assumption that brains should have primarily evolved as volitional subsystems of organisms, not as prediction machines. This emphasizes the dynamical nature of consciousness in terms of critical dynamics to account for metastability, avalanches, and self-organized criticality of brain processes, then coupling it with volition and cognition in a framework unified over the levels. Consciousness emerges near critical points, and unfolds as a discrete stream of momentary states, each volitionally driven from oldest subcortical arousal systems. The stream is the brain's way of making a difference via predictive (Bayesian) processing. Its objective observables could be complexity measures reflecting levels of consciousness and its dynamical coherency to reveal how much knowledge (information gain) the brain acquires over the stream. CET also proposes a quantitative classification of both disorders of consciousness and mental disorders within that unified framework.
Collapse
|
11
|
Parés-Pujolràs E, Matić K, Haggard P. Feeling ready: neural bases of prospective motor readiness judgements. Neurosci Conscious 2023; 2023:niad003. [PMID: 36908683 PMCID: PMC9994593 DOI: 10.1093/nc/niad003] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/12/2022] [Revised: 11/12/2022] [Accepted: 02/02/2023] [Indexed: 03/14/2023] Open
Abstract
The idea that human agents voluntarily control their actions, including their spontaneous movements, strongly implies an anticipatory awareness of action. That is, agents should be aware they are about to act before actually executing a movement. Previous research has identified neural signals that could underpin prospective conscious access to motor preparation, including the readiness potential and the beta-band event-related desynchronization. In this study, we ran two experiments to test whether these two neural precursors of action also tracka subjective feeling of readiness. In Experiment 1, we combined a self-paced action task with an intention-probing design where participants gave binary responses to indicate whether they felt they had been about to move when a probe was presented. In Experiment 2, participants reported their feeling of readiness on a graded scale. We found that the feeling of readiness reliably correlates with the beta-band amplitude, but not with the readiness potential.
Collapse
Affiliation(s)
- Elisabeth Parés-Pujolràs
- Institute of Cognitive Neuroscience, University College London, 17 Queen Square, London WC1N 3AZ, UK.,School of Electrical and Electronic Engineering, University College Dublin, Dublin 4, Ireland.,Department of Biomedical Engineering, City College of the City University of New York, New York, NY 10031, USA
| | - Karla Matić
- Max Planck School of Cognition, Max Planck Institute for Human Cognitive and Brain Sciences, Leipzig 304103, Germany.,Bernstein Center for Computational Neuroscience, Charité-Universitäts medizin Berlin, Corporate Member of Freie Universität Berlin, Humboldt-Universität zu Berlin, Berlin 10117, Germany.,Department of Psychology, Humboldt Universität zu Berlin, Berlin 12489, Germany
| | - Patrick Haggard
- Institute of Cognitive Neuroscience, University College London, 17 Queen Square, London WC1N 3AZ, UK.,Max Planck School of Cognition, Max Planck Institute for Human Cognitive and Brain Sciences, Leipzig 304103, Germany
| |
Collapse
|
12
|
Beta rhythmicity in human motor cortex reflects neural population coupling that modulates subsequent finger coordination stability. Commun Biol 2022; 5:1375. [PMID: 36522455 PMCID: PMC9755311 DOI: 10.1038/s42003-022-04326-4] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/21/2022] [Accepted: 11/30/2022] [Indexed: 12/23/2022] Open
Abstract
Human behavior is not performed completely as desired, but is influenced by the inherent rhythmicity of the brain. Here we show that anti-phase bimanual coordination stability is regulated by the dynamics of pre-movement neural oscillations in bi-hemispheric primary motor cortices (M1) and supplementary motor area (SMA). In experiment 1, pre-movement bi-hemispheric M1 phase synchrony in beta-band (M1-M1 phase synchrony) was online estimated from 129-channel scalp electroencephalograms. Anti-phase bimanual tapping preceded by lower M1-M1 phase synchrony exhibited significantly longer duration than tapping preceded by higher M1-M1 phase synchrony. Further, the inter-individual variability of duration was explained by the interaction of pre-movement activities within the motor network; lower M1-M1 phase synchrony and spectral power at SMA were associated with longer duration. The necessity of cortical interaction for anti-phase maintenance was revealed by sham-controlled repetitive transcranial magnetic stimulation over SMA in another experiment. Our results demonstrate that pre-movement cortical oscillatory coupling within the motor network unknowingly influences bimanual coordination performance in humans after consolidation, suggesting the feasibility of augmenting human motor ability by covertly monitoring preparatory neural dynamics.
Collapse
|
13
|
Park HD, Piton T, Kannape OA, Duncan NW, Lee KY, Lane TJ, Blanke O. Breathing is coupled with voluntary initiation of mental imagery. Neuroimage 2022; 264:119685. [PMID: 36252914 DOI: 10.1016/j.neuroimage.2022.119685] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/02/2022] [Revised: 10/03/2022] [Accepted: 10/13/2022] [Indexed: 11/09/2022] Open
Abstract
Previous research has suggested that bodily signals from internal organs are associated with diverse cortical and subcortical processes involved in sensory-motor functions, beyond homeostatic reflexes. For instance, a recent study demonstrated that the preparation and execution of voluntary actions, as well as its underlying neural activity, are coupled with the breathing cycle. In the current study, we investigated whether such breathing-action coupling is limited to voluntary motor action or whether it is also present for mental actions not involving any overt bodily movement. To answer this question, we recorded electroencephalography (EEG), electromyography (EMG), and respiratory signals while participants were conducting a voluntary action paradigm including self-initiated motor execution (ME), motor imagery (MI), and visual imagery (VI) tasks. We observed that the voluntary initiation of ME, MI, and VI are similarly coupled with the respiration phase. In addition, EEG analysis revealed the existence of readiness potential (RP) waveforms in all three tasks (i.e., ME, MI, VI), as well as a coupling between the RP amplitude and the respiratory phase. Our findings show that the voluntary initiation of both imagined and overt action is coupled with respiration, and further suggest that the breathing system is involved in preparatory processes of voluntary action by contributing to the temporal decision of when to initiate the action plan, regardless of whether this culminates in overt movements.
Collapse
Affiliation(s)
- Hyeong-Dong Park
- Graduate Institute of Mind, Brain and Consciousness, Taipei Medical University, Taipei, Taiwan; Brain and Consciousness Research Centre, Shuang-Ho Hospital, New Taipei City, Taiwan.
| | - Timothy Piton
- Laboratory of Cognitive Neuroscience, Neuro-X Institute and Brain Mind Institute, Swiss Federal Institute of Technology (EPFL), Geneva, Switzerland
| | - Oliver A Kannape
- Laboratory of Cognitive Neuroscience, Neuro-X Institute and Brain Mind Institute, Swiss Federal Institute of Technology (EPFL), Geneva, Switzerland
| | - Niall W Duncan
- Graduate Institute of Mind, Brain and Consciousness, Taipei Medical University, Taipei, Taiwan; Brain and Consciousness Research Centre, Shuang-Ho Hospital, New Taipei City, Taiwan
| | - Kang-Yun Lee
- Division of Pulmonary Medicine, Department of Internal Medicine, Shuang Ho Hospital, Taipei Medical University, New Taipei City, Taiwan
| | - Timothy J Lane
- Graduate Institute of Mind, Brain and Consciousness, Taipei Medical University, Taipei, Taiwan; Brain and Consciousness Research Centre, Shuang-Ho Hospital, New Taipei City, Taiwan; Institute of European and American Studies, Academia Sinica, Taipei, Taiwan
| | - Olaf Blanke
- Laboratory of Cognitive Neuroscience, Neuro-X Institute and Brain Mind Institute, Swiss Federal Institute of Technology (EPFL), Geneva, Switzerland; Department of Clinical Neurosciences, University of Geneva, Geneva, Switzerland
| |
Collapse
|
14
|
Yurchenko SB. From the origins to the stream of consciousness and its neural correlates. Front Integr Neurosci 2022; 16:928978. [PMID: 36407293 PMCID: PMC9672924 DOI: 10.3389/fnint.2022.928978] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/26/2022] [Accepted: 10/12/2022] [Indexed: 09/22/2023] Open
Abstract
There are now dozens of very different theories of consciousness, each somehow contributing to our understanding of its nature. The science of consciousness needs therefore not new theories but a general framework integrating insights from those, yet not making it a still-born "Frankenstein" theory. First, the framework must operate explicitly on the stream of consciousness, not on its static description. Second, this dynamical account must also be put on the evolutionary timeline to explain the origins of consciousness. The Cognitive Evolution Theory (CET), outlined here, proposes such a framework. This starts with the assumption that brains have primarily evolved as volitional subsystems of organisms, inherited from primitive (fast and random) reflexes of simplest neural networks, only then resembling error-minimizing prediction machines. CET adopts the tools of critical dynamics to account for metastability, scale-free avalanches, and self-organization which are all intrinsic to brain dynamics. This formalizes the stream of consciousness as a discrete (transitive, irreflexive) chain of momentary states derived from critical brain dynamics at points of phase transitions and mapped then onto a state space as neural correlates of a particular conscious state. The continuous/discrete dichotomy appears naturally between the brain dynamics at the causal level and conscious states at the phenomenal level, each volitionally triggered from arousal centers of the brainstem and cognitively modulated by thalamocortical systems. Their objective observables can be entropy-based complexity measures, reflecting the transient level or quantity of consciousness at that moment.
Collapse
|
15
|
Cornelio P, Haggard P, Hornbaek K, Georgiou O, Bergström J, Subramanian S, Obrist M. The sense of agency in emerging technologies for human–computer integration: A review. Front Neurosci 2022; 16:949138. [PMID: 36172040 PMCID: PMC9511170 DOI: 10.3389/fnins.2022.949138] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/20/2022] [Accepted: 08/05/2022] [Indexed: 11/13/2022] Open
Abstract
Human–computer integration is an emerging area in which the boundary between humans and technology is blurred as users and computers work collaboratively and share agency to execute tasks. The sense of agency (SoA) is an experience that arises by a combination of a voluntary motor action and sensory evidence whether the corresponding body movements have somehow influenced the course of external events. The SoA is not only a key part of our experiences in daily life but also in our interaction with technology as it gives us the feeling of “I did that” as opposed to “the system did that,” thus supporting a feeling of being in control. This feeling becomes critical with human–computer integration, wherein emerging technology directly influences people’s body, their actions, and the resulting outcomes. In this review, we analyse and classify current integration technologies based on what we currently know about agency in the literature, and propose a distinction between body augmentation, action augmentation, and outcome augmentation. For each category, we describe agency considerations and markers of differentiation that illustrate a relationship between assistance level (low, high), agency delegation (human, technology), and integration type (fusion, symbiosis). We conclude with a reflection on the opportunities and challenges of integrating humans with computers, and finalise with an expanded definition of human–computer integration including agency aspects which we consider to be particularly relevant. The aim this review is to provide researchers and practitioners with guidelines to situate their work within the integration research agenda and consider the implications of any technologies on SoA, and thus overall user experience when designing future technology.
Collapse
Affiliation(s)
- Patricia Cornelio
- Ultraleap Ltd., Bristol, United Kingdom
- Department of Computer Science, University College London, London, United Kingdom
- *Correspondence: Patricia Cornelio,
| | - Patrick Haggard
- Department of Computer Science, University College London, London, United Kingdom
| | - Kasper Hornbaek
- Department of Computer Science, University of Copenhagen, Copenhagen, Denmark
| | | | - Joanna Bergström
- Department of Computer Science, University of Copenhagen, Copenhagen, Denmark
| | - Sriram Subramanian
- Department of Computer Science, University College London, London, United Kingdom
| | - Marianna Obrist
- Department of Computer Science, University College London, London, United Kingdom
| |
Collapse
|
16
|
Niso G, Krol LR, Combrisson E, Dubarry AS, Elliott MA, François C, Héjja-Brichard Y, Herbst SK, Jerbi K, Kovic V, Lehongre K, Luck SJ, Mercier M, Mosher JC, Pavlov YG, Puce A, Schettino A, Schön D, Sinnott-Armstrong W, Somon B, Šoškić A, Styles SJ, Tibon R, Vilas MG, van Vliet M, Chaumon M. Good scientific practice in EEG and MEG research: Progress and perspectives. Neuroimage 2022; 257:119056. [PMID: 35283287 PMCID: PMC11236277 DOI: 10.1016/j.neuroimage.2022.119056] [Citation(s) in RCA: 8] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/28/2021] [Revised: 02/25/2022] [Accepted: 03/01/2022] [Indexed: 11/22/2022] Open
Abstract
Good scientific practice (GSP) refers to both explicit and implicit rules, recommendations, and guidelines that help scientists to produce work that is of the highest quality at any given time, and to efficiently share that work with the community for further scrutiny or utilization. For experimental research using magneto- and electroencephalography (MEEG), GSP includes specific standards and guidelines for technical competence, which are periodically updated and adapted to new findings. However, GSP also needs to be regularly revisited in a broader light. At the LiveMEEG 2020 conference, a reflection on GSP was fostered that included explicitly documented guidelines and technical advances, but also emphasized intangible GSP: a general awareness of personal, organizational, and societal realities and how they can influence MEEG research. This article provides an extensive report on most of the LiveMEEG contributions and new literature, with the additional aim to synthesize ongoing cultural changes in GSP. It first covers GSP with respect to cognitive biases and logical fallacies, pre-registration as a tool to avoid those and other early pitfalls, and a number of resources to enable collaborative and reproducible research as a general approach to minimize misconceptions. Second, it covers GSP with respect to data acquisition, analysis, reporting, and sharing, including new tools and frameworks to support collaborative work. Finally, GSP is considered in light of ethical implications of MEEG research and the resulting responsibility that scientists have to engage with societal challenges. Considering among other things the benefits of peer review and open access at all stages, the need to coordinate larger international projects, the complexity of MEEG subject matter, and today's prioritization of fairness, privacy, and the environment, we find that current GSP tends to favor collective and cooperative work, for both scientific and for societal reasons.
Collapse
Affiliation(s)
- Guiomar Niso
- Psychological & Brain Sciences, Indiana University, Bloomington, IN, USA; Universidad Politecnica de Madrid and CIBER-BBN, Madrid, Spain
| | - Laurens R Krol
- Neuroadaptive Human-Computer Interaction, Brandenburg University of Technology Cottbus-Senftenberg, Germany
| | - Etienne Combrisson
- Aix-Marseille University, Institut de Neurosciences de la Timone, France
| | | | | | | | - Yseult Héjja-Brichard
- Centre d'Ecologie Fonctionnelle et Evolutive, CNRS, EPHE, IRD, Université Montpellier, Montpellier, France
| | - Sophie K Herbst
- Cognitive Neuroimaging Unit, INSERM, CEA, CNRS, NeuroSpin center, Université Paris-Saclay, Gif/Yvette, France
| | - Karim Jerbi
- Cognitive and Computational Neuroscience Laboratory, Department of Psychology, University of Montreal, Montreal, QC, Canada; Mila - Quebec Artificial Intelligence Institute, Canada
| | - Vanja Kovic
- Faculty of Philosophy, Laboratory for neurocognition and applied cognition, University of Belgrade, Serbia
| | - Katia Lehongre
- Institut du Cerveau - Paris Brain Institute - ICM, Inserm U 1127, CNRS UMR 7225, APHP, Hôpital de la Pitié Salpêtrière, Sorbonne Université, Centre MEG-EEG, Centre de NeuroImagerie Recherche (CENIR), Paris, France
| | - Steven J Luck
- Center for Mind & Brain, University of California, Davis, CA, USA
| | - Manuel Mercier
- Aix Marseille Univ, Inserm, INS, Inst Neurosci Syst, Marseille, France
| | - John C Mosher
- McGovern Medical School, University of Texas Health Science Center at Houston, Houston, TX, USA
| | - Yuri G Pavlov
- University of Tuebingen, Germany; Ural Federal University, Yekaterinburg, Russia
| | - Aina Puce
- Psychological & Brain Sciences, Indiana University, Bloomington, IN, USA
| | - Antonio Schettino
- Erasmus University Rotterdam, Rotterdam, the Netherland; Institute for Globally Distributed Open Research and Education (IGDORE), Sweden
| | - Daniele Schön
- Aix Marseille Univ, Inserm, INS, Inst Neurosci Syst, Marseille, France
| | | | | | - Anđela Šoškić
- Faculty of Philosophy, Laboratory for neurocognition and applied cognition, University of Belgrade, Serbia; Teacher Education Faculty, University of Belgrade, Serbia
| | - Suzy J Styles
- Psychology, Nanyang Technological University, Singapore; Singapore Institute for Clinical Sciences, A*STAR, Singapore
| | - Roni Tibon
- MRC Cognition and Brain Sciences Unit, University of Cambridge, Cambridge, UK; School of Psychology, University of Nottingham, Nottingham, UK
| | - Martina G Vilas
- Ernst Strüngmann Institute for Neuroscience, Frankfurt am Main, Germany
| | | | - Maximilien Chaumon
- Institut du Cerveau - Paris Brain Institute - ICM, Inserm U 1127, CNRS UMR 7225, APHP, Hôpital de la Pitié Salpêtrière, Sorbonne Université, Centre MEG-EEG, Centre de NeuroImagerie Recherche (CENIR), Paris, France..
| |
Collapse
|
17
|
Liljenström H. Consciousness, decision making, and volition: freedom beyond chance and necessity. Theory Biosci 2022; 141:125-140. [PMID: 34046848 PMCID: PMC9184456 DOI: 10.1007/s12064-021-00346-6] [Citation(s) in RCA: 6] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/25/2020] [Accepted: 05/04/2021] [Indexed: 12/01/2022]
Abstract
What is the role of consciousness in volition and decision-making? Are our actions fully determined by brain activity preceding our decisions to act, or can consciousness instead affect the brain activity leading to action? This has been much debated in philosophy, but also in science since the famous experiments by Libet in the 1980s, where the current most common interpretation is that conscious free will is an illusion. It seems that the brain knows, up to several seconds in advance what "you" decide to do. These studies have, however, been criticized, and alternative interpretations of the experiments can be given, some of which are discussed in this paper. In an attempt to elucidate the processes involved in decision-making (DM), as an essential part of volition, we have developed a computational model of relevant brain structures and their neurodynamics. While DM is a complex process, we have particularly focused on the amygdala and orbitofrontal cortex (OFC) for its emotional, and the lateral prefrontal cortex (LPFC) for its cognitive aspects. In this paper, we present a stochastic population model representing the neural information processing of DM. Simulation results seem to confirm the notion that if decisions have to be made fast, emotional processes and aspects dominate, while rational processes are more time consuming and may result in a delayed decision. Finally, some limitations of current science and computational modeling will be discussed, hinting at a future development of science, where consciousness and free will may add to chance and necessity as explanation for what happens in the world.
Collapse
Affiliation(s)
- Hans Liljenström
- Agora for Biosystems, SLU, P.O. Box 7032, SE-75007, Uppsala, Sweden.
| |
Collapse
|
18
|
Zabcikova M, Koudelkova Z, Jasek R, Navarro JJL. Recent Advances and Current Trends in Brain-Computer Interface (BCI) Research and Their Applications. Int J Dev Neurosci 2021; 82:107-123. [PMID: 34939217 DOI: 10.1002/jdn.10166] [Citation(s) in RCA: 10] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/26/2021] [Revised: 11/16/2021] [Accepted: 12/18/2021] [Indexed: 11/06/2022] Open
Abstract
Brain-Computer Interface (BCI) provides direct communication between the brain and an external device. BCI systems have become a trendy field of research in recent years. These systems can be used in a variety of applications to help both disabled and healthy people. Concerning significant BCI progress, we may assume that these systems are not very far from real-world applications. This review has taken into account current trends in BCI research. In this survey, one hundred most cited articles from the WOS database were selected over the last four years. This survey is divided into several sectors. These sectors are Medicine, Communication and Control, Entertainment, and Other BCI applications. The application area, recording method, signal acquisition types, and countries of origin have been identified in each article. This survey provides an overview of the BCI articles published from 2016 to 2020 and their current trends and advances in different application areas.
Collapse
Affiliation(s)
- Martina Zabcikova
- Department of Informatics and Artificial Intelligence, Faculty of Applied Informatics, Tomas Bata University in Zlin, Zlin, Czech Republic
| | - Zuzana Koudelkova
- Department of Informatics and Artificial Intelligence, Faculty of Applied Informatics, Tomas Bata University in Zlin, Zlin, Czech Republic
| | - Roman Jasek
- Department of Informatics and Artificial Intelligence, Faculty of Applied Informatics, Tomas Bata University in Zlin, Zlin, Czech Republic
| | - José Javier Lorenzo Navarro
- Departamento de Informática y Sistemas, Instituto Universitario de Sistemas Inteligentes y Aplicaciones Numéricas en Ingeniería, Universidad de Las Palmas de Gran Canaria, Las Palmas de Gran Canaria, Spain
| |
Collapse
|
19
|
Rothwell J, Antal A, Burke D, Carlsen A, Georgiev D, Jahanshahi M, Sternad D, Valls-Solé J, Ziemann U. Central nervous system physiology. Clin Neurophysiol 2021; 132:3043-3083. [PMID: 34717225 PMCID: PMC8863401 DOI: 10.1016/j.clinph.2021.09.013] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/16/2021] [Revised: 09/13/2021] [Accepted: 09/20/2021] [Indexed: 12/15/2022]
Abstract
This is the second chapter of the series on the use of clinical neurophysiology for the study of movement disorders. It focusses on methods that can be used to probe neural circuits in brain and spinal cord. These include use of spinal and supraspinal reflexes to probe the integrity of transmission in specific pathways; transcranial methods of brain stimulation such as transcranial magnetic stimulation and transcranial direct current stimulation, which activate or modulate (respectively) the activity of populations of central neurones; EEG methods, both in conjunction with brain stimulation or with behavioural measures that record the activity of populations of central neurones; and pure behavioural measures that allow us to build conceptual models of motor control. The methods are discussed mainly in relation to work on healthy individuals. Later chapters will focus specifically on changes caused by pathology.
Collapse
Affiliation(s)
- John Rothwell
- Department of Clinical and Movement Neuroscience, UCL Queen Square Institute of Neurology, London, UK,Corresponding author at: Department of Clinical and Movement Neuroscience, UCL Queen Square Institute of Neurology, London WC1N 3BG, UK, (J. Rothwell)
| | - Andrea Antal
- Department of Neurology, University Medical Center Göttingen, Germany
| | - David Burke
- Department of Neurology, Royal Prince Alfred Hospital, University of Sydney, Sydney 2050, Australia
| | - Antony Carlsen
- School of Human Kinetics, University of Ottawa, Ottawa, Canada
| | - Dejan Georgiev
- Department of Neurology, University Medical Centre Ljubljana, Slovenia
| | - Marjan Jahanshahi
- Department of Clinical and Movement Neuroscience, UCL Queen Square Institute of Neurology, London, UK
| | - Dagmar Sternad
- Departments of Biology, Electrical & Computer Engineering, and Physics, Northeastern University, Boston, MA 02115, USA
| | - Josep Valls-Solé
- Institut d’Investigació Biomèdica August Pi I Sunyer, Villarroel, 170, Barcelona, Spain
| | - Ulf Ziemann
- Department of Neurology and Stroke, and Hertie Institute for Clinical Brain Research, Eberhard Karls University, Tübingen, Germany
| |
Collapse
|
20
|
McDermott EJ, Metsomaa J, Belardinelli P, Grosse-Wentrup M, Ziemann U, Zrenner C. Predicting motor behavior: an efficient EEG signal processing pipeline to detect brain states with potential therapeutic relevance for VR-based neurorehabilitation. VIRTUAL REALITY 2021; 27:347-369. [PMID: 36915631 PMCID: PMC9998326 DOI: 10.1007/s10055-021-00538-x] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 06/09/2020] [Accepted: 05/07/2021] [Indexed: 06/18/2023]
Abstract
Virtual reality (VR)-based motor therapy is an emerging approach in neurorehabilitation. The combination of VR with electroencephalography (EEG) presents further opportunities to improve therapeutic efficacy by personalizing the paradigm. Specifically, the idea is to synchronize the choice and timing of stimuli in the perceived virtual world with fluctuating brain states relevant to motor behavior. Here, we present an open source EEG single-trial based classification pipeline that is designed to identify ongoing brain states predictive of the planning and execution of movements. 9 healthy volunteers each performed 1080 trials of a repetitive reaching task with an implicit two-alternative forced choice, i.e., use of the right or left hand, in response to the appearance of a visual target. The performance of the EEG decoding pipeline was assessed with respect to classification accuracy of right vs. left arm use, based on the EEG signal at the time of the stimulus. Different features, feature extraction methods, and classifiers were compared at different time windows; the number and location of informative EEG channels and the number of calibration trials needed were also quantified, as well as any benefits from individual-level optimization of pipeline parameters. This resulted in a set of recommended parameters that achieved an average 83.3% correct prediction on never-before-seen testing data, and a state-of-the-art 77.1% in a real-time simulation. Neurophysiological plausibility of the resulting classifiers was assessed by time-frequency and event-related potential analyses, as well as by Independent Component Analysis topographies and cortical source localization. We expect that this pipeline will facilitate the identification of relevant brain states as prospective therapeutic targets in closed-loop EEG-VR motor neurorehabilitation.
Collapse
Affiliation(s)
- Eric J. McDermott
- Department of Neurology and Stroke, and Hertie Institute for Clinical Brain Research, Eberhard Karls University Tübingen, Hoppe-Seyler-Straße 3, 72076 Tübingen, Germany
- Hertie Institute for Clinical Brain Research, Eberhard Karls University, Tübingen, Germany
- International Max Planck Research School, and Graduate Training Center of Neuroscience, Tübingen, Germany
| | - Johanna Metsomaa
- Department of Neurology and Stroke, and Hertie Institute for Clinical Brain Research, Eberhard Karls University Tübingen, Hoppe-Seyler-Straße 3, 72076 Tübingen, Germany
- Hertie Institute for Clinical Brain Research, Eberhard Karls University, Tübingen, Germany
| | - Paolo Belardinelli
- Department of Neurology and Stroke, and Hertie Institute for Clinical Brain Research, Eberhard Karls University Tübingen, Hoppe-Seyler-Straße 3, 72076 Tübingen, Germany
- Hertie Institute for Clinical Brain Research, Eberhard Karls University, Tübingen, Germany
- CIMeC, Center for Mind/Brain Sciences, University of Trento, Trento, Italy
| | - Moritz Grosse-Wentrup
- Faculty of Computer Science, Research Platform Data Science and Vienna Cognitive Science Hub, University of Vienna, Vienna, Austria
| | - Ulf Ziemann
- Department of Neurology and Stroke, and Hertie Institute for Clinical Brain Research, Eberhard Karls University Tübingen, Hoppe-Seyler-Straße 3, 72076 Tübingen, Germany
- Hertie Institute for Clinical Brain Research, Eberhard Karls University, Tübingen, Germany
| | - Christoph Zrenner
- Department of Neurology and Stroke, and Hertie Institute for Clinical Brain Research, Eberhard Karls University Tübingen, Hoppe-Seyler-Straße 3, 72076 Tübingen, Germany
- Hertie Institute for Clinical Brain Research, Eberhard Karls University, Tübingen, Germany
| |
Collapse
|
21
|
Lashgari E, Ott J, Connelly A, Baldi P, Maoz U. An end-to-end CNN with attentional mechanism applied to raw EEG in a BCI classification task. J Neural Eng 2021; 18. [PMID: 34352734 DOI: 10.1088/1741-2552/ac1ade] [Citation(s) in RCA: 10] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/04/2021] [Accepted: 08/05/2021] [Indexed: 11/12/2022]
Abstract
Objective.Motor-imagery (MI) classification base on electroencephalography (EEG) has been long studied in neuroscience and more recently widely used in healthcare applications such as mobile assistive robots and neurorehabilitation. In particular, EEG-based MI classification methods that rely on convolutional neural networks (CNNs) have achieved relatively high classification accuracy. However, naively training CNNs to classify raw EEG data from all channels, especially for high-density EEG, is computationally demanding and requires huge training sets. It often also introduces many irrelevant input features, making it difficult for the CNN to extract the informative ones. This problem is compounded by a dearth of training data, which is particularly acute for MI tasks, because these are cognitively demanding and thus fatigue inducing.Approach.To address these issues, we proposed an end-to-end CNN-based neural network with attentional mechanism together with different data augmentation (DA) techniques. We tested it on two benchmark MI datasets, brain-computer interface (BCI) competition IV 2a and 2b. In addition, we collected a new dataset, recorded using high-density EEG, and containing both MI and motor execution (ME) tasks, which we share with the community.Main results.Our proposed neural-network architecture outperformed all state-of-the-art methods that we found in the literature, with and without DA, reaching an average classification accuracy of 93.6% and 87.83% on BCI 2a and 2b, respectively. We also directly compare decoding of MI and ME tasks. Focusing on MI classification, we find optimal channel configurations and the best DA techniques as well as investigate combining data across participants and the role of transfer learning.Significance.Our proposed approach improves the classification accuracy for MI in the benchmark datasets. In addition, collecting our own dataset enables us to compare MI and ME and investigate various aspects of EEG decoding critical for neuroscience and BCI.
Collapse
Affiliation(s)
- Elnaz Lashgari
- Schmid College of Science and Technology, Chapman University, Orange, CA, United States of America.,Institute for Interdisciplinary Brain and Behavioral Sciences, Chapman University, Orange, CA, United States of America
| | - Jordan Ott
- Department of Computer Science, University of California, Irvine, CA, United States of America
| | - Akima Connelly
- Schmid College of Science and Technology, Chapman University, Orange, CA, United States of America.,Institute for Interdisciplinary Brain and Behavioral Sciences, Chapman University, Orange, CA, United States of America
| | - Pierre Baldi
- Department of Computer Science, University of California, Irvine, CA, United States of America.,Center for Machine Learning and Intelligent Systems, University of California Irvine, Irvine, CA, United States of America.,Institute for Genomics and Bioinformatics, University of California Irvine, Irvine, CA, United States of America
| | - Uri Maoz
- Schmid College of Science and Technology, Chapman University, Orange, CA, United States of America.,Institute for Interdisciplinary Brain and Behavioral Sciences, Chapman University, Orange, CA, United States of America.,Computational Neuroscience and Psychology, Crean College of Health and Behavioral Sciences, Chapman University, Orange, CA, United States of America.,Fowler School of Engineering, Chapman University, Orange, CA, United States of America.,Anderson School of Management, University of California Los Angeles, Los Angeles, CA, United States of America.,Biology and Bioengineering, California Institute of Technology, Pasadena, CA, United States of America
| |
Collapse
|
22
|
Neafsey EJ. Conscious intention and human action: Review of the rise and fall of the readiness potential and Libet's clock. Conscious Cogn 2021; 94:103171. [PMID: 34325185 DOI: 10.1016/j.concog.2021.103171] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/20/2021] [Revised: 06/26/2021] [Accepted: 07/04/2021] [Indexed: 11/15/2022]
Abstract
Is consciousness-the subjective awareness of the sensations, perceptions, beliefs, desires, and intentions of mental life-a genuine cause of human action or a mere impotent epiphenomenon accompanying the brain's physical activity but utterly incapable of making anything actually happen? This article will review the history and current status of experiments and commentary related to Libet's influential paper (Brain 106:623-664, 1983) whose conclusion "that cerebral initiation even of a spontaneous voluntary act …can and usually does begin unconsciously" has had a huge effect on debate about the efficacy of conscious intentions. Early (up to 2008) and more recent (2008 on) experiments replicating and criticizing Libet's conclusions and especially his methods will be discussed, focusing especially on recent observations that the readiness potential (RP) may only be an "artifact of averaging" and that, when intention is measured using "tone probes," the onset of intention is found much earlier and often before the onset of the RP. Based on these findings, Libet's methodology was flawed and his results are no longer valid reasons for rejecting Fodor's "good old commonsense belief/desire psychology" that "my wanting is causally responsible for my reaching.".
Collapse
Affiliation(s)
- Edward J Neafsey
- Loyola University Chicago Stritch School of Medicine, Department of Molecular Pharmacology and Neuroscience, 2160 S. First Ave., Maywood, IL 60153, United States.
| |
Collapse
|
23
|
Nann M, Haslacher D, Colucci A, Eskofier B, von Tscharner V, Soekadar SR. Heart rate variability predicts decline in sensorimotor rhythm control. J Neural Eng 2021; 18. [PMID: 34229308 DOI: 10.1088/1741-2552/ac1177] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/23/2020] [Accepted: 07/06/2021] [Indexed: 11/11/2022]
Abstract
Objective.Voluntary control of sensorimotor rhythms (SMRs, 8-12 Hz) can be used for brain-computer interface (BCI)-based operation of an assistive hand exoskeleton, e.g. in finger paralysis after stroke. To gain SMR control, stroke survivors are usually instructed to engage in motor imagery (MI) or to attempt moving the paralyzed fingers resulting in task- or event-related desynchronization (ERD) of SMR (SMR-ERD). However, as these tasks are cognitively demanding, especially for stroke survivors suffering from cognitive impairments, BCI control performance can deteriorate considerably over time. Therefore, it would be important to identify biomarkers that predict decline in BCI control performance within an ongoing session in order to optimize the man-machine interaction scheme.Approach.Here we determine the link between BCI control performance over time and heart rate variability (HRV). Specifically, we investigated whether HRV can be used as a biomarker to predict decline of SMR-ERD control across 17 healthy participants using Granger causality. SMR-ERD was visually displayed on a screen. Participants were instructed to engage in MI-based SMR-ERD control over two consecutive runs of 8.5 min each. During the 2nd run, task difficulty was gradually increased.Main results.While control performance (p= .18) and HRV (p= .16) remained unchanged across participants during the 1st run, during the 2nd run, both measures declined over time at high correlation (performance: -0.61%/10 s,p= 0; HRV: -0.007 ms/10 s,p< .001). We found that HRV exhibited predictive characteristics with regard to within-session BCI control performance on an individual participant level (p< .001).Significance.These results suggest that HRV can predict decline in BCI performance paving the way for adaptive BCI control paradigms, e.g. to individualize and optimize assistive BCI systems in stroke.
Collapse
Affiliation(s)
- Marius Nann
- Applied Neurotechnology Lab, Department of Psychiatry and Psychotherapy, University Hospital of Tübingen, Tübingen, Germany.,Clinical Neurotechnology Lab, Neuroscience Research Center (NWFZ), Department of Psychiatry and Psychotherapy, Charité - University Medicine Berlin, Berlin, Germany
| | - David Haslacher
- Clinical Neurotechnology Lab, Neuroscience Research Center (NWFZ), Department of Psychiatry and Psychotherapy, Charité - University Medicine Berlin, Berlin, Germany
| | - Annalisa Colucci
- Clinical Neurotechnology Lab, Neuroscience Research Center (NWFZ), Department of Psychiatry and Psychotherapy, Charité - University Medicine Berlin, Berlin, Germany
| | - Bjoern Eskofier
- Machine Learning and Data Analytics Lab, Department of Computer Science, Friedrich-Alexander University Erlangen-Nürnberg (FAU), Erlangen, Germany
| | | | - Surjo R Soekadar
- Clinical Neurotechnology Lab, Neuroscience Research Center (NWFZ), Department of Psychiatry and Psychotherapy, Charité - University Medicine Berlin, Berlin, Germany
| |
Collapse
|
24
|
Pereira J, Kobler R, Ofner P, Schwarz A, Müller-Putz GR. Online detection of movement during natural and self-initiated reach-and-grasp actions from EEG signals. J Neural Eng 2021; 18. [PMID: 34130267 DOI: 10.1088/1741-2552/ac0b52] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/15/2021] [Accepted: 06/15/2021] [Indexed: 11/11/2022]
Abstract
Movement intention detection using electroencephalography (EEG) is a challenging but essential component of brain-computer interfaces (BCIs) for people with motor disabilities.Objective.The goal of this study is to develop a new experimental paradigm to perform asynchronous online detection of movement based on low-frequency time-domain EEG features, concretely on movement-related cortical potentials. The paradigm must be easily transferable to people without any residual upper-limb movement function and the BCI must be independent of upper-limb movement onset measurements and external cues.Approach. In a study with non-disabled participants, we evaluated a novel BCI paradigm to detect self-initiated reach-and-grasp movements. Two experimental conditions were involved. In one condition, participants performed reach-and-grasp movements to a target and simultaneously shifted their gaze towards it. In a control condition, participants solely shifted their gaze towards the target (oculomotor task). The participants freely decided when to initiate the tasks. After eye artefact correction, the EEG signals were time-locked to the saccade onset and the resulting amplitude features were exploited on a hierarchical classification approach to detect movement asynchronously.Main results. With regards to BCI performance, 54.1% (14.4% SD) of the movements were correctly identified, and all participants achieved a performance above chance-level (around 12%). An average of 21.5% (14.1% SD) of the oculomotor tasks were falsely detected as upper-limb movement. In an additional rest condition, 1.7 (1.6 SD) false positives per minute were measured. Through source imaging, movement information was mapped to sensorimotor, posterior parietal and occipital areas.Significance. We present a novel approach for movement detection using EEG signals which does not rely on upper-limb movement onset measurements or on the presentation of external cues. The participants' behaviour closely matches the natural behaviour during goal-directed reach-and-grasp movements, which also constitutes an advantage with respect to current BCI protocols.
Collapse
Affiliation(s)
- Joana Pereira
- Institute of Neural Engineering, Graz University of Technology, Graz, Austria
| | - Reinmar Kobler
- Institute of Neural Engineering, Graz University of Technology, Graz, Austria
| | - Patrick Ofner
- Institute of Neural Engineering, Graz University of Technology, Graz, Austria
| | - Andreas Schwarz
- Institute of Neural Engineering, Graz University of Technology, Graz, Austria
| | | |
Collapse
|
25
|
LeBlanc AR. Joseph Delboeuf on time as the mechanism of free will. THEORY & PSYCHOLOGY 2021. [DOI: 10.1177/09593543211023143] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
Abstract
In the early 1880s, Joseph Delboeuf proposed a little-known but ingenious solution to the problem the law of the conservation of energy poses for free will. When energy is transferred between two bodies, the law of energy conservation requires that the energy before and after the transfer be the same, but it says nothing of the time it must take. If we could delay this transfer, Delboeuf proposed, we could alter the course of matter without compromising the conservation of energy. This article begins by tracing the early history of the conflict between free will and the first law of thermodynamics and by recounting some initial attempts to resolve it. It next describes Delboeuf’s theory and the arguments that were made against it, before situating it with respect to some recent developments in the philosophy and psychology of free will.
Collapse
|
26
|
Giovannelli F, Menichetti C, Kiferle L, Raglione LM, Brotini S, Vanni P, Bacci D, Baldini M, Borgheresi A, Del Bene A, Grassi E, Guidi L, Toscani L, Volpi G, Palumbo P, Viggiano MP, Cincotta M. Impulsivity traits and awareness of motor intention in Parkinson's disease: a proof-of-concept study. Neurol Sci 2021; 43:335-340. [PMID: 34050422 DOI: 10.1007/s10072-021-05325-9] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/09/2021] [Accepted: 05/15/2021] [Indexed: 11/30/2022]
Abstract
INTRODUCTION In patients with Parkinson's disease (PD), impulsivity is still a matter of investigation. It has been hypothesized that impulsive personality traits may favour impulse control disorder (ICD) onset during dopaminergic therapy. In healthy subjects, a relationship between the awareness of motor intention and impulsive personality traits assessed by the Barratt impulsivity scale (BIS-11) has been reported. The aim of this study was to evaluate the relationship between the awareness of voluntary action and impulsivity traits in PD. METHODS Twenty-eight PD patients (stages I-III on the Hoehn and Yahr scale) underwent an impulsivity trait assessment by the BIS-11 scale and a task based on the Libet's clock. Participants were requested to perform a self-initiated movement and report the time they first feel their intention to move (W-judgement) or the time of the actual movement (M-judgement). RESULTS In patients with higher BIS-11 scores, the time lag between the W-judgement and the actual movement was significantly lower than in patients with lower BIS-11. No difference emerged in the M-judgement. CONCLUSION Data suggest that also in PD patients, the impulsive personality trait is related to a "delayed" awareness of motor intention and therefore to a shorter interval to allow a conscious "veto" of the impending action. Characterization of the temporal profile of awareness of motor intention could prove useful in identifying PD patients at risk of developing ICDs during dopaminergic treatment.
Collapse
Affiliation(s)
- Fabio Giovannelli
- Section of Psychology - Department of Neuroscience, Psychology, Drug Research and Child's Health (NEUROFARBA), University of Florence, Florence, Italy.,Unit of Neurology of Florence, Cerebrovascular and Neurodegenerative Disease Area of the Department of Medical Specialties, Central Tuscany Local Health Authority, Florence, Italy
| | - Chiara Menichetti
- Unit of Neurology of Pistoia, Cerebrovascular and Neurodegenerative Disease Area of the Department of Medical Specialties, Central Tuscany Local Health Authority, Florence, Italy
| | - Lorenzo Kiferle
- Unit of Neurology of Prato, Cerebrovascular and Neurodegenerative Disease Area of the Department of Medical Specialties, Central Tuscany Local Health Authority, Florence, Italy
| | - Laura Maria Raglione
- Unit of Neurology of Florence, Cerebrovascular and Neurodegenerative Disease Area of the Department of Medical Specialties, Central Tuscany Local Health Authority, Florence, Italy
| | - Stefania Brotini
- Unit of Neurology of Empoli, Cerebrovascular and Neurodegenerative Disease Area of the Department of Medical Specialties, Central Tuscany Local Health Authority, Florence, Italy
| | - Paola Vanni
- Unit of Neurology of Florence-OSMA, Cerebrovascular and Neurodegenerative Disease Area of the Department of Medical Specialties, Central Tuscany Local Health Authority, Florence, Italy
| | - Duccio Bacci
- Unit of Neurology of Florence-OSMA, Cerebrovascular and Neurodegenerative Disease Area of the Department of Medical Specialties, Central Tuscany Local Health Authority, Florence, Italy
| | - Mariella Baldini
- Unit of Neurology of Empoli, Cerebrovascular and Neurodegenerative Disease Area of the Department of Medical Specialties, Central Tuscany Local Health Authority, Florence, Italy
| | - Alessandra Borgheresi
- Unit of Neurology of Florence, Cerebrovascular and Neurodegenerative Disease Area of the Department of Medical Specialties, Central Tuscany Local Health Authority, Florence, Italy
| | - Alessandra Del Bene
- Unit of Neurology of Pistoia, Cerebrovascular and Neurodegenerative Disease Area of the Department of Medical Specialties, Central Tuscany Local Health Authority, Florence, Italy
| | - Enrico Grassi
- Unit of Neurology of Prato, Cerebrovascular and Neurodegenerative Disease Area of the Department of Medical Specialties, Central Tuscany Local Health Authority, Florence, Italy
| | - Leonello Guidi
- Unit of Neurology of Empoli, Cerebrovascular and Neurodegenerative Disease Area of the Department of Medical Specialties, Central Tuscany Local Health Authority, Florence, Italy
| | - Lucia Toscani
- Unit of Neurology of Florence-OSMA, Cerebrovascular and Neurodegenerative Disease Area of the Department of Medical Specialties, Central Tuscany Local Health Authority, Florence, Italy
| | - Gino Volpi
- Unit of Neurology of Pistoia, Cerebrovascular and Neurodegenerative Disease Area of the Department of Medical Specialties, Central Tuscany Local Health Authority, Florence, Italy
| | - Pasquale Palumbo
- Unit of Neurology of Prato, Cerebrovascular and Neurodegenerative Disease Area of the Department of Medical Specialties, Central Tuscany Local Health Authority, Florence, Italy
| | - Maria Pia Viggiano
- Section of Psychology - Department of Neuroscience, Psychology, Drug Research and Child's Health (NEUROFARBA), University of Florence, Florence, Italy
| | - Massimo Cincotta
- Unit of Neurology of Florence, Cerebrovascular and Neurodegenerative Disease Area of the Department of Medical Specialties, Central Tuscany Local Health Authority, Florence, Italy.
| |
Collapse
|
27
|
Braun HA. Stochasticity Versus Determinacy in Neurobiology: From Ion Channels to the Question of the "Free Will". Front Syst Neurosci 2021; 15:629436. [PMID: 34122020 PMCID: PMC8190656 DOI: 10.3389/fnsys.2021.629436] [Citation(s) in RCA: 43] [Impact Index Per Article: 14.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/14/2020] [Accepted: 04/06/2021] [Indexed: 11/13/2022] Open
Abstract
If one accepts that decisions are made by the brain and that neuronal mechanisms obey deterministic physical laws, it is hard to deny what some brain researchers postulate, such as "We do not do what we want, but we want what we do" and "We should stop talking about freedom. Our actions are determined by physical laws." This point of view has been substantially supported by spectacular neurophysiological experiments demonstrating action-related brain activity (readiness potentials, blood oxygen level-dependent signals) occurring up to several seconds before an individual becomes aware of his/her decision to perform the action. This report aims to counter the deterministic argument for the absence of free will by using experimental data, supplemented by computer simulations, to demonstrate that biological systems, specifically brain functions, are built on principle randomness, which is introduced already at the lowest level of neuronal information processing, the opening and closing of ion channels. Switching between open and closed states follows physiological laws but also makes use of randomness, which is apparently introduced by Brownian motion - principally unavoidable under all life-compatible conditions. Ion-channel stochasticity, manifested as noise, function is not smoothed out toward higher functional levels but can even be amplified by appropriate adjustment of the system's non-linearities. Examples shall be given to illustrate how stochasticity can propagate from ion channels to single neuron action potentials to neuronal network dynamics to the interactions between different brain nuclei up to the control of autonomic functions. It is proposed that this intrinsic stochasticity helps to keep the brain in a flexible state to explore diverse alternatives as a prerequisite of free decision-making.
Collapse
Affiliation(s)
- Hans Albert Braun
- Neurodynamics Group, Institute of Physiology and Pathophysiology, Philipps University of Marburg, Marburg, Germany
| |
Collapse
|
28
|
Schurger A, Hu P'B, Pak J, Roskies AL. What Is the Readiness Potential? Trends Cogn Sci 2021; 25:558-570. [PMID: 33931306 PMCID: PMC8192467 DOI: 10.1016/j.tics.2021.04.001] [Citation(s) in RCA: 61] [Impact Index Per Article: 20.3] [Reference Citation Analysis] [Abstract] [Key Words] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/14/2021] [Revised: 03/29/2021] [Accepted: 04/01/2021] [Indexed: 12/14/2022]
Abstract
The readiness potential (RP), a slow buildup of electrical potential recorded at the scalp using electroencephalography, has been associated with neural activity involved in movement preparation. It became famous thanks to Benjamin Libet (Brain 1983;106:623-642), who used the time difference between the RP and self-reported time of conscious intention to move to argue that we lack free will. The RP's informativeness about self-generated action and derivatively about free will has prompted continued research on this neural phenomenon. Here, we argue that recent advances in our understanding of the RP, including computational modeling of the phenomenon, call for a reassessment of its relevance for understanding volition and the philosophical problem of free will.
Collapse
Affiliation(s)
- Aaron Schurger
- Department of Psychology, Crean College of Health and Behavioral Sciences, Chapman University, One University Drive, Orange, CA 92867, USA; Institute for Interdisciplinary Brain and Behavioral Sciences, Chapman University, 14725 Alton Parkway, Irvine, CA 92618, USA; INSERM, Cognitive Neuroimaging Unit, NeuroSpin Center, Gif sur Yvette 91191, France; Commissariat à l'Energie Atomique, Direction des Sciences du Vivant, I2BM, NeuroSpin Center, Gif sur Yvette 91191, France.
| | - Pengbo 'Ben' Hu
- Department of Linguistics and Cognitive Science, Pomona College, Claremont, CA 91711, USA
| | - Joanna Pak
- Institute for Interdisciplinary Brain and Behavioral Sciences, Chapman University, 14725 Alton Parkway, Irvine, CA 92618, USA
| | - Adina L Roskies
- Department of Philosophy and Program in Cognitive Science, Dartmouth College, Hanover, NH 03755, USA.
| |
Collapse
|
29
|
Rebouillat B, Leonetti JM, Kouider S. People confabulate with high confidence when their decisions are supported by weak internal variables. Neurosci Conscious 2021; 2021:niab004. [PMID: 33747547 PMCID: PMC7959213 DOI: 10.1093/nc/niab004] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/07/2020] [Revised: 02/01/2021] [Accepted: 02/05/2021] [Indexed: 11/17/2022] Open
Abstract
People can introspect on their internal state and report the reasons driving their decisions but choice blindness (CB) experiments suggest that this ability can sometimes be a retrospective illusion. Indeed, when presented with deceptive cues, people justify choices they did not make in the first place, suggesting that external cues largely contribute to introspective processes. Yet, it remains unclear what are the respective contributions of external cues and internal decision variables in forming introspective report. Here, using a brain–computer interface, we show that internal variables continue to be monitored but are less impactful than deceptive external cues during CB episodes. Moreover, we show that deceptive cues overturn the classical relationship between confidence and accuracy: introspective failures are associated with higher confidence than genuine introspective reports. We tracked back the origin of these overconfident confabulations by revealing their prominence when internal decision evidence is weak and variable. Thus, introspection is neither a direct reading of internal variables nor a mere retrospective illusion, but rather reflects the integration of internal decision evidence and external cues, with CB being a special instance where internal evidence is inconsistent.
Collapse
Affiliation(s)
- Benjamin Rebouillat
- Brain and Consciousness Group (ENS, CNRS), Département d'Études Cognitives, École Normale Supérieure-PSL Research University, 75005 Paris, France.,Ecole Doctorale Cerveau Cognition Comportement, ENS/ParisVI/ParisV, Paris 75005, France
| | - Jean Maurice Leonetti
- Brain and Consciousness Group (ENS, CNRS), Département d'Études Cognitives, École Normale Supérieure-PSL Research University, 75005 Paris, France.,Ecole Doctorale Cerveau Cognition Comportement, ENS/ParisVI/ParisV, Paris 75005, France
| | - Sid Kouider
- Brain and Consciousness Group (ENS, CNRS), Département d'Études Cognitives, École Normale Supérieure-PSL Research University, 75005 Paris, France
| |
Collapse
|
30
|
Suppress Me if You Can: Neurofeedback of the Readiness Potential. eNeuro 2021; 8:ENEURO.0425-20.2020. [PMID: 33568461 PMCID: PMC7986527 DOI: 10.1523/eneuro.0425-20.2020] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/22/2020] [Revised: 12/09/2020] [Accepted: 12/15/2020] [Indexed: 11/23/2022] Open
Abstract
Voluntary movements are usually preceded by a slow, negative-going brain signal over motor areas, the so-called readiness potential (RP). To date, the exact nature and causal role of the RP in movement preparation have remained heavily debated. Although the RP is influenced by several motorical and cognitive factors, it has remained unclear whether people can learn to exert mental control over their RP, for example, by deliberately suppressing it. If people were able to initiate spontaneous movements without eliciting an RP, this would challenge the idea that the RP is a necessary stage of the causal chain leading up to a voluntary movement. We tested the ability of participants to control the magnitude of their RP in a neurofeedback experiment. Participants performed self-initiated movements, and after every movement, they were provided with immediate feedback about the magnitude of their RP. They were asked to find a strategy to perform voluntary movements such that the RPs were as small as possible. We found no evidence that participants were able to to willfully modulate or suppress their RPs while still eliciting voluntary movements. This suggests that the RP might be an involuntary component of voluntary action over which people cannot exert conscious control.
Collapse
|
31
|
Parés-Pujolràs E, Travers E, Ahmetoglu Y, Haggard P. Evidence accumulation under uncertainty - a neural marker of emerging choice and urgency. Neuroimage 2021; 232:117863. [PMID: 33617993 DOI: 10.1016/j.neuroimage.2021.117863] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/06/2020] [Revised: 02/01/2021] [Accepted: 02/09/2021] [Indexed: 12/26/2022] Open
Abstract
To interact meaningfully with its environment, an agent must integrate external information with its own internal states. However, information about the environment is often noisy. In this study, we identify a neural correlate that tracks how asymmetries between competing alternatives evolve over the course of a decision. In our task participants had to monitor a stream of discrete visual stimuli over time and decide whether or not to act, on the basis of either strong or ambiguous evidence. We found that the classic P3 event-related potential evoked by sequential evidence items tracked decision-making processes and predicted participants' categorical choices on a single trial level, both when evidence was strong and when it was ambiguous. The P3 amplitudes in response to evidence supporting the eventually selected option increased over trial time as decisions evolved, being maximally different from the P3 amplitudes evoked by competing evidence at the time of decision. Computational modelling showed that both the neural dynamics and behavioural primacy and recency effects can be explained by a combination of (a) competition between mutually inhibiting accumulators for the two categorical choice outcomes, and (b) a context-dependant urgency signal. In conditions where evidence was presented at a low rate, urgency increased faster than in conditions when evidence was very frequent. We also found that the readiness potential, a classic marker of endogenously initiated actions, was observed preceding movements in all conditions - even when those were strongly driven by external evidence.
Collapse
Affiliation(s)
| | - Eoin Travers
- Institute of Cognitive Neuroscience, University College London, London WC1 3AR, UK
| | - Yoana Ahmetoglu
- Institute of Cognitive Neuroscience, University College London, London WC1 3AR, UK
| | - Patrick Haggard
- Institute of Cognitive Neuroscience, University College London, London WC1 3AR, UK
| |
Collapse
|
32
|
Nguyen TV, Hsu CY, Jaiswal S, Muggleton NG, Liang WK, Juan CH. To Go or Not to Go: Degrees of Dynamic Inhibitory Control Revealed by the Function of Grip Force and Early Electrophysiological Indices. Front Hum Neurosci 2021; 15:614978. [PMID: 33584231 PMCID: PMC7876446 DOI: 10.3389/fnhum.2021.614978] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/07/2020] [Accepted: 01/04/2021] [Indexed: 11/13/2022] Open
Abstract
A critical issue in executive control is how the nervous system exerts flexibility to inhibit a prepotent response and adapt to sudden changes in the environment. In this study, force measurement was used to capture “partial” unsuccessful trials that are highly relevant in extending the current understanding of motor inhibition processing. Moreover, a modified version of the stop-signal task was used to control and eliminate potential attentional capture effects from the motor inhibition index. The results illustrate that the non-canceled force and force rate increased as a function of stop-signal delay (SSD), offering new objective indices for gauging the dynamic inhibitory process. Motor response (time and force) was a function of delay in the presentation of novel/infrequent stimuli. A larger lateralized readiness potential (LRP) amplitude in go and novel stimuli indicated an influence of the novel stimuli on central motor processing. Moreover, an early N1 component reflects an index of motor inhibition in addition to the N2 component reported in previous studies. Source analysis revealed that the activation of N2 originated from inhibitory control associated areas: the right inferior frontal gyrus (rIFG), pre-motor cortex, and primary motor cortex. Regarding partial responses, LRP and error-related negativity (ERNs) were associated with error correction processes, whereas the N2 component may indicate the functional overlap between inhibition and error correction. In sum, the present study has developed reliable and objective indices of motor inhibition by introducing force, force-rate and electrophysiological measures, further elucidating our understandings of dynamic motor inhibition and error correction.
Collapse
Affiliation(s)
- Trung Van Nguyen
- Institute of Cognitive Neuroscience, National Central University, Jhongli City, Taiwan
| | - Che-Yi Hsu
- Institute of Cognitive Neuroscience, National Central University, Jhongli City, Taiwan
| | - Satish Jaiswal
- Institute of Cognitive Neuroscience, National Central University, Jhongli City, Taiwan.,Department of Pathology and Laboratory Medicine, School of Medicine and Public Health, University of Wisconsin-Madison, Madison, WI, United States
| | - Neil G Muggleton
- Institute of Cognitive Neuroscience, National Central University, Jhongli City, Taiwan.,Cognitive Intelligence and Precision Healthcare Center, National Central University, Jhongli City, Taiwan.,Institute of Cognitive Neuroscience, University College London, London, United Kingdom.,Department of Psychology, Goldsmiths, University of London, London, United Kingdom
| | - Wei-Kuang Liang
- Institute of Cognitive Neuroscience, National Central University, Jhongli City, Taiwan.,Department of Pathology and Laboratory Medicine, School of Medicine and Public Health, University of Wisconsin-Madison, Madison, WI, United States
| | - Chi-Hung Juan
- Institute of Cognitive Neuroscience, National Central University, Jhongli City, Taiwan.,Cognitive Intelligence and Precision Healthcare Center, National Central University, Jhongli City, Taiwan.,Department of Psychology, Kaohsiung Medical University, Kaohsiung, Taiwan
| |
Collapse
|
33
|
Travers E, Friedemann M, Haggard P. The Readiness Potential reflects planning-based expectation, not uncertainty, in the timing of action. Cogn Neurosci 2020; 12:14-27. [PMID: 33153362 DOI: 10.1080/17588928.2020.1824176] [Citation(s) in RCA: 12] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/23/2022]
Abstract
Actions are guided by a combination of external cues, internal intentions, and stored knowledge. Self-initiated voluntary actions, produced without immediate external cues, may be preceded by a slow EEG Readiness Potential (RP) that progressively increases prior to action. The cognitive significance of this neural event is controversial. Some accounts link the RP to the fact that timing of voluntary actions is generated endogenously, without external constraints. Others link it to the unique role of a planning process, and therefore of temporal expectation, in voluntary actions. In many previous experiments, actions are unconstrained by external cues, but also potentially involve preplanning and anticipation. To separate these factors, we developed a reinforcement learning paradigm where participants learned, through trial and error, the optimal time to act. If the RP reflects freedom from external constraint, its amplitude should be greater early in learning, when participants do not yet know when to act. Conversely, if the RP reflects planning, it should be greater later on, when participants have learned, and plan in advance, the time of action. We found that RP amplitudes grew with learning, suggesting that this neural activity reflects planning and anticipation for the forthcoming action, rather than freedom from external constraint.
Collapse
Affiliation(s)
- Eoin Travers
- Institute of Cognitive Neuroscience, University College London , London, UK
| | - Maja Friedemann
- Institute of Cognitive Neuroscience, University College London , London, UK.,Department of Experimental Psychology, University of Oxford , Oxford, UK
| | - Patrick Haggard
- Institute of Cognitive Neuroscience, University College London , London, UK
| |
Collapse
|
34
|
Li H, Huang G, Lin Q, Zhao J, Fu Q, Li L, Mao Y, Wei X, Yang W, Wang B, Zhang Z, Huang D. EEG Changes in Time and Time-Frequency Domain During Movement Preparation and Execution in Stroke Patients. Front Neurosci 2020; 14:827. [PMID: 32973428 PMCID: PMC7468244 DOI: 10.3389/fnins.2020.00827] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/13/2019] [Accepted: 07/15/2020] [Indexed: 12/31/2022] Open
Abstract
This study investigated electroencephalogram (EEG) changes during movement preparation and execution in stroke patients. EEG-based event-related potential (ERP) technology was used to measure brain activity changes. Seventeen stroke patients participated in this study and completed ERP tests that were designed to measure EEG changes during unilateral upper limb movements in preparation and execution stages, with Instruction Response Movement (IRM) and Cued Instruction Response Movement (CIRM) paradigms. EEG data were analyzed using motor potential (MP) in the time domain and the mu-rhythm and beta frequency band response mean value (R-means) in the time-frequency domain. In IRM, the MP amplitude at Cz was higher during hemiplegic arm movement than during unaffected arm movement. MP latency was shorter at Cz and the contralesional motor cortex during hemiplegic arm movement in CIRM compared to IRM. No significant differences were found in R-means among locations, between movement sides in both ERP tests. This study presents the brain activity changes in the time and time-frequency domains in stroke patients during movement preparation and execution and supports the contralesional compensation and adjacent-region compensation mechanism of post-stroke brain reconstruction. These findings may contribute to future rehabilitation research about neuroplasticity and technology development such as the brain-computer interface.
Collapse
Affiliation(s)
- Hai Li
- Neurorehabilitation Laboratory, Department of Rehabilitation Medicine, Shenzhen Hospital, Southern Medical University, Shenzhen, China.,Department of Rehabilitation Medicine, Guangdong Engineering Technology Research Center for Rehabilitation Medicine and Clinical Translation, The First Affiliated Hospital, Sun Yat-sen University, Guangzhou, China
| | - Gan Huang
- Guangdong Provincial Key Laboratory of Biomedical Measurements and Ultrasound Imaging, School of Biomedical Engineering, Health Science Center, Shenzhen University, Shenzhen, China
| | - Qiang Lin
- Department of Rehabilitation Medicine, Guangdong Engineering Technology Research Center for Rehabilitation Medicine and Clinical Translation, The First Affiliated Hospital, Sun Yat-sen University, Guangzhou, China.,Department of Rehabilitation Medicine, The Fifth Affiliated Hospital of Guangzhou Medical University, Guangzhou, China
| | - Jiangli Zhao
- Department of Rehabilitation Medicine, Guangdong Engineering Technology Research Center for Rehabilitation Medicine and Clinical Translation, The First Affiliated Hospital, Sun Yat-sen University, Guangzhou, China
| | - Qiang Fu
- Guangdong Provincial Key Laboratory of Biomedical Measurements and Ultrasound Imaging, School of Biomedical Engineering, Health Science Center, Shenzhen University, Shenzhen, China.,Ira A. Fulton Schools of Engineering, Arizona State University, Tempe, AZ, United States
| | - Le Li
- Department of Rehabilitation Medicine, Guangdong Engineering Technology Research Center for Rehabilitation Medicine and Clinical Translation, The First Affiliated Hospital, Sun Yat-sen University, Guangzhou, China
| | - Yurong Mao
- Department of Rehabilitation Medicine, Guangdong Engineering Technology Research Center for Rehabilitation Medicine and Clinical Translation, The First Affiliated Hospital, Sun Yat-sen University, Guangzhou, China
| | - Xijun Wei
- Neurorehabilitation Laboratory, Department of Rehabilitation Medicine, Shenzhen Hospital, Southern Medical University, Shenzhen, China
| | - Wanzhang Yang
- Neurorehabilitation Laboratory, Department of Rehabilitation Medicine, Shenzhen Hospital, Southern Medical University, Shenzhen, China
| | - Bingshui Wang
- Neurorehabilitation Laboratory, Department of Rehabilitation Medicine, Shenzhen Hospital, Southern Medical University, Shenzhen, China
| | - Zhiguo Zhang
- Guangdong Provincial Key Laboratory of Biomedical Measurements and Ultrasound Imaging, School of Biomedical Engineering, Health Science Center, Shenzhen University, Shenzhen, China
| | - Dongfeng Huang
- Department of Rehabilitation Medicine, Guangdong Engineering Technology Research Center for Rehabilitation Medicine and Clinical Translation, The First Affiliated Hospital, Sun Yat-sen University, Guangzhou, China.,Department of Rehabilitation Medicine, The Seventh Affiliated Hospital, Sun Yat-sen University, Guangzhou, China
| |
Collapse
|
35
|
Broday-Dvir R, Malach R. Resting-State Fluctuations Underlie Free and Creative Verbal Behaviors in the Human Brain. Cereb Cortex 2020; 31:213-232. [PMID: 32935840 DOI: 10.1093/cercor/bhaa221] [Citation(s) in RCA: 9] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/13/2020] [Revised: 06/22/2020] [Accepted: 07/17/2020] [Indexed: 11/13/2022] Open
Abstract
Resting-state fluctuations are ubiquitous and widely studied phenomena of the human brain, yet we are largely in the dark regarding their function in human cognition. Here we examined the hypothesis that resting-state fluctuations underlie the generation of free and creative human behaviors. In our experiment, participants were asked to perform three voluntary verbal tasks: a verbal fluency task, a verbal creativity task, and a divergent thinking task, during functional magnetic resonance imaging scanning. Blood oxygenation level dependent (BOLD)-activity during these tasks was contrasted with a control- deterministic verbal task, in which the behavior was fully determined by external stimuli. Our results reveal that all voluntary verbal-generation responses displayed a gradual anticipatory buildup that preceded the deterministic control-related responses. Critically, the time-frequency dynamics of these anticipatory buildups were significantly correlated with resting-state fluctuations' dynamics. These correlations were not a general BOLD-related or verbal-response related result, as they were not found during the externally determined verbal control condition. Furthermore, they were located in brain regions known to be involved in language production, specifically the left inferior frontal gyrus. These results suggest a common function of resting-state fluctuations as the neural mechanism underlying the generation of free and creative behaviors in the human cortex.
Collapse
Affiliation(s)
- Rotem Broday-Dvir
- Department of Neurobiology, Weizmann Institute of Science, Rehovot 76100, Israel
| | - Rafael Malach
- Department of Neurobiology, Weizmann Institute of Science, Rehovot 76100, Israel
| |
Collapse
|
36
|
Orset B, Lee K, Chavarriaga R, Millan JDR. User Adaptation to Closed-Loop Decoding of Motor Imagery Termination. IEEE Trans Biomed Eng 2020; 68:3-10. [PMID: 32746025 DOI: 10.1109/tbme.2020.3001981] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
Abstract
One of the most popular methods in non-invasive brain machine interfaces (BMI) relies on the decoding of sensorimotor rhythms associated to sustained motor imagery. Although motor imagery has been intensively studied, its termination is mostly neglected. OBJECTIVE Here, we provide insights in the decoding of motor imagery termination and investigate the use of such decoder in closed-loop BMI. METHODS Participants (N = 9) were asked to perform kinesthetic motor imagery of both hands simultaneously cued with a clock indicating the initiation and termination of the action. Using electroencephalogram (EEG) signals, we built a decoder to detect the transition between event-related desynchronization and event-related synchronization. Features for this decoder were correlates of motor termination in the upper μ and β bands. RESULTS The decoder reached an accuracy of 76.2% (N = 9), revealing the high robustness of our approach. More importantly, this paper shows that the decoding of motor termination has an intrinsic latency mainly due to the delayed appearance of its correlates. Because the latency was consistent and thus predictable, users were able to compensate it after training. CONCLUSION Using our decoding system, BMI users were able to adapt their behavior and modulate their sensorimotor rhythm to stop the device (clock) accurately on time. SIGNIFICANCE These results show the importance of closed-loop evaluations of BMI decoders and open new possibilities for BMI control using decoding of movement termination.
Collapse
|
37
|
Hermann B, Salah AB, Perlbarg V, Valente M, Pyatigorskaya N, Habert MO, Raimondo F, Stender J, Galanaud D, Kas A, Puybasset L, Perez P, Sitt JD, Rohaut B, Naccache L. Habituation of auditory startle reflex is a new sign of minimally conscious state. Brain 2020; 143:2154-2172. [PMID: 32582938 PMCID: PMC7364741 DOI: 10.1093/brain/awaa159] [Citation(s) in RCA: 25] [Impact Index Per Article: 6.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/22/2019] [Revised: 03/05/2020] [Accepted: 03/30/2020] [Indexed: 02/07/2023] Open
Abstract
Neurological examination of non-communicating patients relies on a few decisive items that enable the crucial distinction between vegetative state (VS)-also coined unresponsive wakefulness syndrome (UWS)-and minimally conscious state. Over the past 10 years, this distinction has proven its diagnostic value as well as its important prognostic value on consciousness recovery. However, clinicians are currently limited by three factors: (i) the current behavioural repertoire of minimally conscious state items is limited and restricted to a few cognitive domains in the goldstandard revised version of the Coma Recovery Scale; (ii) a proportion of ∼15-20% clinically VS/UWS patients are actually in a richer state than VS/UWS as evidenced by functional brain imaging; and (iii) the neurophysiological and cognitive interpretation of each minimally conscious state item is still unclear and debated. In the current study we demonstrate that habituation of the auditory startle reflex (hASR) tested at bedside constitutes a novel, simple and powerful behavioural sign that can accurately distinguish minimally conscious state from VS/UWS. In addition to enlarging the minimally conscious state items repertoire, and therefore decreasing the low sensitivity of current behavioural measures, we also provide an original and rigorous description of the neurophysiological basis of hASR through a combination of functional (high density EEG and 18F-fluorodeoxyglucose PET imaging) and structural (diffusion tensor imaging MRI) measures. We show that preservation of hASR is associated with the functional and structural integrity of a brain-scale fronto-parietal network, including prefrontal regions related to control of action and inhibition, and meso-parietal areas associated with minimally conscious and conscious states. Lastly, we show that hASR predicts 6-month improvement of consciousness. Taken together, our results show that hASR is a cortically-mediated behaviour, and suggest that it could be a new clinical item to clearly and accurately identify non-communicating patients who are in the minimally conscious state.
Collapse
Affiliation(s)
- Bertrand Hermann
- Institut du Cerveau et de la Moelle épinière - ICM, Inserm U1127, CNRS UMR 7225, F-75013, Paris, France
- Department of Neurology, Groupe hospitalier Pitié-Salpêtrière, AP-HP, F-75013, Paris, France
- Faculté de Médecine Pitié-Salpêtrière, Sorbonne Universités, UPMC Université Paris 06, Paris, France
| | - Amina Ben Salah
- Institut du Cerveau et de la Moelle épinière - ICM, Inserm U1127, CNRS UMR 7225, F-75013, Paris, France
| | - Vincent Perlbarg
- Sorbonne Université, CNRS, INSERM, Laboratoire d’Imagerie Biomédicale, LIB, F-75006, Paris, France
- BrainTale SAS, F-75013, Paris, France
| | - Mélanie Valente
- Institut du Cerveau et de la Moelle épinière - ICM, Inserm U1127, CNRS UMR 7225, F-75013, Paris, France
- Department of Clinical Neurophysiology, Groupe hospitalier Pitié-Salpêtrière, AP-HP, F-75013, Paris, France
| | - Nadya Pyatigorskaya
- Institut du Cerveau et de la Moelle épinière - ICM, Inserm U1127, CNRS UMR 7225, F-75013, Paris, France
- Faculté de Médecine Pitié-Salpêtrière, Sorbonne Universités, UPMC Université Paris 06, Paris, France
- Department of Neuroradiology, Groupe hospitalier Pitié-Salpêtrière, AP-HP, F-75013, Paris, France
| | - Marie-Odile Habert
- Sorbonne Université, CNRS, INSERM, Laboratoire d’Imagerie Biomédicale, LIB, F-75006, Paris, France
- Department of Nuclear Medicine, Groupe hospitalier Pitié-Salpêtrière, AP-HP, F-75013, Paris, France
| | - Federico Raimondo
- Institut du Cerveau et de la Moelle épinière - ICM, Inserm U1127, CNRS UMR 7225, F-75013, Paris, France
- Coma Science Group, GIGA Consciousness, University of Liège, Belgium
- Centre du Cerveau, University Hospital of Liège, Belgium
| | - Johan Stender
- Institut du Cerveau et de la Moelle épinière - ICM, Inserm U1127, CNRS UMR 7225, F-75013, Paris, France
| | - Damien Galanaud
- Institut du Cerveau et de la Moelle épinière - ICM, Inserm U1127, CNRS UMR 7225, F-75013, Paris, France
- Faculté de Médecine Pitié-Salpêtrière, Sorbonne Universités, UPMC Université Paris 06, Paris, France
- Department of Neuroradiology, Groupe hospitalier Pitié-Salpêtrière, AP-HP, F-75013, Paris, France
| | - Aurélie Kas
- Sorbonne Université, CNRS, INSERM, Laboratoire d’Imagerie Biomédicale, LIB, F-75006, Paris, France
- Department of Nuclear Medicine, Groupe hospitalier Pitié-Salpêtrière, AP-HP, F-75013, Paris, France
| | - Louis Puybasset
- Faculté de Médecine Pitié-Salpêtrière, Sorbonne Universités, UPMC Université Paris 06, Paris, France
- Sorbonne Université, CNRS, INSERM, Laboratoire d’Imagerie Biomédicale, LIB, F-75006, Paris, France
- Department of Anesthesia and Critical Care, Multidisciplinary Intensive Care Unit, Groupe hospitalier Pitié-Salpêtrière, AP-HP, F-75013, Paris, France
| | - Pauline Perez
- Institut du Cerveau et de la Moelle épinière - ICM, Inserm U1127, CNRS UMR 7225, F-75013, Paris, France
| | - Jacobo D Sitt
- Institut du Cerveau et de la Moelle épinière - ICM, Inserm U1127, CNRS UMR 7225, F-75013, Paris, France
| | - Benjamin Rohaut
- Institut du Cerveau et de la Moelle épinière - ICM, Inserm U1127, CNRS UMR 7225, F-75013, Paris, France
- Department of Neurology, Groupe hospitalier Pitié-Salpêtrière, AP-HP, F-75013, Paris, France
- Faculté de Médecine Pitié-Salpêtrière, Sorbonne Universités, UPMC Université Paris 06, Paris, France
- Department of Neurology, Columbia University, New York, NY 10027, USA
| | - Lionel Naccache
- Institut du Cerveau et de la Moelle épinière - ICM, Inserm U1127, CNRS UMR 7225, F-75013, Paris, France
- Department of Neurology, Groupe hospitalier Pitié-Salpêtrière, AP-HP, F-75013, Paris, France
- Faculté de Médecine Pitié-Salpêtrière, Sorbonne Universités, UPMC Université Paris 06, Paris, France
- Department of Clinical Neurophysiology, Groupe hospitalier Pitié-Salpêtrière, AP-HP, F-75013, Paris, France
| |
Collapse
|
38
|
Ditz JC, Schwarz A, Müller-Putz GR. Perturbation-evoked potentials can be classified from single-trial EEG. J Neural Eng 2020; 17:036008. [PMID: 32299075 DOI: 10.1088/1741-2552/ab89fb] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/12/2022]
Abstract
OBJECTIVE Loss of balance control can have serious consequences on interaction between humans and machines as well as the general well-being of humans. Perceived balance perturbations are always accompanied by a specific cortical activation, the so-called perturbation-evoked potential (PEP). In this study, we investigate the possibility to classify PEPs from ongoing EEG. APPROACH Fifteen healthy subjects were exposed to seated whole-body perturbations. Each participant performed 120 trials; they were rapidly tilted to the right and left, 60 times respectively. MAIN RESULTS We achieved classification accuracies of more than 85% between PEPs and rest EEG using a window-based classification approach. Different window lengths and electrode layouts were compared. We were able to achieve excellent classification performance (87.6 ± 8.0% accuracy) by using a short window length of 200 ms and a minimal electrode layout consisting of only the Cz electrode. The peak classification accuracy coincides in time with the strongest component of PEPs, called N1. SIGNIFICANCE We showed that PEPs can be discriminated against ongoing EEG with high accuracy. These findings can contribute to the development of a system that can detect balance perturbations online.
Collapse
Affiliation(s)
- Jonas C Ditz
- Institute of Neural Engineering, Graz University of Technology, Graz, Austria. Methods in Medical Informatics, Department of Computer Science, University of Tübingen, Tübingen, Germany
| | | | | |
Collapse
|
39
|
Schultze-Kraft M, Parés-Pujolràs E, Matić K, Haggard P, Haynes JD. Preparation and execution of voluntary action both contribute to awareness of intention. Proc Biol Sci 2020; 287:20192928. [PMID: 32208835 DOI: 10.1098/rspb.2019.2928] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/12/2022] Open
Abstract
How and when motor intentions form has long been controversial. In particular, the extent to which motor preparation and action-related processes produce a conscious experience of intention remains unknown. Here, we used a brain-computer interface (BCI) while participants performed a self-paced movement task to trigger cues upon the detection of a readiness potential (a well-characterized brain signal that precedes movement) or in its absence. The BCI-triggered cues instructed participants either to move or not to move. Following this instruction, participants reported whether they felt they were about to move at the time the cue was presented. Participants were more likely to report an intention (i) when the cue was triggered by the presence of a readiness potential than when the same cue was triggered by its absence, and (ii) when they had just made an action than when they had not. We further describe a time-dependent integration of these two factors: the probability of reporting an intention was maximal when cues were triggered in the presence of a readiness potential, and when participants also executed an action shortly afterwards. Our results provide a first systematic investigation of how prospective and retrospective components are integrated in forming a conscious intention to move.
Collapse
Affiliation(s)
- Matthias Schultze-Kraft
- Bernstein Center for Computational Neuroscience, Charité-Universitätsmedizin Berlin, Berlin, Germany.,Berlin Center for Advanced Neuroimaging, Charité-Universitätsmedizin Berlin, Berlin, Germany.,SFB 940 Volition and Cognitive Control, Technische Universität Dresden, Dresden, Germany
| | | | - Karla Matić
- Bernstein Center for Computational Neuroscience, Charité-Universitätsmedizin Berlin, Berlin, Germany.,Laboratory of Experimental Psychology, KU Leuven, Louvain, Belgium
| | - Patrick Haggard
- Institute of Cognitive Neuroscience, University College London, London, UK.,Laboratoire des Neuroscience Cognitives, Département d'Études Cognitives, École Normale Supérieure, PSL University, Paris, France
| | - John-Dylan Haynes
- Bernstein Center for Computational Neuroscience, Charité-Universitätsmedizin Berlin, Berlin, Germany.,Berlin Center for Advanced Neuroimaging, Charité-Universitätsmedizin Berlin, Berlin, Germany.,Clinic of Neurology, Charité-Universitätsmedizin Berlin, Berlin, Germany.,SFB 940 Volition and Cognitive Control, Technische Universität Dresden, Dresden, Germany.,Department of Psychology, Humboldt Universität zu Berlin, Berlin, Germany.,Excellence Cluster Science of Intelligence, Technische Universität Berlin and Humbold Universität zu Berlin, Berlin, Germany
| |
Collapse
|
40
|
Anderson NE, Kiehl KA. Re-wiring Guilt: How Advancing Neuroscience Encourages Strategic Interventions Over Retributive Justice. Front Psychol 2020; 11:390. [PMID: 32231619 PMCID: PMC7082751 DOI: 10.3389/fpsyg.2020.00390] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/11/2019] [Accepted: 02/20/2020] [Indexed: 11/13/2022] Open
Abstract
The increasing visibility of neuroscience employed in legal contexts has rightfully prompted critical discourse regarding the boundaries of its utility. High profile debates include some extreme positions that either undermine the relevance of neuroscience or overstate its role in determining legal responsibility. Here we adopt a conciliatory attitude, reaffirming the current value of neuroscience in jurisprudence and addressing its role in shifting normative attitudes about culpability. Adopting a balanced perspective about the interaction between two dynamic fields (science and law) allows for more fruitful consideration of practical changes likely to improve the way we engage in legal decision-making. Neuroscience provides a useful platform for addressing nuanced and multifaceted deterministic factors promoting antisocial behavior. Ultimately, we suggest that shifting normative attitudes about culpability vis-à-vis advancing neuroscience are not likely to promote major changes in the way we assign legal responsibility. Rather, it helps us to shed our harshest retributivist instincts in favor of more pragmatic strategies for combating the most conspicuous patterns promoting mass incarceration and recidivism.
Collapse
Affiliation(s)
| | - Kent A Kiehl
- The Mind Research Network, Albuquerque, NM, United States.,Departments of Psychology, Neuroscience, and Law, University of New Mexico, Albuquerque, NM, United States
| |
Collapse
|
41
|
Marmor O, Rappel P, Valsky D, Bick AS, Arkadir D, Linetsky E, Peled O, Tamir I, Bergman H, Israel Z, Eitan R. Movement context modulates neuronal activity in motor and limbic-associative domains of the human parkinsonian subthalamic nucleus. Neurobiol Dis 2020; 136:104716. [DOI: 10.1016/j.nbd.2019.104716] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/15/2019] [Revised: 12/08/2019] [Accepted: 12/13/2019] [Indexed: 11/16/2022] Open
|
42
|
Breathing is coupled with voluntary action and the cortical readiness potential. Nat Commun 2020; 11:289. [PMID: 32029711 PMCID: PMC7005287 DOI: 10.1038/s41467-019-13967-9] [Citation(s) in RCA: 35] [Impact Index Per Article: 8.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/24/2019] [Accepted: 12/10/2019] [Indexed: 11/30/2022] Open
Abstract
Voluntary action is a fundamental element of self-consciousness. The readiness potential (RP), a slow drift of neural activity preceding self-initiated movement, has been suggested to reflect neural processes underlying the preparation of voluntary action; yet more than fifty years after its introduction, interpretation of the RP remains controversial. Based on previous research showing that internal bodily signals affect sensory processing and ongoing neural activity, we here investigated the potential role of interoceptive signals in voluntary action and the RP. We report that (1) participants initiate voluntary actions more frequently during expiration, (2) this respiration-action coupling is absent during externally triggered actions, and (3) the RP amplitude is modulated depending on the respiratory phase. Our findings demonstrate that voluntary action is coupled with the respiratory system and further suggest that the RP is associated with fluctuations of ongoing neural activity that are driven by the involuntary and cyclic motor act of breathing. Voluntary action and free will have been associated with cortical activity, referred to as “the readiness potential” that precedes self-initiated actions by about 1 s. Here, the authors show that the involuntary and cyclic motor act of breathing is coupled with voluntary action and the readiness potential.
Collapse
|
43
|
Jeong JH, Kwak NS, Guan C, Lee SW. Decoding Movement-Related Cortical Potentials Based on Subject-Dependent and Section-Wise Spectral Filtering. IEEE Trans Neural Syst Rehabil Eng 2020; 28:687-698. [PMID: 31944982 DOI: 10.1109/tnsre.2020.2966826] [Citation(s) in RCA: 31] [Impact Index Per Article: 7.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/09/2022]
Abstract
An important challenge in developing a movement-related cortical potential (MRCP)-based brain-machine interface (BMI) is an accurate decoding of the user intention for real-world environments. However, the performance remains insufficient for real-time decoding owing to the endogenous signal characteristics compared to other BMI paradigms. This study aims to enhance the MRCP decoding performance from the perspective of preprocessing techniques (i.e., spectral filtering). To the best of our knowledge, existing MRCP studies have used spectral filters with a fixed frequency bandwidth for all subjects. Hence, we propose a subject-dependent and section-wise spectral filtering (SSSF) method that considers the subjects' individual MRCP characteristics for two different temporal sections. In this study, MRCP data were acquired under a powered exoskeleton environments in which the subjects conducted self-initiated walking. We evaluated our method using both our experimental data and a public dataset (BNCI Horizon 2020). The decoding performance using the SSSF was 0.86 (±0.09), and the performance on the public dataset was 0.73 (±0.06) across all subjects. The experimental results showed a statistically significant enhancement ( ) compared with the fixed frequency bands used in previous methods on both datasets. In addition, we presented successful decoding results from a pseudo-online analysis. Therefore, we demonstrated that the proposed SSSF method can involve more meaningful MRCP information than conventional methods.
Collapse
|
44
|
Fellous JM, Sapiro G, Rossi A, Mayberg H, Ferrante M. Explainable Artificial Intelligence for Neuroscience: Behavioral Neurostimulation. Front Neurosci 2019; 13:1346. [PMID: 31920509 PMCID: PMC6923732 DOI: 10.3389/fnins.2019.01346] [Citation(s) in RCA: 52] [Impact Index Per Article: 10.4] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/11/2019] [Accepted: 11/29/2019] [Indexed: 01/08/2023] Open
Abstract
The use of Artificial Intelligence and machine learning in basic research and clinical neuroscience is increasing. AI methods enable the interpretation of large multimodal datasets that can provide unbiased insights into the fundamental principles of brain function, potentially paving the way for earlier and more accurate detection of brain disorders and better informed intervention protocols. Despite AI's ability to create accurate predictions and classifications, in most cases it lacks the ability to provide a mechanistic understanding of how inputs and outputs relate to each other. Explainable Artificial Intelligence (XAI) is a new set of techniques that attempts to provide such an understanding, here we report on some of these practical approaches. We discuss the potential value of XAI to the field of neurostimulation for both basic scientific inquiry and therapeutic purposes, as well as, outstanding questions and obstacles to the success of the XAI approach.
Collapse
Affiliation(s)
- Jean-Marc Fellous
- Theoretical and Computational Neuroscience Program, National Institute of Mental Health, National Institutes of Health, Bethesda, MD, United States
- Department of Psychology and Biomedical Engineering, University of Arizona, Tucson, AZ, United States
| | - Guillermo Sapiro
- Department of Electrical and Computer Engineering, Duke University, Durham, NC, United States
| | - Andrew Rossi
- Executive Functions and Reward Systems Program, National Institute of Mental Health, National Institutes of Health, Bethesda, MD, United States
| | - Helen Mayberg
- Center for Advanced Circuit Therapeutics, Icahn School of Medicine at Mount Sinai, New York, NY, United States
| | - Michele Ferrante
- Theoretical and Computational Neuroscience Program, National Institute of Mental Health, National Institutes of Health, Bethesda, MD, United States
- Computational Psychiatry Program, National Institute of Mental Health, National Institutes of Health, Bethesda, MD, United States
| |
Collapse
|
45
|
Abstract
When we are presented with two equally appealing options, how does the brain break the symmetry between them and make a choice? Recent research has proposed that when no clear information can guide decisions, we use irrelevant noise to tip the scale in favour of one alternative and decide how to act. In the present study, we investigated this issue exploring how human decisions were influenced by noise in a visual signal that cued instructed or free choice. Participants were presented with random-dot kinematograms, moving unidirectionally either upwards or downwards (in instructed trials) or both upwards and downwards simultaneously (free-choice trials). By varying the coherence of dot motion, we were able to test how moment-to-moment fluctuations in motion energy could influence action selection processes. We also measured participants' awareness of such influence. Our results revealed three novel findings: Participants' choices tended to follow fluctuations in dot motion, showing that sensory noise biased "free" selection between actions, irrespective of the clarity of the free cue. However, participants appeared to remain unaware of that influence, because subjective ratings of freedom did not correlate with the degree of sensory biasing. In one exception to this general rule, we found that, when participants resisted the bias and made a choice opposite to the one suggested by the stimulus, they reported strong subjective sense of having chosen independently of the stimulation. This result suggests that inhibitory control is tightly linked to the sense of freedom of choice.
Collapse
Affiliation(s)
- Lucie Charles
- Institute of Cognitive Neuroscience, University College London, London, UK
| | - Patrick Haggard
- Institute of Cognitive Neuroscience, University College London, London, UK
| |
Collapse
|
46
|
Travers E, Khalighinejad N, Schurger A, Haggard P. Do readiness potentials happen all the time? Neuroimage 2019; 206:116286. [PMID: 31629833 DOI: 10.1016/j.neuroimage.2019.116286] [Citation(s) in RCA: 13] [Impact Index Per Article: 2.6] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/01/2019] [Revised: 10/01/2019] [Accepted: 10/14/2019] [Indexed: 10/25/2022] Open
Abstract
The Readiness Potential (RP) is a slow negative EEG potential found in the seconds preceding voluntary actions. Here, we explore whether the RP is found only at this time, or if it also occurs when no action is produced. Recent theories suggest the RP reflects the average of accumulated stochastic fluctuations in neural activity, rather than a specific signal related to self-initiated action: RP-like events should then be widely present, even in the absence of actions. We investigated this hypothesis by searching for RP-like events in background EEG of an appropriate dataset for which the action-locked EEG had previously been analysed to test other hypotheses [Khalighinejad, N., Brann, E., Dorgham, A., Haggard, P. Dissociating cognitive and motoric precursors of human self-initiated action. Journal of Cognitive Neuroscience. 2019, 1-14]. We used the actual mean RP as a template, and searched the entire epoch for similar neural signals, using similarity metrics that capture the temporal or spatial properties of the RP. Most EEG epochs contained a number of events that were similar to the true RP, but did not lead directly to any voluntary action. However, these RP-like events were equally common in epochs that eventually terminated in voluntary actions as in those where voluntary actions were not permitted. Events matching the temporal profile of the RP were also a poor match for the spatial profile, and vice versa. We conclude that these events are false positives, and do not reflect the same mechanism as the RP itself. Finally, applying the same template-search algorithm to simulated EEG data synthesized from different noise distributions showed that RP-like events will occur in any dataset containing the 1⁄f noise ubiquitous in EEG recordings. To summarise, we found no evidence of genuinely RP-like events at any time other than immediately prior to self-initiated actions. Our findings do not support a purely stochastic model of RP generation, and suggest that the RP may be a specific precursor of self-initiated voluntary actions.
Collapse
Affiliation(s)
- Eoin Travers
- Institute of Cognitive Neuroscience, University College London, UK.
| | - Nima Khalighinejad
- Institute of Cognitive Neuroscience, University College London, UK; Wellcome Centre for Integrative Neuroimaging, Department of Experimental Psychology, University of Oxford, UK
| | - Aaron Schurger
- INSERM U992, Cognitive Neuroimaging Unit, Gif sur Yvette, 91191, France; Commissariat à l'Energie Atomique, Direction des Sciences du Vivant, I2BM, NeuroSpin center, Gif sur Yvette, 91191, France; Department of Psychology, Crean College of Health and Behavioral Sciences, Chapman University, Orange, CA, USA; Institute for Interdisciplinary Brain and Behavioral Sciences, Chapman University, Irvine, CA, USA
| | - Patrick Haggard
- Institute of Cognitive Neuroscience, University College London, UK
| |
Collapse
|
47
|
Verbaarschot C, Farquhar J, Haselager P. Free Wally: Where motor intentions meet reason and consequence. Neuropsychologia 2019; 133:107156. [DOI: 10.1016/j.neuropsychologia.2019.107156] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/12/2019] [Revised: 07/29/2019] [Accepted: 08/02/2019] [Indexed: 10/26/2022]
|
48
|
Wisniewski D, Deutschländer R, Haynes JD. Free will beliefs are better predicted by dualism than determinism beliefs across different cultures. PLoS One 2019; 14:e0221617. [PMID: 31509562 PMCID: PMC6738589 DOI: 10.1371/journal.pone.0221617] [Citation(s) in RCA: 12] [Impact Index Per Article: 2.4] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/25/2019] [Accepted: 08/12/2019] [Indexed: 11/18/2022] Open
Abstract
Most people believe in free will. Whether this belief is warranted or not, free will beliefs (FWB) are foundational for many legal systems and reducing FWB has effects on behavior from the motor to the social level. This raises the important question as to which specific FWB people hold. There are many different ways to conceptualize free will, and some might see physical determinism as a threat that might reduce FWB, while others might not. Here, we investigate lay FWB in a large, representative, replicated online survey study in the US and Singapore (n = 1800), assessing differences in FWB with unprecedented depth within and between cultures. Specifically, we assess the relation of FWB, as measured using the Free Will Inventory, to determinism, dualism and related concepts like libertarianism and compatibilism. We find that libertarian, compatibilist, and dualist, intuitions were related to FWB, but that these intuitions were often logically inconsistent. Importantly, direct comparisons suggest that dualism was more predictive of FWB than other intuitions. Thus, believing in free will goes hand-in-hand with a belief in a non-physical mind. Highlighting the importance of dualism for FWB impacts academic debates on free will, which currently largely focus on its relation to determinism. Our findings also shed light on how recent (neuro)scientific findings might impact FWB. Demonstrating physical determinism in the brain need not have a strong impact on FWB, due to a wide-spread belief in dualism.
Collapse
Affiliation(s)
- David Wisniewski
- Bernstein Center for Computational Neuroscience, Charité-Universitätsmedizin Berlin, Berlin, Germany
- Department of Experimental Psychology, Ghent University, Ghent, Belgium
- * E-mail:
| | - Robert Deutschländer
- Bernstein Center for Computational Neuroscience, Charité-Universitätsmedizin Berlin, Berlin, Germany
| | - John-Dylan Haynes
- Bernstein Center for Computational Neuroscience, Charité-Universitätsmedizin Berlin, Berlin, Germany
- Berlin Center for Advanced Neuroimaging, Charité-Universitätsmedizin Berlin, Berlin, Germany
- Clinic for Neurology, Charité-Universitätsmedizin Berlin, Berlin, Germany
- Berlin Institute of Health, Max Delbrück Center and Charité-Universitätsmedizin Berlin, Berlin, Germany
- Berlin School of Mind and Brain, Humboldt-Universität zu Berlin, Berlin, Germany
- Department of Psychology, Humboldt-Universität zu Berlin, Berlin, Germany
- SFB 940 Volition and Cognitive Control, Technische Universität Dresden, Dresden, Germany
| |
Collapse
|
49
|
Jamali M, Golshani M, Jamali Y. A proposed mechanism for mind-brain interaction using extended Bohmian quantum mechanics in Avicenna's monotheistic perspective. Heliyon 2019; 5:e02130. [PMID: 31388577 PMCID: PMC6667669 DOI: 10.1016/j.heliyon.2019.e02130] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/21/2019] [Revised: 06/12/2019] [Accepted: 07/18/2019] [Indexed: 02/01/2023] Open
Abstract
In quantum approaches to consciousness, the authors try to propose a model and mechanism for the mind-brain interaction using modern physics and some quantum concepts which do not exist in the classical physics. The independent effect of mind on the brain has been one of the challenging issues in the history of science and philosophy. In some recent mind-brain interaction models, the direct influence of mind on matter is either not accepted (as in Stapp's model) or not clear, and there have not been any clear mechanism for it (as in Penrose-Hameroff's model or in Eccles's model). In this manuscript we propose a model and mechanism for mind's effect on the matter using an extended Bohmian quantum mechanics and Avicenna's ideas. We show that mind and mental states can affect brain's activity without any violation of physical laws. This is a mathematical and descriptive model which shows the possibility of providing a causal model for mind's effect on matter. It is shown that this model guarantees the realistic philosophical constraints and respects the laws of nature. In addition, it is shown that it is in agreement with the Libet style experimental results and parapsychological data. To propose this model, we obtained a modified (non-unitary) Schrödinger equation via second quantization method which affects the particle through a modified quantum potential and a new term in the continuity equation. At the second quantized level, which is equivalent to quantum field theory level (QFT), we can use the path integral formalism of Feynman. We show that there are three methods to extend Bohmian QM via path integral formalism, which has different interpretations. By numerical simulation of trajectories in the two-slits experiment, we show their differences and choose one of these methods for our mind-brain model which can be the basis for explaining some phenomena which are not possible to explain in the standard Bohmian QM.
Collapse
Affiliation(s)
- Mohammad Jamali
- Department of Physics, Sharif University of Technology, Tehran, Iran
- School of Physics, Institute for Research in Fundamental Sciences (IPM), Tehran, Iran
| | - Mehdi Golshani
- Department of Physics, Sharif University of Technology, Tehran, Iran
- School of Physics, Institute for Research in Fundamental Sciences (IPM), Tehran, Iran
| | - Yousef Jamali
- Department of Applied Mathematics, School of Mathematical Sciences, Tarbiat Modares University, Tehran, Iran
| |
Collapse
|
50
|
Bonicalzi S, Haggard P. From Freedom From to Freedom To: New Perspectives on Intentional Action. Front Psychol 2019; 10:1193. [PMID: 31191396 PMCID: PMC6546819 DOI: 10.3389/fpsyg.2019.01193] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/08/2019] [Accepted: 05/06/2019] [Indexed: 11/13/2022] Open
Abstract
There are few concepts as relevant as that of intentional action in shaping our sense of self and the interaction with the environment. At the same time, few concepts are so elusive. Indeed, both conceptual and neuroscientific accounts of intentional agency have proven to be problematic. On the one hand, most conceptual views struggle in defining how agents can adequately exert control over their actions. On the other hand, neuroscience settles for definitions by exclusion whereby key features of human intentional actions, including goal-directness, remain underspecified. This paper reviews the existing literature and sketches how this gap might be filled. In particular, we defend a gradualist notion of intentional behavior, which revolves around the following key features: autonomy, flexibility in the integration of causal vectors, and control.
Collapse
Affiliation(s)
- Sofia Bonicalzi
- Fakultät für Philosophie, Wissenschaftstheorie und Religionswissenschaft, Ludwig-Maximilians-Universität, Munich, Germany
| | - Patrick Haggard
- Institute of Cognitive Neuroscience, University College London, London, United Kingdom.,Laboratoire de Neurosciences Cognitives, Département d'Études Cognitives, École Normale Supérieure, Paris, France.,Institute of Philosophy, School of Advanced Study, University of London, London, United Kingdom
| |
Collapse
|