1
|
Muñoz-Moldes S, Tursic A, Lührs M, Eck J, Benitez Andonegui A, Peters J, Cleeremans A, Goebel R. Online self-evaluation of fMRI-based neurofeedback performance. Philos Trans R Soc Lond B Biol Sci 2024; 379:20230089. [PMID: 39428884 PMCID: PMC11491843 DOI: 10.1098/rstb.2023.0089] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/30/2023] [Revised: 02/29/2024] [Accepted: 06/01/2024] [Indexed: 10/22/2024] Open
Abstract
This study explores the subjective evaluation of supplementary motor area (SMA) regulation performance in a real-time functional magnetic resonance imaging neurofeedback (fMRI-NF) task. In fMRI-NF, people learn how to self-regulate their brain activity by performing mental actions to achieve a certain target level (TL) of blood-oxygen-level-dependent (BOLD) activation. Here, we studied two types of self-evaluation: performance predictions and perceived confidence in the prediction judgement. Participants completed three sessions of SMA regulation in a 7 T fMRI scanner, performing a mental drawing task. During each trial, they modulated their imagery strategy to achieve one of two different levels of SMA activation and reported a performance prediction and their confidence in the prediction before receiving delayed BOLD-activation feedback. Results show that participants' performance predictions improved with learning throughout the three sessions, and that these improvements were not driven exclusively by their knowledge of previous performance. Confidence reports on the other hand showed no change throughout training and did not correlate with better and worse predictions. In addition to shedding light on mechanisms of internal self-evaluation during neurofeedback training, these results also point to a dissociation between predictions of performance and confidence reports in the presence of feedback. This article is part of the theme issue 'Neurofeedback: new territories and neurocognitive mechanisms of endogenous neuromodulation'.
Collapse
Affiliation(s)
- Santiago Muñoz-Moldes
- Consciousness, Cognition and Computation group, Center for Research in Cognition & Neuroscience, Faculty of Psychology and Education, Université Libre de Bruxelles, Brussels, Belgium
- Department of Psychology, University of Cambridge, Cambridge, UK
| | - Anita Tursic
- Brain Innovation B.V., Research Department, Maastricht, The Netherlands
- Department of Cognitive Neuroscience, Faculty of Psychology and Neuroscience, Maastricht University, Maastricht, The Netherlands
| | - Michael Lührs
- Brain Innovation B.V., Research Department, Maastricht, The Netherlands
- Department of Cognitive Neuroscience, Faculty of Psychology and Neuroscience, Maastricht University, Maastricht, The Netherlands
| | - Judith Eck
- Brain Innovation B.V., Research Department, Maastricht, The Netherlands
- Department of Cognitive Neuroscience, Faculty of Psychology and Neuroscience, Maastricht University, Maastricht, The Netherlands
| | - Amaia Benitez Andonegui
- Department of Cognitive Neuroscience, Faculty of Psychology and Neuroscience, Maastricht University, Maastricht, The Netherlands
| | - Judith Peters
- Department of Cognitive Neuroscience, Faculty of Psychology and Neuroscience, Maastricht University, Maastricht, The Netherlands
| | - Axel Cleeremans
- Consciousness, Cognition and Computation group, Center for Research in Cognition & Neuroscience, Faculty of Psychology and Education, Université Libre de Bruxelles, Brussels, Belgium
| | - Rainer Goebel
- Brain Innovation B.V., Research Department, Maastricht, The Netherlands
- Department of Cognitive Neuroscience, Faculty of Psychology and Neuroscience, Maastricht University, Maastricht, The Netherlands
| |
Collapse
|
2
|
Kvamme TL, Sarmanlu M, Overgaard M. Doubting the double-blind: Introducing a questionnaire for awareness of experimental purposes in neurofeedback studies. Conscious Cogn 2022; 104:103381. [PMID: 35947940 DOI: 10.1016/j.concog.2022.103381] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/10/2022] [Revised: 07/18/2022] [Accepted: 07/19/2022] [Indexed: 11/29/2022]
Abstract
Double-blinding subjects to the experiment's purpose is an important standard in neurofeedback studies. However, it is difficult to provide evidence that humans are entirely unaware of certain information. This study used insights from consciousness studies and neurophenomenology to develop a contingency awareness questionnaire for neurofeedback. We assessed whether participants had an awareness of experimental purposes to manipulate their attention and multisensory perception. A subset of subjects (5 out of 20) gained a degree of awareness of experimental purposes as evidenced by their correct guess about the purposes of the experiment to affect their attention and multisensory perceptions specific to their double-blinded group assignment. The results warrant replication before they are applied to clinical neurofeedback studies, given the considerable time taken to perform the questionnaire (∼25 min). We discuss the strengths and limitations of our contingency awareness questionnaire and the growing appeal of the double-blinded standard in clinical neurofeedback studies.
Collapse
Affiliation(s)
- Timo L Kvamme
- Cognitive Neuroscience Research Unit, CFIN/MINDLab, Aarhus University, Aarhus, Denmark; Centre for Alcohol and Drug Research, Aarhus University, Aarhus, Denmark.
| | - Mesud Sarmanlu
- Cognitive Neuroscience Research Unit, CFIN/MINDLab, Aarhus University, Aarhus, Denmark
| | - Morten Overgaard
- Cognitive Neuroscience Research Unit, CFIN/MINDLab, Aarhus University, Aarhus, Denmark
| |
Collapse
|
3
|
Lubianiker N, Paret C, Dayan P, Hendler T. Neurofeedback through the lens of reinforcement learning. Trends Neurosci 2022; 45:579-593. [PMID: 35550813 DOI: 10.1016/j.tins.2022.03.008] [Citation(s) in RCA: 13] [Impact Index Per Article: 6.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/17/2021] [Revised: 02/11/2022] [Accepted: 03/24/2022] [Indexed: 11/29/2022]
Abstract
Despite decades of experimental and clinical practice, the neuropsychological mechanisms underlying neurofeedback (NF) training remain obscure. NF is a unique form of reinforcement learning (RL) task, during which participants are provided with rewarding feedback regarding desired changes in neural patterns. However, key RL considerations - including choices during practice, prediction errors, credit-assignment problems, or the exploration-exploitation tradeoff - have infrequently been considered in the context of NF. We offer an RL-based framework for NF, describing different internal states, actions, and rewards in common NF protocols, thus fashioning new proposals for characterizing, predicting, and hastening the course of learning. In this way we hope to advance current understanding of neural regulation via NF, and ultimately to promote its effectiveness, personalization, and clinical utility.
Collapse
Affiliation(s)
- Nitzan Lubianiker
- School of Psychological Sciences, Gershon H. Gordon Faculty of Social Sciences, Tel Aviv University, Tel Aviv, Israel; Sagol Brain Institute, Wohl Institute for Advanced Imaging, Tel Aviv Sourasky Medical Center, Tel Aviv, Israel.
| | - Christian Paret
- School of Psychological Sciences, Gershon H. Gordon Faculty of Social Sciences, Tel Aviv University, Tel Aviv, Israel; Sagol Brain Institute, Wohl Institute for Advanced Imaging, Tel Aviv Sourasky Medical Center, Tel Aviv, Israel; Department of Psychosomatic Medicine and Psychotherapy, Central Institute of Mental Health Mannheim, Medical Faculty Mannheim/Heidelberg University, Mannheim, Germany
| | - Peter Dayan
- Max Planck Institute for Biological Cybernetics, Tübingen, Germany; University of Tübingen, Tübingen, Germany
| | - Talma Hendler
- School of Psychological Sciences, Gershon H. Gordon Faculty of Social Sciences, Tel Aviv University, Tel Aviv, Israel; Sagol Brain Institute, Wohl Institute for Advanced Imaging, Tel Aviv Sourasky Medical Center, Tel Aviv, Israel; Sagol school of Neuroscience, Tel Aviv University, Tel Aviv, Israel; Sackler Faculty of Medicine, Tel Aviv University, Tel Aviv, Israel.
| |
Collapse
|
4
|
Stirner M, Gurevitch G, Lubianiker N, Hendler T, Schmahl C, Paret C. An Investigation of Awareness and Metacognition in Neurofeedback with the Amygdala Electrical Fingerprint. Conscious Cogn 2022; 98:103264. [PMID: 35026688 DOI: 10.1016/j.concog.2021.103264] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/07/2021] [Revised: 11/24/2021] [Accepted: 12/15/2021] [Indexed: 11/16/2022]
Abstract
Awareness theory posits that individuals connected to a brain-computer interface can learn to estimate and discriminate their brain states. We used the amygdala Electrical Fingerprint (amyg-EFP) - a functional Magnetic Resonance Imaging-inspired Electroencephalogram surrogate of deep brain activation - to investigate whether participants could accurately estimate their own brain activation. Ten participants completed up to 20 neurofeedback runs and estimated their amygdala-EFP activation (depicted as a thermometer) and confidence in this rating during each trial. We analysed data using multilevel models, predicting the real thermometer position with participant rated position and adjusted for activation during the previous trial. Hypotheses on learning regulation and improvement of estimation were not confirmed. However, participant ratings were significantly associated with the amyg-EFP signal. Higher rating accuracy also predicted higher subjective confidence in the rating. This proof-of-concept study introduces an approach to study awareness with fMRI-informed neurofeedback and provides initial evidence for metacognition in neurofeedback.
Collapse
Affiliation(s)
- Madita Stirner
- Department of Psychosomatic Medicine and Psychotherapy, Central Institute of Mental Health Mannheim, Medical Faculty Mannheim/Heidelberg University, Germany
| | - Guy Gurevitch
- Sagol Brain Institute, Wohl Institute for Advanced Imaging, Tel-Aviv Sourasky Medical Center and School of Psychological Sciences, Tel-Aviv University, Israel; Department of Physiology and Pharmacology, Sackler Faculty of Medicine, Tel-Aviv University, Israel
| | - Nitzan Lubianiker
- Sagol Brain Institute, Wohl Institute for Advanced Imaging, Tel-Aviv Sourasky Medical Center and School of Psychological Sciences, Tel-Aviv University, Israel; School of Psychological Sciences, Gershon H. Gordon Faculty of Social Sciences, Tel-Aviv University, Israel
| | - Talma Hendler
- Sagol Brain Institute, Wohl Institute for Advanced Imaging, Tel-Aviv Sourasky Medical Center and School of Psychological Sciences, Tel-Aviv University, Israel; Department of Physiology and Pharmacology, Sackler Faculty of Medicine, Tel-Aviv University, Israel; School of Psychological Sciences, Gershon H. Gordon Faculty of Social Sciences, Tel-Aviv University, Israel
| | - Christian Schmahl
- Department of Psychosomatic Medicine and Psychotherapy, Central Institute of Mental Health Mannheim, Medical Faculty Mannheim/Heidelberg University, Germany
| | - Christian Paret
- Department of Psychosomatic Medicine and Psychotherapy, Central Institute of Mental Health Mannheim, Medical Faculty Mannheim/Heidelberg University, Germany; Sagol Brain Institute, Wohl Institute for Advanced Imaging, Tel-Aviv Sourasky Medical Center and School of Psychological Sciences, Tel-Aviv University, Israel.
| |
Collapse
|
5
|
Muñoz-Moldes S, Cleeremans A. Delineating implicit and explicit processes in neurofeedback learning. Neurosci Biobehav Rev 2020; 118:681-688. [PMID: 32918947 PMCID: PMC7758707 DOI: 10.1016/j.neubiorev.2020.09.003] [Citation(s) in RCA: 24] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/26/2020] [Revised: 08/09/2020] [Accepted: 09/05/2020] [Indexed: 11/21/2022]
Abstract
Neurofeedback allows humans to self-regulate neural activity in specific brain regions and is considered a promising tool for psychiatric interventions. Recently, methods have been developed to use neurofeedback implicitly, prompting a theoretical debate on the role of awareness in neurofeedback learning. We offer a critical review of the role of awareness in neurofeedback learning, with a special focus on recently developed neurofeedback paradigms. We detail differences in instructions and propose a fine-grained categorization of tasks based on the degree of involvement of explicit and implicit processes. Finally, we review the methods used to measure awareness in neurofeedback and propose new candidate measures. We conclude that explicit processes cannot be eschewed in most current implicit tasks that have explicit goals, and suggest ways in which awareness could be better measured in the future. Investigating awareness during learning will help understand the learning mechanisms underlying neurofeedback learning and will help shape future tasks.
Collapse
Affiliation(s)
- Santiago Muñoz-Moldes
- Consciousness, Cognition and Computation group, Center for Research in Cognition & Neuroscience, Faculty of Psychology and Education, Université Libre de Bruxelles, 1050 Brussels, Belgium; Department of Psychology, University of Cambridge, Cambridge, United Kingdom.
| | - Axel Cleeremans
- Consciousness, Cognition and Computation group, Center for Research in Cognition & Neuroscience, Faculty of Psychology and Education, Université Libre de Bruxelles, 1050 Brussels, Belgium.
| |
Collapse
|
6
|
Jawed S, Amin HU, Malik AS, Faye I. Classification of Visual and Non-visual Learners Using Electroencephalographic Alpha and Gamma Activities. Front Behav Neurosci 2019; 13:86. [PMID: 31133829 PMCID: PMC6513874 DOI: 10.3389/fnbeh.2019.00086] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/08/2018] [Accepted: 04/11/2019] [Indexed: 11/13/2022] Open
Abstract
This study analyzes the learning styles of subjects based on their electroencephalo-graphy (EEG) signals. The goal is to identify how the EEG features of a visual learner differ from those of a non-visual learner. The idea is to measure the students' EEGs during the resting states (eyes open and eyes closed conditions) and when performing learning tasks. For this purpose, 34 healthy subjects are recruited. The subjects have no background knowledge of the animated learning content. The subjects are shown the animated learning content in a video format. The experiment consists of two sessions and each session comprises two parts: (1) Learning task: the subjects are shown the animated learning content for an 8-10 min duration. (2) Memory retrieval task The EEG signals are measured during the leaning task and memory retrieval task in two sessions. The retention time for the first session was 30 min, and 2 months for the second session. The analysis is performed for the EEG measured during the memory retrieval tasks. The study characterizes and differentiates the visual learners from the non-visual learners considering the extracted EEG features, such as the power spectral density (PSD), power spectral entropy (PSE), and discrete wavelet transform (DWT). The PSD and DWT features are analyzed. The EEG PSD and DWT features are computed for the recorded EEG in the alpha and gamma frequency bands over 128 scalp sites. The alpha and gamma frequency band for frontal, occipital, and parietal regions are analyzed as these regions are activated during learning. The extracted PSD and DWT features are then reduced to 8 and 15 optimum features using principal component analysis (PCA). The optimum features are then used as an input to the k-nearest neighbor (k-NN) classifier using the Mahalanobis distance metric, with 10-fold cross validation and support vector machine (SVM) classifier using linear kernel, with 10-fold cross validation. The classification results showed 97% and 94% accuracies rate for the first session and 96% and 93% accuracies for the second session in the alpha and gamma bands for the visual learners and non-visual learners, respectively, for k-NN classifier for PSD features and 68% and 100% accuracies rate for first session and 100% accuracies rate for second session for DWT features using k-NN classifier for the second session in the alpha and gamma band. For PSD features 97% and 96% accuracies rate for the first session, 100% and 95% accuracies rate for second session using SVM classifier and 79% and 82% accuracy for first session and 56% and 74% accuracy for second session for DWT features using SVM classifier. The results showed that the PSDs in the alpha and gamma bands represent distinct and stable EEG signatures for visual learners and non-visual learners during the retrieval of the learned contents.
Collapse
Affiliation(s)
- Soyiba Jawed
- Centre of Intelligent Signal and Imaging Research, Universiti Teknologi PETRONAS, Seri Iskandar, Malaysia.,Department of Electrical and Electronic Engineering, Universiti Teknologi PETRONAS, Seri Iskandar, Malaysia
| | - Hafeez Ullah Amin
- Centre of Intelligent Signal and Imaging Research, Universiti Teknologi PETRONAS, Seri Iskandar, Malaysia.,Department of Electrical and Electronic Engineering, Universiti Teknologi PETRONAS, Seri Iskandar, Malaysia
| | | | - Ibrahima Faye
- Centre of Intelligent Signal and Imaging Research, Universiti Teknologi PETRONAS, Seri Iskandar, Malaysia.,Department of Fundamental and Applied Sciences, Universiti Teknologi PETRONAS, Seri Iskandar, Malaysia
| |
Collapse
|