1
|
Grasso-Cladera A, Bremer M, Ladouce S, Parada F. A systematic review of mobile brain/body imaging studies using the P300 event-related potentials to investigate cognition beyond the laboratory. COGNITIVE, AFFECTIVE & BEHAVIORAL NEUROSCIENCE 2024; 24:631-659. [PMID: 38834886 DOI: 10.3758/s13415-024-01190-z] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Accepted: 04/15/2024] [Indexed: 06/06/2024]
Abstract
The P300 ERP component, related to the onset of task-relevant or infrequent stimuli, has been widely used in the Mobile Brain/Body Imaging (MoBI) literature. This systematic review evaluates the quality and breadth of P300 MoBI studies, revealing a maturing field with well-designed research yet grappling with standardization and global representation challenges. While affirming the reliability of measuring P300 ERP components in mobile settings, the review identifies significant hurdles in standardizing data cleaning and processing techniques, impacting comparability and reproducibility. Geographical disparities emerge, with studies predominantly in the Global North and a dearth of research from the Global South, emphasizing the need for broader inclusivity to counter the WEIRD bias in psychology. Collaborative projects and mobile EEG systems showcase the feasibility of reaching diverse populations, which is essential to advance precision psychiatry and to integrate varied data streams. Methodologically, a trend toward ecological validity is noted, shifting from lab-based to real-world settings with portable EEG system advancements. Future hardware developments are expected to balance signal quality and sensor intrusiveness, enriching data collection in everyday contexts. Innovative methodologies reflect a move toward more natural experimental settings, prompting critical questions about the applicability of traditional ERP markers, such as the P300 outside structured paradigms. The review concludes by highlighting the crucial role of integrating mobile technologies, physiological sensors, and machine learning to advance cognitive neuroscience. It advocates for an operational definition of ecological validity to bridge the gap between controlled experiments and the complexity of embodied cognitive experiences, enhancing both theoretical understanding and practical application in study design.
Collapse
Affiliation(s)
| | - Marko Bremer
- Facultad de Psicología, Centro de Estudios en Neurociencia Humana y Neuropsicología (CENHN), Diego Portales University, Santiago, Chile
- Facultad de Psicología, Programa de Magíster en Neurociencia Social, Diego Portales University, Santiago, Chile
| | - Simon Ladouce
- Department Brain and Cognition, Leuven Brain Institute, KU Leuven, Leuven, Belgium
| | - Francisco Parada
- Facultad de Psicología, Centro de Estudios en Neurociencia Humana y Neuropsicología (CENHN), Diego Portales University, Santiago, Chile.
| |
Collapse
|
2
|
Kober SE, Wood G, Schuster S, Körner C. Do Miniature Eye Movements Affect Neurofeedback Training Performance? A Combined EEG-Eye Tracking Study. Appl Psychophysiol Biofeedback 2024; 49:313-327. [PMID: 38492124 PMCID: PMC11101551 DOI: 10.1007/s10484-024-09625-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 02/08/2024] [Indexed: 03/18/2024]
Abstract
EEG-based neurofeedback is a prominent method to modulate one's own brain activity in a desired direction. However, the EEG signal can be disturbed by artifacts, e.g., eye movements, which can consequently confound the neurofeedback performance. Involuntary miniature eye movements can be hardly detected by conventional EEG correction methods such as recording the electro-oculogram (EOG) and subtracting EOG activity from the EEG signal. However, such miniature eye movements can influence EEG activity, especially in the Gamma frequency range, enormously. In the present study, we investigated whether power in different EEG frequencies can be effectively modulated by self-control of brain signals during neurofeedback training and/or whether changes in EEG power are provoked by miniature eye movements during the training. To this end, 24 participants performed one session of SMR and one session of Gamma neurofeedback training. Additionally, in each training session sham feedback was performed. An eye tracker was used to detect miniature eye movements (< 1°) during neurofeedback training. About two thirds of the participants were able to increase their SMR power over the course of NF training, while one third was able to increase Gamma power. Generally, miniature eye movements induced a strong Gamma power increase. The number of eye movements also increased numerically over the course of the NF training. However, we did not find a significant relationship with the NF training performance. This is a first indication that miniature saccades do not affect NF training performance, but should not be neglected during NF training. Our results have to be confirmed in future studies.
Collapse
Affiliation(s)
- Silvia Erika Kober
- Department of Psychology, University of Graz, Universitaetsplatz 2/III, 8010, Graz, Austria.
- BioTechMed-Graz, Graz, Austria.
| | - Guilherme Wood
- Department of Psychology, University of Graz, Universitaetsplatz 2/III, 8010, Graz, Austria
- BioTechMed-Graz, Graz, Austria
| | - Sarah Schuster
- Department of Psychology, University of Graz, Universitaetsplatz 2/III, 8010, Graz, Austria
| | - Christof Körner
- Department of Psychology, University of Graz, Universitaetsplatz 2/III, 8010, Graz, Austria
- BioTechMed-Graz, Graz, Austria
| |
Collapse
|
3
|
Natalizio A, Sieghartsleitner S, Schreiner L, Walchshofer M, Esposito A, Scharinger J, Pretl H, Arpaia P, Parvis M, Solé-Casals J, Sebastián-Romagosa M, Ortner R, Guger C. Real-time estimation of EEG-based engagement in different tasks. J Neural Eng 2024; 21:016014. [PMID: 38237182 DOI: 10.1088/1741-2552/ad200d] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/28/2023] [Accepted: 01/18/2024] [Indexed: 02/01/2024]
Abstract
Objective.Recent trends in brain-computer interface (BCI) research concern the passive monitoring of brain activity, which aim to monitor a wide variety of cognitive states. Engagement is such a cognitive state, which is of interest in contexts such as learning, entertainment or rehabilitation. This study proposes a novel approach for real-time estimation of engagement during different tasks using electroencephalography (EEG).Approach.Twenty-three healthy subjects participated in the BCI experiment. A modified version of the d2 test was used to elicit engagement. Within-subject classification models which discriminate between engaging and resting states were trained based on EEG recorded during a d2 test based paradigm. The EEG was recorded using eight electrodes and the classification model was based on filter-bank common spatial patterns and a linear discriminant analysis. The classification models were evaluated in cross-task applications, namely when playing Tetris at different speeds (i.e. slow, medium, fast) and when watching two videos (i.e. advertisement and landscape video). Additionally, subjects' perceived engagement was quantified using a questionnaire.Main results.The models achieved a classification accuracy of 90% on average when tested on an independent d2 test paradigm recording. Subjects' perceived and estimated engagement were found to be greater during the advertisement compared to the landscape video (p= 0.025 andp<0.001, respectively); greater during medium and fast compared to slow Tetris speed (p<0.001, respectively); not different between medium and fast Tetris speeds. Additionally, a common linear relationship was observed for perceived and estimated engagement (rrm= 0.44,p<0.001). Finally, theta and alpha band powers were investigated, which respectively increased and decreased during more engaging states.Significance.This study proposes a task-specific EEG engagement estimation model with cross-task capabilities, offering a framework for real-world applications.
Collapse
Affiliation(s)
- Angela Natalizio
- g.tec medical engineering GmbH, Schiedlberg, Austria
- Augmented Reality for Health Monitoring Laboratory (ARHeMLab), Università degli Studi di Napoli Federico II, Naples, Italy
- Department of Electronics and Telecommunications (DET), Polytechnic of Turin, Turin, Italy
| | - Sebastian Sieghartsleitner
- g.tec medical engineering GmbH, Schiedlberg, Austria
- Institute of Computational Perception, Johannes Kepler University, Linz, Austria
| | - Leonhard Schreiner
- g.tec medical engineering GmbH, Schiedlberg, Austria
- Institute for Integrated Circuits, Johannes Kepler University, Linz, Austria
| | | | - Antonio Esposito
- Augmented Reality for Health Monitoring Laboratory (ARHeMLab), Università degli Studi di Napoli Federico II, Naples, Italy
- Department of Engineering for Innovation University of Salento, Lecce, Italy
| | - Josef Scharinger
- Institute of Computational Perception, Johannes Kepler University, Linz, Austria
| | - Harald Pretl
- Institute for Integrated Circuits, Johannes Kepler University, Linz, Austria
| | - Pasquale Arpaia
- Augmented Reality for Health Monitoring Laboratory (ARHeMLab), Università degli Studi di Napoli Federico II, Naples, Italy
- Department of Electrical Engineering and Information Technology (DIETI), Università degli Studi di Napoli Federico II, Naples, Italy
- Centro Interdipartimentale di Ricerca in Management Sanitario e Innovazione in Sanità (CIRMIS), Università degli Studi di Napoli Federico II, Naples, Italy
| | - Marco Parvis
- Department of Electronics and Telecommunications (DET), Polytechnic of Turin, Turin, Italy
| | - Jordi Solé-Casals
- Data and Signal Processing Research Group, University of Vic-Central, University of Catalonia, Vic, Catalonia, Spain
- Department of Psychiatry, University of Cambridge, Cambridge, United Kingdom
| | | | - Rupert Ortner
- g.tec medical engineering Spain SL, Barcelona, Spain
| | - Christoph Guger
- g.tec medical engineering GmbH, Schiedlberg, Austria
- g.tec medical engineering Spain SL, Barcelona, Spain
| |
Collapse
|
4
|
Foster Vander Elst O, Foster NHD, Vuust P, Keller PE, Kringelbach ML. The Neuroscience of Dance: A Conceptual Framework and Systematic Review. Neurosci Biobehav Rev 2023; 150:105197. [PMID: 37100162 DOI: 10.1016/j.neubiorev.2023.105197] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/14/2022] [Revised: 04/13/2023] [Accepted: 04/21/2023] [Indexed: 04/28/2023]
Abstract
Ancient and culturally universal, dance pervades many areas of life and has multiple benefits. In this article, we provide a conceptual framework and systematic review, as a guide for researching the neuroscience of dance. We identified relevant articles following PRISMA guidelines, and summarised and evaluated all original results. We identified avenues for future research in: the interactive and collective aspects of dance; groove; dance performance; dance observation; and dance therapy. Furthermore, the interactive and collective aspects of dance constitute a vital part of the field but have received almost no attention from a neuroscientific perspective so far. Dance and music engage overlapping brain networks, including common regions involved in perception, action, and emotion. In music and dance, rhythm, melody, and harmony are processed in an active, sustained pleasure cycle giving rise to action, emotion, and learning, led by activity in specific hedonic brain networks. The neuroscience of dance is an exciting field, which may yield information concerning links between psychological processes and behaviour, human flourishing, and the concept of eudaimonia.
Collapse
Affiliation(s)
- Olivia Foster Vander Elst
- Center for Music in the Brain, Department of Clinical Medicine, Aarhus University & The Royal Academy of Music Aarhus/Aalborg, Denmark; Centre for Eudaimonia and Human Flourishing, Linacre College, University of Oxford, UK.
| | | | - Peter Vuust
- Center for Music in the Brain, Department of Clinical Medicine, Aarhus University & The Royal Academy of Music Aarhus/Aalborg, Denmark
| | - Peter E Keller
- Center for Music in the Brain, Department of Clinical Medicine, Aarhus University & The Royal Academy of Music Aarhus/Aalborg, Denmark; The MARCS Institute for Brain, Behaviour and Development, Western Sydney University, Australia
| | - Morten L Kringelbach
- Center for Music in the Brain, Department of Clinical Medicine, Aarhus University & The Royal Academy of Music Aarhus/Aalborg, Denmark; Centre for Eudaimonia and Human Flourishing, Linacre College, University of Oxford, UK; Department of Psychiatry, University of Oxford, UK
| |
Collapse
|
5
|
Moreau Q, Parrotta E, Pesci UG, Era V, Candidi M. Early categorization of social affordances during the visual encoding of bodily stimuli. Neuroimage 2023; 274:120151. [PMID: 37191657 DOI: 10.1016/j.neuroimage.2023.120151] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/29/2022] [Revised: 04/27/2023] [Accepted: 04/30/2023] [Indexed: 05/17/2023] Open
Abstract
Interpersonal interactions rely on various communication channels, both verbal and non-verbal, through which information regarding one's intentions and emotions are perceived. Here, we investigated the neural correlates underlying the visual processing of hand postures conveying social affordances (i.e., hand-shaking), compared to control stimuli such as hands performing non-social actions (i.e., grasping) or showing no movement at all. Combining univariate and multivariate analysis on electroencephalography (EEG) data, our results indicate that occipito-temporal electrodes show early differential processing of stimuli conveying social information compared to non-social ones. First, the amplitude of the Early Posterior Negativity (EPN, an Event-Related Potential related to the perception of body parts) is modulated differently during the perception of social and non-social content carried by hands. Moreover, our multivariate classification analysis (MultiVariate Pattern Analysis - MVPA) expanded the univariate results by revealing early (<200 ms) categorization of social affordances over occipito-parietal sites. In conclusion, we provide new evidence suggesting that the encoding of socially relevant hand gestures is categorized in the early stages of visual processing.
Collapse
Affiliation(s)
- Q Moreau
- Department of Psychology, Sapienza University, Rome, Italy; IRCCS Fondazione Santa Lucia, Rome, Italy.
| | - E Parrotta
- Department of Psychology, Sapienza University, Rome, Italy; IRCCS Fondazione Santa Lucia, Rome, Italy
| | - U G Pesci
- Department of Psychology, Sapienza University, Rome, Italy; IRCCS Fondazione Santa Lucia, Rome, Italy
| | - V Era
- Department of Psychology, Sapienza University, Rome, Italy; IRCCS Fondazione Santa Lucia, Rome, Italy
| | - M Candidi
- Department of Psychology, Sapienza University, Rome, Italy; IRCCS Fondazione Santa Lucia, Rome, Italy.
| |
Collapse
|
6
|
Hoshi A, Hirayama Y, Saito F, Ishiguro T, Suetani H, Kitajo K. Spatiotemporal consistency of neural responses to repeatedly presented video stimuli accounts for population preferences. Sci Rep 2023; 13:5532. [PMID: 37015982 PMCID: PMC10073227 DOI: 10.1038/s41598-023-31751-0] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/09/2022] [Accepted: 03/16/2023] [Indexed: 04/06/2023] Open
Abstract
Population preferences for video advertisements vary across short video clips. What underlies these differences? Repeatedly watching a video clip may produce a consistent spatiotemporal pattern of neural activity that is dependent on the individual and the stimulus. Moreover, such consistency may be associated with the degree of engagement and memory of individual viewers. Since the population preferences are associated with the engagement and memory of the individual viewers, the consistency observed in a smaller group of viewers can be a predictor of population preferences. To test the hypothesis, we measured the degree of inter-trial consistency in participants' electroencephalographic (EEG) responses to repeatedly presented television commercials. We observed consistency in the neural activity patterns across repetitive views and found that the similarity in the spatiotemporal patterns of neural responses while viewing popular television commercials predicts population preferences obtained from a large audience. Moreover, a regression model that used two datasets, including two separate groups of participants viewing different stimulus sets, showed good predictive performance in a leave-one-out cross-validation. These findings suggest that universal spatiotemporal patterns in EEG responses can account for population-level human behaviours.
Collapse
Affiliation(s)
- Ayaka Hoshi
- RIKEN Center for Brain Science, 2-1 Hirosawa, Wako, Saitama, 351-0198, Japan
- KIRIN Central Research Institute, Research & Development Division, Kirin Holdings Company, Limited, 26-1-12-12 Muraoka-Higashi 2-chome, Fujisawa, Kanagawa, 251-8555, Japan
| | - Yuya Hirayama
- RIKEN Center for Brain Science, 2-1 Hirosawa, Wako, Saitama, 351-0198, Japan
| | - Fumihiro Saito
- RIKEN Center for Brain Science, 2-1 Hirosawa, Wako, Saitama, 351-0198, Japan
| | - Tatsuji Ishiguro
- KIRIN Central Research Institute, Research & Development Division, Kirin Holdings Company, Limited, 26-1-12-12 Muraoka-Higashi 2-chome, Fujisawa, Kanagawa, 251-8555, Japan
| | - Hiromichi Suetani
- RIKEN Center for Brain Science, 2-1 Hirosawa, Wako, Saitama, 351-0198, Japan
- Faculty of Science and Technology, Oita University, 700 Dannoharu, Oita, 870-1192, Japan
| | - Keiichi Kitajo
- RIKEN Center for Brain Science, 2-1 Hirosawa, Wako, Saitama, 351-0198, Japan.
- Division of Neural Dynamics, Department of System Neuroscience, National Institute for Physiological Sciences, National Institutes of Natural Sciences, 38 Nishigonaka, Myodaiji, Okazaki, Aichi, 444-8585, Japan.
- Department of Physiological Sciences, School of Life Science, The Graduate University for Advanced Studies (SOKENDAI), 38 Nishigonaka, Myodaiji, Okazaki, 444-8585, Japan.
| |
Collapse
|
7
|
Kaiser D. Spectral brain signatures of aesthetic natural perception in the α and β frequency bands. J Neurophysiol 2022; 128:1501-1505. [PMID: 36259673 DOI: 10.1152/jn.00385.2022] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/06/2023] Open
Abstract
During our everyday lives, visual beauty is often conveyed by sustained and dynamic visual stimulation, such as when we walk through an enchanting forest or watch our pets playing. Here, I devised an MEG experiment that mimics such situations: participants viewed 8 s videos of everyday situations and rated their beauty. Using multivariate analysis, I linked aesthetic ratings to 1) sustained MEG broadband responses and 2) spectral MEG responses in the α and β frequency bands. These effects were not accounted for by a set of high- and low-level visual descriptors of the videos, suggesting that they are genuinely related to aesthetic perception. My findings provide the first characterization of spectral brain signatures linked to aesthetic experiences in the real world.NEW & NOTEWORTHY In the real world, aesthetic experiences arise from complex and dynamic inputs. This study shows that such aesthetic experiences are represented in a spectral neural code: cortical α and β activity track our judgments of the aesthetic appearance of natural videos, providing a new starting point for studying the neural correlates of beauty through rhythmic brain activity.
Collapse
Affiliation(s)
- Daniel Kaiser
- Mathematical Institute, Department of Mathematics and Computer Science, Physics, Geography, Justus-Liebig-University, Gießen, Germany.,Center for Mind, Brain and Behavior (CMBB), Philipps-University Marburg and Justus-Liebig-University Gießen, Germany
| |
Collapse
|