1
|
Grasso-Cladera A, Bremer M, Ladouce S, Parada F. A systematic review of mobile brain/body imaging studies using the P300 event-related potentials to investigate cognition beyond the laboratory. COGNITIVE, AFFECTIVE & BEHAVIORAL NEUROSCIENCE 2024; 24:631-659. [PMID: 38834886 DOI: 10.3758/s13415-024-01190-z] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Accepted: 04/15/2024] [Indexed: 06/06/2024]
Abstract
The P300 ERP component, related to the onset of task-relevant or infrequent stimuli, has been widely used in the Mobile Brain/Body Imaging (MoBI) literature. This systematic review evaluates the quality and breadth of P300 MoBI studies, revealing a maturing field with well-designed research yet grappling with standardization and global representation challenges. While affirming the reliability of measuring P300 ERP components in mobile settings, the review identifies significant hurdles in standardizing data cleaning and processing techniques, impacting comparability and reproducibility. Geographical disparities emerge, with studies predominantly in the Global North and a dearth of research from the Global South, emphasizing the need for broader inclusivity to counter the WEIRD bias in psychology. Collaborative projects and mobile EEG systems showcase the feasibility of reaching diverse populations, which is essential to advance precision psychiatry and to integrate varied data streams. Methodologically, a trend toward ecological validity is noted, shifting from lab-based to real-world settings with portable EEG system advancements. Future hardware developments are expected to balance signal quality and sensor intrusiveness, enriching data collection in everyday contexts. Innovative methodologies reflect a move toward more natural experimental settings, prompting critical questions about the applicability of traditional ERP markers, such as the P300 outside structured paradigms. The review concludes by highlighting the crucial role of integrating mobile technologies, physiological sensors, and machine learning to advance cognitive neuroscience. It advocates for an operational definition of ecological validity to bridge the gap between controlled experiments and the complexity of embodied cognitive experiences, enhancing both theoretical understanding and practical application in study design.
Collapse
Affiliation(s)
| | - Marko Bremer
- Facultad de Psicología, Centro de Estudios en Neurociencia Humana y Neuropsicología (CENHN), Diego Portales University, Santiago, Chile
- Facultad de Psicología, Programa de Magíster en Neurociencia Social, Diego Portales University, Santiago, Chile
| | - Simon Ladouce
- Department Brain and Cognition, Leuven Brain Institute, KU Leuven, Leuven, Belgium
| | - Francisco Parada
- Facultad de Psicología, Centro de Estudios en Neurociencia Humana y Neuropsicología (CENHN), Diego Portales University, Santiago, Chile.
| |
Collapse
|
2
|
Zeng H, Zeng X, Liu N, Ding Y, Wu J, Zhang F, Xiong N. Development and validation of a nomogram for tracheotomy decannulation in individuals in a persistent vegetative state: A multicentre study. Ann Phys Rehabil Med 2024; 67:101849. [PMID: 38830320 DOI: 10.1016/j.rehab.2024.101849] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/27/2023] [Revised: 03/12/2024] [Accepted: 03/20/2024] [Indexed: 06/05/2024]
Abstract
BACKGROUND Decannulation for people in a persistent vegetative state (PVS) is challenging and relevant predictors of successful decannulation have yet to be identified. OBJECTIVE This study aimed to explore the predictors of tracheostomy decannulation outcomes in individuals in PVS and to develop a nomogram. METHOD In 2022, 872 people with tracheostomy in PVS were retrospectively enrolled and their data was randomly divided into a training set and a validation set in a 7:3 ratio. Univariate and multivariate regression analyses were performed on the training set to explore the influencing factors for decannulation and nomogram development. Internal validation was performed using 5-fold cross-validation. External validation was performed using receiver operating characteristic (ROC) curves, calibration curves, and decision curve analysis (DCA) on both the training and validation sets. RESULT Data from 610 to 262 individuals were used for the training and validation sets, respectively. The multivariate regression analysis found that duration of tracheostomy tube placement≥30 days (Odds Ratio [OR] 0.216, 95 % CI 0.151-0.310), pulmonary infection (OR 0.528, 95 %CI 0.366-0.761), hypoproteinemia (OR 0.669, 95 % CI 0.463-0.967), no passive standing training (OR 0.372, 95 % CI 0.253-0.547), abnormal swallowing reflex (OR 0.276, 95 % CI 0.116-0.656), mechanical ventilation (OR 0.658, 95 % CI 0.461-0.940), intensive care unit (ICU) duration>4 weeks (OR 0.517, 95 % CI 0.332-0.805), duration of endotracheal tube (OR 0.855, 95 % CI 0.803-0.907), older age (OR 0.981, 95 % CI 0.966-0.996) were risk factors for decannulation failure. Conversely, peroral feeding (OR 1.684, 95 % CI 1.178-2.406), passive standing training≥60 min (OR 1.687, 95 % CI 1.072-2.656), private caregiver (OR 1.944, 95 % CI 1.350-2.799) and ICU duration<2 weeks (OR 1.758, 95 % CI 1.173-2.634) were protective factors conducive to successful decannulation. The 5-fold cross-validation revealed a mean area under the curve of 0.744. The ROC curve C-indexes for the training and validation sets were 0.784 and 0.768, respectively, and the model exhibited good stability and accuracy. The DCA revealed a net benefit when the risk threshold was between 0 and 0.4. CONCLUSION The nomogram can help adjust the treatment and reduce decannulation failure. REGISTRATION Clinical registration is not mandatory for retrospective studies.
Collapse
Affiliation(s)
- Hongji Zeng
- School of Public Health, Zhengzhou University, No. 100 Science Avenue, Zhengzhou City, Henan Province 450000, China
| | - Xi Zeng
- Department of Rehabilitation Medicine III, The First Affiliated Hospital of Zhengzhou University, No.169-10 Nanyang Road, Zhengzhou City, Henan Province 450000, China; The NHC Key Laboratory of Prevention and Treatment of Cerebrovascular Disease, No.1 Jianshe East Road, Zhengzhou City, Henan Province 450000, China.
| | - Nanxi Liu
- Sanquan College, No. 688, East Section of Shixiangyang Road, Xinxiang City, Henan Province 453000, China
| | - Yu Ding
- Department of Neurology, The Second Medical Center, PLA General Hospital, No. 28 Fuxing Road, Beijing City 100000, China
| | - Junfa Wu
- Department of Rehabilitation Medicine, Huashan Hospital, Fudan University, No. 433 Huashan Road, Shanghai City 200000, China
| | - Fangquan Zhang
- Department of Rehabilitation Medicine, Xinyang Central Hospital, No.1 Siyi Road, Xinyang City, Henan Province 464000, China
| | - Nana Xiong
- Peking University Sixth Hospital, No. 51 Huayuan North Road, Beijing City 101499, China
| |
Collapse
|
3
|
Mathewson KE, Kuziek JP, Scanlon JEM, Robles D. The moving wave: Applications of the mobile EEG approach to study human attention. Psychophysiology 2024:e14603. [PMID: 38798056 DOI: 10.1111/psyp.14603] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/17/2023] [Revised: 04/22/2024] [Accepted: 04/23/2024] [Indexed: 05/29/2024]
Abstract
Although historically confined to traditional research laboratories, electroencephalography (EEG) paradigms are now being applied to study a wide array of behaviors, from daily activities to specialized tasks in diverse fields such as sports science, neurorehabilitation, and education. This transition from traditional to real-world mobile research can provide new tools for understanding attentional processes as they occur naturally. Early mobile EEG research has made progress, despite the large size and wired connections. Recent developments in hardware and software have expanded the possibilities of mobile EEG, enabling a broader range of applications. Despite these advancements, limitations influencing mobile EEG remain that must be overcome to achieve adequate reliability and validity. In this review, we first assess the feasibility of mobile paradigms, including electrode selection, artifact correction techniques, and methodological considerations. This review underscores the importance of ecological, construct, and predictive validity in ensuring the trustworthiness and applicability of mobile EEG findings. Second, we explore studies on attention in naturalistic settings, focusing on replicating classic P3 component studies in mobile paradigms like stationary biking in our lab, and activities such as walking, cycling, and dual-tasking outside of the lab. We emphasize how the mobile approach complements traditional laboratory paradigms and the types of insights gained in naturalistic research settings. Third, we discuss promising applications of portable EEG in workplace safety and other areas including road safety, rehabilitation medicine, and brain-computer interfaces. In summary, this review explores the expanding possibilities of mobile EEG while recognizing the existing challenges in fully realizing its potential.
Collapse
Affiliation(s)
- Kyle E Mathewson
- Department of Psychology, Faculty of Science, University of Alberta, Edmonton, Alberta, Canada
| | - Jonathan P Kuziek
- Faculty of Medicine, University of Calgary, Calgary, Alberta, Canada
| | | | - Daniel Robles
- Department of Psychology, Rutgers University, Piscataway, New Jersey, USA
| |
Collapse
|
4
|
Papin LJ, Esche M, Scanlon JEM, Jacobsen NSJ, Debener S. Investigating cognitive-motor effects during slacklining using mobile EEG. Front Hum Neurosci 2024; 18:1382959. [PMID: 38818032 PMCID: PMC11137308 DOI: 10.3389/fnhum.2024.1382959] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/07/2024] [Accepted: 04/24/2024] [Indexed: 06/01/2024] Open
Abstract
Balancing is a very important skill, supporting many daily life activities. Cognitive-motor interference (CMI) dual-tasking paradigms have been established to identify the cognitive load of complex natural motor tasks, such as running and cycling. Here we used wireless, smartphone-recorded electroencephalography (EEG) and motion sensors while participants were either standing on firm ground or on a slackline, either performing an auditory oddball task (dual-task condition) or no task simultaneously (single-task condition). We expected a reduced amplitude and increased latency of the P3 event-related potential (ERP) component to target sounds for the complex balancing compared to the standing on ground condition, and a further decrease in the dual-task compared to the single-task balancing condition. Further, we expected greater postural sway during slacklining while performing the concurrent auditory attention task. Twenty young, experienced slackliners performed an auditory oddball task, silently counting rare target tones presented in a series of frequently occurring standard tones. Results revealed similar P3 topographies and morphologies during both movement conditions. Contrary to our predictions we observed neither significantly reduced P3 amplitudes, nor significantly increased latencies during slacklining. Unexpectedly, we found greater postural sway during slacklining with no additional task compared to dual-tasking. Further, we found a significant correlation between the participant's skill level and P3 latency, but not between skill level and P3 amplitude or postural sway. This pattern of results indicates an interference effect for less skilled individuals, whereas individuals with a high skill level may have shown a facilitation effect. Our study adds to the growing field of research demonstrating that ERPs obtained in uncontrolled, daily-life situations can provide meaningful results. We argue that the individual CMI effects on the P3 ERP reflects how demanding the balancing task is for untrained individuals, which draws on limited resources that are otherwise available for auditory attention processing. In future work, the analysis of concurrently recorded motion-sensor signals will help to identify the cognitive demands of motor tasks executed in natural, uncontrolled environments.
Collapse
Affiliation(s)
- Lara J. Papin
- Neuropsychology Lab, Department of Psychology, Carl von Ossietzky University of Oldenburg, Oldenburg, Germany
| | - Manik Esche
- Neuropsychology Lab, Department of Psychology, Carl von Ossietzky University of Oldenburg, Oldenburg, Germany
| | - Joanna E. M. Scanlon
- Neuropsychology Lab, Department of Psychology, Carl von Ossietzky University of Oldenburg, Oldenburg, Germany
- Oldenburg Branch for Hearing, Speech and Audio Technology (HSA), Fraunhofer Institute for Digital Media Technology (IDMT), Oldenburg, Germany
| | - Nadine S. J. Jacobsen
- Neuropsychology Lab, Department of Psychology, Carl von Ossietzky University of Oldenburg, Oldenburg, Germany
| | - Stefan Debener
- Neuropsychology Lab, Department of Psychology, Carl von Ossietzky University of Oldenburg, Oldenburg, Germany
- Oldenburg Branch for Hearing, Speech and Audio Technology (HSA), Fraunhofer Institute for Digital Media Technology (IDMT), Oldenburg, Germany
- Cluster of Excellence Hearing4all, Carl von Ossietzky University of Oldenburg, Oldenburg, Germany
- Center for Neurosensory Science and Systems, Carl von Ossietzky University of Oldenburg, Oldenburg, Germany
| |
Collapse
|
5
|
Swerdloff MM, Hargrove LJ. Dry EEG measurement of P3 to evaluate cognitive load during sitting, standing, and walking. PLoS One 2023; 18:e0287885. [PMID: 37410768 PMCID: PMC10325065 DOI: 10.1371/journal.pone.0287885] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/02/2022] [Accepted: 06/14/2023] [Indexed: 07/08/2023] Open
Abstract
Combining brain imaging with dual-task paradigms provides a quantitative, direct metric of cognitive load that is agnostic to the motor task. This work aimed to quantitatively assess cognitive load during activities of daily living-sitting, standing, and walking-using a commercial dry encephalography headset. We recorded participants' brain activity while engaging in a stimulus paradigm that elicited event-related potentials. The stimulus paradigm consisted of an auditory oddball task in which participants had to report the number of oddball tones that were heard during each motor task. We extracted the P3 event-related potential, which is inversely proportional to cognitive load, from EEG signals in each condition. Our main findings showed that P3 was significantly lower during walking compared to sitting (p = .039), suggesting that cognitive load was higher during walking compared to the other activities. There were no significant differences in P3 between sitting and standing. Head motion did not have a significant impact on the measurement of cognitive load. This work validates the use of a commercial dry-EEG headset for measuring cognitive load across different motor tasks. The ability to accurately measure cognitive load in dynamic activities opens new avenues for exploring cognitive-motor interactions in individuals with and without motor impairments. This work highlights the potential of dry EEG for measuring cognitive load in naturalistic settings.
Collapse
Affiliation(s)
- Margaret M. Swerdloff
- Department of Biomedical Engineering, Northwestern University, Chicago, Illinois, United States of America
| | - Levi J. Hargrove
- Department of Biomedical Engineering, Northwestern University, Chicago, Illinois, United States of America
- Regenstein Center for Bionic Medicine, Shirley Ryan AbilityLab, Chicago, Illinois, United States of America
| |
Collapse
|
6
|
Damalerio RB, Lim R, Gao Y, Zhang TT, Cheng MY. Development of Low-Contact-Impedance Dry Electrodes for Electroencephalogram Signal Acquisition. SENSORS (BASEL, SWITZERLAND) 2023; 23:s23094453. [PMID: 37177657 PMCID: PMC10181682 DOI: 10.3390/s23094453] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/30/2023] [Revised: 04/24/2023] [Accepted: 04/30/2023] [Indexed: 05/15/2023]
Abstract
Dry electroencephalogram (EEG) systems have a short set-up time and require limited skin preparation. However, they tend to require strong electrode-to-skin contact. In this study, dry EEG electrodes with low contact impedance (<150 kΩ) were fabricated by partially embedding a polyimide flexible printed circuit board (FPCB) in polydimethylsiloxane and then casting them in a sensor mold with six symmetrical legs or bumps. Silver-silver chloride paste was used at the exposed tip of each leg or bump that must touch the skin. The use of an FPCB enabled the fabricated electrodes to maintain steady impedance. Two types of dry electrodes were fabricated: flat-disk electrodes for skin with limited hair and multilegged electrodes for common use and for areas with thick hair. Impedance testing was conducted with and without a custom head cap according to the standard 10-20 electrode arrangement. The experimental results indicated that the fabricated electrodes exhibited impedance values between 65 and 120 kΩ. The brain wave patterns acquired with these electrodes were comparable to those acquired using conventional wet electrodes. The fabricated EEG electrodes passed the primary skin irritation tests based on the ISO 10993-10:2010 protocol and the cytotoxicity tests based on the ISO 10993-5:2009 protocol.
Collapse
Affiliation(s)
- Ramona B Damalerio
- Institute of Microelectronics, Agency for Science, Technology and Research, Singapore 138634, Singapore
| | - Ruiqi Lim
- Institute of Microelectronics, Agency for Science, Technology and Research, Singapore 138634, Singapore
| | - Yuan Gao
- Institute of Microelectronics, Agency for Science, Technology and Research, Singapore 138634, Singapore
| | - Tan-Tan Zhang
- Institute of Microelectronics, Agency for Science, Technology and Research, Singapore 138634, Singapore
| | - Ming-Yuan Cheng
- Institute of Microelectronics, Agency for Science, Technology and Research, Singapore 138634, Singapore
| |
Collapse
|
7
|
Wireless EEG: A survey of systems and studies. Neuroimage 2023; 269:119774. [PMID: 36566924 DOI: 10.1016/j.neuroimage.2022.119774] [Citation(s) in RCA: 30] [Impact Index Per Article: 30.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/05/2022] [Revised: 11/18/2022] [Accepted: 11/27/2022] [Indexed: 12/24/2022] Open
Abstract
The popular brain monitoring method of electroencephalography (EEG) has seen a surge in commercial attention in recent years, focusing mostly on hardware miniaturization. This has led to a varied landscape of portable EEG devices with wireless capability, allowing them to be used by relatively unconstrained users in real-life conditions outside of the laboratory. The wide availability and relative affordability of these devices provide a low entry threshold for newcomers to the field of EEG research. The large device variety and the at times opaque communication from their manufacturers, however, can make it difficult to obtain an overview of this hardware landscape. Similarly, given the breadth of existing (wireless) EEG knowledge and research, it can be challenging to get started with novel ideas. Therefore, this paper first provides a list of 48 wireless EEG devices along with a number of important-sometimes difficult-to-obtain-features and characteristics to enable their side-by-side comparison, along with a brief introduction to each of these aspects and how they may influence one's decision. Secondly, we have surveyed previous literature and focused on 110 high-impact journal publications making use of wireless EEG, which we categorized by application and analyzed for device used, number of channels, sample size, and participant mobility. Together, these provide a basis for informed decision making with respect to hardware and experimental precedents when considering new, wireless EEG devices and research. At the same time, this paper provides background material and commentary about pitfalls and caveats regarding this increasingly accessible line of research.
Collapse
|
8
|
Scanlon JE, Jacobsen NS, Maack MC, Debener S. Outdoor walking: Mobile EEG dataset from walking during oddball task and walking synchronization task. Data Brief 2022; 46:108847. [PMID: 36687153 PMCID: PMC9852920 DOI: 10.1016/j.dib.2022.108847] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/24/2022] [Revised: 12/01/2022] [Accepted: 12/19/2022] [Indexed: 12/24/2022] Open
Abstract
This article describes a dataset from one standing and two outdoor walking tasks. Each task was performed by the same 18 participants twice, using foot accelerometers and two different EEG system configurations. The first task was a brief eyes open/eyes closed task. The second task was a six minute auditory oddball task performed in three conditions: Standing, walking alone and walking next to an experimenter. In the third task, the participants walked with the experimenter in three conditions: With their view of the experimenter blocked, walking naturally, and trying to synchronize their steps with the experimenter. During all walking conditions which included the experimenter, the experimenter walked following a headphone metronome to keep their steps consistent, also wearing a foot accelerometer. All tasks were performed twice on two separate days, using active electrode and passive electrode EEG configurations (Brain Products, GmbH). Data was used for Scanlon et al. (2021) and Scanlon et al. (2022), and could be used for learning about attention, walking mechanisms and social neuroscience. Scanlon, J. E., Jacobsen, N. S. J., Maack, M. C., & Debener, S. (2021). Does the electrode amplification style matter? A comparison of active and passive EEG system configurations during standing and walking. European Journal of Neuroscience, 54(12), 8381-8395. Scanlon, J. E. M., Jacobsen, N. S. J., Maack, M. C., & Debener, S. (2022). Stepping in time: Alpha-mu and beta oscillations during a walking synchronization task. NeuroImage, 253, 119099.
Collapse
Affiliation(s)
- Joanna E.M. Scanlon
- Neuropsychology Lab, Department of Psychology, University of Oldenburg, Germany,Branch for Hearing, Speech and Audio Technology HSA, Fraunhofer Institute for Digital Media Technology IDMT, Oldenburg, Germany,Corresponding author at: Neuropsychology Lab, Department of Psychology, University of Oldenburg, Germany. @joanna_scanlon
| | | | - Marike C. Maack
- Neuropsychology Lab, Department of Psychology, University of Oldenburg, Germany
| | - Stefan Debener
- Neuropsychology Lab, Department of Psychology, University of Oldenburg, Germany,Cluster of Excellence Hearing4all, University of Oldenburg, Oldenburg, Germany,Center for Neurosensory Science and Systems, University of Oldenburg, Oldenburg, Germany,Branch for Hearing, Speech and Audio Technology HSA, Fraunhofer Institute for Digital Media Technology IDMT, Oldenburg, Germany
| |
Collapse
|
9
|
Mavros P, J Wälti M, Nazemi M, Ong CH, Hölscher C. A mobile EEG study on the psychophysiological effects of walking and crowding in indoor and outdoor urban environments. Sci Rep 2022; 12:18476. [PMID: 36323718 PMCID: PMC9628500 DOI: 10.1038/s41598-022-20649-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/18/2021] [Accepted: 09/16/2022] [Indexed: 11/06/2022] Open
Abstract
Environmental psychologists have established multiple psychological benefits of interaction with natural, compared to urban, environments on emotion, cognition, and attention. Yet, given the increasing urbanisation worldwide, it is equally important to understand how differences within different urban environments influence human psychological experience. We developed a laboratory experiment to examine the psychophysiological effects of the physical (outdoor or indoor) and social (crowded versus uncrowded) environment in healthy young adults, and to validate the use of mobile electroencephalography (EEG) and electrodermal activity (EDA) measurements during active walking. Participants (N = 42) were randomly assigned into a walking or a standing group, and watched six 1-min walk-through videos of green, urban indoor and urban outdoor environments, depicting high or low levels of social density. Self-reported emotional states show that green spaces is perceived as more calm and positive, and reduce attentional demands. Further, the outdoor urban space is perceived more positively than the indoor environment. These findings are consistent with earlier studies on the psychological benefits of nature and confirm the effectiveness of our paradigm and stimuli. In addition, we hypothesised that even short-term exposure to crowded scenes would have negative psychological effects. We found that crowded scenes evoked higher self-reported arousal, more negative self-reported valence, and recruited more cognitive and attentional resources. However, in walking participants, they evoked higher frontal alpha asymmetry, suggesting more positive affective responses. Furthermore, we found that using recent signal-processing methods, the EEG data produced a comparable signal-to-noise ratio between walking and standing, and that despite differences between walking and standing, skin-conductance also captured effectively psychophysiological responses to stimuli. These results suggest that emotional responses to visually presented stimuli can be measured effectively using mobile EEG and EDA in ambulatory settings, and that there is complex interaction between active walking, the social density of urban spaces, and direct and indirect affective responses to such environments.
Collapse
Affiliation(s)
- Panagiotis Mavros
- Singapore-ETH Centre, Future Cities Laboratory, CREATE campus, 1 CREATE Way, #06-01 CREATE Tower, Singapore, 138602, Singapore.
| | - Michel J Wälti
- Singapore-ETH Centre, Future Cities Laboratory, CREATE campus, 1 CREATE Way, #06-01 CREATE Tower, Singapore, 138602, Singapore
| | - Mohsen Nazemi
- Singapore-ETH Centre, Future Cities Laboratory, CREATE campus, 1 CREATE Way, #06-01 CREATE Tower, Singapore, 138602, Singapore
| | - Crystal Huiyi Ong
- Singapore-ETH Centre, Future Cities Laboratory, CREATE campus, 1 CREATE Way, #06-01 CREATE Tower, Singapore, 138602, Singapore
- National University of Singapore, Singapore, Singapore
| | - Christoph Hölscher
- Singapore-ETH Centre, Future Cities Laboratory, CREATE campus, 1 CREATE Way, #06-01 CREATE Tower, Singapore, 138602, Singapore
- Chair of Cognitive Science, Department of Humanities, Social and Political Sciences, ETH Zürich, Zürich, 8092, Switzerland
| |
Collapse
|
10
|
Scanlon JEM, Jacobsen NSJ, Maack MC, Debener S. Stepping in time: Alpha-mu and beta oscillations during a walking synchronization task. Neuroimage 2022; 253:119099. [PMID: 35301131 DOI: 10.1016/j.neuroimage.2022.119099] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/05/2021] [Revised: 02/18/2022] [Accepted: 03/13/2022] [Indexed: 11/25/2022] Open
Abstract
Interpersonal behavioral synchrony is referred to as temporal coordination of action between two or more individuals. Humans tend to synchronize their movements during repetitive movement tasks such as walking. Mobile EEG technology now allows us to examine how this happens during gait. 18 participants equipped with foot accelerometers and mobile EEG walked with an experimenter in three conditions: With their view of the experimenter blocked, walking naturally, and trying to synchronize their steps with the experimenter. The experimenter walked following a headphone metronome to keep their steps consistent for all conditions. Step behavior and synchronization between the experimenter and participant were compared between conditions. Additionally, event-related spectral perturbations (ERSPs) were time-warped to the gait cycle in order to analyze alpha-mu (7.5-12.5 Hz) and beta (16-32 Hz) rhythms over the whole gait cycle. Step synchronization was significantly higher in the synchrony condition than in the natural condition. Likewise regarding ERSPs, right parietal channel (C4, C6, CP4, CP6) alpha-mu and central channel (C1, Cz, C2) beta power were suppressed from baseline in the walking synchrony condition compared to the natural walking condition. The natural and blocked conditions were not found to be significantly different in behavioral or spectral comparisons. Our results are compatible with the view that intentional synchronization employs systems associated with social interaction as well as the central motor system.
Collapse
Affiliation(s)
- J E M Scanlon
- Neuropsychology Lab, Department of Psychology, University of Oldenburg, Oldenburg, Germany.
| | - N S J Jacobsen
- Neuropsychology Lab, Department of Psychology, University of Oldenburg, Oldenburg, Germany
| | - M C Maack
- Neuropsychology Lab, Department of Psychology, University of Oldenburg, Oldenburg, Germany
| | - S Debener
- Neuropsychology Lab, Department of Psychology, University of Oldenburg, Oldenburg, Germany; Cluster of Excellence Hearing4all, University of Oldenburg, Oldenburg, Germany; Center for Neurosensory Science and Systems, University of Oldenburg, Oldenburg, Germany
| |
Collapse
|
11
|
Straetmans L, Holtze B, Debener S, Jaeger M, Mirkovic B. Neural tracking to go: auditory attention decoding and saliency detection with mobile EEG. J Neural Eng 2021; 18. [PMID: 34902846 DOI: 10.1088/1741-2552/ac42b5] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/13/2021] [Accepted: 12/13/2021] [Indexed: 11/11/2022]
Abstract
OBJECTIVE Neuro-steered assistive technologies have been suggested to offer a major advancement in future devices like neuro-steered hearing aids. Auditory attention decoding methods would in that case allow for identification of an attended speaker within complex auditory environments, exclusively from neural data. Decoding the attended speaker using neural information has so far only been done in controlled laboratory settings. Yet, it is known that ever-present factors like distraction and movement are reflected in the neural signal parameters related to attention. APPROACH Thus, in the current study we applied a two-competing speaker paradigm to investigate performance of a commonly applied EEG-based auditory attention decoding (AAD) model outside of the laboratory during leisure walking and distraction. Unique environmental sounds were added to the auditory scene and served as distractor events. MAIN RESULTS The current study shows, for the first time, that the attended speaker can be accurately decoded during natural movement. At a temporal resolution of as short as 5-seconds and without artifact attenuation, decoding was found to be significantly above chance level. Further, as hypothesized, we found a decrease in attention to the to-be-attended and the to-be-ignored speech stream after the occurrence of a salient event. Additionally, we demonstrate that it is possible to predict neural correlates of distraction with a computational model of auditory saliency based on acoustic features. CONCLUSION Taken together, our study shows that auditory attention tracking outside of the laboratory in ecologically valid conditions is feasible and a step towards the development of future neural-steered hearing aids.
Collapse
Affiliation(s)
- Lisa Straetmans
- Department of Psychology, Carl von Ossietzky Universität Oldenburg Fakultät für Medizin und Gesundheitswissenschaften, Ammerländer Heerstraße 114-118, Oldenburg, Niedersachsen, 26129, GERMANY
| | - B Holtze
- Department of Psychology, Carl von Ossietzky Universität Oldenburg Fakultät für Medizin und Gesundheitswissenschaften, Ammerländer Heerstr. 114-118, Oldenburg, Niedersachsen, 26129, GERMANY
| | - Stefan Debener
- Department of Psychology, Carl von Ossietzky Universität Oldenburg Fakultät für Medizin und Gesundheitswissenschaften, Ammerländer Heerstr. 114-118, Oldenburg, Niedersachsen, 26129, GERMANY
| | - Manuela Jaeger
- Department of Psychology, Carl von Ossietzky Universität Oldenburg Fakultät für Medizin und Gesundheitswissenschaften, Ammerländer Heerstr. 114-118, Oldenburg, Niedersachsen, 26129, GERMANY
| | - Bojana Mirkovic
- Department of Psychology , Carl von Ossietzky Universität Oldenburg Fakultät für Medizin und Gesundheitswissenschaften, Ammerländer Heerstr. 114-118, Oldenburg, Niedersachsen, 26129, GERMANY
| |
Collapse
|
12
|
Blum S, Hölle D, Bleichner MG, Debener S. Pocketable Labs for Everyone: Synchronized Multi-Sensor Data Streaming and Recording on Smartphones with the Lab Streaming Layer. SENSORS (BASEL, SWITZERLAND) 2021; 21:8135. [PMID: 34884139 PMCID: PMC8662410 DOI: 10.3390/s21238135] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 10/15/2021] [Revised: 11/16/2021] [Accepted: 12/01/2021] [Indexed: 12/14/2022]
Abstract
The streaming and recording of smartphone sensor signals is desirable for mHealth, telemedicine, environmental monitoring and other applications. Time series data gathered in these fields typically benefit from the time-synchronized integration of different sensor signals. However, solutions required for this synchronization are mostly available for stationary setups. We hope to contribute to the important emerging field of portable data acquisition by presenting open-source Android applications both for the synchronized streaming (Send-a) and recording (Record-a) of multiple sensor data streams. We validate the applications in terms of functionality, flexibility and precision in fully mobile setups and in hybrid setups combining mobile and desktop hardware. Our results show that the fully mobile solution is equivalent to well-established desktop versions. With the streaming application Send-a and the recording application Record-a, purely smartphone-based setups for mobile research and personal health settings can be realized on off-the-shelf Android devices.
Collapse
Affiliation(s)
- Sarah Blum
- Neuropsychology Lab, Department of Psychology, University of Oldenburg, 26111 Oldenburg, Germany;
- Cluster of Excellence Hearing4all, 26111 Oldenburg, Germany
| | - Daniel Hölle
- Neurophysiology of Everyday Life Group, Department of Psychology, University of Oldenburg, 26111 Oldenburg, Germany; (D.H.); (M.G.B.)
| | - Martin Georg Bleichner
- Neurophysiology of Everyday Life Group, Department of Psychology, University of Oldenburg, 26111 Oldenburg, Germany; (D.H.); (M.G.B.)
| | - Stefan Debener
- Neuropsychology Lab, Department of Psychology, University of Oldenburg, 26111 Oldenburg, Germany;
- Cluster of Excellence Hearing4all, 26111 Oldenburg, Germany
| |
Collapse
|
13
|
De Sanctis P, Solis-Escalante T, Seeber M, Wagner J, Ferris DP, Gramann K. Time to move: Brain dynamics underlying natural action and cognition. Eur J Neurosci 2021; 54:8075-8080. [PMID: 34904290 PMCID: PMC10454984 DOI: 10.1111/ejn.15562] [Citation(s) in RCA: 9] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/06/2021] [Revised: 12/08/2021] [Accepted: 12/08/2021] [Indexed: 12/14/2022]
Abstract
Advances in Mobile Brain/Body Imaging (MoBI) technology allows for real-time measurements of human brain dynamics during every day, natural, real-life situations. This special issue Time to Move brings together a collection of experimental papers, targeted reviews and opinion articles that lay out the latest MoBI findings. A wide range of topics across different fields are covered including art, athletics, virtual reality, and mobility. What unites these diverse topics is the common goal to enhance and restore human abilities by reaching a better understanding on how cognition is implemented by the brain-body relationship. The breadth and novelty of paradigms and findings reported here positions MoBI as a new frontier in the field of human cognitive neuroscience.
Collapse
Affiliation(s)
- Pierfilippo De Sanctis
- The Cognitive Neurophysiology Laboratory, Department of Pediatrics, Albert Einstein College of Medicine, New York City, New York, USA
- Department of Neurology, Division of Cognitive & Motor Aging, Albert Einstein College of Medicine, New York City, New York, USA
| | - Teodoro Solis-Escalante
- Department of Rehabilitation, Donders Institute for Brain, Cognition and Behavior, Radboud University Medical Center, Nijmegen, Netherlands
| | - Martin Seeber
- Functional Brain Mapping Laboratory, Department of Fundamental Neurosciences, Campus Biotech, University of Geneva, Geneva, Switzerland
| | - Johanna Wagner
- Swartz Center for Computational Neuroscience, Institute for Neural Computation, University of California San Diego, La Jolla, California, USA
| | - Daniel P Ferris
- J. Crayton Pruitt Family Department of Biomedical Engineering, University of Florida, Gainesville, Florida, USA
| | - Klaus Gramann
- Department of Psychology and Ergonomics, Biological Psychology and Neuroergonomics, Institute of Psychology and Ergonomics, Berlin Institute of Technology, Berlin, Germany
| |
Collapse
|
14
|
Song S, Nordin AD. Mobile Electroencephalography for Studying Neural Control of Human Locomotion. Front Hum Neurosci 2021; 15:749017. [PMID: 34858154 PMCID: PMC8631362 DOI: 10.3389/fnhum.2021.749017] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/28/2021] [Accepted: 10/05/2021] [Indexed: 01/09/2023] Open
Abstract
Walking or running in real-world environments requires dynamic multisensory processing within the brain. Studying supraspinal neural pathways during human locomotion provides opportunities to better understand complex neural circuity that may become compromised due to aging, neurological disorder, or disease. Knowledge gained from studies examining human electrical brain dynamics during gait can also lay foundations for developing locomotor neurotechnologies for rehabilitation or human performance. Technical barriers have largely prohibited neuroimaging during gait, but the portability and precise temporal resolution of non-invasive electroencephalography (EEG) have expanded human neuromotor research into increasingly dynamic tasks. In this narrative mini-review, we provide a (1) brief introduction and overview of modern neuroimaging technologies and then identify considerations for (2) mobile EEG hardware, (3) and data processing, (4) including technical challenges and possible solutions. Finally, we summarize (5) knowledge gained from human locomotor control studies that have used mobile EEG, and (6) discuss future directions for real-world neuroimaging research.
Collapse
Affiliation(s)
- Seongmi Song
- Department of Health and Kinesiology, Texas A&M University, College Station, TX, United States
| | - Andrew D Nordin
- Department of Health and Kinesiology, Texas A&M University, College Station, TX, United States
- Department of Biomedical Engineering, Texas A&M University, College Station, TX, United States
- Texas A&M Institute for Neuroscience, College Station, TX, United States
| |
Collapse
|
15
|
Zamm A, Palmer C, Bauer AKR, Bleichner MG, Demos AP, Debener S. Behavioral and Neural Dynamics of Interpersonal Synchrony Between Performing Musicians: A Wireless EEG Hyperscanning Study. Front Hum Neurosci 2021; 15:717810. [PMID: 34588966 PMCID: PMC8473838 DOI: 10.3389/fnhum.2021.717810] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/31/2021] [Accepted: 07/27/2021] [Indexed: 11/13/2022] Open
Abstract
Interpersonal synchrony refers to the temporal coordination of actions between individuals and is a common feature of social behaviors, from team sport to ensemble music performance. Interpersonal synchrony of many rhythmic (periodic) behaviors displays dynamics of coupled biological oscillators. The current study addresses oscillatory dynamics on the levels of brain and behavior between music duet partners performing at spontaneous (uncued) rates. Wireless EEG was measured from N = 20 pairs of pianists as they performed a melody first in Solo performance (at their spontaneous rate of performance), and then in Duet performances at each partner's spontaneous rate. Influences of partners' spontaneous rates on interpersonal synchrony were assessed by correlating differences in partners' spontaneous rates of Solo performance with Duet tone onset asynchronies. Coupling between partners' neural oscillations was assessed by correlating amplitude envelope fluctuations of cortical oscillations at the Duet performance frequency between observed partners and between surrogate (re-paired) partners, who performed the same melody but at different times. Duet synchronization was influenced by partners' spontaneous rates in Solo performance. The size and direction of the difference in partners' spontaneous rates were mirrored in the size and direction of the Duet asynchronies. Moreover, observed Duet partners showed greater inter-brain correlations of oscillatory amplitude fluctuations than did surrogate partners, suggesting that performing in synchrony with a musical partner is reflected in coupled cortical dynamics at the performance frequency. The current study provides evidence that dynamics of oscillator coupling are reflected in both behavioral and neural measures of temporal coordination during musical joint action.
Collapse
Affiliation(s)
- Anna Zamm
- Sequence Production Laboratory, Department of Psychology, McGill University, Montreal, QC, Canada
| | - Caroline Palmer
- Sequence Production Laboratory, Department of Psychology, McGill University, Montreal, QC, Canada
| | - Anna-Katharina R. Bauer
- Neuropsychology Laboratory, Institute for Psychology, European Medical School, University of Oldenburg, Oldenburg, Germany
| | - Martin G. Bleichner
- Neuropsychology Laboratory, Institute for Psychology, European Medical School, University of Oldenburg, Oldenburg, Germany
| | - Alexander P. Demos
- Sequence Production Laboratory, Department of Psychology, McGill University, Montreal, QC, Canada
| | - Stefan Debener
- Neuropsychology Laboratory, Institute for Psychology, European Medical School, University of Oldenburg, Oldenburg, Germany
- Cluster of Excellence Hearing4All Oldenburg, University of Oldenburg, Oldenburg, Germany
| |
Collapse
|