151
|
Croce P, Zappasodi F, Marzetti L, Merla A, Pizzella V, Chiarelli AM. Deep Convolutional Neural Networks for Feature-Less Automatic Classification of Independent Components in Multi-Channel Electrophysiological Brain Recordings. IEEE Trans Biomed Eng 2018; 66:2372-2380. [PMID: 30582523 DOI: 10.1109/tbme.2018.2889512] [Citation(s) in RCA: 36] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/07/2022]
Abstract
OBJECTIVE Interpretation of the electroencephalographic (EEG) and magnetoencephalographic (MEG) signals requires off-line artifacts removal. Since artifacts share frequencies with brain activity, filtering is insufficient. Blind source separation, mainly through independent component analysis (ICA), is the gold-standard procedure for the identification of artifacts in multi-dimensional recordings. However, a classification of brain and artifactual independent components (ICs) is still required. Since ICs exhibit recognizable patterns, classification is usually performed by experts' visual inspection. This procedure is time consuming and prone to errors. Automatic ICs classification has been explored, often through complex ICs features extraction prior to classification. Relying on deep-learning ability of self-extracting the features of interest, we investigated the capabilities of convolutional neural networks (CNNs) for off-line, automatic artifact identification through ICs without feature selection. METHODS A CNN was applied to spectrum and topography of a large dataset of few thousand samples of ICs obtained from multi-channel EEG and MEG recordings acquired during heterogeneous experimental settings and on different subjects. CNN performances, when applied to EEG, MEG, and combined EEG and MEG ICs, were explored and compared with state-of-the-art feature-based automatic classification. RESULTS Beyond state-of-the-art automatic classification accuracies were demonstrated through cross validation (92.4% EEG, 95.4% MEG, 95.6% EEG+MEG). CONCLUSION High CNN classification performances were achieved through heuristical selection of machinery hyperparameters and through the CNN self-selection of the features of interest. SIGNIFICANCE Considering the large data availability of multi-channel EEG and MEG recordings, CNNs may be suited for classification of ICs of multi-channel brain electrophysiological recordings.
Collapse
|
152
|
Wass SV, Noreika V, Georgieva S, Clackson K, Brightman L, Nutbrown R, Covarrubias LS, Leong V. Parental neural responsivity to infants' visual attention: How mature brains influence immature brains during social interaction. PLoS Biol 2018; 16:e2006328. [PMID: 30543622 PMCID: PMC6292577 DOI: 10.1371/journal.pbio.2006328] [Citation(s) in RCA: 69] [Impact Index Per Article: 11.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/11/2018] [Accepted: 11/09/2018] [Indexed: 11/18/2022] Open
Abstract
Almost all attention and learning-in particular, most early learning-take place in social settings. But little is known of how our brains support dynamic social interactions. We recorded dual electroencephalography (EEG) from 12-month-old infants and parents during solo play and joint play. During solo play, fluctuations in infants' theta power significantly forward-predicted their subsequent attentional behaviours. However, this forward-predictiveness was lower during joint play than solo play, suggesting that infants' endogenous neural control over attention is greater during solo play. Overall, however, infants were more attentive to the objects during joint play. To understand why, we examined how adult brain activity related to infant attention. We found that parents' theta power closely tracked and responded to changes in their infants' attention. Further, instances in which parents showed greater neural responsivity were associated with longer sustained attention by infants. Our results offer new insights into how one partner influences another during social interaction.
Collapse
Affiliation(s)
- Sam V. Wass
- University of East London, London, United Kingdom
| | | | | | | | | | | | | | - Vicky Leong
- Cambridge University, Cambridge, United Kingdom
- Nanyang Technological University, Singapore
| |
Collapse
|
153
|
Landowska A, Roberts D, Eachus P, Barrett A. Within- and Between-Session Prefrontal Cortex Response to Virtual Reality Exposure Therapy for Acrophobia. Front Hum Neurosci 2018; 12:362. [PMID: 30443209 PMCID: PMC6221970 DOI: 10.3389/fnhum.2018.00362] [Citation(s) in RCA: 26] [Impact Index Per Article: 4.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/16/2018] [Accepted: 08/23/2018] [Indexed: 01/30/2023] Open
Abstract
Exposure Therapy (ET) has demonstrated its efficacy in the treatment of phobias, anxiety and Post-traumatic Stress Disorder (PTSD), however, it suffers a high drop-out rate because of too low or too high patient engagement in treatment. Virtual Reality Exposure Therapy (VRET) is comparably effective regarding symptom reduction and offers an alternative tool to facilitate engagement for avoidant participants. Neuroimaging studies have demonstrated that both ET and VRET normalize brain activity within a fear circuit. However, previous studies have employed brain imaging technology which restricts people's movement and hides their body, surroundings and therapist from view. This is at odds with the way engagement is typically controlled. We used a novel combination of neural imaging and VR technology-Functional Near-Infrared Spectroscopy (fNIRS) and Immersive Projection Technology (IPT), to avoid these limitations. Although there are a few studies that have investigated the effect of VRET on a brain function after the treatment, the present study utilized technologies which promote ecological validity to measure brain changes after VRET treatment. Furthermore, there are no studies that have measured brain activity within VRET session. In this study brain activity within the prefrontal cortex (PFC) was measured during three consecutive exposure sessions. N = 13 acrophobic volunteers were asked to walk on a virtual plank with a 6 m drop below. Changes in oxygenated (HbO) hemoglobin concentrations in the PFC were measured in three blocks using fNIRS. Consistent with previous functional magnetic resonance imaging (fMRI) studies, the analysis showed decreased activity in the DLPFC and MPFC during first exposure. The activity increased toward normal across three sessions. The study demonstrates potential efficacy of a method for measuring within-session neural response to virtual stimuli that could be replicated within clinics and research institutes, with equipment better suited to an ET session and at fraction of the cost, when compared to fMRI. This has application in widening access to, and increasing ecological validity of, immersive neuroimaging across understanding, diagnosis, assessment and treatment of, a range of mental disorders such as phobia, anxiety and PTSD or addictions.
Collapse
Affiliation(s)
- Aleksandra Landowska
- Department of Psychology, School of Health Sciences, University of Salford, Salford, United Kingdom
| | - David Roberts
- Department of Psychology, School of Health Sciences, University of Salford, Salford, United Kingdom
| | - Peter Eachus
- Department of Psychology, School of Health Sciences, University of Salford, Salford, United Kingdom
| | - Alan Barrett
- Military Veterans’ Service, Pennine Care NHS Foundation Trust, Ashton-under-Lyne, United Kingdom
| |
Collapse
|
154
|
Stone DB, Tamburro G, Fiedler P, Haueisen J, Comani S. Automatic Removal of Physiological Artifacts in EEG: The Optimized Fingerprint Method for Sports Science Applications. Front Hum Neurosci 2018; 12:96. [PMID: 29618975 PMCID: PMC5871683 DOI: 10.3389/fnhum.2018.00096] [Citation(s) in RCA: 21] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/29/2017] [Accepted: 02/27/2018] [Indexed: 11/13/2022] Open
Abstract
Data contamination due to physiological artifacts such as those generated by eyeblinks, eye movements, and muscle activity continues to be a central concern in the acquisition and analysis of electroencephalographic (EEG) data. This issue is further compounded in EEG sports science applications where the presence of artifacts is notoriously difficult to control because behaviors that generate these interferences are often the behaviors under investigation. Therefore, there is a need to develop effective and efficient methods to identify physiological artifacts in EEG recordings during sports applications so that they can be isolated from cerebral activity related to the activities of interest. We have developed an EEG artifact detection model, the Fingerprint Method, which identifies different spatial, temporal, spectral, and statistical features indicative of physiological artifacts and uses these features to automatically classify artifactual independent components in EEG based on a machine leaning approach. Here, we optimized our method using artifact-rich training data and a procedure to determine which features were best suited to identify eyeblinks, eye movements, and muscle artifacts. We then applied our model to an experimental dataset collected during endurance cycling. Results reveal that unique sets of features are suitable for the detection of distinct types of artifacts and that the Optimized Fingerprint Method was able to correctly identify over 90% of the artifactual components with physiological origin present in the experimental data. These results represent a significant advancement in the search for effective means to address artifact contamination in EEG sports science applications.
Collapse
Affiliation(s)
- David B Stone
- Department of Neuroscience, Imaging and Clinical Sciences, Behavioral Imaging and Neural Dynamics Center, Università degli Studi G. d'Annunzio Chieti e Pescara, Chieti, Italy
| | - Gabriella Tamburro
- Department of Neuroscience, Imaging and Clinical Sciences, Behavioral Imaging and Neural Dynamics Center, Università degli Studi G. d'Annunzio Chieti e Pescara, Chieti, Italy
| | - Patrique Fiedler
- Institute of Biomedical Engineering and Informatics, Technische Universität Ilmenau, Ilmenau, Germany
| | - Jens Haueisen
- Institute of Biomedical Engineering and Informatics, Technische Universität Ilmenau, Ilmenau, Germany
| | - Silvia Comani
- Department of Neuroscience, Imaging and Clinical Sciences, Behavioral Imaging and Neural Dynamics Center, Università degli Studi G. d'Annunzio Chieti e Pescara, Chieti, Italy
| |
Collapse
|
155
|
Strangman GE, Ivkovic V, Zhang Q. Wearable brain imaging with multimodal physiological monitoring. J Appl Physiol (1985) 2018; 124:564-572. [DOI: 10.1152/japplphysiol.00297.2017] [Citation(s) in RCA: 23] [Impact Index Per Article: 3.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/22/2022] Open
Abstract
The brain is a central component of cognitive and physical human performance. Measures, including functional brain activation, cerebral perfusion, cerebral oxygenation, evoked electrical responses, and resting hemodynamic and electrical activity are all related to, or can predict, health status or performance decrements. However, measuring brain physiology typically requires large, stationary machines that are not suitable for mobile or self-monitoring. Moreover, when individuals are ambulatory, systemic physiological fluctuations—e.g., in heart rate, blood pressure, skin perfusion, and more—can interfere with noninvasive brain measurements. In efforts to address the physiological monitoring and performance assessment needs for astronauts during spaceflight, we have developed easy-to-use, wearable prototypes, such as NINscan, for near-infrared scanning, which can collect synchronized multimodal physiology data, including hemodynamic deep-tissue imaging (including brain and muscles), electroencephalography, electrocardiography, electromyography, electrooculography, accelerometry, gyroscopy, pressure, respiration, and temperature measurements. Given their self-contained and portable nature, these devices can be deployed in a much broader range of settings—including austere environments—thereby, enabling a wider range of novel medical and research physiology applications. We review these, including high-altitude assessments, self-deployable multimodal e.g., (polysomnographic) recordings in remote or low-resource environments, fluid shifts in variable-gravity, or spaceflight analog environments, intracranial brain motion during high-impact sports, and long-duration monitoring for clinical symptom-capture in various clinical conditions. In addition to further enhancing sensitivity and miniaturization, advanced computational algorithms could help support real-time feedback and alerts regarding performance and health.
Collapse
Affiliation(s)
- Gary E. Strangman
- Neural Systems Group, Massachusetts General Hospital, Harvard Medical School, Charlestown, Massachusetts
- Center for Space Medicine, Baylor College of Medicine, Houston, Texas
- Translational Research Institute, Houston, Texas
| | - Vladimir Ivkovic
- Neural Systems Group, Massachusetts General Hospital, Harvard Medical School, Charlestown, Massachusetts
| | - Quan Zhang
- Neural Systems Group, Massachusetts General Hospital, Harvard Medical School, Charlestown, Massachusetts
- Center for Space Medicine, Baylor College of Medicine, Houston, Texas
| |
Collapse
|
156
|
Online denoising of eye-blinks in electroencephalography. Neurophysiol Clin 2017; 47:371-391. [DOI: 10.1016/j.neucli.2017.10.059] [Citation(s) in RCA: 15] [Impact Index Per Article: 2.1] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/27/2017] [Revised: 10/12/2017] [Accepted: 10/12/2017] [Indexed: 11/18/2022] Open
|
157
|
Abstract
Brain-Computer Interfaces (BCIs) are real-time computer-based systems that translate brain signals into useful commands. To date most applications have been demonstrations of proof-of-principle; widespread use by people who could benefit from this technology requires further development. Improvements in current EEG recording technology are needed. Better sensors would be easier to apply, more confortable for the user, and produce higher quality and more stable signals. Although considerable effort has been devoted to evaluating classifiers using public datasets, more attention to real-time signal processing issues and to optimizing the mutually adaptive interaction between the brain and the BCI are essential for improving BCI performance. Further development of applications is also needed, particularly applications of BCI technology to rehabilitation. The design of rehabilitation applications hinges on the nature of BCI control and how it might be used to induce and guide beneficial plasticity in the brain.
Collapse
Affiliation(s)
- D J McFarland
- National Center for Adaptive Neurotechnologies, Wadsworth Center, New York State Department of Health, Albany, NY, USA
| | - J R Wolpaw
- National Center for Adaptive Neurotechnologies, Wadsworth Center, New York State Department of Health, Albany, NY, USA
| |
Collapse
|
158
|
Noise Robustness Analysis of Performance for EEG-Based Driver Fatigue Detection Using Different Entropy Feature Sets. ENTROPY 2017. [DOI: 10.3390/e19080385] [Citation(s) in RCA: 17] [Impact Index Per Article: 2.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/02/2023]
Abstract
Driver fatigue is an important factor in traffic accidents, and the development of a detection system for driver fatigue is of great significance. To estimate and prevent driver fatigue, various classifiers based on electroencephalogram (EEG) signals have been developed; however, as EEG signals have inherent non-stationary characteristics, their detection performance is often deteriorated by background noise. To investigate the effects of noise on detection performance, simulated Gaussian noise, spike noise, and electromyogram (EMG) noise were added into a raw EEG signal. Four types of entropies, including sample entropy (SE), fuzzy entropy (FE), approximate entropy (AE), and spectral entropy (PE), were deployed for feature sets. Three base classifiers (K-Nearest Neighbors (KNN), Support Vector Machine (SVM), and Decision Tree (DT)) and two ensemble methods (Bootstrap Aggregating (Bagging) and Boosting) were employed and compared. Results showed that: (1) the simulated Gaussian noise and EMG noise had an impact on accuracy, while simulated spike noise did not, which is of great significance for the future application of driver fatigue detection; (2) the influence on noise performance was different based on each classifier, for example, the robust effect of classifier DT was the best and classifier SVM was the weakest; (3) the influence on noise performance was also different with each feature set where the robustness of feature set FE and the combined feature set were the best; and (4) while the Bagging method could not significantly improve performance against noise addition, the Boosting method may significantly improve performance against superimposed Gaussian and EMG noise. The entropy feature extraction method could not only identify driver fatigue, but also effectively resist noise, which is of great significance in future applications of an EEG-based driver fatigue detection system.
Collapse
|
159
|
Johnson EL, Dewar CD, Solbakk AK, Endestad T, Meling TR, Knight RT. Bidirectional Frontoparietal Oscillatory Systems Support Working Memory. Curr Biol 2017; 27:1829-1835.e4. [PMID: 28602658 DOI: 10.1016/j.cub.2017.05.046] [Citation(s) in RCA: 64] [Impact Index Per Article: 9.1] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/24/2017] [Revised: 04/12/2017] [Accepted: 05/15/2017] [Indexed: 11/16/2022]
Abstract
The ability to represent and select information in working memory provides the neurobiological infrastructure for human cognition. For 80 years, dominant views of working memory have focused on the key role of prefrontal cortex (PFC) [1-8]. However, more recent work has implicated posterior cortical regions [9-12], suggesting that PFC engagement during working memory is dependent on the degree of executive demand. We provide evidence from neurological patients with discrete PFC damage that challenges the dominant models attributing working memory to PFC-dependent systems. We show that neural oscillations, which provide a mechanism for PFC to communicate with posterior cortical regions [13], independently subserve communications both to and from PFC-uncovering parallel oscillatory mechanisms for working memory. Fourteen PFC patients and 20 healthy, age-matched controls performed a working memory task where they encoded, maintained, and actively processed information about pairs of common shapes. In controls, the electroencephalogram (EEG) exhibited oscillatory activity in the low-theta range over PFC and directional connectivity from PFC to parieto-occipital regions commensurate with executive processing demands. Concurrent alpha-beta oscillations were observed over parieto-occipital regions, with directional connectivity from parieto-occipital regions to PFC, regardless of processing demands. Accuracy, PFC low-theta activity, and PFC → parieto-occipital connectivity were attenuated in patients, revealing a PFC-independent, alpha-beta system. The PFC patients still demonstrated task proficiency, which indicates that the posterior alpha-beta system provides sufficient resources for working memory. Taken together, our findings reveal neurologically dissociable PFC and parieto-occipital systems and suggest that parallel, bidirectional oscillatory systems form the basis of working memory.
Collapse
Affiliation(s)
- Elizabeth L Johnson
- Helen Wills Neuroscience Institute, University of California, Berkeley, Berkeley, CA 94720, USA; Department of Psychology, University of California, Berkeley, Berkeley, CA 94720, USA.
| | - Callum D Dewar
- Helen Wills Neuroscience Institute, University of California, Berkeley, Berkeley, CA 94720, USA
| | - Anne-Kristin Solbakk
- Department of Psychology, Faculty of Social Sciences, University of Oslo, Oslo 0373, Norway; Department of Neurosurgery, Division of Clinical Neuroscience, Oslo University Hospital, Rikshospitalet, Oslo 0372, Norway; Department of Neuropsychology, Helgeland Hospital, Mosjøen 8657, Norway
| | - Tor Endestad
- Department of Psychology, Faculty of Social Sciences, University of Oslo, Oslo 0373, Norway
| | - Torstein R Meling
- Department of Psychology, Faculty of Social Sciences, University of Oslo, Oslo 0373, Norway; Department of Neurosurgery, Division of Clinical Neuroscience, Oslo University Hospital, Rikshospitalet, Oslo 0372, Norway; Institute of Clinical Medicine, Faculty of Medicine, University of Oslo, Oslo 0373, Norway
| | - Robert T Knight
- Helen Wills Neuroscience Institute, University of California, Berkeley, Berkeley, CA 94720, USA; Department of Psychology, University of California, Berkeley, Berkeley, CA 94720, USA
| |
Collapse
|
160
|
Costa M, Goldberger AL, Peng CK. Multiscale entropy analysis of biological signals. PHYSICAL REVIEW. E, STATISTICAL, NONLINEAR, AND SOFT MATTER PHYSICS 2005; 71:021906. [PMID: 15783351 DOI: 10.1109/access.2021.3061692] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/01/2004] [Indexed: 05/19/2023]
Abstract
Traditional approaches to measuring the complexity of biological signals fail to account for the multiple time scales inherent in such time series. These algorithms have yielded contradictory findings when applied to real-world datasets obtained in health and disease states. We describe in detail the basis and implementation of the multiscale entropy (MSE) method. We extend and elaborate previous findings showing its applicability to the fluctuations of the human heartbeat under physiologic and pathologic conditions. The method consistently indicates a loss of complexity with aging, with an erratic cardiac arrhythmia (atrial fibrillation), and with a life-threatening syndrome (congestive heart failure). Further, these different conditions have distinct MSE curve profiles, suggesting diagnostic uses. The results support a general "complexity-loss" theory of aging and disease. We also apply the method to the analysis of coding and noncoding DNA sequences and find that the latter have higher multiscale entropy, consistent with the emerging view that so-called "junk DNA" sequences contain important biological information.
Collapse
Affiliation(s)
- Madalena Costa
- Margret and H. A. Rey Institute for Nonlinear Dynamics in Medicine, Beth Israel Deaconess Medical Center, Harvard Medical School, Boston, Massachusetts 02215, USA
| | | | | |
Collapse
|