1
|
Marchant S, van der Vaart M, Pillay K, Baxter L, Bhatt A, Fitzgibbon S, Hartley C, Slater R. A machine learning artefact detection method for single-channel infant event-related potential studies. J Neural Eng 2024; 21:046021. [PMID: 38925111 PMCID: PMC11250100 DOI: 10.1088/1741-2552/ad5c04] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/13/2023] [Revised: 06/04/2024] [Accepted: 06/26/2024] [Indexed: 06/28/2024]
Abstract
Objective. Automated detection of artefact in stimulus-evoked electroencephalographic (EEG) data recorded in neonates will improve the reproducibility and speed of analysis in clinical research compared with manual identification of artefact. Some studies use very short, single-channel epochs of EEG data with little recorded EEG per infant-for example because the clinical vulnerability of the infants limits access for recording. Current artefact-detection methods that perform well on adult data and resting-state and multi-channel data in infants are not suitable for this application. The aim of this study was to create and test an automated method of detecting artefact in single-channel 1500 ms epochs of infant EEG.Approach. A total of 410 epochs of EEG were used, collected from 160 infants of 28-43 weeks postmenstrual age. This dataset-which was balanced to include epochs of background activity and responses to visual, auditory, tactile and noxious stimuli-was presented to seven independent raters, who independently labelled the epochs according to whether or not they were able to visually identify artefacts. The data was split into a training set (340 epochs) and an independent test set (70 epochs). A random forest model was trained to identify epochs as either artefact or not artefact.Main results. This model performs well, achieving a balanced accuracy of 0.81, which is as good as manual review of data. Accuracy was not significantly related to the infant age or type of stimulus.Significance. This method provides an objective tool for automated artefact rejection for short epoch, single-channel EEG in neonates and could increase the utility of EEG in neonates in both the clinical and research setting.
Collapse
Affiliation(s)
- Simon Marchant
- Department of Paediatrics, University of Oxford, Oxford, United Kingdom
| | | | - Kirubin Pillay
- Department of Paediatrics, University of Oxford, Oxford, United Kingdom
| | - Luke Baxter
- Department of Paediatrics, University of Oxford, Oxford, United Kingdom
| | - Aomesh Bhatt
- Department of Paediatrics, University of Oxford, Oxford, United Kingdom
| | - Sean Fitzgibbon
- FMRIB, Nuffield Department of Clinical Neurosciences, University of Oxford, Oxford, United Kingdom
| | - Caroline Hartley
- Department of Paediatrics, University of Oxford, Oxford, United Kingdom
| | - Rebeccah Slater
- Department of Paediatrics, University of Oxford, Oxford, United Kingdom
| |
Collapse
|
2
|
Zhang G, Garrett DR, Simmons AM, Kiat JE, Luck SJ. Evaluating the effectiveness of artifact correction and rejection in event-related potential research. Psychophysiology 2024; 61:e14511. [PMID: 38165059 PMCID: PMC11021170 DOI: 10.1111/psyp.14511] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/16/2023] [Revised: 11/18/2023] [Accepted: 12/14/2023] [Indexed: 01/03/2024]
Abstract
Eyeblinks and other large artifacts can create two major problems in event-related potential (ERP) research, namely confounds and increased noise. Here, we developed a method for assessing the effectiveness of artifact correction and rejection methods in minimizing these two problems. We then used this method to assess a common artifact minimization approach, in which independent component analysis (ICA) is used to correct ocular artifacts, and artifact rejection is used to reject trials with extreme values resulting from other sources (e.g., movement artifacts). This approach was applied to data from five common ERP components (P3b, N400, N170, mismatch negativity, and error-related negativity). Four common scoring methods (mean amplitude, peak amplitude, peak latency, and 50% area latency) were examined for each component. We found that eyeblinks differed systematically across experimental conditions for several of the components. We also found that artifact correction was reasonably effective at minimizing these confounds, although it did not usually eliminate them completely. In addition, we found that the rejection of trials with extreme voltage values was effective at reducing noise, with the benefits of eliminating these trials outweighing the reduced number of trials available for averaging. For researchers who are analyzing similar ERP components and participant populations, this combination of artifact correction and rejection approaches should minimize artifact-related confounds and lead to improved data quality. Researchers who are analyzing other components or participant populations can use the method developed in this study to determine which artifact minimization approaches are effective in their data.
Collapse
Affiliation(s)
- Guanghui Zhang
- Center for Mind & Brain, University of California-Davis, Davis, California, USA
| | - David R Garrett
- Center for Mind & Brain, University of California-Davis, Davis, California, USA
| | - Aaron M Simmons
- Center for Mind & Brain, University of California-Davis, Davis, California, USA
| | - John E Kiat
- Center for Mind & Brain, University of California-Davis, Davis, California, USA
| | - Steven J Luck
- Center for Mind & Brain, University of California-Davis, Davis, California, USA
| |
Collapse
|
3
|
Kulke L. Coregistration of EEG and eye-tracking in infants and developing populations. Atten Percept Psychophys 2024:10.3758/s13414-024-02857-y. [PMID: 38388851 DOI: 10.3758/s13414-024-02857-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 02/06/2024] [Indexed: 02/24/2024]
Abstract
Infants cannot be instructed where to look; therefore, infant researchers rely on observation of their participant's gaze to make inferences about their cognitive processes. They therefore started studying infant attention in the real world from early on. Developmental researchers were early adopters of methods combining observations of gaze and behaviour with electroencephalography (EEG) to study attention and other cognitive functions. However, the direct combination of eye-tracking methods and EEG to test infants is still rare, as it includes specific challenges. The current article reviews the development of co-registration research in infancy. It points out specific challenges of co-registration in infant research and suggests ways to overcome them. It ends with recommendations for implementing the co-registration of EEG and eye-tracking in infant research to maximise the benefits of the two measures and their combination and to orient on Open Science principles while doing so. In summary, this work shows that the co-registration of EEG and eye-tracking in infant research can be beneficial to studying natural and real-world behaviour despite its challenges.
Collapse
Affiliation(s)
- Louisa Kulke
- Department of Developmental Psychology with Educational Psychology, University of Bremen, Hochschulring 18, 28359, Bremen, Germany.
| |
Collapse
|
4
|
Bouwer FL, Háden GP, Honing H. Probing Beat Perception with Event-Related Potentials (ERPs) in Human Adults, Newborns, and Nonhuman Primates. ADVANCES IN EXPERIMENTAL MEDICINE AND BIOLOGY 2024; 1455:227-256. [PMID: 38918355 DOI: 10.1007/978-3-031-60183-5_13] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/27/2024]
Abstract
The aim of this chapter is to give an overview of how the perception of rhythmic temporal regularity such as a regular beat in music can be studied in human adults, human newborns, and nonhuman primates using event-related brain potentials (ERPs). First, we discuss different aspects of temporal structure in general, and musical rhythm in particular, and we discuss the possible mechanisms underlying the perception of regularity (e.g., a beat) in rhythm. Additionally, we highlight the importance of dissociating beat perception from the perception of other types of structure in rhythm, such as predictable sequences of temporal intervals, ordinal structure, and rhythmic grouping. In the second section of the chapter, we start with a discussion of auditory ERPs elicited by infrequent and frequent sounds: ERP responses to regularity violations, such as mismatch negativity (MMN), N2b, and P3, as well as early sensory responses to sounds, such as P1 and N1, have been shown to be instrumental in probing beat perception. Subsequently, we discuss how beat perception can be probed by comparing ERP responses to sounds in regular and irregular sequences, and by comparing ERP responses to sounds in different metrical positions in a rhythm, such as on and off the beat or on strong and weak beats. Finally, we will discuss previous research that has used the aforementioned ERPs and paradigms to study beat perception in human adults, human newborns, and nonhuman primates. In doing so, we consider the possible pitfalls and prospects of the technique, as well as future perspectives.
Collapse
Affiliation(s)
- Fleur L Bouwer
- Cognitive Psychology Unit, Institute of Psychology, Leiden Institute for Brain and Cognition, Leiden University, Leiden, The Netherlands.
- Department of Psychology, Brain & Cognition, University of Amsterdam, Amsterdam, The Netherlands.
| | - Gábor P Háden
- Institute of Cognitive Neuroscience and Psychology, Budapest, Hungary
- Department of Telecommunications and Media Informatics, Faculty of Electrical Engineering and Informatics, Budapest University of Technology and Economics, Budapest, Hungary
| | - Henkjan Honing
- Music Cognition group (MCG), Institute for Logic, Language and Computation (ILLC), Amsterdam Brain and Cognition (ABC), University of Amsterdam, Amsterdam, The Netherlands
| |
Collapse
|
5
|
Zhang G, Garrett DR, Simmons AM, Kiat JE, Luck SJ. Evaluating the effectiveness of artifact correction and rejection in event-related potential research. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2023:2023.09.16.558075. [PMID: 37745415 PMCID: PMC10516012 DOI: 10.1101/2023.09.16.558075] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 09/26/2023]
Abstract
Eyeblinks and other large artifacts can create two major problems in event-related potential (ERP) research, namely confounds and increased noise. Here, we developed a method for assessing the effectiveness of artifact correction and rejection methods at minimizing these two problems. We then used this method to assess a common artifact minimization approach, in which independent component analysis (ICA) is used to correct ocular artifacts, and artifact rejection is used to reject trials with extreme values resulting from other sources (e.g., movement artifacts). This approach was applied to data from five common ERP components (P3b, N400, N170, mismatch negativity, and error-related negativity). Four common scoring methods (mean amplitude, peak amplitude, peak latency, and 50% area latency) were examined for each component. We found that eyeblinks differed systematically across experimental conditions for several of the components. We also found that artifact correction was reasonably effective at minimizing these confounds, although it did not usually eliminate them completely. In addition, we found that the rejection of trials with extreme voltage values was effective at reducing noise, with the benefits of eliminating these trials outweighing the reduced number of trials available for averaging. For researchers who are analyzing similar ERP components and participant populations, this combination of artifact correction and rejection approaches should minimize artifact-related confounds and lead to improved data quality. Researchers who are analyzing other components or participant populations can use the method developed in this study to determine which artifact minimization approaches are effective in their data.
Collapse
Affiliation(s)
- Guanghui Zhang
- Center for Mind & Brain, University of California-Davis, Davis, CA, USA
| | - David R Garrett
- Center for Mind & Brain, University of California-Davis, Davis, CA, USA
| | - Aaron M Simmons
- Center for Mind & Brain, University of California-Davis, Davis, CA, USA
| | - John E Kiat
- Center for Mind & Brain, University of California-Davis, Davis, CA, USA
| | - Steven J Luck
- Center for Mind & Brain, University of California-Davis, Davis, CA, USA
| |
Collapse
|
6
|
Rico-Picó J, Moyano S, Conejero Á, Hoyo Á, Ballesteros-Duperón MÁ, Rueda MR. Early development of electrophysiological activity: Contribution of periodic and aperiodic components of the EEG signal. Psychophysiology 2023; 60:e14360. [PMID: 37322838 DOI: 10.1111/psyp.14360] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/03/2022] [Revised: 05/04/2023] [Accepted: 05/10/2023] [Indexed: 06/17/2023]
Abstract
Brain function rapidly changes in the first 2 years of life. In the last decades, resting-state EEG has been widely used to explore those changes. Previous studies have focused on the relative power of the signal in established frequency bands (i.e., theta, alpha, and beta). However, EEG power is a mixture of a 1/f-like background power (aperiodic) in combination with narrow peaks that appear over that curve (periodic activity, e.g., alpha peak). Therefore, it is possible that relative power captures both, aperiodic and periodic brain activity, contributing to changes in electrophysiological activity observed in infancy. For this reason, we explored the early developmental trajectory of the relative power in theta, alpha, and beta frequency bands from infancy to toddlerhood and compared it with changes in periodic activity in a longitudinal study with three waves at age 6, 9, and 16 to 18 months. Finally, we tested the contribution of periodic activity and aperiodic components of the EEG to age changes in relative power. We found that relative power and periodic activity trajectories differed in this period in all the frequency bands but alpha. Furthermore, aperiodic EEG activity flattened between 6 and 18 months. More importantly, only alpha relative power was exclusively related to periodic activity, whereas aperiodic components of the signal significantly contributed to the relative power of activity in theta and beta bands. Thus, relative power in these frequencies is influenced by developmental changes of the aperiodic activity, which should be considered for future studies.
Collapse
Affiliation(s)
- Josué Rico-Picó
- Mind, Brain and Behavior Research Center (CIMCYC), University of Granada, Granada, Spain
- Department of Experimental Psychology, University of Granada, Granada, Spain
| | - Sebastián Moyano
- Mind, Brain and Behavior Research Center (CIMCYC), University of Granada, Granada, Spain
- Department of Experimental Psychology, University of Granada, Granada, Spain
| | - Ángela Conejero
- Mind, Brain and Behavior Research Center (CIMCYC), University of Granada, Granada, Spain
- Department of Developmental and Educational Psychology, University of Granada, Granada, Spain
| | - Ángela Hoyo
- Department of Experimental Psychology, University of Granada, Granada, Spain
| | - M Ángeles Ballesteros-Duperón
- Mind, Brain and Behavior Research Center (CIMCYC), University of Granada, Granada, Spain
- Department of Psychobiology, University of Granada, Granada, Spain
| | - M Rosario Rueda
- Mind, Brain and Behavior Research Center (CIMCYC), University of Granada, Granada, Spain
- Department of Experimental Psychology, University of Granada, Granada, Spain
| |
Collapse
|
7
|
Schmoigl-Tonis M, Schranz C, Müller-Putz GR. Methods for motion artifact reduction in online brain-computer interface experiments: a systematic review. Front Hum Neurosci 2023; 17:1251690. [PMID: 37920561 PMCID: PMC10619676 DOI: 10.3389/fnhum.2023.1251690] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/02/2023] [Accepted: 09/11/2023] [Indexed: 11/04/2023] Open
Abstract
Brain-computer interfaces (BCIs) have emerged as a promising technology for enhancing communication between the human brain and external devices. Electroencephalography (EEG) is particularly promising in this regard because it has high temporal resolution and can be easily worn on the head in everyday life. However, motion artifacts caused by muscle activity, fasciculation, cable swings, or magnetic induction pose significant challenges in real-world BCI applications. In this paper, we present a systematic review of methods for motion artifact reduction in online BCI experiments. Using the PRISMA filter method, we conducted a comprehensive literature search on PubMed, focusing on open access publications from 1966 to 2022. We evaluated 2,333 publications based on predefined filtering rules to identify existing methods and pipelines for motion artifact reduction in EEG data. We present a lookup table of all papers that passed the defined filters, all used methods, and pipelines and compare their overall performance and suitability for online BCI experiments. We summarize suitable methods, algorithms, and concepts for motion artifact reduction in online BCI applications, highlight potential research gaps, and discuss existing community consensus. This review aims to provide a comprehensive overview of the current state of the field and guide researchers in selecting appropriate methods for motion artifact reduction in online BCI experiments.
Collapse
Affiliation(s)
- Mathias Schmoigl-Tonis
- Laboratory of Collaborative Robotics, Department of Human Motion Analytics, Salzburg Research GmbH, Salzburg, Austria
- Institute of Neural Engineering, Laboratory of Brain-Computer Interfaces, Graz University of Technology, Graz, Austria
| | - Christoph Schranz
- Laboratory of Collaborative Robotics, Department of Human Motion Analytics, Salzburg Research GmbH, Salzburg, Austria
| | - Gernot R. Müller-Putz
- Institute of Neural Engineering, Laboratory of Brain-Computer Interfaces, Graz University of Technology, Graz, Austria
- BioTechMed Graz, Graz, Austria
| |
Collapse
|
8
|
Alreshidi I, Moulitsas I, Jenkins KW. Multimodal Approach for Pilot Mental State Detection Based on EEG. SENSORS (BASEL, SWITZERLAND) 2023; 23:7350. [PMID: 37687804 PMCID: PMC10490287 DOI: 10.3390/s23177350] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/19/2023] [Revised: 03/08/2023] [Accepted: 08/17/2023] [Indexed: 09/10/2023]
Abstract
The safety of flight operations depends on the cognitive abilities of pilots. In recent years, there has been growing concern about potential accidents caused by the declining mental states of pilots. We have developed a novel multimodal approach for mental state detection in pilots using electroencephalography (EEG) signals. Our approach includes an advanced automated preprocessing pipeline to remove artefacts from the EEG data, a feature extraction method based on Riemannian geometry analysis of the cleaned EEG data, and a hybrid ensemble learning technique that combines the results of several machine learning classifiers. The proposed approach provides improved accuracy compared to existing methods, achieving an accuracy of 86% when tested on cleaned EEG data. The EEG dataset was collected from 18 pilots who participated in flight experiments and publicly released at NASA's open portal. This study presents a reliable and efficient solution for detecting mental states in pilots and highlights the potential of EEG signals and ensemble learning algorithms in developing cognitive cockpit systems. The use of an automated preprocessing pipeline, feature extraction method based on Riemannian geometry analysis, and hybrid ensemble learning technique set this work apart from previous efforts in the field and demonstrates the innovative nature of the proposed approach.
Collapse
Affiliation(s)
- Ibrahim Alreshidi
- Centre for Computational Engineering Sciences, Cranfield University, Cranfield MK43 0AL, UK
- Machine Learning and Data Analytics Laboratory, Digital Aviation Research and Technology Centre (DARTeC), Cranfield University, Bedford MK43 0AL, UK
- College of Computer Science and Engineering, University of Ha’il, Ha’il 81451, Saudi Arabia
| | - Irene Moulitsas
- Centre for Computational Engineering Sciences, Cranfield University, Cranfield MK43 0AL, UK
- Machine Learning and Data Analytics Laboratory, Digital Aviation Research and Technology Centre (DARTeC), Cranfield University, Bedford MK43 0AL, UK
| | - Karl W. Jenkins
- Centre for Computational Engineering Sciences, Cranfield University, Cranfield MK43 0AL, UK
| |
Collapse
|
9
|
Naik S, Dehaene-Lambertz G, Battaglia D. Repairing Artifacts in Neural Activity Recordings Using Low-Rank Matrix Estimation. SENSORS (BASEL, SWITZERLAND) 2023; 23:4847. [PMID: 37430760 DOI: 10.3390/s23104847] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/11/2023] [Revised: 05/09/2023] [Accepted: 05/10/2023] [Indexed: 07/12/2023]
Abstract
Electrophysiology recordings are frequently affected by artifacts (e.g., subject motion or eye movements), which reduces the number of available trials and affects the statistical power. When artifacts are unavoidable and data are scarce, signal reconstruction algorithms that allow for the retention of sufficient trials become crucial. Here, we present one such algorithm that makes use of large spatiotemporal correlations in neural signals and solves the low-rank matrix completion problem, to fix artifactual entries. The method uses a gradient descent algorithm in lower dimensions to learn the missing entries and provide faithful reconstruction of signals. We carried out numerical simulations to benchmark the method and estimate optimal hyperparameters for actual EEG data. The fidelity of reconstruction was assessed by detecting event-related potentials (ERP) from a highly artifacted EEG time series from human infants. The proposed method significantly improved the standardized error of the mean in ERP group analysis and a between-trial variability analysis compared to a state-of-the-art interpolation technique. This improvement increased the statistical power and revealed significant effects that would have been deemed insignificant without reconstruction. The method can be applied to any time-continuous neural signal where artifacts are sparse and spread out across epochs and channels, increasing data retention and statistical power.
Collapse
Affiliation(s)
- Shruti Naik
- Cognitive Neuroimaging Unit, Centre National de la Recherche Scientifique (CNRS), Institut National de la Santé et de la Recherche Médicale (INSERM), CEA, Université Paris-Saclay, NeuroSpin Center, F-91190 Gif-sur-Yvette, France
| | - Ghislaine Dehaene-Lambertz
- Cognitive Neuroimaging Unit, Centre National de la Recherche Scientifique (CNRS), Institut National de la Santé et de la Recherche Médicale (INSERM), CEA, Université Paris-Saclay, NeuroSpin Center, F-91190 Gif-sur-Yvette, France
| | - Demian Battaglia
- Institut de Neurosciences des Systèmes, U1106, Centre National de la Recherche Scientifique (CNRS) Aix-Marseille Université, F-13005 Marseille, France
- Institute for Advanced Studies, University of Strasbourg, (USIAS), F-67000 Strasbourg, France
| |
Collapse
|
10
|
Lopez KL, Monachino AD, Vincent KM, Peck FC, Gabard-Durnam LJ. Stability, change, and reliable individual differences in electroencephalography measures: a lifespan perspective on progress and opportunities. Neuroimage 2023; 275:120116. [PMID: 37169118 DOI: 10.1016/j.neuroimage.2023.120116] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/07/2023] [Revised: 03/27/2023] [Accepted: 04/13/2023] [Indexed: 05/13/2023] Open
Abstract
Electroencephalographic (EEG) methods have great potential to serve both basic and clinical science approaches to understand individual differences in human neural function. Importantly, the psychometric properties of EEG data, such as internal consistency and test-retest reliability, constrain their ability to differentiate individuals successfully. Rapid and recent technological and computational advancements in EEG research make it timely to revisit the topic of psychometric reliability in the context of individual difference analyses. Moreover, pediatric and clinical samples provide some of the most salient and urgent opportunities to apply individual difference approaches, but the changes these populations experience over time also provide unique challenges from a psychometric perspective. Here we take a developmental neuroscience perspective to consider progress and new opportunities for parsing the reliability and stability of individual differences in EEG measurements across the lifespan. We first conceptually map the different profiles of measurement reliability expected for different types of individual difference analyses over the lifespan. Next, we summarize and evaluate the state of the field's empirical knowledge and need for testing measurement reliability, both internal consistency and test-retest reliability, across EEG measures of power, event-related potentials, nonlinearity, and functional connectivity across ages. Finally, we highlight how standardized pre-processing software for EEG denoising and empirical metrics of individual data quality may be used to further improve EEG-based individual differences research moving forward. We also include recommendations and resources throughout that individual researchers can implement to improve the utility and reproducibility of individual differences analyses with EEG across the lifespan.
Collapse
Affiliation(s)
- K L Lopez
- Northeastern University, 360 Huntington Ave, Boston, MA, United States
| | - A D Monachino
- Northeastern University, 360 Huntington Ave, Boston, MA, United States
| | - K M Vincent
- Northeastern University, 360 Huntington Ave, Boston, MA, United States
| | - F C Peck
- University of California, Los Angeles, Los Angeles, CA, United States
| | - L J Gabard-Durnam
- Northeastern University, 360 Huntington Ave, Boston, MA, United States.
| |
Collapse
|
11
|
Gennari G, Dehaene S, Valera C, Dehaene-Lambertz G. Spontaneous supra-modal encoding of number in the infant brain. Curr Biol 2023; 33:1906-1915.e6. [PMID: 37071994 DOI: 10.1016/j.cub.2023.03.062] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/17/2022] [Revised: 01/30/2023] [Accepted: 03/21/2023] [Indexed: 04/20/2023]
Abstract
The core knowledge hypothesis postulates that infants automatically analyze their environment along abstract dimensions, including numbers. According to this view, approximate numbers should be encoded quickly, pre-attentively, and in a supra-modal manner by the infant brain. Here, we directly tested this idea by submitting the neural responses of sleeping 3-month-old infants, measured with high-density electroencephalography (EEG), to decoders designed to disentangle numerical and non-numerical information. The results show the emergence, in approximately 400 ms, of a decodable number representation, independent of physical parameters, that separates auditory sequences of 4 vs. 12 tones and generalizes to visual arrays of 4 vs. 12 objects. Thus, the infant brain contains a number code that transcends sensory modality, sequential or simultaneous presentation, and arousal state.
Collapse
Affiliation(s)
- Giulia Gennari
- Cognitive Neuroimaging Unit U992, Institut National de la Santé et de la Recherche Médicale, Commissariat à l'Énergie Atomique et aux Énergies Alternatives, Direction de la Recherche Fondamentale/Institut Joliot, Centre National de la Recherche Scientifique ERL9003, NeuroSpin Center, Université Paris-Saclay, 91191 Gif-sur-Yvette, France; Neuroscience Institute, New York University Grossman School of Medicine, New York, NY 10016, USA.
| | - Stanislas Dehaene
- Cognitive Neuroimaging Unit U992, Institut National de la Santé et de la Recherche Médicale, Commissariat à l'Énergie Atomique et aux Énergies Alternatives, Direction de la Recherche Fondamentale/Institut Joliot, Centre National de la Recherche Scientifique ERL9003, NeuroSpin Center, Université Paris-Saclay, 91191 Gif-sur-Yvette, France; Collège de France, Université Paris Sciences Lettres (PSL), 75005 Paris, France
| | - Chanel Valera
- Cognitive Neuroimaging Unit U992, Institut National de la Santé et de la Recherche Médicale, Commissariat à l'Énergie Atomique et aux Énergies Alternatives, Direction de la Recherche Fondamentale/Institut Joliot, Centre National de la Recherche Scientifique ERL9003, NeuroSpin Center, Université Paris-Saclay, 91191 Gif-sur-Yvette, France
| | - Ghislaine Dehaene-Lambertz
- Cognitive Neuroimaging Unit U992, Institut National de la Santé et de la Recherche Médicale, Commissariat à l'Énergie Atomique et aux Énergies Alternatives, Direction de la Recherche Fondamentale/Institut Joliot, Centre National de la Recherche Scientifique ERL9003, NeuroSpin Center, Université Paris-Saclay, 91191 Gif-sur-Yvette, France
| |
Collapse
|
12
|
Benjamin L, Fló A, Palu M, Naik S, Melloni L, Dehaene-Lambertz G. Tracking transitional probabilities and segmenting auditory sequences are dissociable processes in adults and neonates. Dev Sci 2023; 26:e13300. [PMID: 35772033 DOI: 10.1111/desc.13300] [Citation(s) in RCA: 5] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/09/2021] [Revised: 05/31/2022] [Accepted: 06/11/2022] [Indexed: 11/27/2022]
Abstract
Since speech is a continuous stream with no systematic boundaries between words, how do pre-verbal infants manage to discover words? A proposed solution is that they might use the transitional probability between adjacent syllables, which drops at word boundaries. Here, we tested the limits of this mechanism by increasing the size of the word-unit to four syllables, and its automaticity by testing asleep neonates. Using markers of statistical learning in neonates' EEG, compared to adult behavioral performances in the same task, we confirmed that statistical learning is automatic enough to be efficient even in sleeping neonates. We also revealed that: (1) Successfully tracking transition probabilities (TP) in a sequence is not sufficient to segment it. (2) Prosodic cues, as subtle as subliminal pauses, enable to recover words segmenting capacities. (3) Adults' and neonates' capacities to segment streams seem remarkably similar despite the difference of maturation and expertise. Finally, we observed that learning increased the overall similarity of neural responses across infants during exposure to the stream, providing a novel neural marker to monitor learning. Thus, from birth, infants are equipped with adult-like tools, allowing them to extract small coherent word-like units from auditory streams, based on the combination of statistical analyses and auditory parsing cues. RESEARCH HIGHLIGHTS: Successfully tracking transitional probabilities in a sequence is not always sufficient to segment it. Word segmentation solely based on transitional probability is limited to bi- or tri-syllabic elements. Prosodic cues, as subtle as subliminal pauses, enable to recover chunking capacities in sleeping neonates and awake adults for quadriplets.
Collapse
Affiliation(s)
- Lucas Benjamin
- Cognitive Neuroimaging Unit, CNRS ERL 9003, INSERM U992, CEA, Université Paris-Saclay, NeuroSpin Center, Gif-sur-Yvette, Île-de-France, France
| | - Ana Fló
- Cognitive Neuroimaging Unit, CNRS ERL 9003, INSERM U992, CEA, Université Paris-Saclay, NeuroSpin Center, Gif-sur-Yvette, Île-de-France, France
| | - Marie Palu
- Cognitive Neuroimaging Unit, CNRS ERL 9003, INSERM U992, CEA, Université Paris-Saclay, NeuroSpin Center, Gif-sur-Yvette, Île-de-France, France
| | - Shruti Naik
- Cognitive Neuroimaging Unit, CNRS ERL 9003, INSERM U992, CEA, Université Paris-Saclay, NeuroSpin Center, Gif-sur-Yvette, Île-de-France, France
| | - Lucia Melloni
- Department of Neuroscience, Max Planck Institute for Empirical Aesthetics, Frankfurt am Main, Hessen, Germany.,Department of Neurology, NYU Grossman School of Medicine, New York City, New York, USA
| | - Ghislaine Dehaene-Lambertz
- Cognitive Neuroimaging Unit, CNRS ERL 9003, INSERM U992, CEA, Université Paris-Saclay, NeuroSpin Center, Gif-sur-Yvette, Île-de-France, France
| |
Collapse
|
13
|
Abstract
Automated preprocessing methods are critically needed to process the large publicly-available EEG databases, but the optimal approach remains unknown because we lack data quality metrics to compare them. Here, we designed a simple yet robust EEG data quality metric assessing the percentage of significant channels between two experimental conditions within a 100 ms post-stimulus time range. Because of volume conduction in EEG, given no noise, most brain-evoked related potentials (ERP) should be visible on every single channel. Using three publicly available collections of EEG data, we showed that, with the exceptions of high-pass filtering and bad channel interpolation, automated data corrections had no effect on or significantly decreased the percentage of significant channels. Referencing and advanced baseline removal methods were significantly detrimental to performance. Rejecting bad data segments or trials could not compensate for the loss in statistical power. Automated Independent Component Analysis rejection of eyes and muscles failed to increase performance reliably. We compared optimized pipelines for preprocessing EEG data maximizing ERP significance using the leading open-source EEG software: EEGLAB, FieldTrip, MNE, and Brainstorm. Only one pipeline performed significantly better than high-pass filtering the data.
Collapse
Affiliation(s)
- Arnaud Delorme
- SCCN, INC, UCSD, La Jolla, CA, USA.
- CerCo CNRS, Paul Sabatier University, Toulouse, France.
| |
Collapse
|
14
|
Buzzell GA, Morales S, Valadez EA, Hunnius S, Fox NA. Maximizing the potential of EEG as a developmental neuroscience tool. Dev Cogn Neurosci 2023; 60:101201. [PMID: 36732112 PMCID: PMC10150174 DOI: 10.1016/j.dcn.2023.101201] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/28/2023] Open
Affiliation(s)
- George A Buzzell
- Department of Psychology, Florida International University, USA; Center for Children and Families, Florida International University, USA.
| | - Santiago Morales
- Department of Psychology, University of Southern California, USA
| | - Emilio A Valadez
- Department of Human Development and Quantitative Methodology, University of Maryland - College Park, USA
| | - Sabine Hunnius
- Donders Institute for Brain, Cognition, and Behaviour, Radboud University, Nijmegen, the Netherlands
| | - Nathan A Fox
- Department of Human Development and Quantitative Methodology, University of Maryland - College Park, USA
| |
Collapse
|
15
|
Hervé E, Mento G, Desnous B, François C. Challenges and new perspectives of developmental cognitive EEG studies. Neuroimage 2022; 260:119508. [PMID: 35882267 DOI: 10.1016/j.neuroimage.2022.119508] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/31/2022] [Revised: 07/07/2022] [Accepted: 07/22/2022] [Indexed: 10/16/2022] Open
Abstract
Despite shared procedures with adults, electroencephalography (EEG) in early development presents many specificities that need to be considered for good quality data collection. In this paper, we provide an overview of the most representative early cognitive developmental EEG studies focusing on the specificities of this neuroimaging technique in young participants, such as attrition and artifacts. We also summarize the most representative results in developmental EEG research obtained in the time and time-frequency domains and use more advanced signal processing methods. Finally, we briefly introduce three recent standardized pipelines that will help promote replicability and comparability across experiments and ages. While this paper does not claim to be exhaustive, it aims to give a sufficiently large overview of the challenges and solutions available to conduct robust cognitive developmental EEG studies.
Collapse
Affiliation(s)
- Estelle Hervé
- CNRS, LPL, Aix-Marseille University, 5 Avenue Pasteur, Aix-en-Provence 13100, France
| | - Giovanni Mento
- Department of General Psychology, University of Padova, Padova 35131, Italy; Padua Neuroscience Center (PNC), University of Padova, Padova 35131, Italy
| | - Béatrice Desnous
- APHM, Reference Center for Rare Epilepsies, Timone Children Hospital, Aix-Marseille University, Marseille 13005, France; Inserm, INS, Aix-Marseille University, Marseille 13005, France
| | - Clément François
- CNRS, LPL, Aix-Marseille University, 5 Avenue Pasteur, Aix-en-Provence 13100, France.
| |
Collapse
|
16
|
Sleeping neonates track transitional probabilities in speech but only retain the first syllable of words. Sci Rep 2022; 12:4391. [PMID: 35292694 PMCID: PMC8924158 DOI: 10.1038/s41598-022-08411-w] [Citation(s) in RCA: 10] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/04/2021] [Accepted: 02/25/2022] [Indexed: 12/15/2022] Open
Abstract
Extracting statistical regularities from the environment is a primary learning mechanism that might support language acquisition. While it has been shown that infants are sensitive to transition probabilities between syllables in speech, it is still not known what information they encode. Here we used electrophysiology to study how full-term neonates process an artificial language constructed by randomly concatenating four pseudo-words and what information they retain after a few minutes of exposure. Neural entrainment served as a marker of the regularities the brain was tracking during learning. Then in a post-learning phase, evoked-related potentials (ERP) to different triplets explored which information was retained. After two minutes of familiarization with the artificial language, neural entrainment at the word rate emerged, demonstrating rapid learning of the regularities. ERPs in the test phase significantly differed between triplets starting or not with the correct first syllables, but no difference was associated with subsequent violations in transition probabilities. Thus, our results revealed a two-step learning process: neonates segmented the stream based on its statistical regularities, but memory encoding targeted during the word recognition phase entangled the ordinal position of the syllables but was still incomplete at that age.
Collapse
|