1
|
Cooke A, Hindle J, Lawrence C, Bellomo E, Pritchard AW, MacLeod CA, Martin-Forbes P, Jones S, Bracewell M, Linden DEJ, Mehler DMA. Effects of home-based EEG neurofeedback training as a non-pharmacological intervention for Parkinson's disease. Neurophysiol Clin 2024; 54:102997. [PMID: 38991470 DOI: 10.1016/j.neucli.2024.102997] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/21/2024] [Revised: 06/12/2024] [Accepted: 06/12/2024] [Indexed: 07/13/2024] Open
Abstract
OBJECTIVES Aberrant movement-related cortical activity has been linked to impaired motor function in Parkinson's disease (PD). Dopaminergic drug treatment can restore these, but dosages and long-term treatment are limited by adverse side-effects. Effective non-pharmacological treatments could help reduce reliance on drugs. This experiment reports the first study of home-based electroencephalographic (EEG) neurofeedback training as a non-pharmacological candidate treatment for PD. Our primary aim was to test the feasibility of our EEG neurofeedback intervention in a home setting. METHODS Sixteen people with PD received six home visits comprising symptomology self-reports, a standardised motor assessment, and a precision handgrip force production task while EEG was recorded (visits 1, 2 and 6); and 3 × 1-hr EEG neurofeedback training sessions to supress the EEG mu rhythm before initiating handgrip movements (visits 3 to 5). RESULTS Participants successfully learned to self-regulate mu activity, and this appeared to expedite the initiation of precision movements (i.e., time to reach target handgrip force off-medication pre-intervention = 628 ms, off-medication post-intervention = 564 ms). There was no evidence of wider symptomology reduction (e.g., Movement Disorder Society Unified Parkinson's Disease Rating Scale Part III Motor Examination, off-medication pre-intervention = 29.00, off-medication post intervention = 30.07). Interviews indicated that the intervention was well-received. CONCLUSION Based on the significant effect of neurofeedback on movement-related cortical activity, positive qualitative reports from participants, and a suggestive benefit to movement initiation, we conclude that home-based neurofeedback for people with PD is a feasible and promising non-pharmacological treatment that warrants further research.
Collapse
Affiliation(s)
- Andrew Cooke
- Instutute for the Psychology of Elite Performance (IPEP), Bangor University, UK; School of Psychology and Sport Science, Bangor University, UK.
| | - John Hindle
- The Centre for Research in Ageing and Cognitive Health (REACH), University of Exeter, UK; University of Exeter Medical School, UK
| | - Catherine Lawrence
- Centre for Health Economics and Medicines Evaluation (CHEME), Bangor University, UK; School of Health Sciences, Bangor University, UK
| | - Eduardo Bellomo
- Instutute for the Psychology of Elite Performance (IPEP), Bangor University, UK
| | | | - Catherine A MacLeod
- Centre for Population Health Sciences, Usher Institute, The University of Edinburgh, UK
| | | | | | - Martyn Bracewell
- School of Psychology and Sport Science, Bangor University, UK; North Wales Medical School, Bangor University, UK; Walton Centre NHS Foundation Trust, UK
| | - David E J Linden
- School for Mental Health and Neuroscience, Faculty of Health, Medicine and Life Sciences, Maastricht University, The Netherlands; Cardiff University Brain Research Imaging Centre (CUBRIC), School of Psychology, Cardiff University, UK; MRC Center for Neuropsychiatric Genetics and Genomics, School of Medicine, Cardiff University, UK
| | - David M A Mehler
- Cardiff University Brain Research Imaging Centre (CUBRIC), School of Psychology, Cardiff University, UK; MRC Center for Neuropsychiatric Genetics and Genomics, School of Medicine, Cardiff University, UK; Division of Psychological Medicine and Clinical Neurosciences, School of Medicine, Cardiff University, UK; Department of Psychiatry, Psychotherapy and Psychosomatics, Medical School, RWTH Aachen University, Germany; Institute for Translational Psychiatry, University Hospital Münster, Germany
| |
Collapse
|
2
|
Hu H, Wu B, Li H, Wang B, Wu X. Diversity and limitations of electroencephalogram and event-related potential applications in nursing research: A scoping review. Jpn J Nurs Sci 2024; 21:e12593. [PMID: 38441361 DOI: 10.1111/jjns.12593] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/10/2023] [Revised: 12/28/2023] [Accepted: 02/07/2024] [Indexed: 07/03/2024]
Abstract
AIMS This scoping review was conducted to provide a comprehensive summary of how electroencephalogram (EEG) and event-related potentials (ERPs) have been used in nursing research, with the goal of mapping the themes and methods of nursing research involving EEGs or ERPs as a measurement tool. METHODS The eligibility criteria were determined according to the Population, Concept, and Context principle. A systematic electronic search of articles in the PubMed, Web of Science, Embase, CINAHL, APA PsycInfo, and Scopus databases was carried out for the period from database establishment to November 21, 2022. The included studies were analyzed using descriptive statistics and content analysis. RESULTS The review process culminated in 45 articles, evidencing an increasing trend and dispersion characteristics of EEG in nursing research and reflecting five thematic domains of inquiry related to nursing. There was a deficiency of detailed reports of EEG recording and data analysis parameters in nursing research. The common EEG bands in nursing research were Delta, Theta, Alpha, Beta, Gamma. The ERP components used frequently were P3, P2, N1, N2, P1, N170, and feedback-related negativity. CONCLUSIONS The wide variety of EEG components used show broad potential for studying nursing questions. In the future, it will be necessary to increase the depth of the research content, the repeatability of the experiment and the standardization of the report. Nursing researchers should give full play to the characteristics of nursing and establish a systematic and complete EEG research system for nursing.
Collapse
Affiliation(s)
- Huiling Hu
- School of Nursing, Peking University, Beijing, China
| | - Bilin Wu
- School of Nursing, Peking University, Beijing, China
| | - Huijun Li
- Department of Nursing, Beijing Children's Hospital, Capital Medical University, National Center for Children's Health, Beijing, China
| | - Binlin Wang
- School of Nursing, Peking University, Beijing, China
| | - Xue Wu
- School of Nursing, Peking University, Beijing, China
- Peking University Health Science Centre for Evidence-Based Nursing: A JBI Centre of Excellence, Beijing, China
| |
Collapse
|
3
|
Klein F. Optimizing spatial specificity and signal quality in fNIRS: an overview of potential challenges and possible options for improving the reliability of real-time applications. FRONTIERS IN NEUROERGONOMICS 2024; 5:1286586. [PMID: 38903906 PMCID: PMC11188482 DOI: 10.3389/fnrgo.2024.1286586] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 08/31/2023] [Accepted: 04/29/2024] [Indexed: 06/22/2024]
Abstract
The optical brain imaging method functional near-infrared spectroscopy (fNIRS) is a promising tool for real-time applications such as neurofeedback and brain-computer interfaces. Its combination of spatial specificity and mobility makes it particularly attractive for clinical use, both at the bedside and in patients' homes. Despite these advantages, optimizing fNIRS for real-time use requires careful attention to two key aspects: ensuring good spatial specificity and maintaining high signal quality. While fNIRS detects superficial cortical brain regions, consistently and reliably targeting specific regions of interest can be challenging, particularly in studies that require repeated measurements. Variations in cap placement coupled with limited anatomical information may further reduce this accuracy. Furthermore, it is important to maintain good signal quality in real-time contexts to ensure that they reflect the true underlying brain activity. However, fNIRS signals are susceptible to contamination by cerebral and extracerebral systemic noise as well as motion artifacts. Insufficient real-time preprocessing can therefore cause the system to run on noise instead of brain activity. The aim of this review article is to help advance the progress of fNIRS-based real-time applications. It highlights the potential challenges in improving spatial specificity and signal quality, discusses possible options to overcome these challenges, and addresses further considerations relevant to real-time applications. By addressing these topics, the article aims to help improve the planning and execution of future real-time studies, thereby increasing their reliability and repeatability.
Collapse
Affiliation(s)
- Franziska Klein
- Biomedical Devices and Systems Group, R&D Division Health, OFFIS - Institute for Information Technology, Oldenburg, Germany
- Department of Psychiatry, Psychotherapy and Psychosomatics, Medical School, RWTH Aachen University, Aachen, Germany
- Neurocognition and Functional Neurorehabilitation Group, Department of Psychology, University of Oldenburg, Oldenburg, Germany
| |
Collapse
|
4
|
Clayson PE, Rocha HA, McDonald JB, Baldwin SA, Larson MJ. A registered report of a two-site study of variations of the flanker task: ERN experimental effects and data quality. Psychophysiology 2024:e14607. [PMID: 38741351 DOI: 10.1111/psyp.14607] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/03/2022] [Revised: 04/25/2024] [Accepted: 04/28/2024] [Indexed: 05/16/2024]
Abstract
Error-related negativity is a widely used measure of error monitoring, and many projects are independently moving ERN recorded during a flanker task toward standardization, optimization, and eventual clinical application. However, each project uses a different version of the flanker task and tacitly assumes ERN is functionally equivalent across each version. The routine neglect of a rigorous test of this assumption undermines efforts to integrate ERN findings across tasks, optimize and standardize ERN assessment, and widely apply ERN in clinical trials. The purpose of this registered report was to determine whether ERN shows similar experimental effects (correct vs. error trials) and data quality (intraindividual variability) during three commonly used versions of a flanker task. ERN was recorded from 172 participants during three versions of a flanker task across two study sites. ERN scores showed numerical differences between tasks, raising questions about the comparability of ERN findings across studies and tasks. Although ERN scores from all three versions of the flanker task yielded high data quality and internal consistency, one version did outperform the other two in terms of the size of experimental effects and the data quality. Exploratory analyses of the error positivity (Pe) provided tentative support for the other two versions of the task over the paradigm that appeared optimal for ERN. The present study provides a roadmap for how to statistically compare psychometric characteristics of ERP scores across paradigms and gives preliminary recommendations for flanker tasks to use for ERN- and Pe-focused studies.
Collapse
Affiliation(s)
- Peter E Clayson
- Department of Psychology, University of South Florida, Tampa, Florida, USA
| | - Harold A Rocha
- Department of Psychology, University of South Florida, Tampa, Florida, USA
| | - Julia B McDonald
- Department of Psychology, University of South Florida, Tampa, Florida, USA
| | - Scott A Baldwin
- Department of Psychology, Brigham Young University, Provo, Utah, USA
| | - Michael J Larson
- Department of Psychology, Brigham Young University, Provo, Utah, USA
- Neuroscience Center, Brigham Young University, Provo, Utah, USA
| |
Collapse
|
5
|
Clayson PE, Mcdonald JB, Park B, Holbrook A, Baldwin SA, Riesel A, Larson MJ. Registered replication report of the construct validity of the error-related negativity (ERN): A multi-site study of task-specific ERN correlations with internalizing and externalizing symptoms. Psychophysiology 2023:e14496. [PMID: 38155370 DOI: 10.1111/psyp.14496] [Citation(s) in RCA: 3] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/14/2021] [Revised: 11/16/2023] [Accepted: 11/17/2023] [Indexed: 12/30/2023]
Abstract
Intact cognitive control is critical for goal-directed behavior and is widely studied using the error-related negativity (ERN). A common assumption in such studies is that ERNs recorded during different experimental paradigms reflect the same construct or functionally equivalent processes and that ERN is functionally distinct from other error-monitoring event-related brain potentials (ERPs; error positivity [Pe]), other neurophysiological indices of cognitive control (N2), and even other theoretically unrelated indices (visual N1). The present registered report represents a replication-plus-extension study of the psychometric validity of cognitive control ERPs and evaluated the convergent and divergent validity of ERN, Pe, N2, and visual N1 recorded during flanker, Stroop, and Go/no-go tasks. Data from 182 participants were collected from two study sites, and ERP psychometric reliability and validity were evaluated. Findings supported replication of convergent and divergent validity of ERN, Pe, and ΔPe (error minus correct)-these ERPs correlated more with themselves across tasks than with other ERPs measured during the same task. Convergent validity of ΔERN across tasks was not replicated, despite high internal consistency. ERN strongly correlated with N2 at levels similar or higher than those in support of convergent validity for other ERPs, and the present study failed to provide evidence of divergent validity for ERN and Pe from N2 or N1. ERN and ΔERN were unrelated to internalizing or externalizing symptoms. Findings underscore the importance of considering the psychometric validity of ERPs, as it provides a foundation for interpreting and comparing ERPs across tasks and studies.
Collapse
Affiliation(s)
- Peter E Clayson
- Department of Psychology, University of South Florida, Tampa, Florida, USA
| | - Julia B Mcdonald
- Department of Psychology, University of South Florida, Tampa, Florida, USA
| | - Bohyun Park
- Department of Psychology, University of South Florida, Tampa, Florida, USA
| | - Amanda Holbrook
- Department of Psychology, University of South Florida, Tampa, Florida, USA
| | - Scott A Baldwin
- Department of Psychology, Brigham Young University, Provo, Utah, USA
| | - Anja Riesel
- Department of Psychology, Universität Hamburg, Hamburg, Germany
| | - Michael J Larson
- Department of Psychology, Brigham Young University, Provo, Utah, USA
- Neuroscience Center, Brigham Young University, Provo, Utah, USA
| |
Collapse
|
6
|
Huang HJ, Ferris DP. Non-invasive brain imaging to advance the understanding of human balance. CURRENT OPINION IN BIOMEDICAL ENGINEERING 2023; 28:100505. [PMID: 38250696 PMCID: PMC10795750 DOI: 10.1016/j.cobme.2023.100505] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/23/2024]
Affiliation(s)
- Helen J. Huang
- Department of Mechanical and Aerospace Engineering, University of Central Florida, Orlando, FL, USA
- Disability, Aging, and Technology Cluster, University of Central Florida, Orlando, FL, USA
- Biionix (Bionic Materials, Implants & Interfaces) Cluster, University of Central Florida, Orlando, FL, USA
| | - Daniel P. Ferris
- J. Crayton Pruitt Department of Biomedical Engineering, University of Florida, Gainesville, FL, USA
- Department of Mechanical and Aerospace Engineering, University of Florida, Gainesville, FL, USA
- Department of Neurology, University of Florida, Gainesville, FL, USA
| |
Collapse
|
7
|
Bechtold L, Cosper SH, Malyshevskaya A, Montefinese M, Morucci P, Niccolai V, Repetto C, Zappa A, Shtyrov Y. Brain Signatures of Embodied Semantics and Language: A Consensus Paper. J Cogn 2023; 6:61. [PMID: 37841669 PMCID: PMC10573703 DOI: 10.5334/joc.237] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/06/2022] [Accepted: 07/29/2022] [Indexed: 10/17/2023] Open
Abstract
According to embodied theories (including embodied, embedded, extended, enacted, situated, and grounded approaches to cognition), language representation is intrinsically linked to our interactions with the world around us, which is reflected in specific brain signatures during language processing and learning. Moving on from the original rivalry of embodied vs. amodal theories, this consensus paper addresses a series of carefully selected questions that aim at determining when and how rather than whether motor and perceptual processes are involved in language processes. We cover a wide range of research areas, from the neurophysiological signatures of embodied semantics, e.g., event-related potentials and fields as well as neural oscillations, to semantic processing and semantic priming effects on concrete and abstract words, to first and second language learning and, finally, the use of virtual reality for examining embodied semantics. Our common aim is to better understand the role of motor and perceptual processes in language representation as indexed by language comprehension and learning. We come to the consensus that, based on seminal research conducted in the field, future directions now call for enhancing the external validity of findings by acknowledging the multimodality, multidimensionality, flexibility and idiosyncrasy of embodied and situated language and semantic processes.
Collapse
Affiliation(s)
- Laura Bechtold
- Institute for Experimental Psychology, Department for Biological Psychology, Heinrich-Heine University Düsseldorf, Germany
| | - Samuel H. Cosper
- Institute of Cognitive Science, University of Osnabrück, Germany
| | - Anastasia Malyshevskaya
- Centre for Cognition and Decision making, Institute for Cognitive Neuroscience, HSE University, Russian Federation
- Potsdam Embodied Cognition Group, Cognitive Sciences, University of Potsdam, Germany
| | | | | | - Valentina Niccolai
- Institute of Clinical Neuroscience and Medical Psychology, Medical Faculty, Heinrich-Heine University Düsseldorf, Germany
| | - Claudia Repetto
- Department of Psychology, Università Cattolica del Sacro Cuore, Milan, Italy
| | - Ana Zappa
- Laboratoire parole et langage, Aix-Marseille Université, Aix-en-Provence, France
| | - Yury Shtyrov
- Centre for Cognition and Decision making, Institute for Cognitive Neuroscience, HSE University, Russian Federation
- Center of Functionally Integrative Neuroscience, Department of Clinical Medicine, Aarhus University, Denmark
| |
Collapse
|
8
|
Botvinik-Nezer R, Wager TD. Reproducibility in Neuroimaging Analysis: Challenges and Solutions. BIOLOGICAL PSYCHIATRY. COGNITIVE NEUROSCIENCE AND NEUROIMAGING 2023; 8:780-788. [PMID: 36906444 DOI: 10.1016/j.bpsc.2022.12.006] [Citation(s) in RCA: 7] [Impact Index Per Article: 7.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/15/2022] [Revised: 11/27/2022] [Accepted: 12/11/2022] [Indexed: 12/23/2022]
Abstract
Recent years have marked a renaissance in efforts to increase research reproducibility in psychology, neuroscience, and related fields. Reproducibility is the cornerstone of a solid foundation of fundamental research-one that will support new theories built on valid findings and technological innovation that works. The increased focus on reproducibility has made the barriers to it increasingly apparent, along with the development of new tools and practices to overcome these barriers. Here, we review challenges, solutions, and emerging best practices with a particular emphasis on neuroimaging studies. We distinguish 3 main types of reproducibility, discussing each in turn. Analytical reproducibility is the ability to reproduce findings using the same data and methods. Replicability is the ability to find an effect in new datasets, using the same or similar methods. Finally, robustness to analytical variability refers to the ability to identify a finding consistently across variation in methods. The incorporation of these tools and practices will result in more reproducible, replicable, and robust psychological and brain research and a stronger scientific foundation across fields of inquiry.
Collapse
Affiliation(s)
- Rotem Botvinik-Nezer
- Department of Psychological and Brain Sciences, Dartmouth College, Hanover, New Hampshire.
| | - Tor D Wager
- Department of Psychological and Brain Sciences, Dartmouth College, Hanover, New Hampshire
| |
Collapse
|
9
|
Zare Jeddi M, Galea KS, Viegas S, Fantke P, Louro H, Theunis J, Govarts E, Denys S, Fillol C, Rambaud L, Kolossa-Gehring M, Santonen T, van der Voet H, Ghosh M, Costa C, Teixeira JP, Verhagen H, Duca RC, Van Nieuwenhuyse A, Jones K, Sams C, Sepai O, Tranfo G, Bakker M, Palmen N, van Klaveren J, Scheepers PTJ, Paini A, Canova C, von Goetz N, Katsonouri A, Karakitsios S, Sarigiannis DA, Bessems J, Machera K, Harrad S, Hopf NB. FAIR environmental and health registry (FAIREHR)- supporting the science to policy interface and life science research, development and innovation. FRONTIERS IN TOXICOLOGY 2023; 5:1116707. [PMID: 37342468 PMCID: PMC10278765 DOI: 10.3389/ftox.2023.1116707] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/05/2022] [Accepted: 04/19/2023] [Indexed: 06/23/2023] Open
Abstract
The environmental impact on health is an inevitable by-product of human activity. Environmental health sciences is a multidisciplinary field addressing complex issues on how people are exposed to hazardous chemicals that can potentially affect adversely the health of present and future generations. Exposure sciences and environmental epidemiology are becoming increasingly data-driven and their efficiency and effectiveness can significantly improve by implementing the FAIR (findable, accessible, interoperable, reusable) principles for scientific data management and stewardship. This will enable data integration, interoperability and (re)use while also facilitating the use of new and powerful analytical tools such as artificial intelligence and machine learning in the benefit of public health policy, and research, development and innovation (RDI). Early research planning is critical to ensuring data is FAIR at the outset. This entails a well-informed and planned strategy concerning the identification of appropriate data and metadata to be gathered, along with established procedures for their collection, documentation, and management. Furthermore, suitable approaches must be implemented to evaluate and ensure the quality of the data. Therefore, the 'Europe Regional Chapter of the International Society of Exposure Science' (ISES Europe) human biomonitoring working group (ISES Europe HBM WG) proposes the development of a FAIR Environment and health registry (FAIREHR) (hereafter FAIREHR). FAIR Environment and health registry offers preregistration of studies on exposure sciences and environmental epidemiology using HBM (as a starting point) across all areas of environmental and occupational health globally. The registry is proposed to receive a dedicated web-based interface, to be electronically searchable and to be available to all relevant data providers, users and stakeholders. Planned Human biomonitoring studies would ideally be registered before formal recruitment of study participants. The resulting FAIREHR would contain public records of metadata such as study design, data management, an audit trail of major changes to planned methods, details of when the study will be completed, and links to resulting publications and data repositories when provided by the authors. The FAIREHR would function as an integrated platform designed to cater to the needs of scientists, companies, publishers, and policymakers by providing user-friendly features. The implementation of FAIREHR is expected to yield significant benefits in terms of enabling more effective utilization of human biomonitoring (HBM) data.
Collapse
Affiliation(s)
- Maryam Zare Jeddi
- National Institute for Public Health and the Environment (RIVM), Bilthoven, Netherlands
| | - Karen S. Galea
- Institute of Occupational Medicine (IOM), Research Avenue North, Riccarton, United Kingdom
| | - Susana Viegas
- NOVA National School of Public Health, Public Health Research Centre, Comprehensive Health Research Center, CHRC, NOVA University Lisbon, Lisbon, Portugal
| | - Peter Fantke
- Quantitative Sustainability Assessment, Department of Environmental and Resource Engineering, Technical University of Denmark, Kgs. Lyngby, Denmark
| | - Henriqueta Louro
- National Institute of Health Dr. Ricardo Jorge, Department of Human Genetics, Lisbon and ToxOmics - Centre for Toxicogenomics and Human Health, NOVA Medical School, Universidade NOVA de Lisboa, Lisbon, Portugal
| | - Jan Theunis
- VITO HEALTH, Flemish Institute for Technological Research (VITO), Mol, Belgium
| | - Eva Govarts
- VITO HEALTH, Flemish Institute for Technological Research (VITO), Mol, Belgium
| | - Sébastien Denys
- SpF— Santé Publique France, Environmental and Occupational Health Division, Saint-Maurice, France
| | - Clémence Fillol
- SpF— Santé Publique France, Environmental and Occupational Health Division, Saint-Maurice, France
| | - Loïc Rambaud
- SpF— Santé Publique France, Environmental and Occupational Health Division, Saint-Maurice, France
| | | | - Tiina Santonen
- Finnish Institute of Occupational Health (FIOH), Helsinki, Finland
| | | | - Manosij Ghosh
- Environment and Health, Department of Public Health and Primary Care, KU Leuven, Leuven, Belgium
| | - Carla Costa
- Department of Environmental Health, National Institute of Health Dr. Ricardo Jorge, Porto, Portugal and EPIUnit—Instituto de Saúde Pública da Universidade do Porto, Porto, Portugal
| | - João Paulo Teixeira
- Department of Environmental Health, National Institute of Health Dr. Ricardo Jorge, Porto, Portugal and EPIUnit—Instituto de Saúde Pública da Universidade do Porto, Porto, Portugal
| | - Hans Verhagen
- Nutrition Innovation Center for Food and Health (NICHE), University of Ulster, Coleraine, United Kingdom
- National Food Institute, Technical University of Denmark, Kgs. Lyngby, Denmark
- Food Safety and Nutrition Consultancy, Zeist, Netherlands
| | - Radu-Corneliu Duca
- Environment and Health, Department of Public Health and Primary Care, KU Leuven, Leuven, Belgium
- Department of Health Protection, Laboratoire National de Santé (LNS), Dudelange, Luxembourg
| | - An Van Nieuwenhuyse
- Environment and Health, Department of Public Health and Primary Care, KU Leuven, Leuven, Belgium
- Department of Health Protection, Laboratoire National de Santé (LNS), Dudelange, Luxembourg
| | - Kate Jones
- HSE—Health and Safety Executive, Buxton, United Kingdom
| | - Craig Sams
- HSE—Health and Safety Executive, Buxton, United Kingdom
| | - Ovnair Sepai
- UK Health Security Agency, Radiation, Chemical and Environmental Hazards Division, Chilton, United Kingdom
| | - Giovanna Tranfo
- Department of Occupational and Environmental Medicine, Epidemiology and Hygiene, Italian Institute Against Accidents at Work (INAIL), Monte PorzioCatone(RM), Italy
| | - Martine Bakker
- National Institute for Public Health and the Environment (RIVM), Bilthoven, Netherlands
| | - Nicole Palmen
- National Institute for Public Health and the Environment (RIVM), Bilthoven, Netherlands
| | - Jacob van Klaveren
- National Institute for Public Health and the Environment (RIVM), Bilthoven, Netherlands
| | - Paul T. J. Scheepers
- Radboud Institute for Biological and Environmental Sciences, Radboud University, Nijmegen, Netherlands
| | | | - Cristina Canova
- Unit of Biostatistics, Epidemiology and Public Health, Department of Cardio-Thoraco-Vascular Sciences and Public Health, University of Padua, Padova, Italy
| | - Natalie von Goetz
- Federal Office of Public Health, Bern, Switzerland
- Swiss Federal Institute of Technology (ETH) Zurich, Zurich, Switzerland
| | | | - Spyros Karakitsios
- HERACLES Research Center on the Exposome and Health, Center for Interdisciplinary Research and Innovation, Aristotle University of Thessaloniki, Thessaloniki, Greece
| | - Dimosthenis A. Sarigiannis
- HERACLES Research Center on the Exposome and Health, Center for Interdisciplinary Research and Innovation, Aristotle University of Thessaloniki, Thessaloniki, Greece
- Complex Risk and Data Analysis Research Center, University School for Advanced Studies IUSS, Pavia, Italy
| | - Jos Bessems
- VITO HEALTH, Flemish Institute for Technological Research (VITO), Mol, Belgium
| | - Kyriaki Machera
- Laboratory of Pesticides’ Toxicology, Department of Pesticides Control and Phytopharmacy, Benaki Phytopathological Institute, Kifissia, Greece
| | - Stuart Harrad
- School of Geography, Earth, and Environmental Sciences, University of Birmingham, United Kingdom
| | - Nancy B. Hopf
- Centre for Primary Care and Public Health (Unisanté), University of Lausanne, Lausanne, Switzerland
| |
Collapse
|
10
|
Wireless EEG: A survey of systems and studies. Neuroimage 2023; 269:119774. [PMID: 36566924 DOI: 10.1016/j.neuroimage.2022.119774] [Citation(s) in RCA: 32] [Impact Index Per Article: 32.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/05/2022] [Revised: 11/18/2022] [Accepted: 11/27/2022] [Indexed: 12/24/2022] Open
Abstract
The popular brain monitoring method of electroencephalography (EEG) has seen a surge in commercial attention in recent years, focusing mostly on hardware miniaturization. This has led to a varied landscape of portable EEG devices with wireless capability, allowing them to be used by relatively unconstrained users in real-life conditions outside of the laboratory. The wide availability and relative affordability of these devices provide a low entry threshold for newcomers to the field of EEG research. The large device variety and the at times opaque communication from their manufacturers, however, can make it difficult to obtain an overview of this hardware landscape. Similarly, given the breadth of existing (wireless) EEG knowledge and research, it can be challenging to get started with novel ideas. Therefore, this paper first provides a list of 48 wireless EEG devices along with a number of important-sometimes difficult-to-obtain-features and characteristics to enable their side-by-side comparison, along with a brief introduction to each of these aspects and how they may influence one's decision. Secondly, we have surveyed previous literature and focused on 110 high-impact journal publications making use of wireless EEG, which we categorized by application and analyzed for device used, number of channels, sample size, and participant mobility. Together, these provide a basis for informed decision making with respect to hardware and experimental precedents when considering new, wireless EEG devices and research. At the same time, this paper provides background material and commentary about pitfalls and caveats regarding this increasingly accessible line of research.
Collapse
|
11
|
Schroeder PA, Artemenko C, Kosie JE, Cockx H, Stute K, Pereira J, Klein F, Mehler DMA. Using preregistration as a tool for transparent fNIRS study design. NEUROPHOTONICS 2023; 10:023515. [PMID: 36908680 PMCID: PMC9993433 DOI: 10.1117/1.nph.10.2.023515] [Citation(s) in RCA: 3] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 07/09/2022] [Accepted: 01/11/2023] [Indexed: 05/04/2023]
Abstract
Significance The expansion of functional near-infrared spectroscopy (fNIRS) methodology and analysis tools gives rise to various design and analytical decisions that researchers have to make. Several recent efforts have developed guidelines for preprocessing, analyzing, and reporting practices. For the planning stage of fNIRS studies, similar guidance is desirable. Study preregistration helps researchers to transparently document study protocols before conducting the study, including materials, methods, and analyses, and thus, others to verify, understand, and reproduce a study. Preregistration can thus serve as a useful tool for transparent, careful, and comprehensive fNIRS study design. Aim We aim to create a guide on the design and analysis steps involved in fNIRS studies and to provide a preregistration template specified for fNIRS studies. Approach The presented preregistration guide has a strong focus on fNIRS specific requirements, and the associated template provides examples based on continuous-wave (CW) fNIRS studies conducted in humans. These can, however, be extended to other types of fNIRS studies. Results On a step-by-step basis, we walk the fNIRS user through key methodological and analysis-related aspects central to a comprehensive fNIRS study design. These include items specific to the design of CW, task-based fNIRS studies, but also sections that are of general importance, including an in-depth elaboration on sample size planning. Conclusions Our guide introduces these open science tools to the fNIRS community, providing researchers with an overview of key design aspects and specification recommendations for comprehensive study planning. As such it can be used as a template to preregister fNIRS studies or merely as a tool for transparent fNIRS study design.
Collapse
Affiliation(s)
- Philipp A. Schroeder
- University of Tuebingen, Department of Psychology, Faculty of Science, Tuebingen, Germany
| | - Christina Artemenko
- University of Tuebingen, Department of Psychology, Faculty of Science, Tuebingen, Germany
| | - Jessica E. Kosie
- Princeton University, Social and Natural Sciences, Department of Psychology, Princeton, New Jersey, United States
| | - Helena Cockx
- Radboud University, Donders Institute for Brain, Cognition and Behaviour, Biophysics Department, Faculty of Science, Nijmegen, The Netherlands
| | - Katharina Stute
- Chemnitz University of Technology, Institute of Human Movement Science and Health, Faculty of Behavioural and Social Sciences, Chemnitz, Germany
| | - João Pereira
- University of Coimbra, Coimbra Institute for Biomedical Imaging and Translational Research, Coimbra, Portugal
| | - Franziska Klein
- University of Oldenburg, Department of Psychology, Neurocognition and functional Neurorehabilitation Group, Oldenburg (Oldb), Germany
- RWTH Aachen University, Medical School, Department of Psychiatry, Psychotherapy and Psychosomatics, Aachen, Germany
| | - David M. A. Mehler
- RWTH Aachen University, Medical School, Department of Psychiatry, Psychotherapy and Psychosomatics, Aachen, Germany
- University of Münster, Institute for Translational Psychiatry, Medical School, Münster, Germany
| |
Collapse
|
12
|
Stefan AM, Schönbrodt FD. Big little lies: a compendium and simulation of p-hacking strategies. ROYAL SOCIETY OPEN SCIENCE 2023; 10:220346. [PMID: 36778954 PMCID: PMC9905987 DOI: 10.1098/rsos.220346] [Citation(s) in RCA: 11] [Impact Index Per Article: 11.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 03/17/2022] [Accepted: 01/11/2023] [Indexed: 06/18/2023]
Abstract
In many research fields, the widespread use of questionable research practices has jeopardized the credibility of scientific results. One of the most prominent questionable research practices is p-hacking. Typically, p-hacking is defined as a compound of strategies targeted at rendering non-significant hypothesis testing results significant. However, a comprehensive overview of these p-hacking strategies is missing, and current meta-scientific research often ignores the heterogeneity of strategies. Here, we compile a list of 12 p-hacking strategies based on an extensive literature review, identify factors that control their level of severity, and demonstrate their impact on false-positive rates using simulation studies. We also use our simulation results to evaluate several approaches that have been proposed to mitigate the influence of questionable research practices. Our results show that investigating p-hacking at the level of strategies can provide a better understanding of the process of p-hacking, as well as a broader basis for developing effective countermeasures. By making our analyses available through a Shiny app and R package, we facilitate future meta-scientific research aimed at investigating the ramifications of p-hacking across multiple strategies, and we hope to start a broader discussion about different manifestations of p-hacking in practice.
Collapse
Affiliation(s)
- Angelika M. Stefan
- Department of Psychology, University of Amsterdam, Amsterdam, The Netherlands
- Department of Psychology, Universität der Bundeswehr München, München, Germany
| | - Felix D. Schönbrodt
- Department of Psychology, Ludwig-Maximilians-Universität München, Munchen, Germany
| |
Collapse
|
13
|
Hardwicke TE, Wagenmakers EJ. Reducing bias, increasing transparency and calibrating confidence with preregistration. Nat Hum Behav 2023; 7:15-26. [PMID: 36707644 DOI: 10.1038/s41562-022-01497-2] [Citation(s) in RCA: 8] [Impact Index Per Article: 8.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/23/2021] [Accepted: 11/09/2022] [Indexed: 01/29/2023]
Abstract
Flexibility in the design, analysis and interpretation of scientific studies creates a multiplicity of possible research outcomes. Scientists are granted considerable latitude to selectively use and report the hypotheses, variables and analyses that create the most positive, coherent and attractive story while suppressing those that are negative or inconvenient. This creates a risk of bias that can lead to scientists fooling themselves and fooling others. Preregistration involves declaring a research plan (for example, hypotheses, design and statistical analyses) in a public registry before the research outcomes are known. Preregistration (1) reduces the risk of bias by encouraging outcome-independent decision-making and (2) increases transparency, enabling others to assess the risk of bias and calibrate their confidence in research outcomes. In this Perspective, we briefly review the historical evolution of preregistration in medicine, psychology and other domains, clarify its pragmatic functions, discuss relevant meta-research, and provide recommendations for scientists and journal editors.
Collapse
Affiliation(s)
- Tom E Hardwicke
- Department of Psychology, University of Amsterdam, Amsterdam, the Netherlands.
| | | |
Collapse
|
14
|
Bortoletto M, Veniero D, Julkunen P, Hernandez-Pavon JC, Mutanen TP, Zazio A, Bagattini C. T4TE: Team for TMS-EEG to improve reproducibility through an open collaborative initiative. Brain Stimul 2023; 16:20-22. [PMID: 36528272 DOI: 10.1016/j.brs.2022.12.004] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/24/2022] [Accepted: 12/10/2022] [Indexed: 12/23/2022] Open
Affiliation(s)
- Marta Bortoletto
- Neurophysiology Lab, IRCCS Istituto Centro San Giovanni di Dio Fatebenefratelli, Brescia, Italy.
| | | | - Petro Julkunen
- Department of Clinical Neurophysiology, Kuopio University Hospital, Kuopio, Finland; Department of Technical Physics, University of Eastern Finland, Kuopio, Finland
| | - Julio C Hernandez-Pavon
- Department of Physical Medicine and Rehabilitation, Feinberg School of Medicine, Northwestern University, Chicago, IL, USA; Legs + Walking Lab, Shirley Ryan AbilityLab (Formerly, The Rehabilitation Institute of Chicago), Chicago, IL, USA; Center for Brain Stimulation, Shirley Ryan AbilityLab, Chicago, IL, USA
| | - Tuomas P Mutanen
- Department of Neuroscience and Biomedical Engineering, Aalto University School of Science, Finland
| | - Agnese Zazio
- Neurophysiology Lab, IRCCS Istituto Centro San Giovanni di Dio Fatebenefratelli, Brescia, Italy
| | - Chiara Bagattini
- Neurophysiology Lab, IRCCS Istituto Centro San Giovanni di Dio Fatebenefratelli, Brescia, Italy; Section of Neurosurgery, Department of Neurosciences, Biomedicine and Movement Sciences, University of Verona, Italy
| |
Collapse
|
15
|
The replicability crisis in science and protected area research: Poor practices and potential solutions. J Nat Conserv 2022. [DOI: 10.1016/j.jnc.2022.126236] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/20/2022]
|
16
|
Héroux ME, Butler AA, Cashin AG, McCaughey EJ, Affleck AJ, Green MA, Cartwright A, Jones M, Kiely KM, van Schooten KS, Menant JC, Wewege M, Gandevia SC. Quality Output Checklist and Content Assessment (QuOCCA): a new tool for assessing research quality and reproducibility. BMJ Open 2022; 12:e060976. [PMID: 36167369 PMCID: PMC9516158 DOI: 10.1136/bmjopen-2022-060976] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 11/04/2022] Open
Abstract
Research must be well designed, properly conducted and clearly and transparently reported. Our independent medical research institute wanted a simple, generic tool to assess the quality of the research conducted by its researchers, with the goal of identifying areas that could be improved through targeted educational activities. Unfortunately, none was available, thus we devised our own. Here, we report development of the Quality Output Checklist and Content Assessment (QuOCCA), and its application to publications from our institute's scientists. Following consensus meetings and external review by statistical and methodological experts, 11 items were selected for the final version of the QuOCCA: research transparency (items 1-3), research design and analysis (items 4-6) and research reporting practices (items 7-11). Five pairs of raters assessed all 231 articles published in 2017 and 221 in 2018 by researchers at our institute. Overall, the results were similar between years and revealed limited engagement with several recommended practices highlighted in the QuOCCA. These results will be useful to guide educational initiatives and their effectiveness. The QuOCCA is brief and focuses on broadly applicable and relevant concepts to open, high-quality, reproducible and well-reported science. Thus, the QuOCCA could be used by other biomedical institutions and individual researchers to evaluate research publications, assess changes in research practice over time and guide the discussion about high-quality, open science. Given its generic nature, the QuOCCA may also be useful in other research disciplines.
Collapse
Affiliation(s)
- Martin E Héroux
- Neuroscience Research Australia, Sydney, New South Wales, Australia
- University of New South Wales, Sydney, New South Wales, Australia
| | - Annie A Butler
- Neuroscience Research Australia, Sydney, New South Wales, Australia
- University of New South Wales, Sydney, New South Wales, Australia
| | - Aidan G Cashin
- Neuroscience Research Australia, Sydney, New South Wales, Australia
- University of New South Wales, Sydney, New South Wales, Australia
| | - Euan J McCaughey
- Neuroscience Research Australia, Sydney, New South Wales, Australia
- Queen Elizabeth National Spinal Injuries Unit, Queen Elizabeth University Hospital Campus, Glasgow, UK
| | - Andrew J Affleck
- Neuroscience Research Australia, Sydney, New South Wales, Australia
- Department of Neuropathology, Royal Prince Alfred Hospital, Camperdown, New South Wales, Australia
| | - Michael A Green
- Neuroscience Research Australia, Sydney, New South Wales, Australia
- University of New South Wales, Sydney, New South Wales, Australia
| | | | - Matthew Jones
- University of New South Wales, Sydney, New South Wales, Australia
| | - Kim M Kiely
- Neuroscience Research Australia, Sydney, New South Wales, Australia
- University of New South Wales, Sydney, New South Wales, Australia
| | - Kimberley S van Schooten
- Neuroscience Research Australia, Sydney, New South Wales, Australia
- University of New South Wales, Sydney, New South Wales, Australia
| | - Jasmine C Menant
- Neuroscience Research Australia, Sydney, New South Wales, Australia
- University of New South Wales, Sydney, New South Wales, Australia
| | - Michael Wewege
- Neuroscience Research Australia, Sydney, New South Wales, Australia
- University of New South Wales, Sydney, New South Wales, Australia
| | - Simon C Gandevia
- Neuroscience Research Australia, Sydney, New South Wales, Australia
- University of New South Wales, Sydney, New South Wales, Australia
| |
Collapse
|
17
|
Zazio A, Barchiesi G, Ferrari C, Marcantoni E, Bortoletto M. M1-P15 as a cortical marker for transcallosal inhibition: A preregistered TMS-EEG study. Front Hum Neurosci 2022; 16:937515. [PMID: 36188169 PMCID: PMC9523880 DOI: 10.3389/fnhum.2022.937515] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/06/2022] [Accepted: 08/22/2022] [Indexed: 11/24/2022] Open
Abstract
In a recently published study combining transcranial magnetic stimulation and electroencephalography (TMS-EEG), an early component of TMS-evoked potentials (TEPs), i.e., M1-P15, was proposed as a measure of transcallosal inhibition between motor cortices. Given that early TEPs are known to be highly variable, further evidence is needed before M1-P15 can be considered a reliable index of effective connectivity. Here, we conceived a new preregistered TMS-EEG study with two aims. The first aim was validating the M1-P15 as a cortical index of transcallosal inhibition by replicating previous findings on its relationship with the ipsilateral silent period (iSP) and with performance in bimanual coordination. The second aim was inducing a task-dependent modulation of transcallosal inhibition. A new sample of 32 healthy right-handed participants underwent behavioral motor tasks and TMS-EEG recording, in which left and right M1 were stimulated both during bimanual tasks and during an iSP paradigm. Hypotheses and methods were preregistered before data collection. Results show a replication of our previous findings on the positive relationship between M1-P15 amplitude and the iSP normalized area. Differently, the relationship between M1-P15 latency and bimanual coordination was not confirmed. Finally, M1-P15 amplitude was modulated by the characteristics of the bimanual task the participants were performing, and not by the contralateral hand activity during the iSP paradigm. In sum, the present results corroborate our previous findings in validating the M1-P15 as a cortical marker of transcallosal inhibition and provide novel evidence of its task-dependent modulation. Importantly, we demonstrate the feasibility of preregistration in the TMS-EEG field to increase methodological rigor and transparency.
Collapse
Affiliation(s)
- Agnese Zazio
- Neurophysiology Lab, IRCCS Istituto Centro San Giovanni di Dio Fatebenefratelli, Brescia, Italy
- *Correspondence: Agnese Zazio
| | - Guido Barchiesi
- Neurophysiology Lab, IRCCS Istituto Centro San Giovanni di Dio Fatebenefratelli, Brescia, Italy
- Cognition in Action (CIA) Unit - PHILAB, Department of Philosophy, University of Milan, Milan, Italy
| | - Clarissa Ferrari
- Statistics Unit, IRCCS Istituto Centro San Giovanni di Dio Fatebenefratelli, Brescia, Italy
| | - Eleonora Marcantoni
- Neurophysiology Lab, IRCCS Istituto Centro San Giovanni di Dio Fatebenefratelli, Brescia, Italy
| | - Marta Bortoletto
- Neurophysiology Lab, IRCCS Istituto Centro San Giovanni di Dio Fatebenefratelli, Brescia, Italy
| |
Collapse
|
18
|
Niso G, Botvinik-Nezer R, Appelhoff S, De La Vega A, Esteban O, Etzel JA, Finc K, Ganz M, Gau R, Halchenko YO, Herholz P, Karakuzu A, Keator DB, Markiewicz CJ, Maumet C, Pernet CR, Pestilli F, Queder N, Schmitt T, Sójka W, Wagner AS, Whitaker KJ, Rieger JW. Open and reproducible neuroimaging: From study inception to publication. Neuroimage 2022; 263:119623. [PMID: 36100172 PMCID: PMC10008521 DOI: 10.1016/j.neuroimage.2022.119623] [Citation(s) in RCA: 29] [Impact Index Per Article: 14.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/13/2022] [Revised: 08/17/2022] [Accepted: 09/09/2022] [Indexed: 10/31/2022] Open
Abstract
Empirical observations of how labs conduct research indicate that the adoption rate of open practices for transparent, reproducible, and collaborative science remains in its infancy. This is at odds with the overwhelming evidence for the necessity of these practices and their benefits for individual researchers, scientific progress, and society in general. To date, information required for implementing open science practices throughout the different steps of a research project is scattered among many different sources. Even experienced researchers in the topic find it hard to navigate the ecosystem of tools and to make sustainable choices. Here, we provide an integrated overview of community-developed resources that can support collaborative, open, reproducible, replicable, robust and generalizable neuroimaging throughout the entire research cycle from inception to publication and across different neuroimaging modalities. We review tools and practices supporting study inception and planning, data acquisition, research data management, data processing and analysis, and research dissemination. An online version of this resource can be found at https://oreoni.github.io. We believe it will prove helpful for researchers and institutions to make a successful and sustainable move towards open and reproducible science and to eventually take an active role in its future development.
Collapse
Affiliation(s)
- Guiomar Niso
- Psychological & Brain Sciences, Indiana University, Bloomington, IN, USA; Universidad Politecnica de Madrid, Madrid and CIBER-BBN, Spain; Instituto Cajal, CSIC, Madrid, Spain.
| | - Rotem Botvinik-Nezer
- Department of Psychological and Brain Sciences, Dartmouth College, Hanover, NH, USA.
| | - Stefan Appelhoff
- Center for Adaptive Rationality, Max Planck Institute for Human Development, Berlin, Germany
| | | | - Oscar Esteban
- Dept. of Radiology, Lausanne University Hospital and University of Lausanne, Lausanne, Switzerland; Department of Psychology, Stanford University, Stanford, CA, USA
| | - Joset A Etzel
- Department of Psychological and Brain Sciences, Washington University in St. Louis, St. Louis, MO, USA
| | - Karolina Finc
- Centre for Modern Interdisciplinary Technologies, Nicolaus Copernicus University, Toruń, Poland
| | - Melanie Ganz
- Neurobiology Research Unit, Rigshospitalet, Copenhagen, Denmark; Department of Computer Science, University of Copenhagen, Copenhagen, Denmark
| | - Rémi Gau
- Institute of Psychology, Université catholique de Louvain, Louvain la Neuve, Belgium
| | - Yaroslav O Halchenko
- Department of Psychological and Brain Sciences, Dartmouth College, Hanover, NH, USA
| | - Peer Herholz
- Montreal Neurological Institute-Hospital, McGill University, Montréal, Quebec, Canada
| | - Agah Karakuzu
- Biomedical Engineering Institute, Polytechnique Montréal, Montréal, Quebec, Canada; Montréal Heart Institute, Montréal, Quebec, Canada
| | - David B Keator
- Department of Psychiatry and Human Behavior, University of California, Irvine, CA, USA
| | | | - Camille Maumet
- Inria, Univ Rennes, CNRS, Inserm - IRISA UMR 6074, Empenn ERL U 1228, Rennes, France
| | - Cyril R Pernet
- Neurobiology Research Unit, Rigshospitalet, Copenhagen, Denmark
| | - Franco Pestilli
- Psychological & Brain Sciences, Indiana University, Bloomington, IN, USA; Department of Psychology, The University of Texas at Austin, Austin, TX, USA
| | - Nazek Queder
- Montreal Neurological Institute-Hospital, McGill University, Montréal, Quebec, Canada; Department of Neurobiology and Behavior, University of California, Irvine, CA, USA
| | - Tina Schmitt
- Neuroimaging Unit, Carl-von-Ossietzky Universität, Oldenburg, Germany
| | - Weronika Sójka
- Faculty of Philosophy and Social Sciences, Nicolaus Copernicus University, Toruń, Poland
| | - Adina S Wagner
- Institute for Neuroscience and Medicine, Research Centre Juelich, Germany
| | | | - Jochem W Rieger
- Neuroimaging Unit, Carl-von-Ossietzky Universität, Oldenburg, Germany; Department of Psychology, Carl-von-Ossietzky Universität, Oldenburg, Germany.
| |
Collapse
|
19
|
Rubin M, Donkin C. Exploratory hypothesis tests can be more compelling than confirmatory hypothesis tests. PHILOSOPHICAL PSYCHOLOGY 2022. [DOI: 10.1080/09515089.2022.2113771] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 10/15/2022]
Affiliation(s)
- Mark Rubin
- Department of Psychology, Durham University, Durham, UK
| | - Chris Donkin
- Faculty of Psychology and Educational Sciences, Ludwig Maximilian University of Munich, Munich, Germany
| |
Collapse
|
20
|
Niso G, Krol LR, Combrisson E, Dubarry AS, Elliott MA, François C, Héjja-Brichard Y, Herbst SK, Jerbi K, Kovic V, Lehongre K, Luck SJ, Mercier M, Mosher JC, Pavlov YG, Puce A, Schettino A, Schön D, Sinnott-Armstrong W, Somon B, Šoškić A, Styles SJ, Tibon R, Vilas MG, van Vliet M, Chaumon M. Good scientific practice in EEG and MEG research: Progress and perspectives. Neuroimage 2022; 257:119056. [PMID: 35283287 PMCID: PMC11236277 DOI: 10.1016/j.neuroimage.2022.119056] [Citation(s) in RCA: 8] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/28/2021] [Revised: 02/25/2022] [Accepted: 03/01/2022] [Indexed: 11/22/2022] Open
Abstract
Good scientific practice (GSP) refers to both explicit and implicit rules, recommendations, and guidelines that help scientists to produce work that is of the highest quality at any given time, and to efficiently share that work with the community for further scrutiny or utilization. For experimental research using magneto- and electroencephalography (MEEG), GSP includes specific standards and guidelines for technical competence, which are periodically updated and adapted to new findings. However, GSP also needs to be regularly revisited in a broader light. At the LiveMEEG 2020 conference, a reflection on GSP was fostered that included explicitly documented guidelines and technical advances, but also emphasized intangible GSP: a general awareness of personal, organizational, and societal realities and how they can influence MEEG research. This article provides an extensive report on most of the LiveMEEG contributions and new literature, with the additional aim to synthesize ongoing cultural changes in GSP. It first covers GSP with respect to cognitive biases and logical fallacies, pre-registration as a tool to avoid those and other early pitfalls, and a number of resources to enable collaborative and reproducible research as a general approach to minimize misconceptions. Second, it covers GSP with respect to data acquisition, analysis, reporting, and sharing, including new tools and frameworks to support collaborative work. Finally, GSP is considered in light of ethical implications of MEEG research and the resulting responsibility that scientists have to engage with societal challenges. Considering among other things the benefits of peer review and open access at all stages, the need to coordinate larger international projects, the complexity of MEEG subject matter, and today's prioritization of fairness, privacy, and the environment, we find that current GSP tends to favor collective and cooperative work, for both scientific and for societal reasons.
Collapse
Affiliation(s)
- Guiomar Niso
- Psychological & Brain Sciences, Indiana University, Bloomington, IN, USA; Universidad Politecnica de Madrid and CIBER-BBN, Madrid, Spain
| | - Laurens R Krol
- Neuroadaptive Human-Computer Interaction, Brandenburg University of Technology Cottbus-Senftenberg, Germany
| | - Etienne Combrisson
- Aix-Marseille University, Institut de Neurosciences de la Timone, France
| | | | | | | | - Yseult Héjja-Brichard
- Centre d'Ecologie Fonctionnelle et Evolutive, CNRS, EPHE, IRD, Université Montpellier, Montpellier, France
| | - Sophie K Herbst
- Cognitive Neuroimaging Unit, INSERM, CEA, CNRS, NeuroSpin center, Université Paris-Saclay, Gif/Yvette, France
| | - Karim Jerbi
- Cognitive and Computational Neuroscience Laboratory, Department of Psychology, University of Montreal, Montreal, QC, Canada; Mila - Quebec Artificial Intelligence Institute, Canada
| | - Vanja Kovic
- Faculty of Philosophy, Laboratory for neurocognition and applied cognition, University of Belgrade, Serbia
| | - Katia Lehongre
- Institut du Cerveau - Paris Brain Institute - ICM, Inserm U 1127, CNRS UMR 7225, APHP, Hôpital de la Pitié Salpêtrière, Sorbonne Université, Centre MEG-EEG, Centre de NeuroImagerie Recherche (CENIR), Paris, France
| | - Steven J Luck
- Center for Mind & Brain, University of California, Davis, CA, USA
| | - Manuel Mercier
- Aix Marseille Univ, Inserm, INS, Inst Neurosci Syst, Marseille, France
| | - John C Mosher
- McGovern Medical School, University of Texas Health Science Center at Houston, Houston, TX, USA
| | - Yuri G Pavlov
- University of Tuebingen, Germany; Ural Federal University, Yekaterinburg, Russia
| | - Aina Puce
- Psychological & Brain Sciences, Indiana University, Bloomington, IN, USA
| | - Antonio Schettino
- Erasmus University Rotterdam, Rotterdam, the Netherland; Institute for Globally Distributed Open Research and Education (IGDORE), Sweden
| | - Daniele Schön
- Aix Marseille Univ, Inserm, INS, Inst Neurosci Syst, Marseille, France
| | | | | | - Anđela Šoškić
- Faculty of Philosophy, Laboratory for neurocognition and applied cognition, University of Belgrade, Serbia; Teacher Education Faculty, University of Belgrade, Serbia
| | - Suzy J Styles
- Psychology, Nanyang Technological University, Singapore; Singapore Institute for Clinical Sciences, A*STAR, Singapore
| | - Roni Tibon
- MRC Cognition and Brain Sciences Unit, University of Cambridge, Cambridge, UK; School of Psychology, University of Nottingham, Nottingham, UK
| | - Martina G Vilas
- Ernst Strüngmann Institute for Neuroscience, Frankfurt am Main, Germany
| | | | - Maximilien Chaumon
- Institut du Cerveau - Paris Brain Institute - ICM, Inserm U 1127, CNRS UMR 7225, APHP, Hôpital de la Pitié Salpêtrière, Sorbonne Université, Centre MEG-EEG, Centre de NeuroImagerie Recherche (CENIR), Paris, France..
| |
Collapse
|
21
|
Mercier MR, Dubarry AS, Tadel F, Avanzini P, Axmacher N, Cellier D, Vecchio MD, Hamilton LS, Hermes D, Kahana MJ, Knight RT, Llorens A, Megevand P, Melloni L, Miller KJ, Piai V, Puce A, Ramsey NF, Schwiedrzik CM, Smith SE, Stolk A, Swann NC, Vansteensel MJ, Voytek B, Wang L, Lachaux JP, Oostenveld R. Advances in human intracranial electroencephalography research, guidelines and good practices. Neuroimage 2022; 260:119438. [PMID: 35792291 DOI: 10.1016/j.neuroimage.2022.119438] [Citation(s) in RCA: 41] [Impact Index Per Article: 20.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/15/2021] [Revised: 05/23/2022] [Accepted: 06/30/2022] [Indexed: 12/11/2022] Open
Abstract
Since the second-half of the twentieth century, intracranial electroencephalography (iEEG), including both electrocorticography (ECoG) and stereo-electroencephalography (sEEG), has provided an intimate view into the human brain. At the interface between fundamental research and the clinic, iEEG provides both high temporal resolution and high spatial specificity but comes with constraints, such as the individual's tailored sparsity of electrode sampling. Over the years, researchers in neuroscience developed their practices to make the most of the iEEG approach. Here we offer a critical review of iEEG research practices in a didactic framework for newcomers, as well addressing issues encountered by proficient researchers. The scope is threefold: (i) review common practices in iEEG research, (ii) suggest potential guidelines for working with iEEG data and answer frequently asked questions based on the most widespread practices, and (iii) based on current neurophysiological knowledge and methodologies, pave the way to good practice standards in iEEG research. The organization of this paper follows the steps of iEEG data processing. The first section contextualizes iEEG data collection. The second section focuses on localization of intracranial electrodes. The third section highlights the main pre-processing steps. The fourth section presents iEEG signal analysis methods. The fifth section discusses statistical approaches. The sixth section draws some unique perspectives on iEEG research. Finally, to ensure a consistent nomenclature throughout the manuscript and to align with other guidelines, e.g., Brain Imaging Data Structure (BIDS) and the OHBM Committee on Best Practices in Data Analysis and Sharing (COBIDAS), we provide a glossary to disambiguate terms related to iEEG research.
Collapse
|
22
|
Amora KK, Tretow A, Verwimp C, Tijms J, Leppänen PHT, Csépe V. Typical and Atypical Development of Visual Expertise for Print as Indexed by the Visual Word N1 (N170w): A Systematic Review. Front Neurosci 2022; 16:898800. [PMID: 35844207 PMCID: PMC9279737 DOI: 10.3389/fnins.2022.898800] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/17/2022] [Accepted: 05/24/2022] [Indexed: 11/24/2022] Open
Abstract
The visual word N1 (N170w) is an early brain ERP component that has been found to be a neurophysiological marker for print expertise, which is a prelexical requirement associated with reading development. To date, no other review has assimilated existing research on reading difficulties and atypical development of processes reflected in the N170w response. Hence, this systematic review synthesized results and evaluated neurophysiological and experimental procedures across different studies about visual print expertise in reading development. Literature databases were examined for relevant studies from 1995 to 2020 investigating the N170w response in individuals with or without reading disorders. To capture the development of the N170w related to reading, results were compared between three different age groups: pre-literate children, school-aged children, and young adults. The majority of available N170w studies (N = 69) investigated adults (n = 31) followed by children (school-aged: n = 21; pre-literate: n = 4) and adolescents (n = 1) while some studies investigated a combination of these age groups (n = 12). Most studies were conducted with German-speaking populations (n = 17), followed by English (n = 15) and Chinese (n = 14) speaking participants. The N170w was primarily investigated using a combination of words, pseudowords, and symbols (n = 20) and mostly used repetition-detection (n = 16) or lexical-decision tasks (n = 16). Different studies posed huge variability in selecting electrode sites for analysis; however, most focused on P7, P8, and O1 sites of the international 10–20 system. Most of the studies in adults have found a more negative N170w in controls than poor readers, whereas in children, the results have been mixed. In typical readers, N170w ranged from having a bilateral distribution to a left-hemispheric dominance throughout development, whereas in young, poor readers, the response was mainly right-lateralized and then remained in a bilateral distribution. Moreover, the N170w latency has varied according to age group, with adults having an earlier onset yet with shorter latency than school-aged and pre-literate children. This systematic review provides a comprehensive picture of the development of print expertise as indexed by the N170w across age groups and reading abilities and discusses theoretical and methodological differences and challenges in the field, aiming to guide future research.
Collapse
Affiliation(s)
- Kathleen Kay Amora
- Brain Imaging Centre, Research Centre for Natural Sciences, Budapest, Hungary
- Faculty of Modern Philology and Social Sciences, Multilingualism Doctoral School, University of Pannonia, Veszprém, Hungary
- *Correspondence: Kathleen Kay Amora ;
| | - Ariane Tretow
- Department of Psychology, University of Jyväskylä, Jyväskylä, Finland
| | - Cara Verwimp
- Department of Developmental Psychology, University of Amsterdam, Amsterdam, Netherlands
- Rudolf Berlin Center, Amsterdam, Netherlands
| | - Jurgen Tijms
- Department of Developmental Psychology, University of Amsterdam, Amsterdam, Netherlands
- Rudolf Berlin Center, Amsterdam, Netherlands
| | | | - Valéria Csépe
- Brain Imaging Centre, Research Centre for Natural Sciences, Budapest, Hungary
- Institute for Hungarian and Applied Linguistics, University of Pannonia, Veszprém, Hungary
| |
Collapse
|
23
|
Keil A, Bernat EM, Cohen MX, Ding M, Fabiani M, Gratton G, Kappenman ES, Maris E, Mathewson KE, Ward RT, Weisz N. Recommendations and publication guidelines for studies using frequency domain and time-frequency domain analyses of neural time series. Psychophysiology 2022; 59:e14052. [PMID: 35398913 PMCID: PMC9717489 DOI: 10.1111/psyp.14052] [Citation(s) in RCA: 28] [Impact Index Per Article: 14.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/08/2022] [Accepted: 03/08/2022] [Indexed: 01/29/2023]
Abstract
Since its beginnings in the early 20th century, the psychophysiological study of human brain function has included research into the spectral properties of electrical and magnetic brain signals. Now, dramatic advances in digital signal processing, biophysics, and computer science have enabled increasingly sophisticated methodology for neural time series analysis. Innovations in hardware and recording techniques have further expanded the range of tools available to researchers interested in measuring, quantifying, modeling, and altering the spectral properties of neural time series. These tools are increasingly used in the field, by a growing number of researchers who vary in their training, background, and research interests. Implementation and reporting standards also vary greatly in the published literature, causing challenges for authors, readers, reviewers, and editors alike. The present report addresses this issue by providing recommendations for the use of these methods, with a focus on foundational aspects of frequency domain and time-frequency analyses. It also provides publication guidelines, which aim to (1) foster replication and scientific rigor, (2) assist new researchers who wish to enter the field of brain oscillations, and (3) facilitate communication among authors, reviewers, and editors.
Collapse
Affiliation(s)
- Andreas Keil
- Department and Psychology and Center for the Study of Emotion and Attention, University of Florida, Gainesville, Florida, USA
| | - Edward M. Bernat
- Department of Psychology, University of Maryland, College Park, Maryland, USA
| | - Michael X. Cohen
- Radboud University and University Medical Center, Nijmegen, the Netherlands
| | - Mingzhou Ding
- J Crayton Pruitt Family Department of Biomedical Engineering, University of Florida, Gainesville, Florida, USA
| | - Monica Fabiani
- Beckman Institute for Advanced Science and Technology, University of Illinois at Urbana-Champaign, Urbana, Illinois, USA,Psychology Department, University of Illinois at Urbana-Champaign, Champaign, Illinois, USA
| | - Gabriele Gratton
- Beckman Institute for Advanced Science and Technology, University of Illinois at Urbana-Champaign, Urbana, Illinois, USA,Psychology Department, University of Illinois at Urbana-Champaign, Champaign, Illinois, USA
| | - Emily S. Kappenman
- Department of Psychology, San Diego State University, San Diego, California, USA
| | - Eric Maris
- Donders Institute for Brain, Cognition, and Behaviour & Faculty of Social Sciences Radboud University, Nijmegen, the Netherlands
| | - Kyle E. Mathewson
- Department of Psychology, Faculty of Science, University of Alberta, Edmonton, Alberta, Canada
| | - Richard T. Ward
- Department and Psychology and Center for the Study of Emotion and Attention, University of Florida, Gainesville, Florida, USA
| | - Nathan Weisz
- Psychology, University of Salzburg, Salzburg, Austria,Neuroscience Institute, Christian Doppler University Hospital, Paracelsus Medical University, Salzburg, Austria
| |
Collapse
|
24
|
Vuoriainen E, Bakermans-Kranenburg MJ, Huffmeijer R, van IJzendoorn MH, Peltola MJ. Processing children's faces in the parental brain: A meta-analysis of ERP studies. Neurosci Biobehav Rev 2022; 136:104604. [PMID: 35278598 DOI: 10.1016/j.neubiorev.2022.104604] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/06/2021] [Revised: 01/22/2022] [Accepted: 03/06/2022] [Indexed: 10/18/2022]
Abstract
Event-related potentials (ERPs) are an excellent tool for investigating parental neural responses to child stimuli. Using meta-analysis, we quantified the results of available studies reporting N170 or LPP/P3 ERP responses to children's faces, targeting three questions: 1) Do parents and non-parents differ in ERP responses to child faces? 2) Are parental ERP responses larger to own vs. unfamiliar child faces? 3) Are parental ERP responses to child faces associated with indicators of parenting quality, such as observed parental sensitivity? Across 23 studies (N = 1035), key findings showed 1) larger N170 amplitudes to child faces in parents than in non-parents (r = 0.19), 2) larger LPP/P3 responses to own vs. unfamiliar child faces in parents (r = 0.19), and 3) positive associations between parental LPP/P3 responses to child faces and parenting quality outcomes (r = 0.15). These results encourage further research particularly with the LPP/P3 to assess attentional-motivational processes of parenting, but also highlight the need for larger samples and more systematic assessments of associations between ERPs and parenting.
Collapse
Affiliation(s)
- Elisa Vuoriainen
- Human Information Processing Laboratory, Psychology, Faculty of Social Sciences, Tampere University, Finland
| | - Marian J Bakermans-Kranenburg
- Faculty of Behavioural and Movement Sciences, Educational and Family Studies, Vrije Universiteit Amsterdam, The Netherlands
| | - Rens Huffmeijer
- Institute of Education and Child Studies, Leiden University, The Netherlands
| | - Marinus H van IJzendoorn
- Research Department of Clinical, Education and Health Psychology, Faculty of Brain Sciences, UCL, University of London, UK
| | - Mikko J Peltola
- Human Information Processing Laboratory, Psychology, Faculty of Social Sciences, Tampere University, Finland; Tampere Institute for Advanced Study, Tampere University, Finland.
| |
Collapse
|
25
|
Abstract
Open science practices are gaining momentum in psychophysiological research, but at the nascent stage of this special issue in the International Journal of Psychophysiology there was no systematic collection of resources to support the adoption of open science practices specific to studies of human electrophysiology (EEG). The purpose of this special issue was to gather and provide resources that identify the idiosyncratic considerations and implications of open science practices specifically for studies of human EEG and event-related potentials (ERPs). Papers also show the importance of promoting good scientific practices in the application of open science principles to EEG and ERPs. This introduction to the special issue provides a roadmap for identifying the resources necessary to begin and improve the application of open science principles to EEG and ERP research. We are optimistic that open science practices will help increase the robustness, rigor, and replicability of EEG research and ultimately become the norm in studies of EEG and ERPs.
Collapse
Affiliation(s)
- Peter E Clayson
- Department of Psychology, University of South Florida, Tampa, FL, USA.
| | - Andreas Keil
- Department of Psychology, Center for the Study of Emotion and Attention, University of Florida, Gainesville, FL, USA
| | - Michael J Larson
- Department of Psychology, Brigham Young University, Provo, UT, USA; Neuroscience Center, Brigham Young University, Provo, UT, USA
| |
Collapse
|
26
|
Styles SJ, Ković V, Ke H, Šoškić A. Towards ARTEM-IS: Design guidelines for evidence-based EEG methodology reporting tools. Neuroimage 2021; 245:118721. [PMID: 34826594 DOI: 10.1016/j.neuroimage.2021.118721] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/12/2021] [Revised: 10/11/2021] [Accepted: 11/03/2021] [Indexed: 10/19/2022] Open
Abstract
As the number of EEG papers increases, so too do the number of guidelines for how to report what has been done. However, current guidelines and checklists appear to have limited adoption, as systematic reviews have shown the journal article format is highly prone to errors, ambiguities and omissions of methodological details. This is a problem for transparency in the scientific record, along with reproducibility and metascience. Following lessons learned in the high complexity fields of aviation and surgery, we conclude that new tools are needed to overcome the limitations of written methodology descriptions, and that these tools should be developed through community consultation to ensure that they have the most utility for EEG stakeholders. As a first step in tool development, we present the ARTEM-IS Statement describing what action will be needed to create an Agreed Reporting Template for Electroencephalography Methodology - International Standard (ARTEM-IS), along with ARTEM-IS Design Guidelines for developing tools that use an evidence-based approach to error reduction. We first launched the statement at the LiveMEEG conference in 2020 along with a draft of an ARTEM-IS template for public consultation. Members of the EEG community are invited to join this collective effort to create evidence-based tools that will help make the process of reporting methodology intuitive to complete and foolproof by design.
Collapse
Affiliation(s)
- Suzy J Styles
- Psychology, Nanyang Technological University, Singapore; Centre for Research and Development in Learning, Nanyang Technological University, Singapore; Singapore Institute for Clinical Sciences, Agency for Science, Technology and Research (A*STAR), Singapore.
| | - Vanja Ković
- Laboratory for Neurocognition and Applied Cognition, Faculty of Philosophy, University of Belgrade, Singapore
| | - Han Ke
- Psychology, Nanyang Technological University, Singapore
| | - Anđela Šoškić
- Laboratory for Neurocognition and Applied Cognition, Faculty of Philosophy, University of Belgrade, Singapore; Teacher Education Faculty, University of Belgrade, Singapore.
| |
Collapse
|
27
|
Crüwell S, Evans NJ. Preregistration in diverse contexts: a preregistration template for the application of cognitive models. ROYAL SOCIETY OPEN SCIENCE 2021; 8:210155. [PMID: 34659776 PMCID: PMC8511762 DOI: 10.1098/rsos.210155] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/29/2021] [Accepted: 08/16/2021] [Indexed: 05/20/2023]
Abstract
In recent years, open science practices have become increasingly popular in psychology and related sciences. These practices aim to increase rigour and transparency in science as a potential response to the challenges posed by the replication crisis. Many of these reforms-including the increasingly used preregistration-have been designed for purely experimental work that tests straightforward hypotheses with standard inferential statistical analyses, such as assessing whether an experimental manipulation has an effect on a variable of interest. But psychology is a diverse field of research. The somewhat narrow focus of the prevalent discussions surrounding and templates for preregistration has led to debates on how appropriate these reforms are for areas of research with more diverse hypotheses and more intricate methods of analysis, such as cognitive modelling research within mathematical psychology. Our article attempts to bridge the gap between open science and mathematical psychology, focusing on the type of cognitive modelling that Crüwell et al. (Crüwell S, Stefan AM, Evans NJ. 2019 Robust standards in cognitive science. Comput. Brain Behav. 2, 255-265) labelled model application, where researchers apply a cognitive model as a measurement tool to test hypotheses about parameters of the cognitive model. Specifically, we (i) discuss several potential researcher degrees of freedom within model application, (ii) provide the first preregistration template for model application and (iii) provide an example of a preregistered model application using our preregistration template. More broadly, we hope that our discussions and concrete proposals constructively advance the mostly abstract current debate surrounding preregistration in cognitive modelling, and provide a guide for how preregistration templates may be developed in other diverse or intricate research contexts.
Collapse
Affiliation(s)
- Sophia Crüwell
- Meta-Research Innovation Center Berlin (METRIC-B), QUEST Center for Transforming Biomedical Research, Berlin Institute of Health, Charité – Universitätsmedizin Berlin, Berlin, Germany
- Department of Psychology, University of Amsterdam, Amsterdam, The Netherlands
- Department of History and Philosophy of Science, University of Cambridge, Cambridge, UK
| | - Nathan J. Evans
- Department of Psychology, University of Amsterdam, Amsterdam, The Netherlands
- School of Psychology, University of Queensland, Queensland, Australia
- School of Psychology, University of Newcastle, Callaghan, Australia
| |
Collapse
|
28
|
Persson S, Pownall M. Can Open Science be a Tool to Dismantle Claims of Hardwired Brain Sex Differences? Opportunities and Challenges for Feminist Researchers. PSYCHOLOGY OF WOMEN QUARTERLY 2021. [DOI: 10.1177/03616843211037613] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/17/2022]
Abstract
Feminist scholars have long been concerned with claims of hardwired brain sex differences emanating from neuroscience and evolutionary psychology. Past criticisms of these claims have rightfully questioned the impact of this research on gender equality, pointing out how findings can be used to vindicate gender stereotypes. In this article, we appraise the brain sex differences literature through the lens of open science, a movement aimed at improving the robustness and reliability of science. In this discussion, we offer a feminist evaluation of the strategies (e.g., pre-registration, data sharing, and accountability) provided by open science, and we question whether these may be the novel and disruptive tools needed to dismantle claims about hardwired brain sex differences. We suggest that open science strategies can be useful in challenging some of these claims, and we note that promising initiatives are already being developed in neuroscience and allied fields. We end by acknowledging the distinct challenges that feminist researchers wishing to engage in open science face, particularly in the context of limited diversity. We conclude that open science presents considerable opportunity for feminist researchers, and that it will be crucial for feminists to be involved in shaping the future of this movement.
Collapse
Affiliation(s)
- Sofia Persson
- School of Social Sciences, Leeds Beckett University, Leeds, UK
| | | |
Collapse
|
29
|
Clayson PE, Brush C, Hajcak G. Data quality and reliability metrics for event-related potentials (ERPs): The utility of subject-level reliability. Int J Psychophysiol 2021; 165:121-136. [DOI: 10.1016/j.ijpsycho.2021.04.004] [Citation(s) in RCA: 19] [Impact Index Per Article: 6.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/25/2020] [Revised: 04/20/2021] [Accepted: 04/21/2021] [Indexed: 12/15/2022]
|
30
|
Junge C, Boumeester M, Mills DL, Paul M, Cosper SH. Development of the N400 for Word Learning in the First 2 Years of Life: A Systematic Review. Front Psychol 2021; 12:689534. [PMID: 34276518 PMCID: PMC8277998 DOI: 10.3389/fpsyg.2021.689534] [Citation(s) in RCA: 9] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/01/2021] [Accepted: 05/27/2021] [Indexed: 11/13/2022] Open
Abstract
The N400 ERP component is a direct neural index of word meaning. Studies show that the N400 component is already present in early infancy, albeit often delayed. Many researchers capitalize on this finding, using the N400 component to better understand how early language acquisition unfolds. However, variability in how researchers quantify the N400 makes it difficult to set clear predictions or build theory. Not much is known about how the N400 component develops in the first 2 years of life in terms of its latency and topographical distributions, nor do we know how task parameters affect its appearance. In the current paper we carry out a systematic review, comparing over 30 studies that report the N400 component as a proxy of semantic processing elicited in infants between 0 and 24 months old who listened to linguistic stimuli. Our main finding is that there is large heterogeneity across semantic-priming studies in reported characteristics of the N400, both with respect to latency and to distributions. With age, the onset of the N400 insignificantly decreases, while its offset slightly increases. We also examined whether the N400 appears different for recently-acquired novel words vs. existing words: both situations reveal heterogeneity across studies. Finally, we inspected whether the N400 was modulated differently with studies using a between-subject design. In infants with more proficient language skills the N400 was more often present or showed itself here with earlier latency, compared to their peers; but no consistent patterns were observed for distribution characteristics of the N400. One limitation of the current review is that we compared studies that widely differed in choice of EEG recordings, pre-processing steps and quantification of the N400, all of which could affect the characteristics of the infant N400. The field is still missing research that systematically tests development of the N400 using the same paradigm across infancy.
Collapse
Affiliation(s)
- Caroline Junge
- Department of Experimental Psychology, Utrecht University, Utrecht, Netherlands
| | - Marlijne Boumeester
- Department of Experimental Psychology, Utrecht University, Utrecht, Netherlands
| | - Debra L. Mills
- School of Psychology, Bangor University, Bangor, United Kingdom
| | - Mariella Paul
- Psychology of Language Research Group, Georg-August-Universität Göttingen, Göttingen, Germany
| | - Samuel H. Cosper
- Institute of Cognitive Science, University of Osnabrück, Osnabrück, Germany
| |
Collapse
|
31
|
Lutz MC, Kok R, Franken IHA. Event-related potential (ERP) measures of error processing as biomarkers of externalizing disorders: A narrative review. Int J Psychophysiol 2021; 166:151-159. [PMID: 34146603 DOI: 10.1016/j.ijpsycho.2021.06.002] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/14/2020] [Revised: 03/24/2021] [Accepted: 06/06/2021] [Indexed: 12/12/2022]
Abstract
Previous studies have shown that electrophysiological measures of error processing are affected in patients at risk or diagnosed with internalizing disorders, hence, suggesting that error processing could be a suitable biomarker for internalizing disorders. In this narrative review, we will evaluate studies that address the role of event-related potential (ERP) measures of error-processing in externalizing disorders and discuss to what extend these can be considered a biomarker for externalizing disorders. Currently, there is evidence for the notion that electrophysiological indices of error processing such as the error-related negativity (ERN) and error positivity (Pe) are reduced in individuals with substance use disorders, attention-deficit/hyperactivity disorder, and in forensic populations. However, it remains unclear whether this is also the case for other understudied disorders such as behavioral addiction. Furthermore, to fully understand how these deficits affect day to day behavior, we encourage research to focus on testing current theories and hypotheses of ERN and Pe. In addition, we argue that within an externalizing disorder, individual differences in error processing deficits may be related to prognosis and gender of the patient, methodological issues and presence of comorbidity. Next, we review studies that have related treatment trajectories with ERP measures of error processing, and we discuss the prospect of improving error processing as a treatment option. We conclude that ERP measures of error processing are candidate biomarkers for externalizing disorders, albeit we strongly urge researchers to continue looking into the predictive value of these measures in the etiology and treatment outcome through multi-method and longitudinal designs.
Collapse
Affiliation(s)
- Miranda C Lutz
- Department of Psychology, Education and Child Studies, Erasmus University Rotterdam, P.O. 1738, 3000 DR Rotterdam, the Netherlands; Department of Clinical, Neuro- and Developmental Psychology, Vrije Universiteit Amsterdam, Van der Boechorststraat 1, 1081 HV Amsterdam, the Netherlands
| | - Rianne Kok
- Department of Psychology, Education and Child Studies, Erasmus University Rotterdam, P.O. 1738, 3000 DR Rotterdam, the Netherlands
| | - Ingmar H A Franken
- Department of Psychology, Education and Child Studies, Erasmus University Rotterdam, P.O. 1738, 3000 DR Rotterdam, the Netherlands.
| |
Collapse
|
32
|
Devezer B, Navarro DJ, Vandekerckhove J, Ozge Buzbas E. The case for formal methodology in scientific reform. ROYAL SOCIETY OPEN SCIENCE 2021; 8:200805. [PMID: 34035933 PMCID: PMC8101540 DOI: 10.1098/rsos.200805] [Citation(s) in RCA: 13] [Impact Index Per Article: 4.3] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/08/2021] [Accepted: 03/04/2021] [Indexed: 05/03/2023]
Abstract
Current attempts at methodological reform in sciences come in response to an overall lack of rigor in methodological and scientific practices in experimental sciences. However, most methodological reform attempts suffer from similar mistakes and over-generalizations to the ones they aim to address. We argue that this can be attributed in part to lack of formalism and first principles. Considering the costs of allowing false claims to become canonized, we argue for formal statistical rigor and scientific nuance in methodological reform. To attain this rigor and nuance, we propose a five-step formal approach for solving methodological problems. To illustrate the use and benefits of such formalism, we present a formal statistical analysis of three popular claims in the metascientific literature: (i) that reproducibility is the cornerstone of science; (ii) that data must not be used twice in any analysis; and (iii) that exploratory projects imply poor statistical practice. We show how our formal approach can inform and shape debates about such methodological claims.
Collapse
Affiliation(s)
- Berna Devezer
- Department of Business, University of Idaho, Moscow, Idaho, USA
| | | | - Joachim Vandekerckhove
- Department of Cognitive Sciences and Department of Statistics, University of California, Irvine, USA
| | - Erkan Ozge Buzbas
- Department of Mathematics and Statistical Science, University of Idaho, Moscow, Idaho, USA
| |
Collapse
|