151
|
Niu PH, Zhao LL, Wu HL, Zhao DB, Chen YT. Artificial intelligence in gastric cancer: Application and future perspectives. World J Gastroenterol 2020; 26:5408-5419. [PMID: 33024393 PMCID: PMC7520602 DOI: 10.3748/wjg.v26.i36.5408] [Citation(s) in RCA: 51] [Impact Index Per Article: 12.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 05/24/2020] [Revised: 08/02/2020] [Accepted: 08/29/2020] [Indexed: 02/06/2023] Open
Abstract
Gastric cancer is the fourth leading cause of cancer-related mortality across the globe, with a 5-year survival rate of less than 40%. In recent years, several applications of artificial intelligence (AI) have emerged in the gastric cancer field based on its efficient computational power and learning capacities, such as image-based diagnosis and prognosis prediction. AI-assisted diagnosis includes pathology, endoscopy, and computerized tomography, while researchers in the prognosis circle focus on recurrence, metastasis, and survival prediction. In this review, a comprehensive literature search was performed on articles published up to April 2020 from the databases of PubMed, Embase, Web of Science, and the Cochrane Library. Thereby the current status of AI-applications was systematically summarized in gastric cancer. Moreover, future directions that target this field were also analyzed to overcome the risk of overfitting AI models and enhance their accuracy as well as the applicability in clinical practice.
Collapse
Affiliation(s)
- Peng-Hui Niu
- Department of Pancreatic and Gastric Surgery, National Cancer Center/National Clinical Research Center for Cancer/Cancer Hospital, Chinese Academy of Medical Sciences and Peking Union Medical College, Beijing 100021, China
| | - Lu-Lu Zhao
- Department of Pancreatic and Gastric Surgery, National Cancer Center/National Clinical Research Center for Cancer/Cancer Hospital, Chinese Academy of Medical Sciences and Peking Union Medical College, Beijing 100021, China
| | - Hong-Liang Wu
- Department of Anesthesiology, National Cancer Center/National Clinical Research Center for Cancer/Cancer Hospital, Chinese Academy of Medical Sciences and Peking Union Medical College, Beijing 100021, China
| | - Dong-Bing Zhao
- Department of Pancreatic and Gastric Surgery, National Cancer Center/National Clinical Research Center for Cancer/Cancer Hospital, Chinese Academy of Medical Sciences and Peking Union Medical College, Beijing 100021, China
| | - Ying-Tai Chen
- Department of Pancreatic and Gastric Surgery, National Cancer Center/National Clinical Research Center for Cancer/Cancer Hospital, Chinese Academy of Medical Sciences and Peking Union Medical College, Beijing 100021, China
| |
Collapse
|
152
|
Searching for the Backfire Effect: Measurement and Design Considerations. JOURNAL OF APPLIED RESEARCH IN MEMORY AND COGNITION 2020; 9:286-299. [PMID: 32905023 PMCID: PMC7462781 DOI: 10.1016/j.jarmac.2020.06.006] [Citation(s) in RCA: 57] [Impact Index Per Article: 14.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/14/2020] [Revised: 06/20/2020] [Accepted: 06/21/2020] [Indexed: 01/14/2023]
Abstract
One of the most concerning notions for science communicators, fact-checkers, and advocates of truth, is the backfire effect; this is when a correction leads to an individual increasing their belief in the very misconception the correction is aiming to rectify. There is currently a debate in the literature as to whether backfire effects exist at all, as recent studies have failed to find the phenomenon, even under theoretically favorable conditions. In this review, we summarize the current state of the worldview and familiarity backfire effect literatures. We subsequently examine barriers to measuring the backfire phenomenon, discuss approaches to improving measurement and design, and conclude with recommendations for fact-checkers. We suggest that backfire effects are not a robust empirical phenomenon, and more reliable measures, powerful designs, and stronger links between experimental design and theory could greatly help move the field ahead.
Collapse
|
153
|
Keil A, Gatzke‐Kopp LM, Horváth J, Jennings JR, Fabiani M. A registered report format for
Psychophysiology. Psychophysiology 2020. [DOI: 10.1111/psyp.13663] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/30/2022]
Affiliation(s)
- Andreas Keil
- Center for the Study of Emotion and Attention & Department of Psychology University of Florida Gainesville FL USA
| | - Lisa M. Gatzke‐Kopp
- Human Development and Family Studies The Pennsylvania State University University Park PA USA
| | - János Horváth
- Institute of Cognitive Neuroscience and Psychology Research Centre for Natural Sciences Budapest Hungary
- Károli Gáspár University of the Reformed Church in Hungary Budapest Hungary
| | - J. Richard Jennings
- Department of Psychiatry and Psychology University of Pittsburgh Pittsburgh PA USA
| | - Monica Fabiani
- Department of Psychology University of Illinois at Urbana‐Champaign Champaign IL USA
- Beckman Institute for Advanced Science and Technology University of Illinois at Urbana‐Champaign Urbana IL USA
| |
Collapse
|
154
|
Vrdoljak J, Sanchez KI, Arreola-Ramos R, Diaz Huesa EG, Villagra A, Avila LJ, Morando M. Testing repeatability, measurement error and species differentiation when using geometric morphometrics on complex shapes: a case study of Patagonian lizards of the genus Liolaemus (Squamata: Liolaemini). Biol J Linn Soc Lond 2020. [DOI: 10.1093/biolinnean/blaa079] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/14/2022]
Abstract
Abstract
The repeatability of findings is the key factor behind scientific reliability, and the failure to reproduce scientific findings has been termed the ‘replication crisis’. Geometric morphometrics is an established tool in evolutionary biology. However, different operators (and/or different methods) could act as large sources of variation in the data obtained. Here, we investigated inter-operator error in geometric morphometric protocols on complex shapes of Liolaemus lizards, as well as measurement error in three taxa varying in their difficulty of digitalization. We also examined the potential for these protocols to discriminate among complex shapes in closely related species. We found a wide range of inter-operator error, contributing between 19.5% and 60% to the total variation. Moreover, measurement error increased with the complexity of the quantified shape. All protocols were able to discriminate between species, but the use of more landmarks did not imply better performance. We present evidence that complex shapes reduce repeatability, highlighting the need to explore different sources of variation that could lead to such low repeatability. Lastly, we suggest some recommendations to improve the repeatability and reliability of geometric morphometrics results.
Collapse
Affiliation(s)
- Juan Vrdoljak
- Instituto Patagónico para el Estudio de los Ecosistemas Continentales, Consejo Nacional de Investigaciones Científicas y Técnicas (IPEEC-CONICET), Puerto Madryn, Chubut, Argentina
| | - Kevin Imanol Sanchez
- Instituto Patagónico para el Estudio de los Ecosistemas Continentales, Consejo Nacional de Investigaciones Científicas y Técnicas (IPEEC-CONICET), Puerto Madryn, Chubut, Argentina
| | - Roberto Arreola-Ramos
- Instituto Patagónico para el Estudio de los Ecosistemas Continentales, Consejo Nacional de Investigaciones Científicas y Técnicas (IPEEC-CONICET), Puerto Madryn, Chubut, Argentina
| | - Emilce Guadalupe Diaz Huesa
- Instituto de Diversidad y Evolución Austral, Consejo Nacional de Investigaciones Científicas y Técnicas (IDEAUS-CONICET), Puerto Madryn, Chubut, Argentina
| | - Alejandro Villagra
- Universidad Nacional de la Patagonia San Juan Bosco (UNPSJB), Puerto Madryn, Chubut, Argentina
| | - Luciano Javier Avila
- Instituto Patagónico para el Estudio de los Ecosistemas Continentales, Consejo Nacional de Investigaciones Científicas y Técnicas (IPEEC-CONICET), Puerto Madryn, Chubut, Argentina
| | - Mariana Morando
- Instituto Patagónico para el Estudio de los Ecosistemas Continentales, Consejo Nacional de Investigaciones Científicas y Técnicas (IPEEC-CONICET), Puerto Madryn, Chubut, Argentina
| |
Collapse
|
155
|
Palfi B, Moga G, Lush P, Scott RB, Dienes Z. Can hypnotic suggestibility be measured online? PSYCHOLOGICAL RESEARCH 2020; 84:1460-1471. [PMID: 30834966 PMCID: PMC7270050 DOI: 10.1007/s00426-019-01162-w] [Citation(s) in RCA: 10] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/27/2018] [Accepted: 02/27/2019] [Indexed: 12/02/2022]
Abstract
Hypnosis and hypnotic suggestions are gradually gaining popularity within the consciousness community as established tools for the experimental manipulation of illusions of involuntariness, hallucinations and delusions. However, hypnosis is still far from being a widespread instrument; a crucial hindrance to taking it up is the amount of time needed to invest in identifying people high and low in responsiveness to suggestion. In this study, we introduced an online assessment of hypnotic response and estimated the extent to which the scores and psychometric properties of an online screening differ from an offline one. We propose that the online screening of hypnotic response is viable as it reduces the level of responsiveness only by a slight extent. The application of online screening may prompt researchers to run large-scale studies with more heterogeneous samples, which would help researchers to overcome some of the issues underlying the current replication crisis in psychology.
Collapse
Affiliation(s)
- Bence Palfi
- School of Psychology, University of Sussex, Brighton, UK.
- Sackler Centre for Consciousness Science, University of Sussex, Brighton, UK.
| | - G Moga
- School of Psychology, University of Sussex, Brighton, UK
| | - P Lush
- Sackler Centre for Consciousness Science, University of Sussex, Brighton, UK
- School of Informatics, University of Sussex, Brighton, UK
| | - R B Scott
- School of Psychology, University of Sussex, Brighton, UK
- Sackler Centre for Consciousness Science, University of Sussex, Brighton, UK
| | - Z Dienes
- School of Psychology, University of Sussex, Brighton, UK
- Sackler Centre for Consciousness Science, University of Sussex, Brighton, UK
| |
Collapse
|
156
|
McWeeny S, Norton ES. Understanding event-related potentials (ERPs) in clinical and basic language and communication disorders research: a tutorial. INTERNATIONAL JOURNAL OF LANGUAGE & COMMUNICATION DISORDERS 2020; 55:445-457. [PMID: 32347637 PMCID: PMC7802513 DOI: 10.1111/1460-6984.12535] [Citation(s) in RCA: 12] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/23/2020] [Revised: 03/12/2020] [Accepted: 03/15/2020] [Indexed: 05/09/2023]
Abstract
BACKGROUND Event-related potentials (ERPs), which are electrophysiological neural responses time-locked to a stimulus, have become an increasingly common tool in language and communication disorders research. They can provide complementary evidence to behavioural measures as well as unique perspectives on communication disorders. ERPs have the distinct advantage of providing precise information about the timing of neural processes and can be used in cases where it is difficult to obtain responses from participants, such as infants or individuals who are minimally verbal. However, clinicians and clinician-scientists rarely receive training in how to interpret ERP research. AIMS To provide information that allows readers to better understand, interpret and evaluate research using ERPs. We focus on research related to communication sciences and disorders and the information that is most relevant to interpreting research articles. METHOD We explain what ERPs are and how ERP data are collected, referencing key texts and primary research articles. Potential threats to validity, guidelines for interpreting data, and the pros and cons using of ERPs are discussed. Research in the area of paediatric language disorders is used as a model; common paradigms such as the semantic incongruity N400 and auditory mismatch negativity are used as tangible examples. With this foundation of understanding ERPs, the state of the field in terms of how ERPs are used and the ways they may inform the field are discussed. MAIN CONTRIBUTION To date, no review has focused on ERPs as they relate to clinical or communication research. The main contribution of this review is that it provides practical information geared toward understanding ERP research. CONCLUSIONS ERPs offer insights into neural processes supporting communication and can both complement behaviour and provide information that behavioural measures cannot. We encourage readers to evaluate articles using ERPs critically, effectively pushing the field forward through increased understanding and rigor. What this paper adds ERPs have become more prevalent in research relevant to communication sciences and disorders. In order for clinicians to review and evaluate this research, an understanding of ERPs is needed. This review adds to the field by providing an accessible description of what ERPs are, a description of what ERP components are, and the most relevant commonly used components, as well as how ERP data are recorded and processed. With this foundational understanding of how ERPs work, guidelines for the interpretation of ERP data are given. Though few ERP studies currently have direct implications for clinical practice, we discuss several ways through which ERPs can impact clinical practice in future, by providing information that cannot be obtained by behaviour alone about the aetiology of disorders, and as potential biomarkers of disorder or treatment response.
Collapse
Affiliation(s)
- Sean McWeeny
- Roxelyn and Richard Pepper Department of Communication Sciences and Disorders, Northwestern University, 2240 Campus Drive, Evanston, IL 60208
| | - Elizabeth S. Norton
- Roxelyn and Richard Pepper Department of Communication Sciences and Disorders, Northwestern University, 2240 Campus Drive, Evanston, IL 60208
- Institute for Innovations in Developmental Sciences, Northwestern University, Chicago, IL 60611
| |
Collapse
|
157
|
Fife D. The Eight Steps of Data Analysis: A Graphical Framework to Promote Sound Statistical Analysis. PERSPECTIVES ON PSYCHOLOGICAL SCIENCE 2020; 15:1054-1075. [PMID: 32502366 DOI: 10.1177/1745691620917333] [Citation(s) in RCA: 18] [Impact Index Per Article: 4.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/11/2022]
Abstract
Data analysis is a risky endeavor, particularly among people who are unaware of its dangers. According to some researchers, "statistical conclusions validity" threatens all research subjected to the dark arts of statistical magic. Although traditional statistics classes may advise against certain practices (e.g., multiple comparisons, small sample sizes, violating normality), they may fail to cover others (e.g., outlier detection and violating linearity). More common, perhaps, is that researchers may fail to remember them. In this article, rather than rehashing old warnings and diatribes against this practice or that, I instead advocate a general statistical-analysis strategy. This graphic-based eight-step strategy promises to resolve the majority of statistical traps researchers may fall into-without having to remember large lists of problematic statistical practices. These steps will assist in preventing both false positives and false negatives and yield critical insights about the data that would have otherwise been missed. I conclude with an applied example that shows how the eight steps reveal interesting insights that would not be detected with standard statistical practices.
Collapse
|
158
|
Reproducibility of animal research in light of biological variation. Nat Rev Neurosci 2020; 21:384-393. [PMID: 32488205 DOI: 10.1038/s41583-020-0313-3] [Citation(s) in RCA: 164] [Impact Index Per Article: 41.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 04/23/2020] [Indexed: 12/16/2022]
Abstract
Context-dependent biological variation presents a unique challenge to the reproducibility of results in experimental animal research, because organisms' responses to experimental treatments can vary with both genotype and environmental conditions. In March 2019, experts in animal biology, experimental design and statistics convened in Blonay, Switzerland, to discuss strategies addressing this challenge. In contrast to the current gold standard of rigorous standardization in experimental animal research, we recommend the use of systematic heterogenization of study samples and conditions by actively incorporating biological variation into study design through diversifying study samples and conditions. Here we provide the scientific rationale for this approach in the hope that researchers, regulators, funders and editors can embrace this paradigm shift. We also present a road map towards better practices in view of improving the reproducibility of animal research.
Collapse
|
159
|
Hickey P, Merseal H, Patel AD, Race E. Memory in time: Neural tracking of low-frequency rhythm dynamically modulates memory formation. Neuroimage 2020; 213:116693. [DOI: 10.1016/j.neuroimage.2020.116693] [Citation(s) in RCA: 10] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/30/2019] [Revised: 02/18/2020] [Accepted: 02/26/2020] [Indexed: 12/12/2022] Open
|
160
|
Yanco SW, McDevitt A, Trueman CN, Hartley L, Wunder MB. A modern method of multiple working hypotheses to improve inference in ecology. ROYAL SOCIETY OPEN SCIENCE 2020; 7:200231. [PMID: 32742690 PMCID: PMC7353960 DOI: 10.1098/rsos.200231] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 02/11/2020] [Accepted: 05/15/2020] [Indexed: 05/06/2023]
Abstract
Science provides a method to learn about the relationships between observed patterns and the processes that generate them. However, inference can be confounded when an observed pattern cannot be clearly and wholly attributed to a hypothesized process. Over-reliance on traditional single-hypothesis methods (i.e. null hypothesis significance testing) has resulted in replication crises in several disciplines, and ecology exhibits features common to these fields (e.g. low-power study designs, questionable research practices, etc.). Considering multiple working hypotheses in combination with pre-data collection modelling can be an effective means to mitigate many of these problems. We present a framework for explicitly modelling systems in which relevant processes are commonly omitted, overlooked or not considered and provide a formal workflow for a pre-data collection analysis of multiple candidate hypotheses. We advocate for and suggest ways that pre-data collection modelling can be combined with consideration of multiple working hypotheses to improve the efficiency and accuracy of research in ecology.
Collapse
Affiliation(s)
- Scott W. Yanco
- Department of Integrative Biology, University of Colorado Denver, Denver, CO, USA
- Author for correspondence: Scott W. Yanco e-mail:
| | - Andrew McDevitt
- Department of Integrative Biology, University of Colorado Denver, Denver, CO, USA
| | - Clive N. Trueman
- Ocean and Earth Science, University of Southampton, National Oceanography Centre, Southampton, UK
| | - Laurel Hartley
- Department of Integrative Biology, University of Colorado Denver, Denver, CO, USA
| | - Michael B. Wunder
- Department of Integrative Biology, University of Colorado Denver, Denver, CO, USA
| |
Collapse
|
161
|
Kantonen T, Karjalainen T, Isojärvi J, Nuutila P, Tuisku J, Rinne J, Hietala J, Kaasinen V, Kalliokoski K, Scheinin H, Hirvonen J, Vehtari A, Nummenmaa L. Interindividual variability and lateralization of μ-opioid receptors in the human brain. Neuroimage 2020; 217:116922. [PMID: 32407992 DOI: 10.1016/j.neuroimage.2020.116922] [Citation(s) in RCA: 46] [Impact Index Per Article: 11.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/01/2020] [Revised: 04/29/2020] [Accepted: 05/01/2020] [Indexed: 12/19/2022] Open
Abstract
Alterations in the brain's μ-opioid receptor (MOR) system have been associated with several neuropsychiatric disorders. Central MOR availability also varies considerably in healthy individuals. Multiple epidemiological factors have been proposed to influence the MOR system, but due to small sample sizes the magnitude of their influence remains inconclusive. We compiled [11C]carfentanil positron emission tomography scans from 204 individuals with no neurologic or psychiatric disorders, and estimated the effects of sex, age, body mass index (BMI) and smoking on [11C]carfentanil binding potential using between-subject regression analysis. We also examined hemispheric differences in MOR availability. Older age was associated with increase in MOR availability in frontotemporal areas but decrease in amygdala, thalamus, and nucleus accumbens. The age-dependent increase was stronger in males. MOR availability was globally lowered in smokers but independent of BMI. Finally, MOR availability was higher in the right versus the left hemisphere. The presently observed variation in MOR availability may explain why some individuals are prone to develop MOR-linked pathological states, such as chronic pain or psychiatric disorders. Lateralized MOR system may reflect hemispheric work specialization in central emotion and pain processes.
Collapse
Affiliation(s)
- Tatu Kantonen
- Turku PET Centre, University of Turku, Finland; Clinical Neurosciences, University of Turku and Turku University Hospital, Finland.
| | - Tomi Karjalainen
- Turku PET Centre, University of Turku, Finland; Turku PET Centre, Turku University Hospital, Finland
| | | | - Pirjo Nuutila
- Turku PET Centre, University of Turku, Finland; Department of Endocrinology, Turku University Hospital, Finland
| | | | - Juha Rinne
- Turku PET Centre, University of Turku, Finland; Clinical Neurosciences, University of Turku and Turku University Hospital, Finland
| | - Jarmo Hietala
- Turku PET Centre, University of Turku, Finland; Department of Psychiatry, University of Turku and Turku University Hospital, Finland
| | - Valtteri Kaasinen
- Turku PET Centre, University of Turku, Finland; Clinical Neurosciences, University of Turku and Turku University Hospital, Finland
| | | | | | | | - Aki Vehtari
- Helsinki Institute for Information Technology HIIT, Department of Computer Science, Aalto University, Finland
| | - Lauri Nummenmaa
- Turku PET Centre, University of Turku, Finland; Department of Psychology, University of Turku, Finland
| |
Collapse
|
162
|
DeBolt MC, Rhemtulla M, Oakes LM. Robust data and power in infant research: A case study of the effect of number of infants and number of trials in visual preference procedures. INFANCY 2020; 25:393-419. [PMID: 32744759 DOI: 10.1111/infa.12337] [Citation(s) in RCA: 28] [Impact Index Per Article: 7.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/02/2019] [Revised: 03/31/2020] [Accepted: 04/03/2020] [Indexed: 11/27/2022]
Abstract
As in many areas of science, infant research suffers from low power. The problem is further compounded in infant research because of the difficulty in recruiting and testing large numbers of infant participants. Researchers have been searching for a solution and, as illustrated by this special section, have been focused on getting the most out of infant data. We illustrate one solution by showing how we can increase power in visual preference tasks by increasing the amount of data obtained from each infant. We discuss issues of power and present work examining how, under some circumstances, power is increased by increasing the precision of measurement. We report the results of a series of simulations based on a sample of visual preference task data collected from three infant laboratories showing how more powerful research designs can be achieved by including more trials per infant. Implications for infant procedures in general are discussed.
Collapse
Affiliation(s)
- Michaela C DeBolt
- Center for Mind and Brain, University of California at Davis, Davis, CA, USA.,Department of Psychology, University of California at Davis, Davis, CA, USA
| | - Mijke Rhemtulla
- Department of Psychology, University of California at Davis, Davis, CA, USA
| | - Lisa M Oakes
- Center for Mind and Brain, University of California at Davis, Davis, CA, USA.,Department of Psychology, University of California at Davis, Davis, CA, USA
| |
Collapse
|
163
|
Kharabian Masouleh S, Eickhoff SB, Zeighami Y, Lewis LB, Dahnke R, Gaser C, Chouinard-Decorte F, Lepage C, Scholtens LH, Hoffstaedter F, Glahn DC, Blangero J, Evans AC, Genon S, Valk SL. Influence of Processing Pipeline on Cortical Thickness Measurement. Cereb Cortex 2020; 30:5014-5027. [PMID: 32377664 PMCID: PMC7391418 DOI: 10.1093/cercor/bhaa097] [Citation(s) in RCA: 36] [Impact Index Per Article: 9.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/14/2019] [Revised: 03/21/2020] [Accepted: 03/23/2020] [Indexed: 11/13/2022] Open
Abstract
In recent years, replicability of neuroscientific findings, specifically those concerning correlates of morphological properties of gray matter (GM), have been subject of major scrutiny. Use of different processing pipelines and differences in their estimates of the macroscale GM may play an important role in this context. To address this issue, here, we investigated the cortical thickness estimates of three widely used pipelines. Based on analyses in two independent large-scale cohorts, we report high levels of within-pipeline reliability of the absolute cortical thickness-estimates and comparable spatial patterns of cortical thickness-estimates across all pipelines. Within each individual, absolute regional thickness differed between pipelines, indicating that in-vivo thickness measurements are only a proxy of actual thickness of the cortex, which shall only be compared within the same software package and thickness estimation technique. However, at group level, cortical thickness-estimates correlated strongly between pipelines, in most brain regions. The smallest between-pipeline correlations were observed in para-limbic areas and insula. These regions also demonstrated the highest interindividual variability and the lowest reliability of cortical thickness-estimates within each pipeline, suggesting that structural variations within these regions should be interpreted with caution.
Collapse
Affiliation(s)
- Shahrzad Kharabian Masouleh
- Research Centre Jülich, Institute of Neuroscience and Medicine (INM-7: Brain and Behavior), 52425, Jülich, Germany
| | - Simon B Eickhoff
- Research Centre Jülich, Institute of Neuroscience and Medicine (INM-7: Brain and Behavior), 52425, Jülich, Germany.,Institute of Systems Neuroscience, Medical Faculty, Heinrich Heine University Düsseldorf, 40225, Düsseldorf, Germany
| | - Yashar Zeighami
- Montreal Neurological Institute, McGill University, Quebec, H3A 2B4, Canada
| | - Lindsay B Lewis
- Montreal Neurological Institute, McGill University, Quebec, H3A 2B4, Canada
| | - Robert Dahnke
- Center of Functionally Integrative Neuroscience, Department of Clinical Medicine, Aarhus University, 8000 Aarhus, Denmark.,Department of Psychiatry and Department of Neurology, Jena University Hospital, 07747 Jena, Germany
| | - Christian Gaser
- Department of Psychiatry and Department of Neurology, Jena University Hospital, 07747 Jena, Germany
| | | | - Claude Lepage
- Montreal Neurological Institute, McGill University, Quebec, H3A 2B4, Canada
| | | | - Felix Hoffstaedter
- Research Centre Jülich, Institute of Neuroscience and Medicine (INM-7: Brain and Behavior), 52425, Jülich, Germany
| | - David C Glahn
- Department of Psychiatry, Yale School of Medicine, New Haven, CT 06511, USA
| | - John Blangero
- South Texas Diabetes and Obesity Institute and Department of Human Genetics, University of Texas Rio Grande Valley School of Medicine, Brownsville, TX 78520, USA
| | - Alan C Evans
- Montreal Neurological Institute, McGill University, Quebec, H3A 2B4, Canada
| | - Sarah Genon
- Research Centre Jülich, Institute of Neuroscience and Medicine (INM-7: Brain and Behavior), 52425, Jülich, Germany
| | - Sofie L Valk
- Research Centre Jülich, Institute of Neuroscience and Medicine (INM-7: Brain and Behavior), 52425, Jülich, Germany.,Institute of Systems Neuroscience, Medical Faculty, Heinrich Heine University Düsseldorf, 40225, Düsseldorf, Germany
| |
Collapse
|
164
|
|
165
|
Efficacy of Interpretation Bias Modification in Patients With Chronic Pain. THE JOURNAL OF PAIN 2020; 21:648-662. [DOI: 10.1016/j.jpain.2019.10.005] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/31/2019] [Revised: 09/23/2019] [Accepted: 10/07/2019] [Indexed: 11/18/2022]
|
166
|
Pescott OL, Jitlal M. Reassessing the observational evidence for nitrogen deposition impacts in acid grassland: spatial Bayesian linear models indicate small and ambiguous effects on species richness. PeerJ 2020; 8:e9070. [PMID: 32391206 PMCID: PMC7195837 DOI: 10.7717/peerj.9070] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/22/2019] [Accepted: 04/06/2020] [Indexed: 01/09/2023] Open
Abstract
Nitrogen deposition (Ndep) is considered a significant threat to plant diversity in grassland ecosystems around the world. The evidence supporting this conclusion comes from both observational and experimental research, with “space-for-time” substitution surveys of pollutant gradients a significant portion of the former. However, estimates of regression coefficients for Ndep impacts on species richness, derived with a focus on causal inference, are hard to locate in the observational literature. Some influential observational studies have presented estimates from univariate models, overlooking the effects of omitted variable bias, and/or have used P-value-based stepwise variable selection (PSVS) to infer impacts, a strategy known to be poorly suited to the accurate estimation of regression coefficients. Broad-scale spatial autocorrelation has also generally been unaccounted for. We re-examine two UK observational datasets that have previously been used to investigate the relationship between Ndep and plant species richness in acid grasslands, a much-researched habitat in this context. One of these studies (Stevens et al., 2004, Science, 303: 1876–1879) estimated a large negative impact of Ndep on richness through the use of PSVS; the other reported smaller impacts (Maskell et al., 2010, Global Change Biology, 16: 671–679), but did not explicitly report regression coefficients or partial effects, making the actual size of the estimated Ndep impact difficult to assess. We reanalyse both datasets using a spatial Bayesian linear model estimated using integrated nested Laplace approximation (INLA). Contrary to previous results, we found similar-sized estimates of the Ndep impact on plant richness between studies, both with and without bryophytes, albeit with some disagreement over the most likely direction of this effect. Our analyses suggest that some previous estimates of Ndep impacts on richness from space-for-time substitution studies are likely to have been over-estimated, and that the evidence from observational studies could be fragile when confronted with alternative model specifications, although further work is required to investigate potentially nonlinear responses. Given the growing literature on the use of observational data to estimate the impacts of pollutants on biodiversity, we suggest that a greater focus on clearly reporting important outcomes with associated uncertainty, the use of techniques to account for spatial autocorrelation, and a clearer focus on the aims of a study, whether explanatory or predictive, are all required.
Collapse
Affiliation(s)
- Oliver L Pescott
- UK Centre for Ecology & Hydrology, Wallingford, Oxfordshire, United Kingdom
| | - Mark Jitlal
- Queen Mary University of London, Wolfson Institute of Preventative Medicine, London, United Kingdom
| |
Collapse
|
167
|
Jacobucci R, Grimm KJ. Machine Learning and Psychological Research: The Unexplored Effect of Measurement. PERSPECTIVES ON PSYCHOLOGICAL SCIENCE 2020; 15:809-816. [PMID: 32348703 DOI: 10.1177/1745691620902467] [Citation(s) in RCA: 36] [Impact Index Per Article: 9.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/17/2022]
Abstract
Machine learning (i.e., data mining, artificial intelligence, big data) has been increasingly applied in psychological science. Although some areas of research have benefited tremendously from a new set of statistical tools, most often in the use of biological or genetic variables, the hype has not been substantiated in more traditional areas of research. We argue that this phenomenon results from measurement errors that prevent machine-learning algorithms from accurately modeling nonlinear relationships, if indeed they exist. This shortcoming is showcased across a set of simulated examples, demonstrating that model selection between a machine-learning algorithm and regression depends on the measurement quality, regardless of sample size. We conclude with a set of recommendations and a discussion of ways to better integrate machine learning with statistics as traditionally practiced in psychological science.
Collapse
|
168
|
Clayson PE. Moderators of the internal consistency of error‐related negativity scores: A meta‐analysis of internal consistency estimates. Psychophysiology 2020; 57:e13583. [DOI: 10.1111/psyp.13583] [Citation(s) in RCA: 27] [Impact Index Per Article: 6.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/20/2019] [Revised: 03/11/2020] [Accepted: 03/13/2020] [Indexed: 12/27/2022]
Affiliation(s)
- Peter E. Clayson
- Department of Psychology University of South Florida Tampa FL USA
| |
Collapse
|
169
|
Hong M, Steedle JT, Cheng Y. Methods of Detecting Insufficient Effort Responding: Comparisons and Practical Recommendations. EDUCATIONAL AND PSYCHOLOGICAL MEASUREMENT 2020; 80:312-345. [PMID: 32158024 PMCID: PMC7047258 DOI: 10.1177/0013164419865316] [Citation(s) in RCA: 21] [Impact Index Per Article: 5.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/29/2023]
Abstract
Insufficient effort responding (IER) affects many forms of assessment in both educational and psychological contexts. Much research has examined different types of IER, IER's impact on the psychometric properties of test scores, and preprocessing procedures used to detect IER. However, there is a gap in the literature in terms of practical advice for applied researchers and psychometricians when evaluating multiple sources of IER evidence, including the best strategy or combination of strategies when preprocessing data. In this study, we demonstrate how the use of different IER detection methods may affect psychometric properties such as predictive validity and reliability. Moreover, we evaluate how different data cleansing procedures can detect different types of IER. We provide evidence via simulation studies and applied analysis using the ACT's Engage assessment as a motivating example. Based on the findings of the study, we provide recommendations and future research directions for those who suspect their data may contain responses reflecting careless, random, or biased responding.
Collapse
Affiliation(s)
| | | | - Ying Cheng
- University of Notre Dame, Notre Dame,
IN, USA
| |
Collapse
|
170
|
Bach DR, Melinscak F. Psychophysiological modelling and the measurement of fear conditioning. Behav Res Ther 2020; 127:103576. [PMID: 32087391 PMCID: PMC7078750 DOI: 10.1016/j.brat.2020.103576] [Citation(s) in RCA: 37] [Impact Index Per Article: 9.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/23/2019] [Revised: 01/23/2020] [Accepted: 02/08/2020] [Indexed: 12/03/2022]
Abstract
Quantification of fear conditioning is paramount to many clinical and translational studies on aversive learning. Various measures of fear conditioning co-exist, including different observables and different methods of pre-processing. Here, we first argue that low measurement error is a rational desideratum for any measurement technique. We then show that measurement error can be approximated in benchmark experiments by how closely intended fear memory relates to measured fear memory, a quantity that we term retrodictive validity. From this perspective, we discuss different approaches commonly used to quantify fear conditioning. One of these is psychophysiological modelling (PsPM). This builds on a measurement model that describes how a psychological variable, such as fear memory, influences a physiological measure. This model is statistically inverted to estimate the most likely value of the psychological variable, given the measured data. We review existing PsPMs for skin conductance, pupil size, heart period, respiration, and startle eye-blink. We illustrate the benefit of PsPMs in terms of retrodictive validity and translate this into sample size required to achieve a desired level of statistical power. This sample size can differ up to a factor of three between different observables, and between the best, and the current standard, data pre-processing methods.
Collapse
Affiliation(s)
- Dominik R Bach
- Wellcome Centre for Human Neuroimaging, Max Planck UCL Centre for Computational Psychiatry and Ageing Research, University College London, 10-12 Russell Square, London, WC1B 5EH, United Kingdom; Computational Psychiatry Research, Department of Psychiatry, Psychotherapy, and Psychosomatics, University of Zurich, Lenggstrasse 31, 8032, Zurich, Switzerland.
| | - Filip Melinscak
- Computational Psychiatry Research, Department of Psychiatry, Psychotherapy, and Psychosomatics, University of Zurich, Lenggstrasse 31, 8032, Zurich, Switzerland.
| |
Collapse
|
171
|
Larson MJ. Improving the Rigor and Replicability of Applied Psychophysiology Research: Sample Size, Standardization, Transparency, and Preregistration. ACTA ACUST UNITED AC 2020. [DOI: 10.5298/1081-5937-48.1.2] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/17/2022]
Abstract
Scientific research across a number of areas, including applied psychophysiology, biofeedback, and neurofeedback, is facing considerable scrutiny for poor replication rates, high numbers of false-positive findings, and insufficient scientific rigor. There are many factors underlying this replication crisis in scientific research; yet incentives for more rigorous research practices at the institutional and editorial levels lag behind the need for improvement. The author provides examples of replication and rigor difficulties in scientific research with an eye toward psychophysiological research, including researcher flexibility in data analysis, “p-hacking,” insufficient sample sizes, and lack of availability and implementation of rigorous methodological and publication guidelines. Subsequently, the author highlights examples and opportunities for improvement, including decreasing researcher flexibility, reporting sample size information, increasing sample sizes through collaboration, improving reporting standards/following established guidelines for reporting psychophysiological data, and increasing adoption of preregistration and registered reports. The author concludes that the Association for Applied Psychophysiology and Biofeedback (AAPB) can improve clinical practice and perception of public and scientific credibility by implementing rigorous and transparent research practices with a focus on replicability and clear methodological and reporting techniques and standards.
Collapse
Affiliation(s)
- Michael J. Larson
- Department of Psychology and Neuroscience Center, Brigham Young University, Provo, UT
| |
Collapse
|
172
|
van Smeden M, Lash TL, Groenwold RHH. Reflection on modern methods: five myths about measurement error in epidemiological research. Int J Epidemiol 2020; 49:338-347. [PMID: 31821469 PMCID: PMC7124512 DOI: 10.1093/ije/dyz251] [Citation(s) in RCA: 60] [Impact Index Per Article: 15.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 11/16/2019] [Indexed: 02/02/2023] Open
Abstract
Epidemiologists are often confronted with datasets to analyse which contain measurement error due to, for instance, mistaken data entries, inaccurate recordings and measurement instrument or procedural errors. If the effect of measurement error is misjudged, the data analyses are hampered and the validity of the study's inferences may be affected. In this paper, we describe five myths that contribute to misjudgments about measurement error, regarding expected structure, impact and solutions to mitigate the problems resulting from mismeasurements. The aim is to clarify these measurement error misconceptions. We show that the influence of measurement error in an epidemiological data analysis can play out in ways that go beyond simple heuristics, such as heuristics about whether or not to expect attenuation of the effect estimates. Whereas we encourage epidemiologists to deliberate about the structure and potential impact of measurement error in their analyses, we also recommend exercising restraint when making claims about the magnitude or even direction of effect of measurement error if not accompanied by statistical measurement error corrections or quantitative bias analysis. Suggestions for alleviating the problems or investigating the structure and magnitude of measurement error are given.
Collapse
Affiliation(s)
- Maarten van Smeden
- Department of Clinical Epidemiology, Leiden University Medical Center, Leiden, The Netherlands
| | - Timothy L Lash
- Department of Epidemiology, Rollins School of Public Health, Emory University, Atlanta, GA, USA
| | - Rolf H H Groenwold
- Department of Clinical Epidemiology, Leiden University Medical Center, Leiden, The Netherlands
- Department of Biomedical Data Sciences, Leiden University Medical Center, Leiden, The Netherlands
| |
Collapse
|
173
|
Matheson GJ, Plavén-Sigray P, Tuisku J, Rinne J, Matuskey D, Cervenka S. Clinical brain PET research must embrace multi-centre collaboration and data sharing or risk its demise. Eur J Nucl Med Mol Imaging 2020; 47:502-504. [PMID: 31713656 PMCID: PMC6974527 DOI: 10.1007/s00259-019-04541-y] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/10/2019] [Accepted: 09/16/2019] [Indexed: 01/08/2023]
Affiliation(s)
- Granville James Matheson
- Centre for Psychiatry Research, Department of Clinical Neuroscience, Karolinska Institutet and Stockholm County, Stockholm, Sweden
| | - Pontus Plavén-Sigray
- Centre for Psychiatry Research, Department of Clinical Neuroscience, Karolinska Institutet and Stockholm County, Stockholm, Sweden
| | - Jouni Tuisku
- Turku PET Centre, University of Turku, Turku, Finland
- Turku PET Centre, Turku University Hospital, Turku, Finland
| | - Juha Rinne
- Turku PET Centre, University of Turku, Turku, Finland
- Turku PET Centre, Turku University Hospital, Turku, Finland
| | - David Matuskey
- PET Center, Department of Radiology and Biomedical Imaging, Yale University, New Haven, USA
- Department of Psychiatry, Yale University, New Haven, USA
| | - Simon Cervenka
- Centre for Psychiatry Research, Department of Clinical Neuroscience, Karolinska Institutet and Stockholm County, Stockholm, Sweden.
| |
Collapse
|
174
|
Johnson AC, Jin X, Nakada N, Sumpter JP. Learning from the past and considering the future of chemicals in the environment. Science 2020; 367:384-387. [DOI: 10.1126/science.aay6637] [Citation(s) in RCA: 84] [Impact Index Per Article: 21.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/20/2022]
Abstract
Knowledge of the hazards and associated risks from chemicals discharged to the environment has grown considerably over the past 40 years. This improving awareness stems from advances in our ability to measure chemicals at low environmental concentrations, recognition of a range of effects on organisms, and a worldwide growth in expertise. Environmental scientists and companies have learned from the experiences of the past; in theory, the next generation of chemicals will cause less acute toxicity and be less environmentally persistent and bioaccumulative. However, researchers still struggle to establish whether the nonlethal effects associated with some modern chemicals and substances will have serious consequences for wildlife. Obtaining the resources to address issues associated with chemicals in the environment remains a challenge.
Collapse
Affiliation(s)
- Andrew C. Johnson
- Centre for Ecology and Hydrology, Benson Lane, Crowmarsh Gifford, Wallingford, Oxfordshire OX10 8BB, UK
| | - Xiaowei Jin
- China National Environment Monitoring Centre, Anwai Dayangfang No. 8, Chaoyang District, Beijing, China
| | - Norihide Nakada
- Research Center for Environmental Quality Management, Kyoto University, 1-2 Yumihama, Otsu, Shiga, 520-0811, Japan
| | - John P. Sumpter
- Institute for the Environment, Health and Societies, Brunel University London, Uxbridge, Middlesex UB8 3PH, UK
| |
Collapse
|
175
|
Wiernik BM, Dahlke JA. Obtaining Unbiased Results in Meta-Analysis: The Importance of Correcting for Statistical Artifacts. ADVANCES IN METHODS AND PRACTICES IN PSYCHOLOGICAL SCIENCE 2020. [DOI: 10.1177/2515245919885611] [Citation(s) in RCA: 34] [Impact Index Per Article: 8.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/17/2022]
Abstract
Most published meta-analyses address only artifactual variance due to sampling error and ignore the role of other statistical and psychometric artifacts, such as measurement error variance (due to factors including unreliability of measurements, group misclassification, and variable treatment strength) and selection effects (including range restriction or enhancement and collider biases). These artifacts can have severe biasing effects on the results of individual studies and meta-analyses. Failing to account for these artifacts can lead to inaccurate conclusions about the mean effect size and between-studies effect-size heterogeneity, and can influence the results of meta-regression, publication-bias, and sensitivity analyses. In this article, we provide a brief introduction to the biasing effects of measurement error variance and selection effects and their relevance to a variety of research designs. We describe how to estimate the effects of these artifacts in different research designs and correct for their impacts in primary studies and meta-analyses. We consider meta-analyses of correlations, observational group differences, and experimental effects. We provide R code to implement the corrections described.
Collapse
|
176
|
Altoè G, Bertoldo G, Zandonella Callegher C, Toffalini E, Calcagnì A, Finos L, Pastore M. Enhancing Statistical Inference in Psychological Research via Prospective and Retrospective Design Analysis. Front Psychol 2020; 10:2893. [PMID: 31993004 PMCID: PMC6970975 DOI: 10.3389/fpsyg.2019.02893] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/22/2019] [Accepted: 12/06/2019] [Indexed: 11/13/2022] Open
Abstract
In the past two decades, psychological science has experienced an unprecedented replicability crisis, which has uncovered several issues. Among others, the use and misuse of statistical inference plays a key role in this crisis. Indeed, statistical inference is too often viewed as an isolated procedure limited to the analysis of data that have already been collected. Instead, statistical reasoning is necessary both at the planning stage and when interpreting the results of a research project. Based on these considerations, we build on and further develop an idea proposed by Gelman and Carlin (2014) termed "prospective and retrospective design analysis." Rather than focusing only on the statistical significance of a result and on the classical control of type I and type II errors, a comprehensive design analysis involves reasoning about what can be considered a plausible effect size. Furthermore, it introduces two relevant inferential risks: the exaggeration ratio or Type M error (i.e., the predictable average overestimation of an effect that emerges as statistically significant) and the sign error or Type S error (i.e., the risk that a statistically significant effect is estimated in the wrong direction). Another important aspect of design analysis is that it can be usefully carried out both in the planning phase of a study and for the evaluation of studies that have already been conducted, thus increasing researchers' awareness during all phases of a research project. To illustrate the benefits of a design analysis to the widest possible audience, we use a familiar example in psychology where the researcher is interested in analyzing the differences between two independent groups considering Cohen's d as an effect size measure. We examine the case in which the plausible effect size is formalized as a single value, and we propose a method in which uncertainty concerning the magnitude of the effect is formalized via probability distributions. Through several examples and an application to a real case study, we show that, even though a design analysis requires significant effort, it has the potential to contribute to planning more robust and replicable studies. Finally, future developments in the Bayesian framework are discussed.
Collapse
Affiliation(s)
- Gianmarco Altoè
- Department of Developmental Psychology and Socialisation, University of Padova, Padova, Italy
| | - Giulia Bertoldo
- Department of Developmental Psychology and Socialisation, University of Padova, Padova, Italy
| | | | - Enrico Toffalini
- Department of General Psychology, University of Padova, Padova, Italy
| | - Antonio Calcagnì
- Department of Developmental Psychology and Socialisation, University of Padova, Padova, Italy
| | - Livio Finos
- Department of Developmental Psychology and Socialisation, University of Padova, Padova, Italy
| | - Massimiliano Pastore
- Department of Developmental Psychology and Socialisation, University of Padova, Padova, Italy
| |
Collapse
|
177
|
Brown VM, Chen J, Gillan CM, Price RB. Improving the Reliability of Computational Analyses: Model-Based Planning and Its Relationship With Compulsivity. BIOLOGICAL PSYCHIATRY: COGNITIVE NEUROSCIENCE AND NEUROIMAGING 2020; 5:601-609. [PMID: 32249207 DOI: 10.1016/j.bpsc.2019.12.019] [Citation(s) in RCA: 28] [Impact Index Per Article: 7.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/20/2019] [Revised: 12/30/2019] [Accepted: 12/30/2019] [Indexed: 12/25/2022]
Abstract
BACKGROUND Computational models show great promise in mapping latent decision-making processes onto dissociable neural substrates and clinical phenotypes. One prominent example in reinforcement learning is model-based planning, which specifically relates to transdiagnostic compulsivity. However, the reliability of computational model-derived measures such as model-based planning is unclear. Establishing reliability is necessary to ensure that such models measure stable, traitlike processes, as assumed in computational psychiatry. Although analysis approaches affect validity of reinforcement learning models and reliability of other task-based measures, their effect on reliability of reinforcement learning models of empirical data has not been systematically studied. METHODS We first assessed within- and across-session reliability and effects of analysis approaches (model estimation, parameterization, and data cleaning) of measures of model-based planning in patients with compulsive disorders (n = 38). The analysis approaches affecting test-retest reliability were tested in 3 large generalization samples (healthy participants: n = 541 and 111; people with a range of compulsivity: n = 1413). RESULTS Analysis approaches greatly influenced reliability: reliability of model-based planning measures ranged from 0 (no concordance) to above 0.9 (acceptable for clinical applications). The largest influence on reliability was whether model-estimation approaches were robust and accounted for the hierarchical structure of estimated parameters. Improvements in reliability generalized to other datasets and greatly reduced the sample size needed to find a relationship between model-based planning and compulsivity in an independent dataset. CONCLUSIONS These results indicate that computational psychiatry measures such as model-based planning can reliably measure latent decision-making processes, but when doing so must assess the ability of methods to estimate complex models from limited data.
Collapse
Affiliation(s)
- Vanessa M Brown
- Department of Psychiatry, University of Pittsburgh, Pittsburgh, PA.
| | - Jiazhou Chen
- Department of Psychiatry, University of Pittsburgh, Pittsburgh, PA
| | - Claire M Gillan
- Department of Psychology, Trinity College Dublin, Dublin, Ireland
| | - Rebecca B Price
- Department of Psychiatry, University of Pittsburgh, Pittsburgh, PA.
| |
Collapse
|
178
|
Legitimacy for Sustainability: A Case of A Strategy Change for An Oil and Gas Company. SUSTAINABILITY 2020. [DOI: 10.3390/su12020525] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
Abstract
This study introduces and validates a measure of a company’s institutional profile for sustainability. It uses institutional theory as a lens to understand the factors that legitimize the adoption of renewable energy activities in an oil and gas company. The three institutional dimensions used in this study are regulative, normative and cognitive, which aimed to measure legitimacy in an oil and gas company under a sustainable change. Survey-based research was carried out among employees to test this theory. Moreover, structural equation modeling was used to test the model fit, validate the measures, and test the four hypotheses. The results showed that regulative and normative pillars play the main role in legitimating renewable energy practices in our case company. The findings provide researchers and companies with a valuable resource for exploring legitimacy in order to understand what makes companies legitimize new sustainable activities that are outside the companies’ core business.
Collapse
|
179
|
Perosa V, de Boer L, Ziegler G, Apostolova I, Buchert R, Metzger C, Amthauer H, Guitart-Masip M, Düzel E, Betts MJ. The Role of the Striatum in Learning to Orthogonalize Action and Valence: A Combined PET and 7 T MRI Aging Study. Cereb Cortex 2020; 30:3340-3351. [PMID: 31897476 DOI: 10.1093/cercor/bhz313] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/12/2022] Open
Abstract
Pavlovian biases influence instrumental learning by coupling reward seeking with action invigoration and punishment avoidance with action suppression. Using a probabilistic go/no-go task designed to orthogonalize action (go/no-go) and valence (reward/punishment), recent studies have shown that the interaction between the two is dependent on the striatum and its key neuromodulator dopamine. Using this task, we sought to identify how structural and neuromodulatory age-related differences in the striatum may influence Pavlovian biases and instrumental learning in 25 young and 31 older adults. Computational modeling revealed a significant age-related reduction in reward and punishment sensitivity and marked (albeit not significant) reduction in learning rate and lapse rate (irreducible noise). Voxel-based morphometry analysis using 7 Tesla MRI images showed that individual differences in learning rate in older adults were related to the volume of the caudate nucleus. In contrast, dopamine synthesis capacity in the dorsal striatum, assessed using [18F]-DOPA positron emission tomography in 22 of these older adults, was not associated with learning performance and did not moderate the relationship between caudate volume and learning rate. This multiparametric approach suggests that age-related differences in striatal volume may influence learning proficiency in old age.
Collapse
Affiliation(s)
- Valentina Perosa
- Institute of Cognitive Neurology and Dementia Research, Otto-von-Guericke-University Magdeburg, Leipzigerstr. 44, 39120, Magdeburg, Germany.,German Center for Neurodegenerative Diseases (DZNE), Leipzigerstr. 44 39120, Magdeburg, Germany.,Department of Neurology, Otto-von-Guericke University, Leipzigerstr. 44, 39120, Magdeburg, Germany
| | - Lieke de Boer
- Ageing Research Centre, Karolinska Institute, SE-11330 Stockholm, Sweden
| | - Gabriel Ziegler
- Institute of Cognitive Neurology and Dementia Research, Otto-von-Guericke-University Magdeburg, Leipzigerstr. 44, 39120, Magdeburg, Germany.,German Center for Neurodegenerative Diseases (DZNE), Leipzigerstr. 44 39120, Magdeburg, Germany
| | - Ivayla Apostolova
- Department of Radiology and Nuclear Medicine, University Hospital Hamburg-Eppendorf, Germany
| | - Ralph Buchert
- Department of Radiology and Nuclear Medicine, University Hospital Hamburg-Eppendorf, Germany.,Max Planck UCL Centre for Computational Psychiatry and Ageing Research, University College London, London WC1B 5EH, UK
| | - Coraline Metzger
- Institute of Cognitive Neurology and Dementia Research, Otto-von-Guericke-University Magdeburg, Leipzigerstr. 44, 39120, Magdeburg, Germany.,German Center for Neurodegenerative Diseases (DZNE), Leipzigerstr. 44 39120, Magdeburg, Germany
| | - Holger Amthauer
- Department of Nuclear Medicine, Charité-Universitätsmedizin Berlin, Augustenburger Platz 1, 13353 Berlin, Germany
| | - Marc Guitart-Masip
- Ageing Research Centre, Karolinska Institute, SE-11330 Stockholm, Sweden.,Max Planck UCL Centre for Computational Psychiatry and Ageing Research, University College London, London WC1B 5EH, UK
| | - Emrah Düzel
- Institute of Cognitive Neurology and Dementia Research, Otto-von-Guericke-University Magdeburg, Leipzigerstr. 44, 39120, Magdeburg, Germany.,German Center for Neurodegenerative Diseases (DZNE), Leipzigerstr. 44 39120, Magdeburg, Germany.,Institute of Cognitive Neuroscience, University College London, 17 Queen Square, London, UK
| | - Matthew J Betts
- Institute of Cognitive Neurology and Dementia Research, Otto-von-Guericke-University Magdeburg, Leipzigerstr. 44, 39120, Magdeburg, Germany.,German Center for Neurodegenerative Diseases (DZNE), Leipzigerstr. 44 39120, Magdeburg, Germany
| |
Collapse
|
180
|
Matsumura I, Chyong D. Statistical noise from recombinant plasmids can be abated via complementation of a ribosomal protein gene deletion. Protein Eng Des Sel 2019; 32:433-441. [PMID: 32328658 DOI: 10.1093/protein/gzaa007] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/05/2019] [Revised: 03/09/2020] [Accepted: 03/12/2020] [Indexed: 11/14/2022] Open
Abstract
The phenotypes conferred by recombinant plasmids upon host cells often exhibit variability between replicate populations. This statistical noise is mostly a consequence of adaptive evolution in response to fitness burdens imposed by the plasmids themselves. We developed a novel strategy, 'ribosome pegging', to exclude common unwanted mutations that benefit host cells at the expense of heterologous gene expression. Plasmids that constitutively co-expressed the fluorescent reporter tagRFP and ribosomal protein L23 (rplW) were used to transform Escherichia coli cells that lacked the essential chromosomal rplW gene. Cells within the population that expressed too little L23, or too much, were evidently inviable. Ribosome pegging obviates the need for antibiotics, thus facilitating the deployment of recombinant bacteria in uncontrolled environments. We show that ribosome-pegged E. coli carrying a plasmid that constitutively expresses L23 and an artificially evolved enzyme protects fruit flies from otherwise toxic doses of the insecticide malathion.
Collapse
Affiliation(s)
- Ichiro Matsumura
- Department of Biochemistry, Emory University School of Medicine, Atlanta, Georgia, U.S.A
| | - Donian Chyong
- Columbia College, Columbia University, New York, New York, U.S.A
| |
Collapse
|
181
|
Abstract
Endometrial cancer is one of the most common gynaecological malignancies worldwide. One type of research in this field is the growing of cell lines (CLs) and cultures, which can be used to explore the biological mechanisms of cancer. The purpose of this review is to offer an overview of the current literature and highlight the importance of correct CL studies. We carried out a literature analysis of more than 60 articles from the Pubmed, Medline databases that were almost exclusively published in indexed journals in the last 10 years as well as the primary originating scientific studies of specific CLs. We then summarized the newest findings and recommendations. Cell lines are becoming widely used as in vitro tumour models. Recent work has shown inconsistencies in nomenclature and culturing of CLs. Their genomic evolution leads to a high degree of variation across CL strains therefore it is of the utmost importance to recognize the variability within laboratory cancer models. Laboratories must adapt, incorporate additional characterisation techniques and view this situation as an opportunity to improve the reproducibility of pre-clinical cancer research. The authors offer a comprehensive literature review about endometrial cancer CLs, a review of the current literature and advice on culturing CLs.
Collapse
|
182
|
Driscoll LL. When siblings matter: Commentary on Golub and Sobin's 'Statistical modeling of litter as a random effect in mixed models to manage "intralitter likeness"'. Neurotoxicol Teratol 2019; 77:106851. [PMID: 31837395 DOI: 10.1016/j.ntt.2019.106851] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/01/2019] [Revised: 12/05/2019] [Accepted: 12/10/2019] [Indexed: 10/25/2022]
Abstract
Responsible data practices include acknowledging and properly dealing with data structures in which the assumption of independence of observations is violated. Golub and Sobin uncover a common statistical faux pas in neurodevelopmental research - inconsistent and inadequate handling of the clustered variability associated with the use of multiple littermates - and propose a simple mixed model solution in which litter is included as a random factor.
Collapse
Affiliation(s)
- Lori L Driscoll
- Department of Psychology, Colorado College, Colorado Springs, CO, United States of America.
| |
Collapse
|
183
|
Bernhardt O, Krey KF, Daboul A, Völzke H, Kindler S, Kocher T, Schwahn C. New insights in the link between malocclusion and periodontal disease. J Clin Periodontol 2019; 46:144-159. [PMID: 30636328 DOI: 10.1111/jcpe.13062] [Citation(s) in RCA: 20] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/01/2018] [Revised: 12/18/2018] [Accepted: 01/04/2019] [Indexed: 12/18/2022]
Abstract
AIM We aimed to investigate associations between malocclusions and periodontal disease by comparing it to that of smoking in subjects recruited from the population-based cross-sectional study "Study of Health in Pomerania." MATERIALS AND METHODS Sagittal intermaxillary relationship, variables of malocclusion and socio-demographic parameters of 1,202 dentate subjects, 20-39 years of age, were selected. Probing depth (PD) and attachment loss (AL) were assessed at four sites by tooth in a half-mouth design. Analyses were performed with multilevel models on subject, jaw and tooth level. RESULTS Distal occlusion determined in the canine region, ectopic position of canines, anterior spacing, deep anterior overbite and increased sagittal overjet were associated with AL (p-value <0.05). Associations between malocclusions and PD: deep anterior overbite with gingival contact (odds ratio [OR] = 1.40, 95% CI: 1.08-1.82; p-value = 0.0101) and anterior crossbite (OR = 1.75, 95% CI: 1.29-2.38; p-value = 0.0003). Regarding crowding, only severe anterior crowding was compatible with a moderate to large association with PD (OR = 1.93, 95% CI: 0.89-4.20). Compared to smoking, the overall effect of malocclusions was about one half for AL and one-third for PD. CONCLUSION Malocclusions or morphologic parameters were associated with periodontal disease.
Collapse
Affiliation(s)
- Olaf Bernhardt
- Department of Restorative Dentistry, Periodontology, Endodontology, Preventive Dentistry and Pediatric Dentistry, University Medicine Greifswald, Greifswald, Germany
| | - Karl-Friedrich Krey
- Department of Orthodontics, University Medicine Greifswald, Greifswald, Germany
| | - Amro Daboul
- Department of Prosthetic Dentistry, Gerodontology and Biomaterials, University Medicine Greifswald, Greifswald, Germany
| | - Henry Völzke
- Institute for Community Medicine, Section Epidemiology of Health Care and Community Health, University Medicine Greifswald, Greifswald, Germany
| | - Stefan Kindler
- Department of Oral and Maxillofacial Surgery/Plastic Surgery, University Medicine Greifswald, Greifswald, Germany
| | - Thomas Kocher
- Department of Restorative Dentistry, Periodontology, Endodontology, Preventive Dentistry and Pediatric Dentistry, University Medicine Greifswald, Greifswald, Germany
| | - Christian Schwahn
- Department of Prosthetic Dentistry, Gerodontology and Biomaterials, University Medicine Greifswald, Greifswald, Germany
| |
Collapse
|
184
|
Girardi P, Merler E. A mortality study on male subjects exposed to polyfluoroalkyl acids with high internal dose of perfluorooctanoic acid. ENVIRONMENTAL RESEARCH 2019; 179:108743. [PMID: 31542491 DOI: 10.1016/j.envres.2019.108743] [Citation(s) in RCA: 52] [Impact Index Per Article: 10.4] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/26/2019] [Revised: 09/09/2019] [Accepted: 09/11/2019] [Indexed: 06/10/2023]
Abstract
OBJECTIVES The aim of the present study was to examine the association between exposure to polyfluoroalkyl substances (PFASs) and mortality (1970-2018) in a cohort of 462 male employees who had worked at least six months before 2009 for a factory (14,658 person-years; 107 deaths, average follow-up time 31.7 years), which had been producing perfluorooctanoic acid (PFOA), perfluorooctanesulfonyl fluoride (PFOS) and other chemicals since 1968. METHODS Employees were classified as follows: 1) by probability of exposure to PFASs; 2) by tertiles of PFOA serum concentrations. In a fraction (n = 120) of workers measurements of internal PFOA serum concentration were used to predict a cumulative serum PFOA concentration of each cohort member. Mortality rates were compared to that of the regional population using the standardized mortality ratio (SMR), and to that of the workers of a nearby metalworking factory in terms of risk ratio (RR), across categories of probability of PFASs exposure and tertiles of cumulative serum PFOA concentrations. RESULTS Internal PFOA serum concentration among 120 workers in the 2000-2013 period was very high (Geometric Mean: 4048 ng/mL; range 19-91,900 ng/mL). The mortality of the chemical cohort was increased for liver cancer (SMR: 2.32; CI: 1.11-4.87), malignant neoplasm of lymphatic and haematopoietic tissue (SMR: 2.26; CI: 1.08-4.73). In the comparison with the cohort of workers from the metalworking factory, the RRs for mortality of the cohort were increased for overall mortality (RR: 1.42; CI: 1.12-1.79), diabetes (RR: 5.95; CI: 1.08-32.8), liver cancer (RR: 6.69; CI: 1.71-26.2) and liver cirrhosis (RR: 3.87; CI: 1.18-12.7). Mortality for these causes increased in association with probability of PFASs exposure and with tertiles of cumulative PFOA serum concentrations. CONCLUSION The present is a small observational study with limited control over confounding factors. The cohort showed increased mortality for all causes and subjects in the highest cumulative internal dose of PFOA had a statistically significant increase for mortality of liver cancer, liver cirrhosis, diabetes, malignant neoplasms of lymphatic and haematopoietic tissue in both comparisons. Toxicological studies on PFOA and PFOS provide support for causality for the observed association with the risk for liver cirrhosis and liver cancer.
Collapse
Affiliation(s)
- Paolo Girardi
- Azienda Zero - Epidemiological Department, Veneto Region, Via Jacopo D'Avanzo, Padua, 35132, Italy; Directorate of Prevention, Food Safety and Veterinary Public Health, Veneto Region, Venice, Italy.
| | - Enzo Merler
- Azienda Zero - Epidemiological Department, Veneto Region, Via Jacopo D'Avanzo, Padua, 35132, Italy; Directorate of Prevention, Food Safety and Veterinary Public Health, Veneto Region, Venice, Italy.
| |
Collapse
|
185
|
Obenauer WG, Langer N. Inclusion is not a slam dunk: A study of differential leadership outcomes in the absence of a glass cliff. THE LEADERSHIP QUARTERLY 2019. [DOI: 10.1016/j.leaqua.2019.101334] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 10/25/2022]
|
186
|
McAuliffe WHB, Carter EC, Berhane J, Snihur AC, McCullough ME. Is Empathy the Default Response to Suffering? A Meta-Analytic Evaluation of Perspective Taking’s Effect on Empathic Concern. PERSONALITY AND SOCIAL PSYCHOLOGY REVIEW 2019; 24:141-162. [DOI: 10.1177/1088868319887599] [Citation(s) in RCA: 20] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/09/2023]
Abstract
We conducted a series of meta-analytic tests on experiments in which participants read perspective-taking instructions—that is, written instructions to imagine a distressed persons’ point of view (“imagine-self” and “imagine-other” instructions), or to inhibit such actions (“remain-objective” instructions)—and afterwards reported how much empathic concern they experienced upon learning about the distressed person. If people spontaneously empathize with others, then participants who receive remain-objective instructions should report less empathic concern than do participants in a “no-instructions” control condition; if people can deliberately increase how much empathic concern they experience, then imagine-self and imagine-other instructions should increase empathic concern relative to not receiving any instructions. Random-effects models revealed that remain-objective instructions reduced empathic concern, but “imagine” instructions did not significantly increase it. The results were robust to most corrections for bias. Our conclusions were not qualified by the study characteristics we examined, but most relevant moderators have not yet been thoroughly studied.
Collapse
Affiliation(s)
| | | | - Juliana Berhane
- University of Miami, Coral Gables, FL, USA
- Bucknell University, Lewisburg, PA, USA
| | - Alexander C. Snihur
- University of Miami, Coral Gables, FL, USA
- Florida International University, Miami, USA
| | | |
Collapse
|
187
|
Wood SM, Wood JN. Using automation to combat the replication crisis: A case study from controlled-rearing studies of newborn chicks. Infant Behav Dev 2019; 57:101329. [DOI: 10.1016/j.infbeh.2019.101329] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/06/2018] [Revised: 01/18/2019] [Accepted: 05/01/2019] [Indexed: 11/24/2022]
|
188
|
Wood SMW, Johnson SP, Wood JN. Automated Study Challenges the Existence of a Foundational Statistical-Learning Ability in Newborn Chicks. Psychol Sci 2019; 30:1592-1602. [PMID: 31615337 PMCID: PMC6843746 DOI: 10.1177/0956797619868998] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/14/2018] [Accepted: 07/15/2019] [Indexed: 11/17/2022] Open
Abstract
What mechanisms underlie learning in newborn brains? Recently, researchers reported that newborn chicks use unsupervised statistical learning to encode the transitional probabilities (TPs) of shapes in a sequence, suggesting that TP-based statistical learning can be present in newborn brains. Using a preregistered design, we attempted to reproduce this finding with an automated method that eliminated experimenter bias and allowed more than 250 times more data to be collected per chick. With precise measurements of each chick's behavior, we were able to perform individual-level analyses and substantially reduce measurement error for the group-level analyses. We found no evidence that newborn chicks encode the TPs between sequentially presented shapes. None of the chicks showed evidence for this ability. Conversely, we obtained strong evidence that newborn chicks encode the shapes of individual objects, showing that this automated method can produce robust results. These findings challenge the claim that TP-based statistical learning is present in newborn brains.
Collapse
Affiliation(s)
| | - Scott P Johnson
- Department of Psychology, University of California, Los Angeles
| | - Justin N Wood
- School of Informatics, Computing & Engineering, Indiana University
| |
Collapse
|
189
|
Scheibehenne B, Coppin G. How does the peak-end rule smell? Tracing hedonic experience with odours. Cogn Emot 2019; 34:713-727. [PMID: 31615343 DOI: 10.1080/02699931.2019.1675599] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/25/2022]
Abstract
The peak-end rule predicts that retrospective evaluations of affective events heavily depend on their most intense and last moment and imply duration neglect. It was originally proposed for negative experiences such as painful medical procedures. It is unclear, however, to what degree it also applies to positive experiences. Previously, rigorous comparisons between the two domains were limited due to the use of qualitatively different stimuli. Hence, it is not clear if the peak-end rule holds for short positive and negative experiences alike. To address these questions in a genuinely emotional domain, we conducted two experiments (n = 48 each) in which we used odours as stimuli. Participants repeatedly evaluated continuous odour sequences delivered into their noses via an olfactometer. The sequences differed in valence (positive vs. negative), length (36 vs. 72 s), and trajectory (increasing, decreasing, U-shaped, and inverse U-shaped). Results provide evidence for the peak-end rule for both positive and negative experiences alike. Results further show an overweighting of intense negative experiences for sequences that contain both pleasant and unpleasant episodes but provide little evidence for an effect of the trajectory manipulation.
Collapse
Affiliation(s)
| | - Géraldine Coppin
- Swiss Center for Affective Sciences, Geneva, Switzerland.,Laboratory for the Study of Emotion Elicitation and Expression, University of Geneva, Geneva, Switzerland.,Swiss Distance University Institute (UniDistance), Centre d'Etudes Suisse Romand, Sierre, Switzerland
| |
Collapse
|
190
|
Sacco DF, Brown M, Bruton SV. Grounds for Ambiguity: Justifiable Bases for Engaging in Questionable Research Practices. SCIENCE AND ENGINEERING ETHICS 2019; 25:1321-1337. [PMID: 30259269 DOI: 10.1007/s11948-018-0065-x] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/29/2018] [Accepted: 09/05/2018] [Indexed: 06/08/2023]
Abstract
The current study sought to determine research scientists' sensitivity to various justifications for engaging in behaviors typically considered to be questionable research practices (QRPs) by asking them to evaluate the appropriateness and ethical defensibility of each. Utilizing a within-subjects design, 107 National Institutes of Health principal investigators responded to an invitation to complete an online survey in which they read a series of research behaviors determined, in prior research, to either be ambiguous or unambiguous in their ethical defensibility. Additionally, each behavior was paired with either an ostensibly sound or unsound reason for the behavior. Consistent with hypotheses, the results indicated that scientists perceived QRPs as more appropriate and defensible when paired with a justifiable motive relative to when paired with a clearly unethical motive, particularly for QRPs that are more ambiguous in their ethicality. In fact, ambiguous QRPs were perceived as categorically defensible when given a justifiable motive. This suggests scientists are sensitive to contextual factors related to QRPs' appropriateness, which could inform how institutions develop appropriate training modules for research integrity.
Collapse
Affiliation(s)
- Donald F Sacco
- School of Psychology, The University of Southern Mississippi, Owings-McQuagge Hall, 118 College Drive #5025, Hattiesburg, MS, 39406, USA.
| | - Mitch Brown
- School of Psychology, The University of Southern Mississippi, Owings-McQuagge Hall, 118 College Drive #5025, Hattiesburg, MS, 39406, USA
| | - Samuel V Bruton
- School of Humanities, The University of Southern Mississippi, 118 College Drive #5037, Hattiesburg, MS, 39406, USA
| |
Collapse
|
191
|
Chen G, Xiao Y, Taylor PA, Rajendra JK, Riggins T, Geng F, Redcay E, Cox RW. Handling Multiplicity in Neuroimaging Through Bayesian Lenses with Multilevel Modeling. Neuroinformatics 2019; 17:515-545. [PMID: 30649677 PMCID: PMC6635105 DOI: 10.1007/s12021-018-9409-6] [Citation(s) in RCA: 45] [Impact Index Per Article: 9.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/22/2022]
Abstract
Here we address the current issues of inefficiency and over-penalization in the massively univariate approach followed by the correction for multiple testing, and propose a more efficient model that pools and shares information among brain regions. Using Bayesian multilevel (BML) modeling, we control two types of error that are more relevant than the conventional false positive rate (FPR): incorrect sign (type S) and incorrect magnitude (type M). BML also aims to achieve two goals: 1) improving modeling efficiency by having one integrative model and thereby dissolving the multiple testing issue, and 2) turning the focus of conventional null hypothesis significant testing (NHST) on FPR into quality control by calibrating type S errors while maintaining a reasonable level of inference efficiency. The performance and validity of this approach are demonstrated through an application at the region of interest (ROI) level, with all the regions on an equal footing: unlike the current approaches under NHST, small regions are not disadvantaged simply because of their physical size. In addition, compared to the massively univariate approach, BML may simultaneously achieve increased spatial specificity and inference efficiency, and promote results reporting in totality and transparency. The benefits of BML are illustrated in performance and quality checking using an experimental dataset. The methodology also avoids the current practice of sharp and arbitrary thresholding in the p-value funnel to which the multidimensional data are reduced. The BML approach with its auxiliary tools is available as part of the AFNI suite for general use.
Collapse
Affiliation(s)
- Gang Chen
- Scientific and Statistical Computing Core, National Institute of Mental Health, Bethesda, MD, USA.
| | - Yaqiong Xiao
- Department of Psychology, University of Maryland, College Park, MD, 20742, USA
| | - Paul A Taylor
- Scientific and Statistical Computing Core, National Institute of Mental Health, Bethesda, MD, USA
| | - Justin K Rajendra
- Scientific and Statistical Computing Core, National Institute of Mental Health, Bethesda, MD, USA
| | - Tracy Riggins
- Department of Psychology, University of Maryland, College Park, MD, 20742, USA
| | - Fengji Geng
- Department of Psychology, University of Maryland, College Park, MD, 20742, USA
| | - Elizabeth Redcay
- Department of Psychology, University of Maryland, College Park, MD, 20742, USA
| | - Robert W Cox
- Scientific and Statistical Computing Core, National Institute of Mental Health, Bethesda, MD, USA
| |
Collapse
|
192
|
LaPlante DA. Replication is fundamental, but is it common? A call for scientific self-reflection and contemporary research practices in gambling-related research. INTERNATIONAL GAMBLING STUDIES 2019. [DOI: 10.1080/14459795.2019.1672768] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/25/2022]
Affiliation(s)
- Debi A. LaPlante
- Division on Addiction, Cambridge Health Alliance, Harvard Medical School, Malden, MA, USA
| |
Collapse
|
193
|
Ribeiro AH, Soler JMP, Hirata R. Variance-Preserving Estimation of Intensity Values Obtained From Omics Experiments. Front Genet 2019; 10:855. [PMID: 31616468 PMCID: PMC6764481 DOI: 10.3389/fgene.2019.00855] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/05/2019] [Accepted: 08/16/2019] [Indexed: 11/29/2022] Open
Abstract
Faced with the lack of reliability and reproducibility in omics studies, more careful and robust methods are needed to overcome the existing challenges in the multi-omics analysis. In conventional omics data analysis, signal intensity values (denoted by M and values) are estimated neglecting pixel-level uncertainties, which may reflect noise and systematic artifacts. For example, intensity values from two-color microarray data are estimated by taking the mean or median of the pixel intensities within the spot and then subjected to a within-slide normalization by LOWESS. Thus, focusing on estimation and normalization of gene expression profiles, we propose a spot quantification method that takes into account pixel-level variability. Also, to preserve relevant variation that may be removed in LOWESS normalization with poorly chosen parameters, we propose a parameter selection method that is parsimonious and considers intrinsic characteristics of microarray data, such as heteroskedasticity. The usefulness of the proposed methods is illustrated by an application to real intestinal metaplasia data. Compared with the conventional approaches, the analysis is more robust and conservative, identifying fewer but more reliable differentially expressed genes. Also, the variability preservation allowed the identification of new differentially expressed genes. Using the proposed approach, we have identified differentially expressed genes involved in pathways in cancer and confirmed some molecular markers already reported in the literature.
Collapse
Affiliation(s)
- Adèle H. Ribeiro
- Department of Computer Science, Institute of Mathematics and Statistics, University of São Paulo, São Paulo, Brazil
- *Correspondence: Adèle H. Ribeiro,
| | - Julia Maria Pavan Soler
- Department of Statistics, Institute of Mathematics and Statistics, University of São Paulo, São Paulo, Brazil
| | - Roberto Hirata
- Department of Computer Science, Institute of Mathematics and Statistics, University of São Paulo, São Paulo, Brazil
| |
Collapse
|
194
|
Hanfstingl B. Should We Say Goodbye to Latent Constructs to Overcome Replication Crisis or Should We Take Into Account Epistemological Considerations? Front Psychol 2019; 10:1949. [PMID: 31507497 PMCID: PMC6718628 DOI: 10.3389/fpsyg.2019.01949] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/01/2019] [Accepted: 08/08/2019] [Indexed: 11/26/2022] Open
Abstract
This paper discusses theoretical and epistemological problems concerning validity of psychological science in the context of latent constructs. I consider the use of latent constructs as one reason for the replicability crisis. At the moment, there exist different constructs describing the same psychological phenomena side by side, and different psychological phenomena that are reflected by the same latent construct. Hagger called them déjà-variables, which lead to a decreasing validity of measurements and inhibit a deeper understanding of psychological phenomena. To overcome this problem, I suggest a shift of theoretical and epistemological perspective on latent constructs. One main point is the explicit consideration of latent constructs as mental representations, which change objects and are changed by objects via assimilative and accommodative processes. The explicit orientation toward assimilation and accommodation allows the control of normally automatized processes that influence our understanding of psychological phenomena and their corresponding latent constructs. I argue that assimilation and accommodation are part of our research practice anyway and cause the mentioned problems. For example, taking a measurement is an assimilative process, and thus a high measurement error should lead to an increase of accommodative processes. Taking into account these considerations, I suggest consequences for research practices, for individual researchers and for the philosophy of science.
Collapse
Affiliation(s)
- Barbara Hanfstingl
- Institute of Instructional and School Development, Alpen-Adria-Universität Klagenfurt, Klagenfurt, Austria
| |
Collapse
|
195
|
Abstract
Self-report data are common in psychological and survey research. Unfortunately, many of these samples are plagued with careless responses, due to unmotivated participants. The purpose of this study was to propose and evaluate a robust estimation method to detect careless or unmotivated responders, while leveraging item response theory (IRT) person-fit statistics. First, we outlined a general framework for robust estimation specific for IRT models. Subsequently, we conducted a simulation study covering multiple conditions in order to evaluate the performance of the proposed method. Ultimately, we showed that robust maximum marginal likelihood (RMML) estimation significantly improves detection rates for careless responders and reduces bias in item parameters across conditions. Furthermore, we applied our method to a real data set, to illustrate the utility of the proposed method. Our findings suggest that robust estimation coupled with person-fit statistics offers a powerful procedure to identify careless respondents for further review and to provide more accurate item parameter estimates in the presence of careless responses.
Collapse
|
196
|
The impact of recent and concurrent affective context on cognitive control: An ERP study of performance monitoring. Int J Psychophysiol 2019; 143:44-56. [DOI: 10.1016/j.ijpsycho.2019.06.007] [Citation(s) in RCA: 12] [Impact Index Per Article: 2.4] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/20/2019] [Revised: 05/07/2019] [Accepted: 06/10/2019] [Indexed: 11/19/2022]
|
197
|
Burstyn I, LaCroix AZ, Litvan I, Wallace RB, Checkoway H. Occupation and Parkinson disease in the Women's Health Initiative Observational Study. Am J Ind Med 2019; 62:766-776. [PMID: 31328814 DOI: 10.1002/ajim.23022] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/21/2019] [Revised: 06/20/2019] [Accepted: 06/21/2019] [Indexed: 11/08/2022]
Abstract
INTRODUCTION There is a lack of consistent study findings on associations between workplace exposures and the risk of Parkinson disease (PD) and a paucity of such data on women. We assessed PD risk among occupational groups to derive insights about potential occupation-specific exposures in a large cohort of women. METHODS The Women's Health Initiative Observational Study (WHI-OS) is a prospective cohort that enrolled 91 627 postmenopausal women, 50 to 79 years of age, from 01 October 1993 through 31 December 1998, at 40 clinical centers across the United States, with average follow-up interval of 11 years. These women reported up to three paid jobs, held the longest since age 18; these jobs were coded and duration of employment calculated. We defined a case by self-report of doctor-diagnosed PD (at baseline or follow-up), death attributed to PD, or taking medication consistent with PD. RESULTS Among 2590 PD cases, we found evidence of excess risk among "counselors, social workers, and other community and social service specialists," and there was a suggestion of increased in risk among postsecondary teachers, and "building and grounds cleaning and maintenance" workers. There was also evidence of a deficit in risk among women who worked in sales. Results according to ever-employed and job duration were similar, except for evidence of excess risk among "health technologists and technicians" with more than 20 years of employment. Longer duration of life on a farm was associated with higher risk. CONCLUSION Our findings paint a largely reassuring picture of occupational risks for PD among US women.
Collapse
Affiliation(s)
- Igor Burstyn
- Department of Environmental and Occupational HealthDrexel University Philadelphia Pennsylvania
| | - Andrea Z. LaCroix
- Department of Family Medicine and Public HealthUniversity of California San Diego California
| | - Irene Litvan
- Department of Neurosciences, Altman Clinical Translational Research InstituteUniversity of California San Diego California
| | - Robert B. Wallace
- Department of EpidemiologyUniversity of Iowa College of Public Health Iowa City Iowa
| | - Harvey Checkoway
- Department of Family Medicine and Public HealthUniversity of California San Diego California
| |
Collapse
|
198
|
Demidenko MI, Huntley ED, Martz ME, Keating DP. Adolescent Health Risk Behaviors: Convergent, Discriminant and Predictive Validity of Self-Report and Cognitive Measures. J Youth Adolesc 2019; 48:1765-1783. [PMID: 31250164 PMCID: PMC6732226 DOI: 10.1007/s10964-019-01057-4] [Citation(s) in RCA: 18] [Impact Index Per Article: 3.6] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/12/2019] [Accepted: 06/06/2019] [Indexed: 01/02/2023]
Abstract
Self-report and cognitive tasks of reward sensitivity and self-regulation have influenced several developmental models that may explain the heightened engagement in risk behaviors during adolescence. Despite some inconsistencies across studies, few studies have explored the convergent, discriminant, and predictive validity of self-report and cognitive measures of these psychological characteristics in adolescence. The present study evaluated the convergent and discriminant validity of self-report and cognitive measures of reward sensitivity and self-regulation among 2017 adolescents (age M = 16.8, SD = 1.1; 56% female; 55% White, 22% Black, 8% Hispanic, 15% other race/ethnic; 49% 10th grade and 51% 12th grade). This study compared the predictive validity of an omnibus measure and specific measures of risk engagement. Convergent and discriminant validity from self-report to cognitive tasks were as predicted, although with weak convergent relationships. As hypothesized, compared to cognitive tasks, self-report measures consistently predicted risky behaviors and explained more variance in the models. These results demonstrate that while cognitive tasks can significantly predict certain risk behaviors, they require increased power to find the very small effects, raising questions about their use as implicit proxies for real world risk behavior.
Collapse
Affiliation(s)
| | - Edward D Huntley
- Institute for Social Research, University of Michigan, Ann Arbor, MI, USA
| | - Meghan E Martz
- Addiction Center, Department of Psychiatry, University of Michigan, Ann Arbor, MI, USA
| | - Daniel P Keating
- Department of Psychology, University of Michigan, Ann Arbor, MI, USA
- Institute for Social Research, University of Michigan, Ann Arbor, MI, USA
| |
Collapse
|
199
|
Arroyo-Araujo M, Graf R, Maco M, van Dam E, Schenker E, Drinkenburg W, Koopmans B, de Boer SF, Cullum-Doyle M, Noldus LPJJ, Loos M, van Dommelen W, Spooren W, Biemans B, Buhl DL, Kas MJ. Reproducibility via coordinated standardization: a multi-center study in a Shank2 genetic rat model for Autism Spectrum Disorders. Sci Rep 2019; 9:11602. [PMID: 31406134 PMCID: PMC6690904 DOI: 10.1038/s41598-019-47981-0] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/26/2019] [Accepted: 07/25/2019] [Indexed: 02/01/2023] Open
Abstract
Inconsistent findings between laboratories are hampering scientific progress and are of increasing public concern. Differences in laboratory environment is a known factor contributing to poor reproducibility of findings between research sites, and well-controlled multisite efforts are an important next step to identify the relevant factors needed to reduce variation in study outcome between laboratories. Through harmonization of apparatus, test protocol, and aligned and non-aligned environmental variables, the present study shows that behavioral pharmacological responses in Shank2 knockout (KO) rats, a model of synaptic dysfunction relevant to autism spectrum disorders, were highly replicable across three research centers. All three sites reliably observed a hyperactive and repetitive behavioral phenotype in KO rats compared to their wild-type littermates as well as a dose-dependent phenotype attenuation following acute injections of a selective mGluR1 antagonist. These results show that reproducibility in preclinical studies can be obtained and emphasizes the need for high quality and rigorous methodologies in scientific research. Considering the observed external validity, the present study also suggests mGluR1 as potential target for the treatment of autism spectrum disorders.
Collapse
Affiliation(s)
- María Arroyo-Araujo
- Groningen Institute for Evolutionary Life Sciences, University of Groningen, Groningen, The Netherlands
| | - Radka Graf
- Neuroscience and Pain Research Unit, Pfizer Inc., Cambridge, MA, USA
| | - Martine Maco
- Roche Innovation Center Basel, Basel, Switzerland
| | - Elsbeth van Dam
- Noldus Information Technology BV, Wageningen, The Netherlands
| | | | | | | | - Sietse F de Boer
- Groningen Institute for Evolutionary Life Sciences, University of Groningen, Groningen, The Netherlands
| | | | | | - Maarten Loos
- Sylics Synaptologics BV, Amsterdam, The Netherlands
| | | | - Will Spooren
- Neuroscience and Pain Research Unit, Pfizer Inc., Cambridge, MA, USA
| | | | - Derek L Buhl
- Neuroscience and Pain Research Unit, Pfizer Inc., Cambridge, MA, USA
| | - Martien J Kas
- Groningen Institute for Evolutionary Life Sciences, University of Groningen, Groningen, The Netherlands. .,Department of Translational Neuroscience, University Medical Center Utrecht, Utrecht, The Netherlands.
| |
Collapse
|
200
|
The reliability of the isotropic fractionator method for counting total cells and neurons. J Neurosci Methods 2019; 326:108392. [PMID: 31394117 DOI: 10.1016/j.jneumeth.2019.108392] [Citation(s) in RCA: 11] [Impact Index Per Article: 2.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/04/2019] [Revised: 07/21/2019] [Accepted: 08/03/2019] [Indexed: 11/21/2022]
Abstract
BACKGROUND The Isotropic Fractionator (IF) is a method to determine the cellular composition of nervous tissue. It has been mostly applied to assess variation across species, where differences are expected to be large enough not to be masked by methodological error. However, understanding the sources of variation in the method is important if the goal is to detect smaller differences, for example, in same-species comparisons. Comparisons between different mice strains suggest that the IF is consistent enough to detect these differences. Nevertheless, the reliability of the method has not yet been examined directly. METHOD In this study, we evaluate the reliability of the method for the determination of cellular and neuronal numbers of Swiss mice. We performed repeated cell counts of the same material by different experimenters to quantify different sources of variation. RESULTS In total cell counts, we observed that for the cerebral cortex most of the variance was at the counter level. For the cerebellum, most of the variance is attributed to the sample itself. As for neurons, random error along with the immunostaining correspond to most of the variation, both in the cerebral cortex and in the cerebellum. Test-retest reliability coefficients were relatively high, especially for cell counts. CONCLUSIONS Although biases between counters and random variation in staining could be problematic when aggregating data from different sources, we offer practical suggestions to improve the reliability of the method. While small, this study is a most needed step towards more precise measurement of the brain's cellular composition.
Collapse
|