3
|
Rahnev D, Desender K, Lee ALF, Adler WT, Aguilar-Lleyda D, Akdoğan B, Arbuzova P, Atlas LY, Balcı F, Bang JW, Bègue I, Birney DP, Brady TF, Calder-Travis J, Chetverikov A, Clark TK, Davranche K, Denison RN, Dildine TC, Double KS, Duyan YA, Faivre N, Fallow K, Filevich E, Gajdos T, Gallagher RM, de Gardelle V, Gherman S, Haddara N, Hainguerlot M, Hsu TY, Hu X, Iturrate I, Jaquiery M, Kantner J, Koculak M, Konishi M, Koß C, Kvam PD, Kwok SC, Lebreton M, Lempert KM, Ming Lo C, Luo L, Maniscalco B, Martin A, Massoni S, Matthews J, Mazancieux A, Merfeld DM, O'Hora D, Palser ER, Paulewicz B, Pereira M, Peters C, Philiastides MG, Pfuhl G, Prieto F, Rausch M, Recht S, Reyes G, Rouault M, Sackur J, Sadeghi S, Samaha J, Seow TXF, Shekhar M, Sherman MT, Siedlecka M, Skóra Z, Song C, Soto D, Sun S, van Boxtel JJA, Wang S, Weidemann CT, Weindel G, Wierzchoń M, Xu X, Ye Q, Yeon J, Zou F, Zylberberg A. The Confidence Database. Nat Hum Behav 2020; 4:317-325. [PMID: 32015487 PMCID: PMC7565481 DOI: 10.1038/s41562-019-0813-1] [Citation(s) in RCA: 49] [Impact Index Per Article: 12.3] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/06/2019] [Accepted: 12/11/2019] [Indexed: 11/09/2022]
Abstract
Understanding how people rate their confidence is critical for the characterization of a wide range of perceptual, memory, motor and cognitive processes. To enable the continued exploration of these processes, we created a large database of confidence studies spanning a broad set of paradigms, participant populations and fields of study. The data from each study are structured in a common, easy-to-use format that can be easily imported and analysed using multiple software packages. Each dataset is accompanied by an explanation regarding the nature of the collected data. At the time of publication, the Confidence Database (which is available at https://osf.io/s46pr/) contained 145 datasets with data from more than 8,700 participants and almost 4 million trials. The database will remain open for new submissions indefinitely and is expected to continue to grow. Here we show the usefulness of this large collection of datasets in four different analyses that provide precise estimations of several foundational confidence-related effects.
Collapse
Affiliation(s)
- Dobromir Rahnev
- School of Psychology, Georgia Institute of Technology, Atlanta, GA, USA.
| | - Kobe Desender
- Department of Neurophysiology and Pathophysiology, University Medical Center Hamburg-Eppendorf, Hamburg, Germany
- Department of Experimental Psychology, Ghent University, Ghent, Belgium
| | - Alan L F Lee
- Department of Applied Psychology and Wofoo Joseph Lee Consulting and Counselling Psychology Research Centre, Lingnan University, Tuen Mun, Hong Kong
| | - William T Adler
- Center for Neural Science, New York University, New York, NY, USA
| | - David Aguilar-Lleyda
- Centre d'Économie de la Sorbonne, CNRS & Université Paris 1 Panthéon-Sorbonne, Paris, France
| | - Başak Akdoğan
- Department of Psychology, Columbia University, New York, NY, USA
| | - Polina Arbuzova
- Bernstein Center for Computational Neuroscience, Berlin, Germany
- Berlin School of Mind and Brain, Humboldt-Universität zu Berlin, Berlin, Germany
- Institute of Psychology, Humboldt-Universität zu Berlin, Berlin, Germany
| | - Lauren Y Atlas
- National Center for Complementary and Integrative Health, National Institutes of Health, Bethesda, MD, USA
- National Institute of Mental Health, National Institutes of Health, Bethesda, MD, USA
- National Institute on Drug Abuse, National Institutes of Health, Baltimore, MD, USA
| | - Fuat Balcı
- Department of Psychology, Koç University, Istanbul, Turkey
| | - Ji Won Bang
- Department of Ophthalmology, New York University (NYU) School of Medicine, NYU Langone Health, New York, NY, USA
| | - Indrit Bègue
- Department of Psychiatry and Mental Health, University Hospitals of Geneva and University of Geneva, Geneva, Switzerland
| | - Damian P Birney
- School of Psychology, University of Sydney, Sydney, New South Wales, Australia
| | - Timothy F Brady
- Department of Psychology, University of California, San Diego, La Jolla, CA, USA
| | | | - Andrey Chetverikov
- Donders Institute for Brain, Cognition and Behavior, Radboud University, Nijmegen, the Netherlands
| | - Torin K Clark
- Smead Aerospace Engineering Sciences, University of Colorado, Boulder, CO, USA
| | | | - Rachel N Denison
- Department of Psychology and Center for Neural Science, New York University, New York, NY, USA
| | - Troy C Dildine
- National Center for Complementary and Integrative Health, National Institutes of Health, Bethesda, MD, USA
- Department of Clinical Neuroscience, Karolinska Institutet, Solna, Sweden
| | - Kit S Double
- Department of Education, University of Oxford, Oxford, UK
| | - Yalçın A Duyan
- Department of Psychology, Koç University, Istanbul, Turkey
| | - Nathan Faivre
- Laboratoire de Psychologie et Neurocognition, Université Grenoble Alpes, Grenoble, France
| | - Kaitlyn Fallow
- Department of Psychology, University of Victoria, Victoria, British Columbia, Canada
| | - Elisa Filevich
- Bernstein Center for Computational Neuroscience, Berlin, Germany
- Berlin School of Mind and Brain, Humboldt-Universität zu Berlin, Berlin, Germany
- Institute of Psychology, Humboldt-Universität zu Berlin, Berlin, Germany
| | | | - Regan M Gallagher
- School of Psychology, University of Queensland, Brisbane, Queensland, Australia
- Department of Experimental & Applied Psychology, Vrije Universiteit Amsterdam, Amsterdam, the Netherlands
- School of Psychological Sciences, Monash University, Melbourne, Victoria, Australia
| | | | - Sabina Gherman
- Institute of Neuroscience and Psychology, University of Glasgow, Glasgow, UK
- Feinstein Institute for Medical Research, Manhasset, NY, USA
| | - Nadia Haddara
- School of Psychology, Georgia Institute of Technology, Atlanta, GA, USA
| | - Marine Hainguerlot
- Erasmus School of Economics, Erasmus University Rotterdam, Rotterdam, the Netherlands
| | - Tzu-Yu Hsu
- Graduate Institute of Mind, Brain, and Consciousness, Taipei Medical University, Taipei, Taiwan
| | - Xiao Hu
- Collaborative Innovation Center of Assessment toward Basic Education Quality, Beijing Normal University, Beijing, China
| | - Iñaki Iturrate
- National Institute of Neurological Disorders and Stroke, National Institutes of Health, Bethesda, MD, USA
| | - Matt Jaquiery
- Department of Experimental Psychology, University of Oxford, Oxford, UK
| | - Justin Kantner
- Department of Psycholgoy, California State University, Northridge, CA, USA
| | - Marcin Koculak
- Consciousness Lab, Institute of Psychology, Jagiellonian University, Krakow, Poland
| | - Mahiko Konishi
- Laboratoire de Sciences Cognitives et de Psycholinguistique, Department d'Etudes Cognitives, ENS, PSL University, EHESS, CNRS, Paris, France
| | - Christina Koß
- Bernstein Center for Computational Neuroscience, Berlin, Germany
- Institute of Psychology, Humboldt-Universität zu Berlin, Berlin, Germany
| | - Peter D Kvam
- Department of Psychology, University of Florida, Gainesville, FL, USA
| | - Sze Chai Kwok
- Shanghai Key Laboratory of Brain Functional Genomics, Key Laboratory of Brain Functional Genomics Ministry of Education, School of Psychology and Cognitive Science, East China Normal University, Shanghai, China
- Shanghai Key Laboratory of Magnetic Resonance, East China Normal University, Shanghai, China
- NYU-ECNU Institute of Brain and Cognitive Science, NYU Shanghai, Shanghai, China
| | - Maël Lebreton
- Swiss Center for Affective Science and LaBNIC, Department of Basic Neuroscience, University of Geneva, Geneva, Switzerland
| | - Karolina M Lempert
- Department of Psychology, University of Pennsylvania, Philadelphia, PA, USA
| | - Chien Ming Lo
- Graduate Institute of Mind, Brain, and Consciousness, Taipei Medical University, Taipei, Taiwan
- Brain and Consciousness Research Centre, TMU Shuang-Ho Hospital, New Taipei City, Taiwan
| | - Liang Luo
- Collaborative Innovation Center of Assessment toward Basic Education Quality, Beijing Normal University, Beijing, China
| | - Brian Maniscalco
- Department of Bioengineering, University of California, Riverside, Riverside, CA, USA
| | - Antonio Martin
- Graduate Institute of Mind, Brain, and Consciousness, Taipei Medical University, Taipei, Taiwan
| | - Sébastien Massoni
- Université de Lorraine, Université de Strasbourg, CNRS, BETA, Nancy, France
| | - Julian Matthews
- School of Psychological Sciences, Monash University, Melbourne, Victoria, Australia
- Philosophy Department, Monash University, Monash, Victoria, Australia
| | - Audrey Mazancieux
- Laboratoire de Psychologie et Neurocognition, Université Grenoble Alpes, Grenoble, France
| | - Daniel M Merfeld
- Otolaryngology-Head and Neck Surgery, The Ohio State University, Columbus, OH, USA
| | - Denis O'Hora
- School of Psychology, National University of Ireland Galway, Galway, Ireland
| | - Eleanor R Palser
- Department of Neurology, University of California, San Francisco, San Francisco, CA, USA
- Psychology and Language Sciences, University College Londo, London, UK
- Institute of Neurology, University College London, London, UK
| | - Borysław Paulewicz
- SWPS University of Social Sciences and Humanities, Katowice Faculty of Psychology, Katowice, Poland
| | - Michael Pereira
- Laboratory of Cognitive Neuroscience, Ecole Polytechnique Fédérale de Lausanne, Lausanne, Switzerland
| | - Caroline Peters
- Bernstein Center for Computational Neuroscience, Berlin, Germany
- Berlin School of Mind and Brain, Humboldt-Universität zu Berlin, Berlin, Germany
- Institute of Psychology, Humboldt-Universität zu Berlin, Berlin, Germany
| | | | - Gerit Pfuhl
- Department of Psychology, UiT the Arctic University of Norway, Tromso, Norway
| | - Fernanda Prieto
- Faculty of Psychology, Universidad del Desarrollo, Santiago, Chile
| | - Manuel Rausch
- Catholic University of Eichstätt-Ingolstadt, Eichstätt, Germany
| | - Samuel Recht
- Laboratoire des Systèmes Perceptifs, Département d'Études Cognitives, École normale supérieure-PSL University, CNRS, Paris, France
| | - Gabriel Reyes
- Faculty of Psychology, Universidad del Desarrollo, Santiago, Chile
| | - Marion Rouault
- Département d'Études Cognitives, École Normale Supérieure-PSL University, CNRS, EHESS, INSERM, Paris, France
| | - Jérôme Sackur
- Département d'Études Cognitives, École Normale Supérieure-PSL University, CNRS, EHESS, INSERM, Paris, France
- École Polytechnique, Palaiseau, France
| | - Saeedeh Sadeghi
- Department of Human Development, Cornell University, Ithaca, NY, USA
| | - Jason Samaha
- Department of Psychology, University of California, Santa Cruz, Santa Cruz, CA, USA
| | - Tricia X F Seow
- School of Psychology, Trinity College Dublin, Dublin, Ireland
| | - Medha Shekhar
- School of Psychology, Georgia Institute of Technology, Atlanta, GA, USA
| | - Maxine T Sherman
- Sackler Centre for Consciousness Science, Brighton, UK
- Brighton and Sussex Medical School, University of Sussex, Brighton, UK
| | - Marta Siedlecka
- Consciousness Lab, Institute of Psychology, Jagiellonian University, Krakow, Poland
| | - Zuzanna Skóra
- Consciousness Lab, Institute of Psychology, Jagiellonian University, Krakow, Poland
| | - Chen Song
- Cardiff University Brain Research Imaging Centre, School of Psychology, Cardiff University, Cardiff, UK
| | - David Soto
- Basque Center on Cognition, Brain and Language, San Sebastian, Spain
- Ikerbasque, Basque Foundation for Science, Bilbao, Spain
| | - Sai Sun
- Divisions of Biology and Biological Engineering and Computation and Neural Systems, California Institute of Technology, Pasadena, CA, USA
| | - Jeroen J A van Boxtel
- School of Psychological Sciences, Monash University, Melbourne, Victoria, Australia
- Discipline of Psychology, University of Canberra, Canberra, Australian Capital Territory, Australia
| | - Shuo Wang
- Department of Chemical and Biomedical Engineering and Rockefeller Neuroscience Institute, West Virginia University, Morgantown, WV, USA
| | | | | | - Michał Wierzchoń
- Consciousness Lab, Institute of Psychology, Jagiellonian University, Krakow, Poland
| | - Xinming Xu
- Shanghai Key Laboratory of Brain Functional Genomics, Key Laboratory of Brain Functional Genomics Ministry of Education, School of Psychology and Cognitive Science, East China Normal University, Shanghai, China
| | - Qun Ye
- Shanghai Key Laboratory of Brain Functional Genomics, Key Laboratory of Brain Functional Genomics Ministry of Education, School of Psychology and Cognitive Science, East China Normal University, Shanghai, China
| | - Jiwon Yeon
- School of Psychology, Georgia Institute of Technology, Atlanta, GA, USA
| | - Futing Zou
- Shanghai Key Laboratory of Brain Functional Genomics, Key Laboratory of Brain Functional Genomics Ministry of Education, School of Psychology and Cognitive Science, East China Normal University, Shanghai, China
| | - Ariel Zylberberg
- Department of Brain and Cognitive Sciences, University of Rochester, Rochester, NY, USA
| |
Collapse
|