1
|
Galesic M, Barkoczi D, Berdahl AM, Biro D, Carbone G, Giannoccaro I, Goldstone RL, Gonzalez C, Kandler A, Kao AB, Kendal R, Kline M, Lee E, Massari GF, Mesoudi A, Olsson H, Pescetelli N, Sloman SJ, Smaldino PE, Stein DL. Beyond collective intelligence: Collective adaptation. J R Soc Interface 2023; 20:20220736. [PMID: 36946092 PMCID: PMC10031425 DOI: 10.1098/rsif.2022.0736] [Citation(s) in RCA: 8] [Impact Index Per Article: 8.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/08/2022] [Accepted: 02/27/2023] [Indexed: 03/23/2023] Open
Abstract
We develop a conceptual framework for studying collective adaptation in complex socio-cognitive systems, driven by dynamic interactions of social integration strategies, social environments and problem structures. Going beyond searching for 'intelligent' collectives, we integrate research from different disciplines and outline modelling approaches that can be used to begin answering questions such as why collectives sometimes fail to reach seemingly obvious solutions, how they change their strategies and network structures in response to different problems and how we can anticipate and perhaps change future harmful societal trajectories. We discuss the importance of considering path dependence, lack of optimization and collective myopia to understand the sometimes counterintuitive outcomes of collective adaptation. We call for a transdisciplinary, quantitative and societally useful social science that can help us to understand our rapidly changing and ever more complex societies, avoid collective disasters and reach the full potential of our ability to organize in adaptive collectives.
Collapse
Affiliation(s)
- Mirta Galesic
- Santa Fe Institute, Santa Fe, NM 87501, USA
- Complexity Science Hub Vienna, 1080 Vienna, Austria
- Vermont Complex Systems Center, University of Vermont, Burlington, VM 05405, USA
| | | | - Andrew M. Berdahl
- School of Aquatic and Fishery Sciences, University of Washington, Seattle, WA 98195, USA
| | - Dora Biro
- Department of Zoology, University of Oxford, Oxford OX1 3PS, UK
| | - Giuseppe Carbone
- Department of Mechanics, Mathematics and Management, Politecnico di Bari, Bari 70125, Italy
| | - Ilaria Giannoccaro
- Department of Mechanics, Mathematics and Management, Politecnico di Bari, Bari 70125, Italy
| | - Robert L. Goldstone
- Psychological and Brain Sciences, Indiana University, Bloomington, IN 47405, USA
| | - Cleotilde Gonzalez
- Department of Social and Decision Sciences, Carnegie Mellon University, Pittsburgh, PA 15213, USA
| | - Anne Kandler
- Department of Mathematics, Max-Planck-Institute for Evolutionary Anthropology, Leipzig 04103, Germany
| | - Albert B. Kao
- Santa Fe Institute, Santa Fe, NM 87501, USA
- Biology Department, University of Massachusetts Boston, Boston, MA 02125, USA
| | - Rachel Kendal
- Centre for Coevolution of Biology and Culture, Durham University, Anthropology Department, Durham, DH1 3LE, UK
| | - Michelle Kline
- Centre for Culture and Evolution, Division of Psychology, Brunel University London, Uxbridge, UB8 3PH, UK
| | - Eun Lee
- Department of Scientific Computing, Pukyong National University, 45 Yongso-ro, Nam-gu, Busan, 48513, Republic of Korea
| | | | - Alex Mesoudi
- Department of Ecology and Conservation, University of Exeter, Penryn TR10 9FE, UK
| | | | | | - Sabina J. Sloman
- Department of Social and Decision Sciences, Carnegie Mellon University, Pittsburgh, PA 15213, USA
- Department of Computer Science, University of Manchester, Manchester, M13 9PL, UK
| | - Paul E. Smaldino
- Santa Fe Institute, Santa Fe, NM 87501, USA
- Department of Cognitive and Information Sciences, University of California, Merced, CA 95343, USA
| | - Daniel L. Stein
- Santa Fe Institute, Santa Fe, NM 87501, USA
- Department of Physics and Courant Institute of Mathematical Sciences, New York University, New York, NY 10012, USA
| |
Collapse
|
2
|
Song M, Baah PA, Cai MB, Niv Y. Humans combine value learning and hypothesis testing strategically in multi-dimensional probabilistic reward learning. PLoS Comput Biol 2022; 18:e1010699. [PMID: 36417419 PMCID: PMC9683628 DOI: 10.1371/journal.pcbi.1010699] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/29/2022] [Accepted: 10/31/2022] [Indexed: 11/24/2022] Open
Abstract
Realistic and complex decision tasks often allow for many possible solutions. How do we find the correct one? Introspection suggests a process of trying out solutions one after the other until success. However, such methodical serial testing may be too slow, especially in environments with noisy feedback. Alternatively, the underlying learning process may involve implicit reinforcement learning that learns about many possibilities in parallel. Here we designed a multi-dimensional probabilistic active-learning task tailored to study how people learn to solve such complex problems. Participants configured three-dimensional stimuli by selecting features for each dimension and received probabilistic reward feedback. We manipulated task complexity by changing how many feature dimensions were relevant to maximizing reward, as well as whether this information was provided to the participants. To investigate how participants learn the task, we examined models of serial hypothesis testing, feature-based reinforcement learning, and combinations of the two strategies. Model comparison revealed evidence for hypothesis testing that relies on reinforcement-learning when selecting what hypothesis to test. The extent to which participants engaged in hypothesis testing depended on the instructed task complexity: people tended to serially test hypotheses when instructed that there were fewer relevant dimensions, and relied more on gradual and parallel learning of feature values when the task was more complex. This demonstrates a strategic use of task information to balance the costs and benefits of the two methods of learning.
Collapse
Affiliation(s)
- Mingyu Song
- Princeton Neuroscience Institute, Princeton University, Princeton, New Jersey, United States of America
- * E-mail:
| | - Persis A. Baah
- Department of Psychology, Princeton University, Princeton, New Jersey, United States of America
| | - Ming Bo Cai
- International Research Center for Neurointelligence (WPI-IRCN), The University of Tokyo, Tokyo, Japan
| | - Yael Niv
- Princeton Neuroscience Institute, Princeton University, Princeton, New Jersey, United States of America
- Department of Psychology, Princeton University, Princeton, New Jersey, United States of America
| |
Collapse
|
3
|
Thomas B, Coon J, Westfall HA, Lee MD. Model-Based Wisdom of the Crowd for Sequential Decision-Making Tasks. Cogn Sci 2021; 45:e13011. [PMID: 34213800 DOI: 10.1111/cogs.13011] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/04/2020] [Revised: 05/27/2021] [Accepted: 05/28/2021] [Indexed: 11/29/2022]
Abstract
We study the wisdom of the crowd in three sequential decision-making tasks: the Balloon Analogue Risk Task (BART), optimal stopping problems, and bandit problems. We consider a behavior-based approach, using majority decisions to determine crowd behavior and show that this approach performs poorly in the BART and bandit tasks. The key problem is that the crowd becomes progressively more extreme as the decision sequence progresses, because the diversity of opinion that underlies the wisdom of the crowd is lost. We also consider model-based approaches to each task. This involves inferring cognitive models for each individual based on their observed behavior, and using these models to predict what each individual would do in any possible task situation. We show that this approach performs robustly well for all three tasks and has the additional advantage of being able to generalize to new problems for which there are no behavioral data. We discuss potential applications of the model-based approach to real-world sequential decision problems and discuss how our approach contributes to the understanding of collective intelligence.
Collapse
Affiliation(s)
- Bobby Thomas
- Department of Cognitive Sciences, University of California, Irvine
| | - Jeff Coon
- Department of Cognitive Sciences, University of California, Irvine
| | - Holly A Westfall
- Department of Cognitive Sciences, University of California, Irvine
| | - Michael D Lee
- Department of Cognitive Sciences, University of California, Irvine
| |
Collapse
|
4
|
Abstract
The science of judgment and decision making involves three interrelated forms of research: analysis of the decisions people face, description of their natural responses, and interventions meant to help them do better. After briefly introducing the field's intellectual foundations, we review recent basic research into the three core elements of decision making: judgment, or how people predict the outcomes that will follow possible choices; preference, or how people weigh those outcomes; and choice, or how people combine judgments and preferences to reach a decision. We then review research into two potential sources of behavioral heterogeneity: individual differences in decision-making competence and developmental changes across the life span. Next, we illustrate applications intended to improve individual and organizational decision making in health, public policy, intelligence analysis, and risk management. We emphasize the potential value of coupling analytical and behavioral research and having basic and applied research inform one another.
Collapse
Affiliation(s)
- Baruch Fischhoff
- Department of Engineering and Public Policy, and Institute for Politics and Strategy, Carnegie Mellon University, Pittsburgh, Pennsylvania 15213, USA
| | - Stephen B. Broomell
- Department of Social and Decision Sciences, Carnegie Mellon University, Pittsburgh, Pennsylvania 15213, USA
| |
Collapse
|
5
|
Davis JP, Maigut A, Forrest C. The wisdom of the crowd: A case of post- to ante-mortem face matching by police super-recognisers. Forensic Sci Int 2019; 302:109910. [PMID: 31421920 DOI: 10.1016/j.forsciint.2019.109910] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/15/2019] [Revised: 07/12/2019] [Accepted: 07/30/2019] [Indexed: 11/28/2022]
Abstract
This case report describes novel methodology used to identify a 43-year-old post-mortem photo of a drowned male recovered from a London river in the 1970s. Embedded in an array of foils, police super-recognisers (n=25) possessing superior simultaneous face matching ability, and police controls (n=139) provided confidence ratings as to the similarity of the post-mortem photo to an ante-mortem photo of a man who went missing at about the same time. Indicative of a match, compared to controls, super-recognisers provided higher ratings to the target than the foils. Effects were enhanced when drawing on the combined wisdom of super-recogniser crowds, but not control crowds. These findings supported additional case evidence allowing the coroner to rule that the deceased male and missing male were likely one and the same person. A description of how similar super-recogniser wisdom of the crowd procedures could be applied to other visual image identification cases when no other method is feasible is provided.
Collapse
Affiliation(s)
- Josh P Davis
- Department of Psychology, Social Work and Counselling, University of Greenwich, London, SE10 9LS, United Kingdom.
| | - Andreea Maigut
- Department of Psychology, Social Work and Counselling, University of Greenwich, London, SE10 9LS, United Kingdom.
| | - Charlotte Forrest
- Department of Psychology, Social Work and Counselling, University of Greenwich, London, SE10 9LS, United Kingdom.
| |
Collapse
|
6
|
Balsdon T, Summersby S, Kemp RI, White D. Improving face identification with specialist teams. COGNITIVE RESEARCH-PRINCIPLES AND IMPLICATIONS 2018; 3:25. [PMID: 29984300 PMCID: PMC6021458 DOI: 10.1186/s41235-018-0114-7] [Citation(s) in RCA: 19] [Impact Index Per Article: 3.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 01/07/2018] [Accepted: 04/05/2018] [Indexed: 11/10/2022]
Abstract
People vary in their ability to identify faces, and this variability is relatively stable across repeated testing. This suggests that recruiting high performers can improve identity verification accuracy in applied settings. Here, we report the first systematic study to evaluate real-world benefits of selecting high performers based on performance in standardized face identification tests. We simulated a recruitment process for a specialist team tasked with detecting fraudulent passport applications. University students (n = 114) completed a battery of screening tests followed by a real-world face identification task that is performed routinely when issuing identity documents. Consistent with previous work, individual differences in the real-world task were relatively stable across repeated tests taken 1 week apart (r = 0.6), and accuracy scores on screening tests and the real-world task were moderately correlated. Nevertheless, performance gains achieved by selecting groups based on screening tests were surprisingly small, leading to a 7% improvement in accuracy. Statistically aggregating decisions across individuals-using a 'wisdom of crowds' approach-led to more substantial gains than selection alone. Finally, controlling for individual accuracy of team members, the performance of a team in one test predicted their performance in a subsequent test, suggesting that a 'good team' is not only defined by the individual accuracy of team members. Overall, these results underline the need to use a combination of approaches to improve face identification performance in professional settings.
Collapse
Affiliation(s)
- Tarryn Balsdon
- School of Psychology, UNSW Sydney, Sydney, NSW 2052 Australia
| | | | - Richard I Kemp
- School of Psychology, UNSW Sydney, Sydney, NSW 2052 Australia
| | - David White
- School of Psychology, UNSW Sydney, Sydney, NSW 2052 Australia
| |
Collapse
|