1
|
Kvam PD, Irving LH, Sokratous K, Smith CT. Improving the reliability and validity of the IAT with a dynamic model driven by similarity. Behav Res Methods 2024; 56:2158-2193. [PMID: 37450219 DOI: 10.3758/s13428-023-02141-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 05/02/2023] [Indexed: 07/18/2023]
Abstract
The Implicit Association Test (IAT), like many behavioral measures, seeks to quantify meaningful individual differences in cognitive processes that are difficult to assess with approaches like self-reports. However, much like other behavioral measures, many IATs appear to show low test-retest reliability and typical scoring methods fail to quantify all of the decision-making processes that generate the overt task performance. Here, we develop a new modeling approach for IATs based on the geometric similarity representation (GSR) model. This model leverages both response times and accuracy on IATs to make inferences about representational similarity between the stimuli and categories. The model disentangles processes related to response caution, stimulus encoding, similarities between concepts and categories, and response processes unrelated to the choice itself. This approach to analyzing IAT data illustrates that the unreliability in IATs is almost entirely attributable to the methods used to analyze data from the task: GSR model parameters show test-retest reliability around .80-.90, on par with reliable self-report measures. Furthermore, we demonstrate how model parameters result in greater validity compared to the IAT D-score, Quad model, and simple diffusion model contrasts, predicting outcomes related to intergroup contact and motivation. Finally, we present a simple point-and-click software tool for fitting the model, which uses a pre-trained neural network to estimate best-fit parameters of the GSR model. This approach allows easy and instantaneous fitting of IAT data with minimal demands on coding or technical expertise on the part of the user, making the new model accessible and effective.
Collapse
Affiliation(s)
- Peter D Kvam
- Department of Psychology, University of Florida, Florida, USA.
| | - Louis H Irving
- Department of Psychology, University of Florida, Florida, USA
| | | | | |
Collapse
|
2
|
Lalla A, Chaykin R, Sheldon S. Option similarity modulates the link between choice and memory. Mem Cognit 2024; 52:7-22. [PMID: 37488345 DOI: 10.3758/s13421-023-01439-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 06/06/2023] [Indexed: 07/26/2023]
Abstract
Choices made in everyday life are highly variable. Sometimes, you may find yourself choosing between two similar options (e.g., breakfast foods to eat) and other times between two dissimilar options (e.g., what to buy with a gift certificate). The goal of the present study was to understand how the similarity of choice options affects our ability to remember what we choose and what we did not choose. We hypothesized that choosing between similar as compared to dissimilar options would evoke a comparison-based strategy (evaluating options with respect to one another), fostering a relational form of encoding and leading to better memory for both the chosen and unchosen options. In Experiment 1, participants reported their strategy when choosing between pairs of similar or dissimilar options, revealing that participants were more likely to use a comparison-based strategy when faced with similar options. In Experiment 2, we tested memory after participants made choices between similar or dissimilar options, finding improved memory for both chosen and unchosen options from the similar compared to dissimilar choice trials. In Experiment 3, we examined strategy use when choosing between pairs of similar or dissimilar options and memory for these options. Replicating and extending the results of the first two experiments, we found that participants were more likely to use a comparison-based strategy when choosing between similar than dissimilar options, and that the positive effect of similarity on memory was stronger for unchosen than chosen options when controlling for strategy use. We interpret our results as evidence that option similarity impacts the mnemonic processes used during choice, altering what we encode and ultimately remember about our choices.
Collapse
Affiliation(s)
- Azara Lalla
- Department of Psychology, McGill University, 2001 McGill Avenue, Montreal, QC, H3A 1G1, Canada
| | - Rose Chaykin
- Department of Psychology, McGill University, 2001 McGill Avenue, Montreal, QC, H3A 1G1, Canada
| | - Signy Sheldon
- Department of Psychology, McGill University, 2001 McGill Avenue, Montreal, QC, H3A 1G1, Canada.
| |
Collapse
|
3
|
Hill EM, Prosser NS, Brown PE, Ferguson E, Green MJ, Kaler J, Keeling MJ, Tildesley MJ. Incorporating heterogeneity in farmer disease control behaviour into a livestock disease transmission model. Prev Vet Med 2023; 219:106019. [PMID: 37699310 DOI: 10.1016/j.prevetmed.2023.106019] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/14/2023] [Revised: 08/07/2023] [Accepted: 08/29/2023] [Indexed: 09/14/2023]
Abstract
Human behaviour is critical to effective responses to livestock disease outbreaks, especially with respect to vaccination uptake. Traditionally, mathematical models used to inform this behaviour have not taken heterogeneity in farmer behaviour into account. We address this by exploring how heterogeneity in farmers vaccination behaviour can be incorporated to inform mathematical models. We developed and used a graphical user interface to elicit farmers (n = 60) vaccination decisions to an unfolding fast-spreading epidemic and linked this to their psychosocial and behavioural profiles. We identified, via cluster analysis, robust patterns of heterogeneity in vaccination behaviour. By incorporating these vaccination behavioural groupings into a mathematical model for a fast-spreading livestock infection, using computational simulation we explored how the inclusion of heterogeneity in farmer disease control behaviour may impact epidemiological and economic focused outcomes. When assuming homogeneity in farmer behaviour versus configurations informed by the psychosocial profile cluster estimates, the modelled scenarios revealed a disconnect in projected distributions and threshold statistics across outbreak size, outbreak duration and economic metrics.
Collapse
Affiliation(s)
- Edward M Hill
- The Zeeman Institute for Systems Biology and Infectious Disease Epidemiology Research, School of Life Sciences and Mathematics Institute, University of Warwick, Coventry, United Kingdom.
| | - Naomi S Prosser
- School of Veterinary Medicine and Science, University of Nottingham, Sutton Bonington Campus, Leicestershire, United Kingdom
| | - Paul E Brown
- The Zeeman Institute for Systems Biology and Infectious Disease Epidemiology Research, School of Life Sciences and Mathematics Institute, University of Warwick, Coventry, United Kingdom
| | - Eamonn Ferguson
- School of Psychology, University Park, University of Nottingham, Nottingham, United Kingdom; National Institute for Health and Care Research Blood and Transplant Research Unit in Donor Health and Behaviour, University of Cambridge, Cambridge, United Kingdom
| | - Martin J Green
- School of Veterinary Medicine and Science, University of Nottingham, Sutton Bonington Campus, Leicestershire, United Kingdom
| | - Jasmeet Kaler
- School of Veterinary Medicine and Science, University of Nottingham, Sutton Bonington Campus, Leicestershire, United Kingdom
| | - Matt J Keeling
- The Zeeman Institute for Systems Biology and Infectious Disease Epidemiology Research, School of Life Sciences and Mathematics Institute, University of Warwick, Coventry, United Kingdom
| | - Michael J Tildesley
- The Zeeman Institute for Systems Biology and Infectious Disease Epidemiology Research, School of Life Sciences and Mathematics Institute, University of Warwick, Coventry, United Kingdom
| |
Collapse
|
4
|
Qie X, Wu J, Li Y, Sun Y. A Stage Model for Agent-Based Emotional Persuasion with an Adaptive Target: From a Social Exchange Perspective. Inf Sci (N Y) 2022. [DOI: 10.1016/j.ins.2022.07.147] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/05/2022]
|
5
|
A rational model of people's inferences about others' preferences based on response times. Cognition 2021; 217:104885. [PMID: 34454336 DOI: 10.1016/j.cognition.2021.104885] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/09/2021] [Revised: 06/26/2021] [Accepted: 08/16/2021] [Indexed: 12/26/2022]
Abstract
There's a difference between someone instantaneously saying "Yes!" when you ask them on a date compared to "…yes." Psychologists and economists have long studied how people can infer preferences from others' choices. However, these models have tended to focus on what people choose and not how long it takes them to make a choice. We present a rational model for inferring preferences from response times, using a drift diffusion model to characterize how preferences influence response time, and Bayesian inference to invert this relationship. We test our model's predictions for three experimental questions. Matching model predictions, participants inferred that a decision-maker preferred a chosen item more if the decision-maker spent less time deliberating (Experiment 1), participants predicted a decision-maker's choice in a novel comparison based on inferring the decision-maker's relative preferences from previous response times and choices (Experiment 2), and participants could incorporate information about a decision-maker's mental state of cautious or careless (Experiments 3, 4A, and 4B).
Collapse
|
6
|
Spektor MS, Bhatia S, Gluth S. The elusiveness of context effects in decision making. Trends Cogn Sci 2021; 25:843-854. [PMID: 34426050 DOI: 10.1016/j.tics.2021.07.011] [Citation(s) in RCA: 15] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/20/2021] [Revised: 07/21/2021] [Accepted: 07/25/2021] [Indexed: 11/30/2022]
Abstract
Contextual features influence human and non-human decision making, giving rise to preference reversals. Decades of research have documented the species and situations in which these effects are observed. More recently, however, researchers have focused on boundary conditions, that is, settings in which established effects disappear or reverse. This work is scattered across academic disciplines and some results appear to contradict each other. We synthesize recent findings and resolve apparent contradictions by considering them in terms of three core categories of decision context: spatial arrangement, attribute concreteness, and deliberation time. We suggest that these categories could be understood using theories of choice representation, which specify how context shapes the information over which deliberation processes operate.
Collapse
Affiliation(s)
- Mikhail S Spektor
- Department of Economics and Business, Universitat Pompeu Fabra, Ramon Trias Fargas 25-27, 08005 Barcelona, Spain; Barcelona Graduate School of Economics, Ramon Trias Fargas 25-27, 08005 Barcelona, Spain.
| | - Sudeep Bhatia
- Department of Psychology, University of Pennsylvania, 3720 Walnut Street, 19104 Philadelphia, PA, USA
| | - Sebastian Gluth
- Department of Psychology, University of Hamburg, Von-Melle-Park 11, 20146 Hamburg, Germany
| |
Collapse
|
7
|
Revealed strength of preference: Inference from response times. JUDGMENT AND DECISION MAKING 2019. [DOI: 10.1017/s1930297500006082] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/04/2023]
Abstract
AbstractRevealed preference is the dominant approach for inferring preferences, but it is limited in that it relies solely on discrete choice data. When a person chooses one alternative over another, we cannot infer the strength of their preference or predict how likely they will be to make the same choice again. However, the choice process also produces response times (RTs), which are continuous and easily observable. It has been shown that RTs often decrease with strength-of-preference. This is a basic property of sequential sampling models such as the drift diffusion model. What remains unclear is whether this relationship is sufficiently strong, relative to the other factors that affect RTs, to allow us to reliably infer strength-of-preference across individuals. Using several experiments, we show that even when every subject chooses the same alternative, we can still rank them based on their RTs and predict their behavior on other choice problems. We can also use RTs to predict whether a subject will repeat or reverse their decision when presented with the same choice problem a second time. Finally, as a proof-of-concept, we demonstrate that it is also possible to recover individual preference parameters from RTs alone. These results demonstrate that it is indeed possible to use RTs to infer preferences.
Collapse
|