1
|
Potential mental health-related harms associated with the universal screening of anxiety and depressive symptoms in Australian secondary schools. Child Adolesc Psychiatry Ment Health 2024; 18:46. [PMID: 38566202 PMCID: PMC10985850 DOI: 10.1186/s13034-024-00734-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 12/18/2023] [Accepted: 03/15/2024] [Indexed: 04/04/2024] Open
Abstract
BACKGROUND Anxiety and depressive disorders typically emerge in adolescence and can be chronic and disabling if not identified and treated early. School-based universal mental health screening may identify young people in need of mental health support and facilitate access to treatment. However, few studies have assessed the potential harms of this approach. This paper examines some of the potential mental health-related harms associated with the universal screening of anxiety and depression administered in Australian secondary schools. METHODS A total of 1802 adolescent students from 22 secondary schools in New South Wales, Australia, were cluster randomised (at the school level) to receive either an intensive screening procedure (intervention) or a light touch screening procedure (control). Participants in the intensive screening condition received supervised self-report web-based screening questionnaires for anxiety, depression and suicidality with the follow-up care matched to their symptom severity. Participants in the light touch condition received unsupervised web-based screening for anxiety and depression only, followed by generalised advice on help-seeking. No other care was provided in this condition. Study outcomes included the increased risk of anxiety, depression, psychological distress, decreased risk of help-seeking, increased risk of mental health stigma, determined from measures assessed at baseline, 6 weeks post-baseline, and 12 weeks post-baseline. Differences between groups were analysed using mixed effect models. RESULTS Participants in the intensive screening group were not adversely affected when compared to the light touch screening condition across a range of potential harms. Rather, participants in the intensive screening group were found to have a decreased risk of inhibited help-seeking behaviour compared to the light touch screening condition. CONCLUSIONS The intensive screening procedure did not appear to adversely impact adolescents' mental health relative to the light touch procedure. Future studies should examine other school-based approaches that may be more effective and efficient than universal screening for reducing mental health burden among students. Trial registration Australian and New Zealand Clinical Trials Registry (ACTRN12618001539224) https://anzctr.org.au/Trial/Registration/TrialReview.aspx?id=375821 .
Collapse
|
2
|
Uncovering the cognitive mechanisms underlying the gaze cueing effect. Q J Exp Psychol (Hove) 2024; 77:803-827. [PMID: 37246917 PMCID: PMC10960327 DOI: 10.1177/17470218231181238] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/31/2022] [Revised: 04/03/2023] [Accepted: 05/16/2023] [Indexed: 05/30/2023]
Abstract
The gaze cueing effect is the tendency for people to respond faster to targets appearing at locations gazed at by others, compared with locations gazed away from by others. The effect is robust, widely studied, and is an influential finding within social cognition. Formal evidence accumulation models provide the dominant theoretical account of the cognitive processes underlying speeded decision-making, but they have rarely been applied to social cognition research. In this study, using a combination of individual-level and hierarchical computational modelling techniques, we applied evidence accumulation models to gaze cueing data (three data sets total, N = 171, 139,001 trials) for the first time to assess the relative capacity that an attentional orienting mechanism and information processing mechanisms have for explaining the gaze cueing effect. We found that most participants were best described by the attentional orienting mechanism, such that response times were slower at gazed away from locations because they had to reorient to the target before they could process the cue. However, we found evidence for individual differences, whereby the models suggested that some gaze cueing effects were driven by a short allocation of information processing resources to the gazed at location, allowing for a brief period where orienting and processing could occur in parallel. There was exceptionally little evidence to suggest any sustained reallocation of information processing resources neither at the group nor individual level. We discuss how this individual variability might represent credible individual differences in the cognitive mechanisms that subserve behaviourally observed gaze cueing effects.
Collapse
|
3
|
Using mixture modeling to examine differences in perceptual decision-making as a function of the time and method of participant recruitment. Behav Res Methods 2024; 56:2194-2212. [PMID: 37466756 PMCID: PMC10991063 DOI: 10.3758/s13428-023-02142-0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 05/02/2023] [Indexed: 07/20/2023]
Abstract
We examine whether perceptual decision-making differs as a function of the time in the academic term and whether the participant is an undergraduate participating for course credit, a paid in-person participant, or a paid online participant recruited via Amazon Mechanical Turk. We use a mixture modeling approach within an evidence accumulation framework that separates stimulus-driven responses from contaminant responses, allowing us to distinguish between performance when a participant is engaged in the task and the consistency in this task focus. We first report a survey showing cognitive psychologists expect performance and response caution to be lower among undergraduate participants recruited at the end of the academic term compared to those recruited near the start, and highest among paid in-person participants. The findings from two experiments using common paradigms revealed very little evidence of time-of-semester effects among course credit participants on accuracy, response time, efficiency of information processing (when engaged in the task), caution, and non-decision time, or consistency in task focus. However, paid in-person participants did tend to be more accurate than the other two groups. Groups showed similar effects of speed/accuracy emphasis on response caution and of discrimination difficulty on information processing efficiency, but the effect of speed/accuracy emphasis on information processing efficiency was less consistent among groups. We conclude that online crowdsourcing platforms can provide quality perceptual decision-making data, but recommend that mixture modeling be used to adequately account for data generated by processes other than the psychological phenomena under investigation.
Collapse
|
4
|
The gated cascade diffusion model: An integrated theory of decision making, motor preparation, and motor execution. Psychol Rev 2024:2024-55154-001. [PMID: 38386394 DOI: 10.1037/rev0000464] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/23/2024]
Abstract
This article introduces an integrated and biologically inspired theory of decision making, motor preparation, and motor execution. The theory is formalized as an extension of the diffusion model, in which diffusive accumulated evidence from the decision-making process is continuously conveyed to motor areas of the brain that prepare the response, where it is smoothed by a mechanism that approximates a Kalman-Bucy filter. The resulting motor preparation variable is gated prior to reaching agonist muscles until it exceeds a particular level of activation. We tested this gated cascade diffusion model by continuously probing the electrical activity of the response agonists through electromyography in four choice tasks that span a variety of domains in cognitive sciences, namely motion perception, numerical cognition, recognition memory, and lexical knowledge. The model provided a good quantitative account of behavioral and electromyographic data and systematically outperformed previous models. This work represents an advance in the integration of processes involved in simple decisions and sheds new light on the interplay between decision and motor systems. (PsycInfo Database Record (c) 2024 APA, all rights reserved).
Collapse
|
5
|
Interference and attentional switching in aging. Neuropsychology 2024; 38:81-95. [PMID: 37384445 DOI: 10.1037/neu0000919] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 07/01/2023] Open
Abstract
OBJECTIVE Diffusion decision modeling (DDM) is a validated cognitive modeling method that has been used to provide insights into why older adults are slower than younger adults on a wide variety of cognitive tasks. DDM results have shown that increased processing time, caution, and sensorimotor factors have explained most of this slowing. Enhanced attentional processing of irrelevant information by older adults has also been reported in DDM studies but not explicitly studied. This enhanced processing of interference has been attributed to a motivational goal-directed decision to minimize errors by increasing accumulation of information (i.e., caution) rather than neurocognitive changes associated with aging. No DDM study has explicitly investigated interference and aging by comparing single task and dual performance within the framework of attentional control to explore more fully what and how attentional processes are involved. Our study attempts to fill these gaps. METHOD We used a choice response time (RT) task of attentional switching with and without interference and applied the EZ-diffusion model on the data of 117 healthy younger and older adults aged 18-87. RESULTS Repeated mixed-measures analyses of variance of DDM parameters found that longer nondecision time was the main driver for longer RTs for older adults on both attentional switch tasks, but more prominently on the attentional switch trials of the dual task. CONCLUSIONS Processing interference before the decision to switch attention was the main driver of increased RTs for older adults. Rather than motivational goal-directed factors for error minimization (i.e., caution), findings supported neurocognitive and inhibition deficit explanations. Future DDM studies into cognition and aging could consider how difficulties inhibiting interference impacts on the cognitive processes under investigation and whether the concept of caution is applicable. Findings raise functional considerations for older adults on visually oriented tasks that require attentional switching (e.g., work vs. driving). (PsycInfo Database Record (c) 2023 APA, all rights reserved).
Collapse
|
6
|
An extension of the shifted Wald model of human response times: Capturing the time dynamic properties of human cognition : Trial-varying Wald model. Psychon Bull Rev 2023:10.3758/s13423-023-02418-8. [PMID: 38049574 DOI: 10.3758/s13423-023-02418-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 10/21/2023] [Indexed: 12/06/2023]
Abstract
Despite the ubiquitous nature of evidence accumulation models in cognitive and experimental psychology, there has been a comparatively limited uptake of such techniques in the applied literature. While quantifying latent cognitive processing properties has significant potential for applied domains such as adaptive work systems, accumulator models often fall short in practical applications. Two primary reasons for these shortcomings are the complexities and time needed for the application of cognitive models, and the failure of current models to capture systematic trial-to-trial variability in parameters. In this manuscript, we develop a novel, trial-varying extension of the shifted Wald model to address these concerns. By leveraging conjugate properties of the Wald distribution, we derive computationally efficient solutions for threshold and drift parameters which can be updated instantaneously with new data. The resulting model allows the quantification of systematic variation in latent cognitive parameters across trials and we demonstrate the utility of such analyses through simulations and an exemplar application to an existing data set. The analytic nature of our solutions opens the door for real-world applications, significantly extending the reach of computational models of behavioral responses.
Collapse
|
7
|
Does allowing for changes of mind influence initial responses? Psychon Bull Rev 2023:10.3758/s13423-023-02371-6. [PMID: 37884778 DOI: 10.3758/s13423-023-02371-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 08/11/2023] [Indexed: 10/28/2023]
Abstract
Evidence accumulation models (EAMs) have become the dominant theoretical framework for rapid decision-making, and while many theoretically distinct variants exist, comparisons have proved challenging due to strong mimicry in their predictions about choice response time data. One solution to reduce mimicry is constraining these models with double responses, which are a second response that is made after the initial response. However, instructing participants that they are allowed to change their mind could influence their strategy for initial responding, meaning that explicit double responding paradigms may not generalise to standard paradigms. Here, we provide a validation of explicit double responding paradigms, by assessing whether participants' initial decisions - as measured by diffusion model parameters - differ based on whether or not they were instructed that they could change their response after their initial response. Across three experiments, our results consistently indicate that allowing for changes of mind does not influence initial responses, with Bayesian analyses providing at least moderate evidence in favour of the null in all cases. Our findings suggest that explicit double responding paradigms should generalise to standard paradigms, validating the use of explicit double responding in future rapid decision-making studies.
Collapse
|
8
|
Inclusion Bayes factors for mixed hierarchical diffusion decision models. Psychol Methods 2023:2023-71555-001. [PMID: 37166854 DOI: 10.1037/met0000582] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Grants] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 05/12/2023]
Abstract
Cognitive models provide a substantively meaningful quantitative description of latent cognitive processes. The quantitative formulation of these models supports cumulative theory building and enables strong empirical tests. However, the nonlinearity of these models and pervasive correlations among model parameters pose special challenges when applying cognitive models to data. Firstly, estimating cognitive models typically requires large hierarchical data sets that need to be accommodated by an appropriate statistical structure within the model. Secondly, statistical inference needs to appropriately account for model uncertainty to avoid overconfidence and biased parameter estimates. In the present work, we show how these challenges can be addressed through a combination of Bayesian hierarchical modeling and Bayesian model averaging. To illustrate these techniques, we apply the popular diffusion decision model to data from a collaborative selective influence study. (PsycInfo Database Record (c) 2023 APA, all rights reserved).
Collapse
|
9
|
Neuro-computational mechanisms and individual biases in action-outcome learning under moral conflict. Nat Commun 2023; 14:1218. [PMID: 36878911 PMCID: PMC9988878 DOI: 10.1038/s41467-023-36807-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/25/2021] [Accepted: 02/17/2023] [Indexed: 03/08/2023] Open
Abstract
Learning to predict action outcomes in morally conflicting situations is essential for social decision-making but poorly understood. Here we tested which forms of Reinforcement Learning Theory capture how participants learn to choose between self-money and other-shocks, and how they adapt to changes in contingencies. We find choices were better described by a reinforcement learning model based on the current value of separately expected outcomes than by one based on the combined historical values of past outcomes. Participants track expected values of self-money and other-shocks separately, with the substantial individual difference in preference reflected in a valuation parameter balancing their relative weight. This valuation parameter also predicted choices in an independent costly helping task. The expectations of self-money and other-shocks were biased toward the favored outcome but fMRI revealed this bias to be reflected in the ventromedial prefrontal cortex while the pain-observation network represented pain prediction errors independently of individual preferences.
Collapse
|
10
|
The bovine foot skin microbiota is associated with host genotype and the development of infectious digital dermatitis lesions. MICROBIOME 2023; 11:4. [PMID: 36624507 PMCID: PMC9830885 DOI: 10.1186/s40168-022-01440-7] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 02/10/2022] [Accepted: 11/30/2022] [Indexed: 06/17/2023]
Abstract
BACKGROUND Bovine Digital Dermatitis (BDD) is a prevalent infectious disease, causing painful foot skin lesions and lameness in cattle. We describe herein the bovine foot skin microbiota and its associations with BDD using 16S rRNA gene amplicon and shotgun metagenomic sequencing on samples from 259 dairy cows from three UK dairy farms. RESULTS We show evidence of dysbiosis, and differences in taxonomy and functional profiles in the bovine foot skin microbiome of clinically healthy animals that subsequently develop BDD lesions, compared to those that do not. Our results suggest that taxonomical and functional differences together with alterations in ecological interactions between bacteria in the normal foot skin microbiome may predispose an animal to develop BDD lesions. Using genome-wide association and regional heritability mapping approaches, we provide first evidence for interactions between host genotype and certain members of the foot skin microbiota. We show the existence of significant genetic variation in the relative abundance of Treponema spp. and Peptoclostridium spp. and identify regions in the bovine genome that explain a significant proportion of this variation. CONCLUSIONS Collectively this work shows early changes in taxonomic and functional profiles of the bovine foot-skin microbiota in clinically healthy animals which are associated with subsequent development of BDD and could be relevant to prevention of disease. The description of host genetic control of members of the foot skin microbiota, combined with the association of the latter with BDD development offer new insights into a complex relationship that can be exploited in selective breeding programmes. Video Abstract.
Collapse
|
11
|
Efficiency in sequential testing: Comparing the sequential probability ratio test and the sequential Bayes factor test. Behav Res Methods 2022; 54:3100-3117. [PMID: 35233752 PMCID: PMC9729330 DOI: 10.3758/s13428-021-01754-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 11/16/2021] [Indexed: 12/16/2022]
Abstract
In a sequential hypothesis test, the analyst checks at multiple steps during data collection whether sufficient evidence has accrued to make a decision about the tested hypotheses. As soon as sufficient information has been obtained, data collection is terminated. Here, we compare two sequential hypothesis testing procedures that have recently been proposed for use in psychological research: Sequential Probability Ratio Test (SPRT; Psychological Methods, 25(2), 206-226, 2020) and the Sequential Bayes Factor Test (SBFT; Psychological Methods, 22(2), 322-339, 2017). We show that although the two methods have different philosophical roots, they share many similarities and can even be mathematically regarded as two instances of an overarching hypothesis testing framework. We demonstrate that the two methods use the same mechanisms for evidence monitoring and error control, and that differences in efficiency between the methods depend on the exact specification of the statistical models involved, as well as on the population truth. Our simulations indicate that when deciding on a sequential design within a unified sequential testing framework, researchers need to balance the needs of test efficiency, robustness against model misspecification, and appropriate uncertainty quantification. We provide guidance for navigating these design decisions based on individual preferences and simulation-based design analyses.
Collapse
|
12
|
A model-based approach to disentangling facilitation and interference effects in conflict tasks. Psychol Rev 2022; 129:1183-1209. [PMID: 35482645 DOI: 10.1037/rev0000357] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
Abstract
Conflict tasks have become one of the most dominant paradigms within cognitive psychology, with their key finding being the conflict effect: That participants are slower and less accurate when task-irrelevant information conflicts with task-relevant information (i.e., incompatible trials), compared to when these sources of information are consistent (i.e., compatible trials). However, the conflict effect can consist of two separate effects: Facilitation effects, which is the amount of benefit provided by consistent task-irrelevant information, and interference effects, which is the amount of impairment caused by conflicting task-irrelevant information. While previous studies have attempted to disentangle these effects using neutral trials, which contrast compatible and incompatible trials to trials that are designed to have neutral task-irrelevant information, these analyses rely on the assumptions of Donder's subtractive method, which are difficult to verify and may be violated in some circumstances. Here, we develop a model-based approach for disentangling facilitation and interference effects, which extends the existing diffusion model for conflict tasks (DMC) framework to allow for different levels of automatic activation in compatible and incompatible trials. Comprehensive parameter recovery assessments display the robust measurement properties of our model-based approach, which we apply to nine previous data sets from the flanker (6) and Simon (3) tasks. Our findings suggest asymmetric facilitation and interference effects, where interference effects appear to be present for most participants across most studies, whereas facilitation effects appear to be small or nonexistent. We believe that our novel model-based approach provides an important step forward for understanding how information processing operates in conflict tasks, allowing researchers to assess the convergence or divergence between experimental-based (i.e., neutral trials) and model-based approaches when investigating facilitation and interference effects. (PsycInfo Database Record (c) 2022 APA, all rights reserved).
Collapse
|
13
|
Behavioural and neural indices of perceptual decision-making in autistic children during visual motion tasks. Sci Rep 2022; 12:6072. [PMID: 35414064 PMCID: PMC9005733 DOI: 10.1038/s41598-022-09885-4] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/04/2022] [Accepted: 03/14/2022] [Indexed: 11/30/2022] Open
Abstract
Many studies report atypical responses to sensory information in autistic individuals, yet it is not clear which stages of processing are affected, with little consideration given to decision-making processes. We combined diffusion modelling with high-density EEG to identify which processing stages differ between 50 autistic and 50 typically developing children aged 6-14 years during two visual motion tasks. Our pre-registered hypotheses were that autistic children would show task-dependent differences in sensory evidence accumulation, alongside a more cautious decision-making style and longer non-decision time across tasks. We tested these hypotheses using hierarchical Bayesian diffusion models with a rigorous blind modelling approach, finding no conclusive evidence for our hypotheses. Using a data-driven method, we identified a response-locked centro-parietal component previously linked to the decision-making process. The build-up in this component did not consistently relate to evidence accumulation in autistic children. This suggests that the relationship between the EEG measure and diffusion-modelling is not straightforward in autistic children. Compared to a related study of children with dyslexia, motion processing differences appear less pronounced in autistic children. Exploratory analyses also suggest weak evidence that ADHD symptoms moderate perceptual decision-making in autistic children.
Collapse
|
14
|
Visual Motion and Decision-Making in Dyslexia: Reduced Accumulation of Sensory Evidence and Related Neural Dynamics. J Neurosci 2022; 42:121-134. [PMID: 34782439 PMCID: PMC8741156 DOI: 10.1523/jneurosci.1232-21.2021] [Citation(s) in RCA: 8] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/15/2021] [Revised: 09/15/2021] [Accepted: 09/20/2021] [Indexed: 11/21/2022] Open
Abstract
Children with and without dyslexia differ in their behavioral responses to visual information, particularly when required to pool dynamic signals over space and time. Importantly, multiple processes contribute to behavioral responses. Here we investigated which processing stages are affected in children with dyslexia when performing visual motion processing tasks, by combining two methods that are sensitive to the dynamic processes leading to responses. We used a diffusion model which decomposes response time and accuracy into distinct cognitive constructs, and high-density EEG. Fifty children with dyslexia (24 male) and 50 typically developing children (28 male) 6-14 years of age judged the direction of motion as quickly and accurately as possible in two global motion tasks (motion coherence and direction integration), which varied in their requirements for noise exclusion. Following our preregistered analyses, we fitted hierarchical Bayesian diffusion models to the data, blinded to group membership. Unblinding revealed reduced evidence accumulation in children with dyslexia compared with typical children for both tasks. Additionally, we identified a response-locked EEG component which was maximal over centro-parietal electrodes which indicated a neural correlate of reduced drift rate in dyslexia in the motion coherence task, thereby linking brain and behavior. We suggest that children with dyslexia tend to be slower to extract sensory evidence from global motion displays, regardless of whether noise exclusion is required, thus furthering our understanding of atypical perceptual decision-making processes in dyslexia.SIGNIFICANCE STATEMENT Reduced sensitivity to visual information has been reported in dyslexia, with a lively debate about whether these differences causally contribute to reading difficulties. In this large preregistered study with a blind modeling approach, we combine state-of-the art methods in both computational modeling and EEG analysis to pinpoint the stages of processing that are atypical in children with dyslexia in two visual motion tasks that vary in their requirement for noise exclusion. We find reduced evidence accumulation in children with dyslexia across both tasks, and identify a neural marker, allowing us to link brain and behavior. We show that children with dyslexia exhibit general difficulties with extracting sensory evidence from global motion displays, not just in tasks that require noise exclusion.
Collapse
|
15
|
Preregistration in diverse contexts: a preregistration template for the application of cognitive models. ROYAL SOCIETY OPEN SCIENCE 2021; 8:210155. [PMID: 34659776 PMCID: PMC8511762 DOI: 10.1098/rsos.210155] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/29/2021] [Accepted: 08/16/2021] [Indexed: 05/20/2023]
Abstract
In recent years, open science practices have become increasingly popular in psychology and related sciences. These practices aim to increase rigour and transparency in science as a potential response to the challenges posed by the replication crisis. Many of these reforms-including the increasingly used preregistration-have been designed for purely experimental work that tests straightforward hypotheses with standard inferential statistical analyses, such as assessing whether an experimental manipulation has an effect on a variable of interest. But psychology is a diverse field of research. The somewhat narrow focus of the prevalent discussions surrounding and templates for preregistration has led to debates on how appropriate these reforms are for areas of research with more diverse hypotheses and more intricate methods of analysis, such as cognitive modelling research within mathematical psychology. Our article attempts to bridge the gap between open science and mathematical psychology, focusing on the type of cognitive modelling that Crüwell et al. (Crüwell S, Stefan AM, Evans NJ. 2019 Robust standards in cognitive science. Comput. Brain Behav. 2, 255-265) labelled model application, where researchers apply a cognitive model as a measurement tool to test hypotheses about parameters of the cognitive model. Specifically, we (i) discuss several potential researcher degrees of freedom within model application, (ii) provide the first preregistration template for model application and (iii) provide an example of a preregistered model application using our preregistration template. More broadly, we hope that our discussions and concrete proposals constructively advance the mostly abstract current debate surrounding preregistration in cognitive modelling, and provide a guide for how preregistration templates may be developed in other diverse or intricate research contexts.
Collapse
|
16
|
A diffusion model decomposition of motion processing performance in children with dyslexia and related neural dynamics. J Vis 2021. [DOI: 10.1167/jov.21.9.2921] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/24/2022] Open
|
17
|
Abstract
This article presents a theory in which motor execution in perceptual decision-making tasks is determined by the same evolving decision variable that drives response time. The theory builds upon recent insights from the neuroscience of decision-making and motor control. It is formalized as an extension of Ratcliff's diffusion model, and assumes that two thresholds operate on the evidence accumulation decision variable. The first threshold, referred to as electromyographic (EMG) threshold, marks the onset of electrical activity in the response-relevant muscle and the beginning of force production. The second threshold corresponds to the response. The theory makes several benchmark predictions. Notably, the mean duration of motor execution, as quantified by the mean latency between EMG onset and the response, should depend on the rate of evidence accumulation, and should thus increase as the perceptual difficulty of the task increases. We tested these predictions in a paradigmatic perceptual decision-making task, the random dot motion task, and recorded the EMG activity of response-relevant muscles. The behavioral and EMG data provide very strong evidence for each prediction. A final quantitative evaluation of the model showed good fits to these data. The theory resolves conflicting findings in the fields of mathematical psychology, motor control, and decision neurosciences. (PsycInfo Database Record (c) 2021 APA, all rights reserved).
Collapse
|
18
|
A Broader Application of the Detection Response Task to Cognitive Tasks and Online Environments. HUMAN FACTORS 2021; 63:896-909. [PMID: 32749155 DOI: 10.1177/0018720820936800] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/11/2023]
Abstract
OBJECTIVE The present research applied a well-established measure of cognitive workload in driving literature to an in-lab paradigm. We then extended this by comparing the in-lab version of the task to an online version. BACKGROUND The accurate and objective measurement of cognitive workload is important in many aspects of psychological research. The detection response task (DRT) is a well-validated method for measuring cognitive workload that has been used extensively in applied tasks, for example, to investigate the effects of phone usage or passenger conversation on driving, but has been used sparingly outside of this field. METHOD The study investigated whether the DRT could be used to measure cognitive workload in tasks more commonly used in experimental cognitive psychology and whether this application could be extended to online environments. We had participants perform a multiple object tracking (MOT) task while simultaneously performing a DRT. We manipulated the cognitive load of the MOT task by changing the number of dots to be tracked. RESULTS Measurements from the DRT were sensitive to changes in the cognitive load, establishing the efficacy of the DRT for experimental cognitive tasks in lab-based situations. This sensitivity continued when applied to an online environment (our code for the online DRT implementation is freely available at https://osf.io/dc39s/), though to a reduced extent compared to the in-lab situation. CONCLUSION The MOT task provides an effective manipulation of cognitive workload. The DRT is sensitive to changes in workload across a range of settings and is suitable to use outside of driving scenarios, as well as via online delivery. APPLICATION Methodology shows how the DRT could be used to measure sources of cognitive workload in a range of human factors contexts.
Collapse
|
19
|
Abstract
Despite the increasing popularity of Bayesian inference in empirical research, few practical guidelines provide detailed recommendations for how to apply Bayesian procedures and interpret the results. Here we offer specific guidelines for four different stages of Bayesian statistical reasoning in a research setting: planning the analysis, executing the analysis, interpreting the results, and reporting the results. The guidelines for each stage are illustrated with a running example. Although the guidelines are geared towards analyses performed with the open-source statistical software JASP, most guidelines extend to Bayesian inference in general.
Collapse
|
20
|
Snake scales record environmental metal(loid) contamination. ENVIRONMENTAL POLLUTION (BARKING, ESSEX : 1987) 2021; 274:116547. [PMID: 33548672 DOI: 10.1016/j.envpol.2021.116547] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/04/2020] [Revised: 01/11/2021] [Accepted: 01/16/2021] [Indexed: 06/12/2023]
Abstract
Wetland snakes, as top predators, are becoming globally recognised as bioindicators of wetland contamination. Livers are the traditional test organ for contaminant exposure in organisms, but research is moving towards a preference for non-lethal tissue sampling. Snake scales can be used as an indicator of exposure, as many metals bind to the keratin. We used laser ablation with inductively coupled plasma-atomic emission spectroscopy and mass spectrometry (LA-ICP-MS) to quantify the concentrations of 19 metals and metalloids (collectively referred to 'metals' hereafter) in Western tiger snake (Notechis scutatus occidentalis) scales from four wetlands along an urban gradient, and compared them to concentrations measured in captive tiger snake scales. We conducted repeat measures to determine the concentration accuracy of each metal using LA-ICP-MS. Concentrations in wild Western tiger snake scales were significantly higher than in reference tiger snake scales for most metals analysed, suggesting accumulation from environmental exposure. We compared the scale concentrations to sediment concentrations of sampled wetlands, and found inter-site differences between mean concentrations of metals in scales parallel patterns recorded from sediment. Four metals (Mn, As, Se, Sb) had strong positive correlations with liver tissue contents suggesting scale concentrations can be used to infer internal concentrations. By screening for a larger suite of metals than we could using traditional digestive methods, we identified additional metals (Ti, V, Sr, Cs, Tl, Th, U) that may be accumulating to levels of concern in tiger snakes in Perth, Western Australia. This research has progressed the use of LA-ICP-MS for quantifying a suite of metals available in snake scales, and highlights the significance of using wetland snake scales as a non-lethal indicator of environmental contamination.
Collapse
|
21
|
The impact of presentation order on attraction and repulsion effects in decision-making. DECISION 2021. [DOI: 10.1037/dec0000144] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
|
22
|
Systematic and random sources of variability in perceptual decision-making: Comment on Ratcliff, Voskuilen, and McKoon (2018). Psychol Rev 2020; 127:932-944. [PMID: 33074702 DOI: 10.1037/rev0000192] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
Abstract
A key assumption of models of human cognition is that there is variability in information processing. Evidence accumulation models (EAMs) commonly assume 2 broad variabilities in information processing: within-trial variability, which is thought to reflect moment-to-moment fluctuations in perceptual processes, and between-trial variability, which is thought to reflect variability in slower-changing processes like attention, or systematic variability between the stimuli on different trials. Recently, Ratcliff, Voskuilen, and McKoon (2018) claimed to "provide direct evidence that external noise is, in fact, required to explain the data from five simple two-choice decision tasks" (p. 33), suggesting that at least some portion of the between-trial variability in information processing is due to "noise." However, we argue that Ratcliff et al. (2018) failed to distinguish between 2 different potential sources of between-trial variability: random (i.e., "external noise") and systematic (e.g., item effects). Contrary to the claims of Ratcliff et al. (2018), we show that "external noise" is not required to explain their findings, as the same trends of data can be produced when only item effects are present. Furthermore, we contend that the concept of "noise" within cognitive models merely serves as a convenience parameter for sources of variability that we know exist but are unable to account for. Therefore, we question the usefulness of experiments aimed at testing the general existence of "random" variability and instead suggest that future research should attempt to replace the random variability terms within cognitive models with actual explanations of the process. (PsycInfo Database Record (c) 2020 APA, all rights reserved).
Collapse
|
23
|
Abstract
The Bayesian statistical framework requires the specification of prior distributions, which reflect predata knowledge about the relative plausibility of different parameter values. As prior distributions influence the results of Bayesian analyses, it is important to specify them with care. Prior elicitation has frequently been proposed as a principled method for deriving prior distributions based on expert knowledge. Although prior elicitation provides a theoretically satisfactory method of specifying prior distributions, there are several implicit decisions that researchers need to make at different stages of the elicitation process, each of them constituting important researcher degrees of freedom. Here, we discuss some of these decisions and group them into 3 categories: decisions about (a) the setup of the prior elicitation; (b) the core elicitation process; and (c) combination of elicited prior distributions from different experts. Importantly, different decision paths could result in greatly varying priors elicited from the same experts. Hence, researchers who wish to perform prior elicitation are advised to carefully consider each of the practical decisions before, during, and after the elicitation process. By explicitly outlining the consequences of these practical decisions, we hope to raise awareness for methodological flexibility in prior elicitation and provide researchers with a more structured approach to navigate the decision paths in prior elicitation. Making the decisions explicit also provides the foundation for further research that can identify evidence-based best practices that may eventually reduce the methodologically flexibility in prior elicitation. (PsycInfo Database Record (c) 2020 APA, all rights reserved).
Collapse
|
24
|
Removal of bovine digital dermatitis-associated treponemes from hoof knives after foot-trimming: a disinfection field study. BMC Vet Res 2020; 16:330. [PMID: 32917195 PMCID: PMC7488572 DOI: 10.1186/s12917-020-02552-8] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/04/2020] [Accepted: 08/31/2020] [Indexed: 12/15/2022] Open
Abstract
Background Bovine digital dermatitis (BDD) is an infectious foot disease found commonly in dairy herds. Foot-trimming is an important husbandry procedure for reducing the ensuing lameness; however, epidemiological, and microbiological studies have identified this as a risk activity for transmitting BDD. Three disinfectants have previously been identified in laboratory work as effective for removing viable BDD-associated Treponema spp., from hoof knife blades. The present study enrolled 133 dairy cattle with BDD lesions, and swabbed hoof knife blades before and after foot-trimming, and after knife disinfection with one of three disinfectants (1:100 FAM30®, 2% Virkon® and 2% sodium hypochlorite) to assess their efficacy under field conditions. Results Detection of BDD treponeme phylogroup DNA was undertaken by direct PCR of swabs, and viable treponemes were detected by PCR of swab cultures after 6 weeks’ incubation. Where hoof knives did not contact the lesion, BDD-associated treponemes were detected after foot-trimming in 12/22 (54.5%) cases by direct PCR and 1/22 (4.5%) cases by PCR of cultured organisms. Where contact was made with the lesion, 111/111 (100%) samples taken after trimming were positive by direct PCR and 47/118 (39.8%) were positive by culture PCR. Viable organisms were identified in cultures from lesion stages M2, M3, M4 and M4.1. No viable organisms were detected after disinfection of hoof knives. Conclusions Hoof knives post-trimming were frequently contaminated with BDD-associated treponeme DNA. Viable organisms were identified in cultures whether contact had been made between hoof knife and lesion or not, although contact clearly increased the frequency of detection of viable organisms. The three disinfectants tested were effective for removing viable organisms. The disinfection protocol used in this study should therefore be considered reliable for adoption as standard industry practice.
Collapse
|
25
|
Urgency, leakage, and the relative nature of information processing in decision-making. Psychol Rev 2020; 128:160-186. [PMID: 32852976 DOI: 10.1037/rev0000255] [Citation(s) in RCA: 14] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
Abstract
Over the last decade, there has been a robust debate in decision neuroscience and psychology about what mechanism governs the time course of decision-making. Historically, the most prominent hypothesis is that neural architectures accumulate information over time until some threshold is met, the so-called Evidence Accumulation hypothesis. However, most applications of this theory rely on simplifying assumptions, belying a number of potential complexities. Is changing stimulus information perceived and processed in an independent manner or is there a relative component? Does urgency play a role? What about evidence leakage? Although the latter questions have been the subject of recent investigations, most studies to date have been piecemeal in nature, addressing one aspect of the decision process or another. Here we develop a modeling framework, an extension of the Urgency Gating Model, in conjunction with a changing information experimental paradigm to simultaneously probe these aspects of the decision process. Using state-of-the-art Bayesian methods to perform parameter-based inference, we find that (a) information processing is relative with early information influencing the perception of late information, (b) time varying urgency and evidence accumulation are of roughly equal strength in the decision process, and (c) leakage is present with a time scale of ∼200-250 ms. We also show that these effects can only be identified in a changing information paradigm. To our knowledge, this is the first comprehensive study to utilize a changing information paradigm to jointly and quantitatively estimate the temporal dynamics of human decision-making. (PsycInfo Database Record (c) 2020 APA, all rights reserved).
Collapse
|
26
|
Abstract
The diffusion decision model (DDM) has been used to investigate the effects of aging on information processing in simple response time (RT) tasks. These analyses have consistently shown that the age-related slowing of RTs can be accounted for by slower processing speed in sensorimotor systems and more cautious responding. However, previous DDM assessments of aging have ignored conflict tasks (e.g., the flanker task), the dominant paradigm for investigating age-related differences in executive control, as the DDM is unable to combine task-relevant and task-irrelevant stimulus information. Our study used two recently developed extensions of the DDM-the diffusion model for conflict tasks (DMC) and the shrinking spotlight diffusion model (SSP)-to provide the first model-based assessment of age-related differences in a flanker task featuring a manipulation of the spacing between target and flanking letters. Consistent with previous findings, older adults were globally slower than younger adults, and the magnitude of the flanker effect was larger for older than younger adults only when the spacing between the target and flanking letters was small. Fits of the models to data revealed a superiority of the DMC over the SSP. The DMC accounts for experimental findings with a 62-ms slowing of the nondecision component of RT for older compared to younger adults, a more cautious decision criterion, and enhanced processing of the target and flanking letters in the near periphery, suggesting a stronger attentional engagement in the task. (PsycInfo Database Record (c) 2020 APA, all rights reserved).
Collapse
|
27
|
Novel ulcerative leg lesions in yearling lambs: Clinical features, microbiology and histopathology. Vet Microbiol 2020; 247:108790. [PMID: 32768234 PMCID: PMC7429982 DOI: 10.1016/j.vetmic.2020.108790] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/04/2020] [Revised: 07/02/2020] [Accepted: 07/06/2020] [Indexed: 11/29/2022]
Abstract
An outbreak of an infectious dermatological disorder of unknown aetiology in a flock of yearling lambs was investigated. Lesions occurred on the distal limb between the coronary band and carpel joint as a circular ulcerative dermatitis. Treponema spp., Dichelobacter nodosus, Staphylococcus aureus, Dermatophilus congolensis and poxvirus screens were negative. Fusobacterium necrophorum and Streptococcus dysgalactiae were detected in the majority of lesions examined. An aetiology involving bacterial infection with F. necrophorum and S. dysgalactiae was implicated.
Here we report an outbreak of an atypical, ulcerative dermatitis in North Country mule lambs, located in South Gloucestershire, UK. The lesions, which appeared to be contagious, occured between the coronary band and the carpal joint as a focal, well demarcated, circular, ulcerative dermatitis. Histopathological examination of the lesion biopsies revealed areas of ulceration, epidermal hyperplasia, suppurative dermatitis and granulation tissue. Clumped keratohyalin granules and intracellular keratinocyte oedema (ballooning degeneration) were evident within lesion biopsies, consistent with an underlying viral aetiology. A PCR-based microbiological investigation failed to detect bovine digital dermatitis-associated treponeme phylogroups, Dichelobacter nodosus, Staphylococcus aureus, Dermatophilus congolensis or Chordopoxvirinae virus DNA. However, 3 of the 10 (30 %) and 6 of 10 (60 %) lesion samples were positive for Fusobacterium necrophorum and Streptococcus dysgalactiae DNA, respectively. Contralateral limb swabs were negative by all standard PCR assays. To better define the involvement of F. necrophorum in the aetiology of these lesions, a qPCR targeting the rpoB gene was employed and confirmed the presence of F. necrophorum DNA in both the control and lesions swab samples, although the mean F. necrophorum genome copy number detected in the lesion swab samples was ∼19-fold higher than detected in the contralateral control swab samples (245 versus 4752 genome copies/μl, respectively; P < 0.001). Although we have not been able to conclusively define an aetiological agent, the presence of both F. necrophorum and S. dysgalactiae in the majority of lesions assayed supports their role in the aetiopathogenesis of these lesions.
Collapse
|
28
|
Strong Effort Manipulations Reduce Response Caution: A Preregistered Reinvention of the Ego-Depletion Paradigm. Psychol Sci 2020; 31:531-547. [PMID: 32315259 PMCID: PMC7238509 DOI: 10.1177/0956797620904990] [Citation(s) in RCA: 40] [Impact Index Per Article: 10.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/15/2022] Open
Abstract
People feel tired or depleted after exerting mental effort. But even
preregistered studies often fail to find effects of exerting effort on
behavioral performance in the laboratory or elucidate the underlying psychology.
We tested a new paradigm in four preregistered within-subjects studies
(N = 686). An initial high-demand task reliably elicited
very strong effort phenomenology compared with a low-demand task. Afterward,
participants completed a Stroop task. We used drift-diffusion modeling to obtain
the boundary (response caution) and drift-rate (information-processing speed)
parameters. Bayesian analyses indicated that the high-demand manipulation
reduced boundary but not drift rate. Increased effort sensations further
predicted reduced boundary. However, our demand manipulation did not affect
subsequent inhibition, as assessed with traditional Stroop behavioral measures
and additional diffusion-model analyses for conflict tasks. Thus, effort
exertion reduced response caution rather than inhibitory control, suggesting
that after exerting effort, people disengage and become uninterested in exerting
further effort.
Collapse
|
29
|
Double responding: A new constraint for models of speeded decision making. Cogn Psychol 2020; 121:101292. [PMID: 32217348 DOI: 10.1016/j.cogpsych.2020.101292] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/14/2019] [Revised: 02/05/2020] [Accepted: 02/26/2020] [Indexed: 11/30/2022]
Abstract
Evidence accumulation models (EAMs) have become the dominant models of speeded decision making, which are able to decompose choices and response times into cognitive parameters that drive the decision process. Several models within the EAM framework contain fundamentally different ideas of how the decision making process operates, though previous assessments have found that these models display a high level of mimicry, which has hindered the ability of researchers to contrast these different theoretical viewpoints. Our study introduces a neglected phenomenon that we term "double responding", which can help to further constrain these models. We show that double responding produces several interesting benchmarks, and that the predictions of different EAMs can be distinguished in standard experiment paradigms when they are constrained to account for the choice response time distributions and double responding behaviour in unison. Our findings suggest that lateral inhibition (e.g., the leaky-competing accumulator) provides models with a universal ability to make accurate predictions for these data. Furthermore, only models containing feed-forward inhibition (e.g., the diffusion model) performed poorly under both of our proposed extensions of the standard EAM framework to double responding, suggesting a general inability of feed-forward inhibition to accurately predict these data. We believe that our study provides an important step forward in further constraining models of speeded decision making, though additional research on double responding is required before broad conclusions are made about which models provide the best explanation of the underlying decision-making process.
Collapse
|
30
|
A comparison of conflict diffusion models in the flanker task through pseudolikelihood Bayes factors. Psychol Rev 2019; 127:114-135. [PMID: 31599635 DOI: 10.1037/rev0000165] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
Abstract
Conflict tasks are one of the most widely studied paradigms within cognitive psychology, where participants are required to respond based on relevant sources of information while ignoring conflicting irrelevant sources of information. The flanker task, in particular, has been the focus of considerable modeling efforts, with only 3 models being able to provide a complete account of empirical choice response time distributions: the dual-stage 2-phase model (DSTP), the shrinking spotlight model (SSP), and the diffusion model for conflict tasks (DMC). Although these models are grounded in different theoretical frameworks, can provide diverging measures of cognitive control, and are quantitatively distinguishable, no previous study has compared all 3 of these models in their ability to account for empirical data. Here, we perform a comparison of the precise quantitative predictions of these models through Bayes factors, using probability density approximation to generate a pseudolikelihood estimate of the unknown probability density function, and thermodynamic integration via differential evolution to approximate the analytically intractable Bayes factors. We find that for every participant across 3 data sets from 3 separate research groups, DMC provides an inferior account of the data to DSTP and SSP, which has important theoretical implications regarding cognitive processes engaged in the flanker task, and practical implications for applying the models to flanker data. More generally, we argue that our combination of probability density approximation with marginal likelihood approximation-which we term pseudolikelihood Bayes factors-provides a crucial step forward for the future of model comparison, where Bayes factors can be calculated between any models that can be simulated. We also discuss the limitations of simulation-based methods, such as the potential for approximation error, and suggest that researchers should use analytically or numerically computed likelihood functions when they are available and computationally tractable. (PsycINFO Database Record (c) 2019 APA, all rights reserved).
Collapse
|
31
|
Assessing Theoretical Conclusions With Blinded Inference to Investigate a Potential Inference Crisis. ADVANCES IN METHODS AND PRACTICES IN PSYCHOLOGICAL SCIENCE 2019. [DOI: 10.1177/2515245919869583] [Citation(s) in RCA: 16] [Impact Index Per Article: 3.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/15/2023]
Abstract
Scientific advances across a range of disciplines hinge on the ability to make inferences about unobservable theoretical entities on the basis of empirical data patterns. Accurate inferences rely on both discovering valid, replicable data patterns and accurately interpreting those patterns in terms of their implications for theoretical constructs. The replication crisis in science has led to widespread efforts to improve the reliability of research findings, but comparatively little attention has been devoted to the validity of inferences based on those findings. Using an example from cognitive psychology, we demonstrate a blinded-inference paradigm for assessing the quality of theoretical inferences from data. Our results reveal substantial variability in experts’ judgments on the very same data, hinting at a possible inference crisis.
Collapse
|
32
|
Assessing the practical differences between model selection methods in inferences about choice response time tasks. Psychon Bull Rev 2019; 26:1070-1098. [PMID: 30783896 PMCID: PMC6710222 DOI: 10.3758/s13423-018-01563-9] [Citation(s) in RCA: 22] [Impact Index Per Article: 4.4] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/29/2022]
Abstract
Evidence accumulations models (EAMs) have become the dominant modeling framework within rapid decision-making, using choice response time distributions to make inferences about the underlying decision process. These models are often applied to empirical data as "measurement tools", with different theoretical accounts being contrasted within the framework of the model. Some method is then needed to decide between these competing theoretical accounts, as only assessing the models on their ability to fit trends in the empirical data ignores model flexibility, and therefore, creates a bias towards more flexible models. However, there is no objectively optimal method to select between models, with methods varying in both their computational tractability and theoretical basis. I provide a systematic comparison between nine different model selection methods using a popular EAM-the linear ballistic accumulator (LBA; Brown & Heathcote, Cognitive Psychology 57(3), 153-178 2008)-in a large-scale simulation study and the empirical data of Dutilh et al. (Psychonomic Bulletin and Review, 1-19 2018). I find that the "predictive accuracy" class of methods (i.e., the Akaike Information Criterion [AIC], the Deviance Information Criterion [DIC], and the Widely Applicable Information Criterion [WAIC]) make different inferences to the "Bayes factor" class of methods (i.e., the Bayesian Information Criterion [BIC], and Bayes factors) in many, but not all, instances, and that the simpler methods (i.e., AIC and BIC) make inferences that are highly consistent with their more complex counterparts. These findings suggest that researchers should be able to use simpler "parameter counting" methods when applying the LBA and be confident in their inferences, but that researchers need to carefully consider and justify the general class of model selection method that they use, as different classes of methods often result in different inferences.
Collapse
|
33
|
Abstract
Theories of perceptual decision making have been dominated by the idea that evidence accumulates in favor of different alternatives until some fixed threshold amount is reached, which triggers a decision. Recent theories have suggested that these thresholds may not be fixed during each decision but change as time passes. These collapsing thresholds can improve performance in particular decision environments, but reviews of data from typical decision-making paradigms have failed to support collapsing thresholds. We designed three experiments to test collapsing threshold assumptions in decision environments specifically tailored to make them optimal. An emphasis on decision speed encouraged the adoption of collapsing thresholds-most strongly through the use of response deadlines but also through instruction to a lesser extent-but setting an explicit goal of reward rate optimality through both instructions and task design did not. Our results suggest that collapsing thresholds models of decision-making are inconsistent with human behaviour even in some situations where there are normative motivations for these models. (PsycINFO Database Record (c) 2020 APA, all rights reserved).
Collapse
|
34
|
|
35
|
Thermodynamic Integration and Steppingstone Sampling Methods for Estimating Bayes Factors: A Tutorial. JOURNAL OF MATHEMATICAL PSYCHOLOGY 2019; 89:67-86. [PMID: 30774151 PMCID: PMC6374050 DOI: 10.1016/j.jmp.2019.01.005] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/29/2023]
Abstract
One of the more principled methods of performing model selection is via Bayes factors. However, calculating Bayes factors requires marginal likelihoods, which are integrals over the entire parameter space, making estimation of Bayes factors for models with more than a few parameters a significant computational challenge. Here, we provide a tutorial review of two Monte Carlo techniques rarely used in psychology that efficiently compute marginal likelihoods: thermodynamic integration (Friel & Pettitt, 2008; Lartillot & Philippe, 2006) and steppingstone sampling (Xie, Lewis, Fan, Kuo, & Chen, 2011). The methods are general and can be easily implemented in existing MCMC code; we provide both the details for implementation and associated R code for the interested reader. While Bayesian toolkits implementing standard statistical analyses (e.g., JASP Team, 2017; Morey & Rouder, 2015) often compute Bayes factors for the researcher, those using Bayesian approaches to evaluate cognitive models are usually left to compute Bayes factors for themselves. Here, we provide examples of the methods by computing marginal likelihoods for a moderately complex model of choice response time, the Linear Ballistic Accumulator model (Brown & Heathcote, 2008), and compare them to findings of Evans and Brown (2017), who used a brute force technique. We then present a derivation of TI and SS within a hierarchical framework, provide results of a model recovery case study using hierarchical models, and show an application to empirical data. A companion R package is available at the Open Science Framework: https://osf.io/jpnb4.
Collapse
|
36
|
Abstract
The "law of practice"-a simple nonlinear function describing the relationship between mean response time (RT) and practice-has provided a practically and theoretically useful way of quantifying the speed-up that characterizes skill acquisition. Early work favored a power law, but this was shown to be an artifact of biases caused by averaging over participants who are individually better described by an exponential law. However, both power and exponential functions make the strong assumption that the speedup always proceeds at a steadily decreasing rate, even though there are sometimes clear exceptions. We propose a new law that can both accommodate an initial delay resulting in a slower-faster-slower rate of learning, with either power or exponential forms as limiting cases, and which can account for not only mean RT but also the effect of practice on the entire distribution of RT. We evaluate this proposal with data from a broad array of tasks using hierarchical Bayesian modeling, which pools data across participants while minimizing averaging artifacts, and using inference procedures that take into account differences in flexibility among laws. In a clear majority of paradigms our results supported a delayed exponential law. (PsycINFO Database Record
Collapse
|
37
|
When humans behave like monkeys: Feedback delays and extensive practice increase the efficiency of speeded decisions. Cognition 2019; 184:11-18. [DOI: 10.1016/j.cognition.2018.11.014] [Citation(s) in RCA: 13] [Impact Index Per Article: 2.6] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/29/2018] [Revised: 11/21/2018] [Accepted: 11/30/2018] [Indexed: 12/30/2022]
|
38
|
Some Evidence for an Association Between Early Life Adversity and Decision Urgency. Front Psychol 2019; 10:243. [PMID: 30804859 PMCID: PMC6377396 DOI: 10.3389/fpsyg.2019.00243] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/27/2018] [Accepted: 01/24/2019] [Indexed: 11/24/2022] Open
Abstract
The relationship between early life adversity and adult outcomes is traditionally investigated relative to risk and protective factors (e.g., resilience, cognitive appraisal), and poor self-control or decision-making. However, life history theory suggests this relationship may be adaptive-underpinned by mechanisms that use early environmental cues to alter the developmental trajectory toward more short-term strategies. These short-term strategies have some theoretical overlap with the most common process models of decision-making-evidence accumulation models-which model decision urgency as a decision threshold. The current study examined the relationship between decision urgency (through the linear ballistic accumulator) and early life adversity. A mixture of analysis methods, including a joint model analysis designed to explicitly account for uncertainty in estimated decision urgency values, revealed weak-to-strong evidence in favor of a relationship between decision urgency and early life adversity, suggesting a possible effect of life history strategy on even the most basic decisions.
Collapse
|
39
|
16S rRNA amplicon sequencing reveals a polymicrobial nature of complicated claw horn disruption lesions and interdigital phlegmon in dairy cattle. Sci Rep 2018; 8:15529. [PMID: 30341326 PMCID: PMC6195575 DOI: 10.1038/s41598-018-33993-9] [Citation(s) in RCA: 23] [Impact Index Per Article: 3.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/03/2018] [Accepted: 10/08/2018] [Indexed: 11/08/2022] Open
Abstract
Lameness represents an intractable problem for the dairy industry. Complicated claw horn disruption lesions, interdigital hyperplasia, and interdigital phlegmon are important lameness causing foot lesions. Their aetiology is multifactorial, but infectious processes are likely implicated in disease pathogenesis. Our aim was to investigate the bacterial profiles of these lesions using 16S rRNA gene sequencing of samples obtained from 51 cattle across ten farms in the UK. In this study, interdigital hyperplasia, interdigital hyperplasia with signs of interdigital dermatitis, interdigital phlegmon, complicated sole ulcers, complicated toe ulcers lesions, and complicated white line lesions were investigated; corresponding healthy skin control samples were also analysed. All diseased tissues displayed reduced microbial richness and diversity (as described by Chao1, Shannon, and Simpson alpha-diversity indices) compared to their healthy skin control samples. Our results confirm the association of Treponema spp with some of these disorders. Other anaerobic bacteria including Fusobacterium spp., Fastidiosipila spp. and Porphyromonas spp. were implicated in the aetiology of all these lesions with the exception of interdigital hyperplasia. Complicated claw horn disruption lesions, and interdigital phlegmon were found to have similar bacterial profiles. Such sharing of bacterial genera suggests many of the infectious agents detected in these foot lesions are acting opportunistically; this finding could contribute towards future treatment and control strategies.
Collapse
|
40
|
Modeling the Covariance Structure of Complex Datasets Using Cognitive Models: An Application to Individual Differences and the Heritability of Cognitive Ability. Cogn Sci 2018; 42:1925-1944. [PMID: 29873105 DOI: 10.1111/cogs.12627] [Citation(s) in RCA: 19] [Impact Index Per Article: 3.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/18/2017] [Revised: 03/03/2018] [Accepted: 05/02/2018] [Indexed: 11/27/2022]
Abstract
Understanding individual differences in cognitive performance is an important part of understanding how variations in underlying cognitive processes can result in variations in task performance. However, the exploration of individual differences in the components of the decision process-such as cognitive processing speed, response caution, and motor execution speed-in previous research has been limited. Here, we assess the heritability of the components of the decision process, with heritability having been a common aspect of individual differences research within other areas of cognition. Importantly, a limitation of previous work on cognitive heritability is the underlying assumption that variability in response times solely reflects variability in the speed of cognitive processing. This assumption has been problematic in other domains, due to the confounding effects of caution and motor execution speed on observed response times. We extend a cognitive model of decision-making to account for relatedness structure in a twin study paradigm. This approach can separately quantify different contributions to the heritability of response time. Using data from the Human Connectome Project, we find strong evidence for the heritability of response caution, and more ambiguous evidence for the heritability of cognitive processing speed and motor execution speed. Our study suggests that the assumption made in previous studies-that the heritability of cognitive ability is based on cognitive processing speed-may be incorrect. More generally, our methodology provides a useful avenue for future research in complex data that aims to analyze cognitive traits across different sources of related data, whether the relation is between people, tasks, experimental phases, or methods of measurement.
Collapse
|
41
|
The computations that support simple decision-making: A comparison between the diffusion and urgency-gating models. Sci Rep 2017; 7:16433. [PMID: 29180789 PMCID: PMC5703954 DOI: 10.1038/s41598-017-16694-7] [Citation(s) in RCA: 29] [Impact Index Per Article: 4.1] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/12/2016] [Accepted: 11/12/2017] [Indexed: 11/17/2022] Open
Abstract
We investigate a question relevant to the psychology and neuroscience of perceptual decision-making: whether decisions are based on steadily accumulating evidence, or only on the most recent evidence. We report an empirical comparison between two of the most prominent examples of these theoretical positions, the diffusion model and the urgency-gating model, via model-based qualitative and quantitative comparisons. Our findings support the predictions of the diffusion model over the urgency-gating model, and therefore, the notion that evidence accumulates without much decay. Gross qualitative patterns and fine structural details of the data are inconsistent with the notion that decisions are based only on the most recent evidence. More generally, we discuss some strengths and weaknesses of scientific methods that investigate quantitative models by distilling the formal models to qualitative predictions.
Collapse
|
42
|
Survival of contagious ovine digital dermatitis (CODD)-associated treponemes on disposable gloves after handling CODD-affected feet. Vet Rec 2017. [PMID: 28642342 PMCID: PMC5531218 DOI: 10.1136/vr.104228] [Citation(s) in RCA: 11] [Impact Index Per Article: 1.6] [Reference Citation Analysis] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/16/2022]
|
43
|
Abstract
Recently, Veksler, Myers, and Gluck (2015) proposed model flexibility analysis as a method that "aids model evaluation by providing a metric for gauging the persuasiveness of a given fit" (p. 755) Model flexibility analysis measures the complexity of a model in terms of the proportion of all possible data patterns it can predict. We show that this measure does not provide a reliable way to gauge complexity, which prevents model flexibility analysis from fulfilling either of the 2 aims outlined by Veksler et al. (2015): absolute and relative model evaluation. We also show that model flexibility analysis can even fail to correctly quantify complexity in the most clear cut case, with nested models. We advocate for the use of well-established techniques with these characteristics, such as Bayes factors, normalized maximum likelihood, or cross-validation, and against the use of model flexibility analysis. In the discussion, we explore 2 issues relevant to the area of model evaluation: the completeness of current model selection methods and the philosophical debate of absolute versus relative model evaluation. (PsycINFO Database Record
Collapse
|
44
|
Bovine ischaemic teat necrosis: a further potential role for digital dermatitis treponemes. Vet Rec 2016; 178:71. [PMID: 26743503 DOI: 10.1136/vr.103167] [Citation(s) in RCA: 15] [Impact Index Per Article: 1.9] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 12/01/2015] [Indexed: 11/04/2022]
Abstract
A recent outbreak of ischaemic teat necrosis (ITN) on mainland UK has resulted in large economic losses for dairy farmers. Typical cases start as an area of dry, thickened and encrusted skin on the medial aspect of the base of the teat, where the teat joins the udder, often with a fetid odour. The erosion spreads down the teat, often causing intense irritation, which in turn leads to more severely affected animals removing the entire teat. Due to the severity of ITN and the substantial economic costs to the industry, analyses were undertaken to ascertain if an infectious agent might be involved in the pathology. The study has considered a role for digital dermatitis (DD) treponemes in the aetiopathogenesis of ITN because, as well as being the prime bacteria associated with infectious lameness, they have been associated with a number of emerging skin diseases of cattle, including udder lesions. A high association between presence of DD-associated treponemes and incidence of ITN (19/22), compared with absence in the control population is reported. Furthermore, sequencing of the 16S rRNA gene of treponeme isolates supports the hypothesis that the identified treponemes are similar or identical to those isolated from classical foot DD lesions in cattle (and sheep). Further studies are required to allow effective targeted prevention measures and/or treatments to be developed.
Collapse
|
45
|
Bovine digital dermatitis: Current concepts from laboratory to farm. Vet J 2015; 211:3-13. [PMID: 27061657 DOI: 10.1016/j.tvjl.2015.10.028] [Citation(s) in RCA: 62] [Impact Index Per Article: 6.9] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/23/2014] [Revised: 02/27/2015] [Accepted: 10/08/2015] [Indexed: 11/28/2022]
Abstract
Bovine digital dermatitis (DD) is a severe infectious disease causing lameness in dairy cattle worldwide and is an important ruminant welfare problem that has considerable economic issues. Bovine DD is endemic in many regions worldwide and it is important to understand this major disease so that effective control strategies can be identified. There is substantial evidence that specific treponeme phylotypes play an important causative role in bovine DD. This review considers current research, including DD Treponema spp. investigations, associated DD pathobiology, and current and potential treatment and control options. Epidemiological data, alongside new microbiological data, help delineate important transmission routes and reservoirs of infection that allow effective interventions to be identified. Better on-farm housing hygiene, pasture access, routine footbathing and claw trimming with disinfected equipment need to be implemented to significantly reduce the incidence of DD. There is a paucity of peer reviewed research into both commonly used and novel treatments. In vitro antimicrobial susceptibility studies of DD treponemes and effective treatment of human treponematoses clearly indicate that antibiotics frequently selected for DD treatments are not the most efficacious. Whilst there are understandable concerns over milk withdrawal times in dairy cattle, more needs to be done to identify, license and implement more appropriate antibiotic treatments, since continued overuse of less efficacious antibiotics, applied incorrectly, will lead to increased disease recurrence and transmission. More research is needed into methods of preventing DD that circumvent the use of antibiotics, including vaccination and transmission blocking studies, to reduce or hopefully eradicate DD in the future.
Collapse
|
46
|
A molecular epidemiology of treponemes in beef cattle digital dermatitis lesions and comparative analyses with sheep contagious ovine digital dermatitis and dairy cattle digital dermatitis lesions. Vet Microbiol 2015; 178:77-87. [PMID: 25937315 DOI: 10.1016/j.vetmic.2015.04.011] [Citation(s) in RCA: 20] [Impact Index Per Article: 2.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/18/2015] [Revised: 04/08/2015] [Accepted: 04/10/2015] [Indexed: 10/23/2022]
Abstract
Bovine digital dermatitis (BDD) is an infective foot disease commonly reported in dairy cattle where Treponema are considered as the primary causative infectious agents. There still remains little definitive information on the etiology of BDD in beef cattle suggesting further investigations are warranted. Beef BDD lesions (n=34) and healthy beef foot tissues (n=38) were analysed by PCR for three BDD-associated Treponema phylogroups and also for Dichelobacter nodosus and Fusobacterium necrophorum. Spirochete culture was attempted on all BDD lesion samples. One or more BDD-associated Treponema phylogroups were detected in 100% of beef BDD lesions. "Treponema medium/Treponema vincentii-like", "Treponema phagedenis-like" and Treponema pedis spirochetes were identified in 27/34 (79%), 31/34 (91%) and 24/34 (71%) of BDD lesions, respectively. No BDD-associated treponeme DNA was amplified from beef healthy foot tissues. D. nodosus and F. necrophorum were present in 24/34 (71%) and 15/34 (44%) of lesions and 10/38 (26%) and 12/38 (32%) of healthy foot tissues, respectively. Twenty spirochetes were isolated from beef BDD lesions; 19 were representatives of the three BDD-associated Treponema phylogroups. One spirochete isolate shared less than 97% 16S rRNA gene similarity to the three cultivable BDD-associated Treponema phylogroups and therefore may represent a novel taxa of Treponema. Upon comparison, sheep contagious ovine digital dermatitis (CODD), dairy cattle and beef cattle BDD lesions appear to have extremely similar bacteriological data and therefore provides evidence of a shared etiopathogenesis posing concerns for cross-species transmission.
Collapse
|
47
|
Abstract
A UK dairy goat herd was assessed after reports of a severe lameness problem of unknown aetiology. A lameness prevalence estimate was produced and individual clinical examination of 15 randomly selected lame goats was performed. Fifteen animals had foot lesions closely resembling contagious ovine digital dermatitis (CODD) in sheep. Eight of the goats examined presented with typical CODD lesions and seven showed what appeared to be a more severe CODD with under-running of the sole. Ten biopsy samples were obtained from the foot lesions and tested by PCR for the three previously isolated digital dermatitis (DD) Treponema phylogroups and culture of treponemes was attempted. Ninety per cent of the biopsy samples were positive for Treponema medium/Treponema vincentii-like spirochaetes and Treponema phagedenis-like DD spirochaetes and 80per cent were positive for Treponema pedis. Spirochaetes were successfully isolated from 50 per cent of lesion samples. Three isolates were identified as belonging to the T. phagedenis-like spirochaetes and two were identified as T. pedis. The frequent isolation of similar treponemes to those isolated from bovine digital dermatitis and CODD lesions and the identification of these DD-associated phylotypes in the vast majority of lesions support the hypothesis that this novel foot condition is associated with infection by DD treponemes, and given the similarities to CODD, it suggests a causal role.
Collapse
|
48
|
Abstract
Abstract
Histone deacetylases (HDACs) play critical roles in the regulation of gene transcription and cell signaling events by deacetylating histones and other important non-histone substrates. Aberrant increases in HDAC enzyme activities are therefore implicated in a number of human infirmities, including cancers, metabolic disease and neurodegeneration. Fortunately, HDAC enzymes represent attractive pharmacological targets because they are readily tractable with small molecule inhibitors. In fact, several HDAC inhibitors (HDACi) have recently proceeded through (or are near) the FDA approval process for the treatment of hematologic malignancies. However, the promise of clinical HDACi therapy has been hampered by significant dose-limiting toxicities. These off-target effects have led to a renewed focus on basic HDAC biology and the development of isoenzyme-specific HDAC inhibitors which could avoid off-target effects. To help facilitate the discovery of compounds with better defined selectivity profiles, we have developed lysine deacetylase assays that selectively measure specific isoenzyme activities in cells, extracts, or purified recombinant preparations. These assays are based on substrates that are selective due to a combination of extended peptide sequence and novel chemical modifications. Deacetylase activity is measured by delivering a single, pro-luminogenic, homogeneous assay reagent to assay wells, resulting in luminescence proportional to HDAC activity. In addition to being isoenzyme selective, these novel substrates are cell permeable allowing for lytic and non-lytic cell-based HDAC assays. Lastly, these assays are also fully compatible with fluorescent viability and/or cytotoxicity assays. This provides additional flexibility for multiplexed formats which examine not only selective HDAC inhibition, but the functional consequences they exert on cell health.
Citation Format: Kevin R. Kupcho, Nathan J. Evans, Andrew L. Niles, Thomas A. Kirkland, Dan F. Lazar. Selective bioluminogenic HDAC activity assays for profiling HDAC inhibitors. [abstract]. In: Proceedings of the 105th Annual Meeting of the American Association for Cancer Research; 2014 Apr 5-9; San Diego, CA. Philadelphia (PA): AACR; Cancer Res 2014;74(19 Suppl):Abstract nr 4784. doi:10.1158/1538-7445.AM2014-4784
Collapse
|
49
|
Abstract
Digital dermatitis (DD) is an infectious foot disease causing severe lameness in dairy cattle (worldwide) and sheep (UK). This study investigated whether DD Treponema phylogroups can be present on equipment used to trim ruminant hooves and, therefore, consider this trimming equipment as a possible vector for the transmission of DD. Equipment was tested after being used to trim DD symptomatic and asymptomatic cattle and sheep hooves, and subsequently after disinfection of equipment. After trimming, 'Treponema medium/Treponema vincentii-like', 'Treponema phagedenis-like' and 'Treponema denticola/T putidum-like' DD spirochaetes, were shown to be present on 23/37 (62%), 21/37 (57%) and 20/37 (54%) of knives, respectively. After disinfection, detection rates for the DD treponemes were 9/37 (24%), 6/37 (16%) and 3/37 (8%), respectively. Following culture of a swab, an isolate belonging to the T phagedenis-like spirochaetes was identified from a knife sample after trimming a DD positive cow. No isolates were obtained from knife samples after disinfection. This new data has, for the first time, identified treponemes in the farm environment, and highlighted disinfection of hoof trimming equipment between animals and between farms, as a logical precaution to limit the spread of DD.
Collapse
|
50
|
|