1
|
Bradford A, Meyer AND, Khan S, Giardina TD, Singh H. Diagnostic error in mental health: a review. BMJ Qual Saf 2024:bmjqs-2023-016996. [PMID: 38575311 DOI: 10.1136/bmjqs-2023-016996] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/04/2023] [Accepted: 03/04/2024] [Indexed: 04/06/2024]
Abstract
Diagnostic errors are associated with patient harm and suboptimal outcomes. Despite national scientific efforts to advance definition, measurement and interventions for diagnostic error, diagnosis in mental health is not well represented in this ongoing work. We aimed to summarise the current state of research on diagnostic errors in mental health and identify opportunities to align future research with the emerging science of diagnostic safety. We review conceptual considerations for defining and measuring diagnostic error, the application of these concepts to mental health settings, and the methods and subject matter focus of recent studies of diagnostic error in mental health. We found that diagnostic error is well understood to be a problem in mental healthcare. Although few studies used clear definitions or frameworks for understanding diagnostic error in mental health, several studies of missed, wrong, delayed and disparate diagnosis of common mental disorders have identified various avenues for future research and development. Nevertheless, a lack of clear consensus on how to conceptualise, define and measure errors in diagnosis will pose a barrier to advancement. Further research should focus on identifying preventable missed opportunities in the diagnosis of mental disorders, which may uncover generalisable opportunities for improvement.
Collapse
Affiliation(s)
- Andrea Bradford
- Department of Medicine, Baylor College of Medicine, Houston, TX, USA
- Center for Innovations in Quality, Effectiveness and Safety, Michael E. DeBakey VA Medical Center and Baylor College of Medicine, Houston, Texas, USA
| | - Ashley N D Meyer
- Department of Medicine, Baylor College of Medicine, Houston, TX, USA
- Center for Innovations in Quality, Effectiveness and Safety, Michael E. DeBakey VA Medical Center and Baylor College of Medicine, Houston, Texas, USA
| | - Sundas Khan
- Center for Innovations in Quality, Effectiveness and Safety, Michael E. DeBakey VA Medical Center and Baylor College of Medicine, Houston, Texas, USA
| | - Traber D Giardina
- Department of Medicine, Baylor College of Medicine, Houston, TX, USA
- Center for Innovations in Quality, Effectiveness and Safety, Michael E. DeBakey VA Medical Center and Baylor College of Medicine, Houston, Texas, USA
| | - Hardeep Singh
- Department of Medicine, Baylor College of Medicine, Houston, TX, USA
- Center for Innovations in Quality, Effectiveness and Safety, Michael E. DeBakey VA Medical Center and Baylor College of Medicine, Houston, Texas, USA
| |
Collapse
|
2
|
Ashinoff BK, Buck J, Woodford M, Horga G. The effects of base rate neglect on sequential belief updating and real-world beliefs. PLoS Comput Biol 2022; 18:e1010796. [PMID: 36548395 PMCID: PMC9831339 DOI: 10.1371/journal.pcbi.1010796] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/17/2022] [Revised: 01/10/2023] [Accepted: 12/06/2022] [Indexed: 12/24/2022] Open
Abstract
Base-rate neglect is a pervasive bias in judgment that is conceptualized as underweighting of prior information and can have serious consequences in real-world scenarios. This bias is thought to reflect variability in inferential processes but empirical support for a cohesive theory of base-rate neglect with sufficient explanatory power to account for longer-term and real-world beliefs is lacking. A Bayesian formalization of base-rate neglect in the context of sequential belief updating predicts that belief trajectories should exhibit dynamic patterns of dependence on the order in which evidence is presented and its consistency with prior beliefs. To test this, we developed a novel 'urn-and-beads' task that systematically manipulated the order of colored bead sequences and elicited beliefs via an incentive-compatible procedure. Our results in two independent online studies confirmed the predictions of the sequential base-rate neglect model: people exhibited beliefs that are more influenced by recent evidence and by evidence inconsistent with prior beliefs. We further found support for a noisy-sampling inference model whereby base-rate neglect results from rational discounting of noisy internal representations of prior beliefs. Finally, we found that model-derived indices of base-rate neglect-including noisier prior representation-correlated with propensity for unusual beliefs outside the laboratory. Our work supports the relevance of Bayesian accounts of sequential base-rate neglect to real-world beliefs and hints at strategies to minimize deleterious consequences of this pervasive bias.
Collapse
Affiliation(s)
- Brandon K. Ashinoff
- Department of Psychiatry, Columbia University, New York, NY, United States of America
- New York State Psychiatric Institute (NYSPI), New York, NY, United States of America
| | - Justin Buck
- Department of Psychiatry, Columbia University, New York, NY, United States of America
- New York State Psychiatric Institute (NYSPI), New York, NY, United States of America
- Department of Neuroscience, Columbia University, New York, NY, United States of America
| | - Michael Woodford
- Department of Economics, Columbia University, New York, NY, United States of America
| | - Guillermo Horga
- Department of Psychiatry, Columbia University, New York, NY, United States of America
- New York State Psychiatric Institute (NYSPI), New York, NY, United States of America
| |
Collapse
|
3
|
Gomroki G, Behzadi H, Fattahi R, Salehi Fadardi J. Identifying effective cognitive biases in information retrieval. J Inf Sci 2021. [DOI: 10.1177/01655515211001777] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/15/2022]
Abstract
The purpose of this study is to identify the types of cognitive biases in the process of information retrieval. This research used a mixed-method approach for data collection. The research population consisted of 25 information retrieval specialists and 30 post-graduate students. We employed three tools for collecting data, including a checklist, log files and semi-structured interviews. The findings showed that from the perspective of information retrieval specialists, the cognitive biases such as ‘Familiarity’, ‘Anchoring’, ‘Rush to solve’ and ‘Curse of knowledge’ could be of the greatest importance in the field of information retrieval. Also, in terms of users’ searching, the ‘Rush to solve problems’ and ‘Mere exposure effects’ biases have the highest frequency, and the ‘Outcome’ and ‘Curse of knowledge’ biases have the lowest frequency in the process of user retrieval information. It can be concluded that, because cognitive biases occurring in information retrieval, designers of information retrieval systems and librarians should pay attention to this issue in designing and evaluating information systems.
Collapse
|
4
|
Spies JP, Woud ML, Kessler H, Rau H, Willmund GD, Köhler K, Herpertz S, Blackwell SE, Bovin M, Marx BP, Cwik JC. Psychometric properties of the German version of the Clinician-Administered PTSD Scale for DSM-5 (CAPS-5) in clinical routine settings: study design and protocol of a multitrait-multimethod study. BMJ Open 2020; 10:e036078. [PMID: 32571861 PMCID: PMC7311000 DOI: 10.1136/bmjopen-2019-036078] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 11/29/2019] [Revised: 04/08/2020] [Accepted: 06/02/2020] [Indexed: 11/04/2022] Open
Abstract
INTRODUCTION The aim of this study is to investigate the diagnostic accuracy, psychometric properties and clinical utility of the German version of the Clinician-Administered Post-Traumatic Stress Disorder (PTSD) Scale for Diagnostic and Statistical Manual of Mental Disorders-5 (DSM-5) (CAPS-5) in routine clinical settings. METHODS AND ANALYSIS This study is a non-interventional, multitrait-multimethod design, multicentre study that will be carried out at German civil and military inpatient and outpatient clinics. A total sample size of n=219 participants who have experienced at least one traumatic event according to criteria as defined in the DSM-5 will be recruited. For the investigation of the diagnostic accuracy and clinical utility of the CAPS-5, participants will be categorised into one of three groups, depending on their traumatic experiences and post-traumatic symptomatology: (1) monotraumatisation with PTSD; (2) multiple traumatisation with PTSD and (3) traumatisation without PTSD. Interviews will be conducted face to face by interviewers in routine clinical settings. All participants will also be asked to complete a comprehensive set of questionnaires in order to investigate different facets of construct validity and clinical utility. First, differences between all three groups in CAPS-5 sum and subscale scores will be investigated. Test-retest reliability and inter-rater reliability will be determined. Internal consistency will be calculated using structural equation modeling (SEM) based internal consistency coefficients. Construct validity will be measured with Spearman's rank correlation analyses and multivariate analyses of variance with Holm-Bonferroni corrected post hoc analysis of variances. In order to test diagnostic accuracy, receiver operating characteristics and sensitivity and specificity analyses will be conducted. The model structure of the German CAPS-5 will be analysed using confirmatory factor analyses. ETHICS AND DISSEMINATION The study received ethical approval by the Ethics Committees of the Faculty of Psychology at the Ruhr-Universität Bochum (reference numbers: 331 and 358). The results of the study will be presented nationally and internationally at scientific conferences and will be published in scientific journals. TRIAL REGISTRATION NUMBER DRKS00015325.
Collapse
Affiliation(s)
- Jan-Peter Spies
- Clinical Psychology and Psychotherapy, Universität zu Köln, Köln, Germany
| | - Marcella Lydia Woud
- Faculty of Psychology, Mental Health Research and Treatment Center, Ruhr-Universität Bochum, Bochum, Germany
| | - Henrik Kessler
- Department of Psychosomatic Medicine and Psychotherapy, LWL University Hospital, Ruhr-Universität Bochum, Bochum, Germany
| | - Heinrich Rau
- German Armed Forces Center for Military Mental Health, Berlin, Germany
| | | | - Kai Köhler
- German Armed Forces Center for Military Mental Health, Berlin, Germany
| | - Stephan Herpertz
- Department of Psychosomatic Medicine and Psychotherapy, LWL University Hospital, Ruhr-Universität Bochum, Bochum, Germany
| | - Simon E Blackwell
- Faculty of Psychology, Mental Health Research and Treatment Center, Ruhr-Universität Bochum, Bochum, Germany
| | - Michelle Bovin
- VA Boston Healthcare System, Massachusetts and Boston University School of Medicine, Boston, Massachusetts, USA
| | - Brian P Marx
- VA Boston Healthcare System, Massachusetts and Boston University School of Medicine, Boston, Massachusetts, USA
| | | |
Collapse
|
5
|
Bernstein MT, Kong J, Sriranjan V, Reisdorf S, Restall G, Walker JR, Singh H. Evaluating Information Quality of Revised Patient Education Information on Colonoscopy: It Is New But Is It Improved? Interact J Med Res 2019; 8:e11938. [PMID: 30785412 PMCID: PMC6401670 DOI: 10.2196/11938] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/17/2018] [Revised: 11/27/2018] [Accepted: 12/09/2018] [Indexed: 12/29/2022] Open
Abstract
BACKGROUND Previous research indicates that patients and their families have many questions about colonoscopy that are not fully answered by existing resources. We developed revised forms on colonoscopy bowel preparation and on the procedure itself. OBJECTIVE As the goal of the revised materials is to have improved information relative to currently available information, we were interested in how revised information compared with what is currently available in terms of information quality and patient preference. METHODS Participants were asked to review one at a time the Revised and Current versions of Colonoscopy bowel preparation instructions (study 1) and About Colonoscopy (study 2). The order of administration of the Revised and Current versions was randomly counterbalanced to assess order effects. Respondents rated each form along the following dimensions: amount, clarity, trustworthiness, readability and understandability, how new or familiar the information was, and reassurance. Participants were asked which form they preferred and 4 questions about why they preferred it. Open-ended questions asked participants to describe likes and dislikes of the forms and suggestions for improvement. RESULTS The study 1 and study 2 samples were similar. Overall, in study 1, 62.4% preferred the Revised form, 28.1% preferred the Current form, and 6.7% were not sure. Overall, in study 2, 50.5% preferred the Revised form, 31.1% preferred the Current form, and 18.4% were not sure. Almost 75% of those in study 1 who received the Revised form first, preferred it, compared with less than half of those who received it first in study 2. In study 1, 75% of those without previous colonoscopy experience preferred the Revised form, compared with more than half of those who had previously undergone a colonoscopy. The study 1 logistic regression analysis demonstrated that participants were more likely to prefer the Revised form if they had viewed it first and had no previous experience with colonoscopy. In study 2, none of the variables assessed were associated with a preference for the Revised form. In comparing the 2 forms head-to-head, participants who preferred the Revised form in study 1 rated it as clearer compared with those who preferred the Current form. Finally, many participants who preferred the Revised form indicated in the open-ended questions that they liked it because it had more information than the Current form and that it had good visual information. CONCLUSIONS This study is one of the first to evaluate 2 different patient education resources in a head-to-head comparison using the same participants in a within-subjects design. This approach was useful in comparing revised educational information with current resources. Moving forward, this knowledge translation approach of a head-to-head comparison of 2 different information sources could be taken to develop and refine information sources on other health issues.
Collapse
Affiliation(s)
- Matthew Tyler Bernstein
- Department of Clinical Health Psychology, University of Manitoba, Winnipeg, MB, Canada.,Inflammatory Bowel Disease Clinical and Research Centre, University of Manitoba, Winnipeg, MB, Canada
| | - James Kong
- Inflammatory Bowel Disease Clinical and Research Centre, University of Manitoba, Winnipeg, MB, Canada
| | - Vaelan Sriranjan
- Inflammatory Bowel Disease Clinical and Research Centre, University of Manitoba, Winnipeg, MB, Canada
| | - Sofia Reisdorf
- Inflammatory Bowel Disease Clinical and Research Centre, University of Manitoba, Winnipeg, MB, Canada
| | - Gayle Restall
- Department of Occupational Therapy, University of Manitoba, Winnipeg, MB, Canada
| | - John Roger Walker
- Department of Clinical Health Psychology, University of Manitoba, Winnipeg, MB, Canada.,Inflammatory Bowel Disease Clinical and Research Centre, University of Manitoba, Winnipeg, MB, Canada
| | - Harminder Singh
- Inflammatory Bowel Disease Clinical and Research Centre, University of Manitoba, Winnipeg, MB, Canada.,Section of Gastroenterology, Department of Internal Medicine, University of Manitoba, Winnipeg, MB, Canada
| |
Collapse
|
6
|
Morozov AM, Sherman RA. Survey of patients of the Tver region of Russia regarding maggots and maggot therapy. Int Wound J 2018; 16:401-405. [PMID: 30548914 DOI: 10.1111/iwj.13046] [Citation(s) in RCA: 11] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/04/2018] [Revised: 11/04/2018] [Accepted: 11/11/2018] [Indexed: 10/27/2022] Open
Abstract
The 21st century is seeing a resurgence in the use of maggot therapy-using the physical and biochemical benefits of fly larvae to debride and heal chronic, problematic wounds. Maggots are repulsive to many people, and this could interfere with the acceptance of this modality. Before instituting a maggot therapy programme at our institution, we sought to better understand the psychological barriers that may exist among patients in the Tver region of Russia. Between 2014 and 2016, all patients with arterial insufficiency and trophic ulcers at City Clinical Hospital No. 7 in Tver were administered a survey consisting of six images. Subjects were asked to rank the images in the order of least to most repulsive or disgusting. A total of 576 subjects were recruited for this study: 414 (72%) women and 162 (28%) men. Nearly 60% of subjects considered the images of maggots to be more repulsive than images of gangrenous wounds. This finding is significant because it indicates that much education and support will need to be conducted to address patient fears and anxiety if patients are to be comfortable with a maggot therapy programme.
Collapse
Affiliation(s)
- Artem M Morozov
- General Surgery Department, Tver State Medical University, Ministry of Health, Tver, Russia
| | - Ronald A Sherman
- BioTherapeutics, Education & Research Foundation, Irvine, California, U.S.A
| |
Collapse
|
7
|
Lockhart JJ, Satya-Murti S. Blinding or information control in diagnosis: could it reduce errors in clinical decision-making? ACTA ACUST UNITED AC 2018; 5:179-189. [PMID: 30231010 DOI: 10.1515/dx-2018-0030] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/26/2018] [Accepted: 08/21/2018] [Indexed: 11/15/2022]
Abstract
Background Clinical medicine has long recognized the potential for cognitive bias in the development of new treatments, and in response developed a tradition of blinding both clinicians and patients to address this specific concern. Although cognitive biases have been shown to exist which impact the accuracy of clinical diagnosis, blinding the diagnostician to potentially misleading information has received little attention as a possible solution. Recently, within the forensic sciences, the control of contextual information (i.e. information apart from the objective test results) has been studied as a technique to reduce errors. We consider the applicability of this technique to clinical medicine. Content This article briefly describes the empirical research examining cognitive biases arising from context which impact clinical diagnosis. We then review the recent awakening of forensic sciences to the serious effects of misleading information. Comparing the approaches, we discuss whether blinding to contextual information might (and in what circumstances) reduce clinical errors. Summary and outlook Substantial research indicates contextual information plays a significant role in diagnostic error and conclusions across several medical specialties. The forensic sciences may provide a useful model for the control of potentially misleading information in diagnosis. A conceptual analog of the forensic blinding process (the "agnostic" first reading) may be applicable to diagnostic investigations such as imaging, microscopic tissue examinations and waveform recognition. An "agnostic" approach, where the first reading occurs with minimal clinical referral information, but is followed by incorporation of the clinical history and reinterpretation, has the potential to reduce errors.
Collapse
Affiliation(s)
- Joseph J Lockhart
- Consulting Psychologist, Forensic Services Division, Department of State Hospitals, State of California, Suite 410, Sacramento, CA 95814, USA
| | | |
Collapse
|
8
|
Margraf J, Cwik JC, Pflug V, Schneider S. Strukturierte klinische Interviews zur Erfassung psychischer Störungen über die Lebensspanne. ZEITSCHRIFT FUR KLINISCHE PSYCHOLOGIE UND PSYCHOTHERAPIE 2017. [DOI: 10.1026/1616-3443/a000430] [Citation(s) in RCA: 101] [Impact Index Per Article: 14.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/04/2022]
Abstract
Zusammenfassung. Psychische Störungen können über die ganze Lebensspanne auftreten. Strukturierte klinische Interviews sind zentrale Hilfsmittel für ihre rasche, zuverlässige und umfassende Diagnostik. Im deutschsprachigen Raum stehen mit den Verfahren der DIPS-Familie Interviews zur Diagnostik psychischer Störungen über die gesamte Lebensspanne zur Verfügung, die seit den 90er Jahren regelmäßig aktualisiert wurden. Ihre Reliabilität, Validität und Akzeptanz wurde wiederholt in großen Stichproben aus ambulanten, stationären und Forschungssettings überprüft. Die Einführung des DSM-5 erforderte eine umfassende Überarbeitung der DIPS-Interviews, deren wesentliche Merkmale dargestellt werden. Um die breitere Verwendung von strukturierten klinischen Interviews zu fördern, werden die Verfahren der DIPS-Familie neu als „Open Access-Dokumente“ zur Verfügung gestellt. Abschließend werden weitere Entwicklungen zu Training, Dissemination und Computerisierung im Ausblick angesprochen.
Collapse
Affiliation(s)
- Jürgen Margraf
- Ruhr-Universität Bochum, Fakultät für Psychologie, Forschungs- und Behandlungszentrum für psychische Gesundheit
| | - Jan Christopher Cwik
- Ruhr-Universität Bochum, Fakultät für Psychologie, Forschungs- und Behandlungszentrum für psychische Gesundheit
| | - Verena Pflug
- Ruhr-Universität Bochum, Fakultät für Psychologie, Forschungs- und Behandlungszentrum für psychische Gesundheit
| | - Silvia Schneider
- Ruhr-Universität Bochum, Fakultät für Psychologie, Forschungs- und Behandlungszentrum für psychische Gesundheit
| |
Collapse
|