1
|
He N, Hao H. Contextual bias in forensic toxicology decisions: A follow-up empirical study from China. J Forensic Sci 2024; 69:1400-1406. [PMID: 38567838 DOI: 10.1111/1556-4029.15520] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/06/2024] [Revised: 03/26/2024] [Accepted: 03/27/2024] [Indexed: 06/28/2024]
Abstract
The impact of contextual bias has been demonstrated repeatedly across forensic domains; however, research on this topic in forensic toxicology is very limited. In our previous study, experimental data from only one context version were compared with the actual forensic biasing casework. As a follow-up, this controlled experiment with 159 forensic toxicology practitioners was conducted, to test whether knowledge of different contextual information influenced their forensic decision-making. Participants in different context groups were tasked to identify testing strategies for carbon monoxide and opiate drugs. The results of chi-squared tests for their selections and two context groups exhibited statistically significant differences (p < 0.05 or p < 0.01). These findings show contextual information can bias forensic toxicology decisions about testing strategies, despite it is a relatively objective domain in forensic science.
Collapse
Affiliation(s)
- Ning He
- Law School, Hunan University, Changsha, China
| | - Hongxia Hao
- Key Laboratory of Evidence Science (China University of Political Science and law), Ministry of Education, Beijing, China
| |
Collapse
|
2
|
Maskell PD, Elliott S, Desharnais B, Findell M, Jackson G. A model of evaluative opinion to encourage greater transparency and justification of interpretation in postmortem forensic toxicology. J Anal Toxicol 2023; 47:563-573. [PMID: 37566485 PMCID: PMC10503647 DOI: 10.1093/jat/bkad055] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/13/2023] [Revised: 07/31/2023] [Accepted: 08/10/2023] [Indexed: 08/13/2023] Open
Abstract
Over the past decades, the calls to improve the robustness of interpretation in forensic science have increased in magnitude. Forensic toxicology has seen limited progress in this regard. In this work, we propose a transparent interpretive pathway for use in postmortem forensic toxicology cases. This process allows the selection of the interpretive methodology based on the amount of previous information that is available for the drug(s) in question. One approach is an assessment of various pharmacological and circumstantial considerations resulting in a toxicological significance score (TSS), which is particularly useful in situations where limited information about a drug is available. When there is a robust amount of case data available, then a probabilistic approach, through the evaluation of likelihood ratios by the forensic toxicologist and of prior probabilities by the fact finder, is utilized. This methodology provides a transparent means of making an interpretive decision on the role of a drug in the cause of death. This will allow the field of forensic toxicology to take a step forward in using best practice in evaluative reporting, a tool already used by many other forensic science disciplines.
Collapse
Affiliation(s)
- Peter D Maskell
- Scottish Police Authority Forensic Services, Glasgow G69 8AE, UK
- Forensic Medicine and Science, University of Glasgow, Glasgow G12 8QQ, UK
| | - Simon Elliott
- Elliott Forensic Consulting, Birmingham, UK
- Department of Analytical, Environmental and Forensic Sciences, King’s College London, London SE1 9NH, UK
| | - Brigitte Desharnais
- Department of Toxicology, Laboratoire de sciences judiciaires et de médecine légale, 1701 Parthenais Street, Montréal, QC H2K 3S7, Canada
| | - Martin Findell
- Division of Psychology and Forensic Science, School of Applied Sciences, Abertay University, Dundee DD1 1HG, UK
| | - Graham Jackson
- Division of Psychology and Forensic Science, School of Applied Sciences, Abertay University, Dundee DD1 1HG, UK
- Advance Forensic Science, St. Andrews, Scotland, UK
| |
Collapse
|
3
|
Dahal S, Chaudhary GK, Agrawal NK. Operation makalu air crash: influence of cognitive and human factors on decision-making. Forensic Sci Res 2023; 7:803-807. [PMID: 36817246 PMCID: PMC9930785 DOI: 10.1080/20961790.2022.2095691] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/24/2023] Open
Abstract
Two onboard crew members lost their lives in the fatal Makalu Air Cessna Grand Caravan 208B domestic cargo flight crash on May 16, 2018. The Disaster Victim Identification (DVI) procedure comprises external examination, photography, DNA collection, fingerprint collection, postmortem examination, antemortem information collection from the family members, and reconciliation. The major challenge of this operation was dealing with cognitive bias. The antemortem dental information of one of the deceased was revealed to the forensic experts just before the postmortem examination. This influenced the testing strategies. There was a tendency to neglect the complete dental examination presuming the identification was established. Later, during a thorough examination, the forensic odontologist realised that the initial decision was erroneous. Furthermore, there are few experience-based resources available to resolve cognitive bias issues. The authors begin by summarising complicated operations in which they have been involved, followed by a discussion of the key sources of cognitive bias along with the solution to resolve these issues in DVI preparedness planning.
Collapse
Affiliation(s)
- Samarika Dahal
- Department of Dentistry, Institute of Medicine, Kathmandu, Nepal,CONTACT Samarika Dahal
| | - Gopal Kumar Chaudhary
- Department of Forensic Medicine, Maharajgunj Medical Campus, Maharajgunj, Kathmandu, Nepal
| | | |
Collapse
|
4
|
Cheng JYK, Hui JWS, Chan WS, So MH, Hong YH, Leung WT, Ku KW, Yeung HS, Lo KM, Fung KM, Ip CY, Dao KL, Cheung BKK. Interpol review of toxicology 2019-2022. Forensic Sci Int Synerg 2022; 6:100303. [PMID: 36597440 PMCID: PMC9799715 DOI: 10.1016/j.fsisyn.2022.100303] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/30/2022]
Affiliation(s)
- Jack Yuk-ki Cheng
- Government Laboratory, Hong Kong Special Administrative Region of China
| | | | - Wing-sum Chan
- Government Laboratory, Hong Kong Special Administrative Region of China
| | - Man-ho So
- Government Laboratory, Hong Kong Special Administrative Region of China
| | - Yau-hin Hong
- Government Laboratory, Hong Kong Special Administrative Region of China
| | - Wai-tung Leung
- Government Laboratory, Hong Kong Special Administrative Region of China
| | - Ka-wai Ku
- Government Laboratory, Hong Kong Special Administrative Region of China
| | - Hoi-sze Yeung
- Government Laboratory, Hong Kong Special Administrative Region of China
| | - Kam-moon Lo
- Government Laboratory, Hong Kong Special Administrative Region of China
| | - Kit-mai Fung
- Government Laboratory, Hong Kong Special Administrative Region of China
| | - Chi-yuen Ip
- Government Laboratory, Hong Kong Special Administrative Region of China
| | - Kwok-leung Dao
- Government Laboratory, Hong Kong Special Administrative Region of China
| | | |
Collapse
|
5
|
Mantl NA, Nakhaeizadeh S, Watts R, Rando C, Morgan RM. Evaluating intuitive decision-making in non-metric sex estimation from the cranium: an exploratory study. AUST J FORENSIC SCI 2022. [DOI: 10.1080/00450618.2022.2104371] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/16/2022]
Affiliation(s)
- Nicole A. Mantl
- Department of Security and Crime Science, University College London, London, UK
- Centre for Forensic Sciences, University College London, London, UK
- Institute of Archaeology, University College London, London, UK
| | - Sherry Nakhaeizadeh
- Department of Security and Crime Science, University College London, London, UK
- Centre for Forensic Sciences, University College London, London, UK
| | - Rebecca Watts
- Institute of Archaeology, University College London, London, UK
| | - Carolyn Rando
- Institute of Archaeology, University College London, London, UK
| | - Ruth M. Morgan
- Department of Security and Crime Science, University College London, London, UK
- Centre for Forensic Sciences, University College London, London, UK
| |
Collapse
|
6
|
Chiam SL, Louise J, Higgins D. “Identified”, “Probable”, “Possible” or “Exclude”: the influence of task-irrelevant information on forensic odontology identification opinion. Sci Justice 2022; 62:461-470. [DOI: 10.1016/j.scijus.2022.06.002] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 05/13/2022] [Revised: 06/24/2022] [Accepted: 06/30/2022] [Indexed: 10/17/2022]
|
7
|
He N, Wang L, Hao H. Contextual Bias on Decision-Making in Forensic Toxicology: First Survey from China. Forensic Sci Int 2022; 333:111232. [DOI: 10.1016/j.forsciint.2022.111232] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/17/2021] [Revised: 02/06/2022] [Accepted: 02/08/2022] [Indexed: 11/28/2022]
|
8
|
Objectivity is a myth that harms the practice and diversity of forensic science. Forensic Sci Int Synerg 2021; 3:100196. [PMID: 34622187 PMCID: PMC8484737 DOI: 10.1016/j.fsisyn.2021.100196] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/01/2021] [Accepted: 09/08/2021] [Indexed: 11/22/2022]
Abstract
Forensic science data are theory laden; pure scientific objectivity is a myth. Upholding this myth marginalizes forensic scientists with subjective positionalities Objectivity rhetoric is exclusive; ethical forensic science needs diverse perspectives. Espousing objectivity prevents us from supporting the communities we serve. Mitigated objectivity acknowledges implicit bias, constraining it via quality control.
Collapse
|
9
|
Chiam SL, Dror IE, Huber CD, Higgins D. The biasing impact of irrelevant contextual information on forensic odontology radiograph matching decisions. Forensic Sci Int 2021; 327:110997. [PMID: 34536753 DOI: 10.1016/j.forsciint.2021.110997] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/21/2021] [Revised: 09/03/2021] [Accepted: 09/07/2021] [Indexed: 11/26/2022]
Abstract
The potential biasing effect of irrelevant context information on the forensic odontology method of radiograph-based identification has never been empirically investigated despite being a recognized problem in other forensic science disciplines. This study examines the effect of irrelevant context information on the probability judgment of match (JOM) of practicing forensic odontologist and dentist participants who were asked to match pairs of dental radiographs supplemented with irrelevant case information. The irrelevant case information contained domain task-irrelevant context information which varied in strength (strong or weak). It suggested either supportive or contradictory bias relative to the actual match status of the radiograph pairs. The dental radiographs consisted of verified match and non-match radiographs pairs sampled and de-identified from actual forensic cases. Changes in accuracy and JOM between supportive and contradictory contexts conditions revealed a contextual bias. Mixed model analysis showed that strong supportive context increased the odds ratio of correct decisions by a factor of 2.4 [1.23, 4.46]; p = 0.0097. Consistent with the biasing effect, the JOM score differences between strong supportive and contradictory irrelevant context information were 1.03 and 0.43 respectively for the non-match and match decisions. The direction of context suggestion (p = 0.0067), the radiograph match status (p = 0.014), and their interactions (p = 0.0061), were all found to impact the participants' decision. The weak context information was not strong enough to have a significant effect on accuracy or JOM scores. This study demonstrates that radiograph match judgment is affected and can be biased by strong irrelevant contextual information.
Collapse
Affiliation(s)
- Sher-Lin Chiam
- Forensic Odontology Unit/Adelaide Dental School, The University of Adelaide, Australia.
| | - Itiel E Dror
- Center for the Forensic Sciences, University College London, UK.
| | - Christian D Huber
- Department of Biology, The Pennsylvania State University, University Park, 16802 PA, USA.
| | - Denice Higgins
- Forensic Odontology Unit/Adelaide Dental School, The University of Adelaide, Australia.
| |
Collapse
|
10
|
Yu Y, Luo Y, Huang L, Quan Y. The impact of contextual information on decision-making in footwear examination: An eye-tracking study. J Forensic Sci 2021; 66:2218-2231. [PMID: 34414574 DOI: 10.1111/1556-4029.14861] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/16/2021] [Revised: 07/22/2021] [Accepted: 08/03/2021] [Indexed: 11/26/2022]
Abstract
In order to investigate whether context factors and expectations might potentially influence the decision-making of forensic footwear examiners, we collected the gaze process of experts examining the shoeprint image sets through the eye-tracking recorder. Additional to eye movement data as an objective measure, questionnaires were completed, and survey was conducted afterwards. Twenty-three qualified examiners assessed the similarity among shoe images for 22 different cases, including three sets were laterally reversed. We divided the experiment into two sessions, and then compared the examiners' performance with and without contextual information. The results showed the effects of contextual bias manipulate on both behavioral data and eye tracking data. The consensus and accuracy of examiners with contextual information were higher than those without contextual information. In the eye-tracking data, there is a significant difference between fixation counts and saccadic counts under contextual information. In addition, we found that the contextual information produced significant changes in inter-examiner consistency as measured by the Earth Mover Distance metric. However, there is no significant statistic differences in saccadic amplitude and total fixation duration of the examiners after exposure to contextual information. Our research results are instructive for understanding the cognitive process of shoeprint examination involved in real cases. In this process, stimuli related to context factors may affect decision-making and behavior. Implications for contextual effect causes are discussed.
Collapse
Affiliation(s)
- Yang Yu
- School of Forensic Science, People's Public Security University of China, Beijing, China
| | - Yaping Luo
- Graduate School, People's Public, Security University of China, Beijing, China
| | - Lu Huang
- School of Medicine, Boston University, Boston, Massachusetts, USA
| | - Yongzhi Quan
- Department of investigation, Shanghai Police College, Shanghai, China
| |
Collapse
|
11
|
Dror IE, Scherr KC, Mohammed LA, MacLean CL, Cunningham L. Biasability and reliability of expert forensic document examiners. Forensic Sci Int 2020; 318:110610. [PMID: 33358191 DOI: 10.1016/j.forsciint.2020.110610] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/02/2020] [Revised: 11/17/2020] [Accepted: 11/18/2020] [Indexed: 11/30/2022]
Abstract
The performance of experts can be characterized in terms of biasability and reliability of their judgments. The current research is the first to explore the judgments of practicing forensic document experts, professionals who examine and compare disputed handwritten evidence to handwriting exemplars of individuals involved in criminal or civil litigation. Forensic handwriting experts determine if questioned and known handwritten items are of common authorship or written by different individuals, and present their findings in legal proceedings. The expert participants in our study (N=25) were not aware that they were part of a research study. Thirteen participants were led to believe that they were working on a case commissioned from the prosecution and the other twelve that it was for the defense. We did not find evidence in this study that this information biased their judgments, which may make sense since document examiners (in contrast to many other forensic domains) do not primarily work within an organizational forensic laboratory culture. The lack of bias in our findings may have been also due to the stimuli we used or/and the great variability in the judgments within each group, reflecting a lack of consistency in conclusions among examiners. A detailed discussion of our findings is presented along with the limitations that may have affected our results.
Collapse
Affiliation(s)
- Itiel E Dror
- University College London, London, United Kingdom.
| | - Kyle C Scherr
- Central Michigan University, Michigan, United States
| | | | | | | |
Collapse
|