Linear Sequential Unmasking-Expanded (LSU-E): A general approach for improving decision making as well as minimizing noise and bias

Contextual bias in forensic toxicology decisions: A follow-up empirical study from China

The impact of contextual bias has been demonstrated repeatedly across forensic domains; however, research on this topic in forensic toxicology is very limited. In our previous study, experimental data from only one context version were compared with the actual forensic biasing casework. As a follow-up, this controlled experiment with 159 forensic toxicology practitioners was conducted, to test whether knowledge of different contextual information influenced their forensic decision-making. Participants in different context groups were tasked to identify testing strategies for carbon monoxide and opiate drugs. The results of chi-squared tests for their selections and two context groups exhibited statistically significant differences (p < 0.05 or p < 0.01). These findings show contextual information can bias forensic toxicology decisions about testing strategies, despite it is a relatively objective domain in forensic science.

Contextual bias by Forensic Document Examination trainees: An empirical study from China

The impact of contextual bias has been repeatedly demonstrated across forensic domains; however, research on this topic in China is scarce. To examine the prevalence of contextual bias in pattern feature-comparison disciplines, we conducted an experiment involving 24 forensic document examination students. The aim was to determine whether knowledge of different contextual information influenced their forensic decision-making. Participants were divided into different context groups and tasked with examining whether questioned signatures with ambiguous features matched reference signatures. The results of independent-samples t-tests for their decision score data in the two context groups exhibited a statistically significant difference (p < 0.05, Cohen's d > 0.8). Moreover, the submitted forensic reports by participants disclosed a biased evaluation of handwriting features. These findings show how contextual information can bias forensic decision-making in handwriting examination. Context management with complementary strategies such as case triage, cognitive training and decision-making transparency must be implemented to minimize bias in handwriting examination.

The effects of cognitive bias, examiner expertise, and stimulus material on forensic evidence analysis

Forensic examiners have come under scrutiny due to high-profile exonerations, highlighting the consequences that contextual bias can have on investigations. Researchers have proposed solutions to reduce the effects of bias including blind testing and redacting task-irrelevant information. Practitioners have concerns over the limitations of some of this research that uses untrained students to examine complex pieces of forensic evidence (e.g., fingerprints) (1; but see 2 for studies including trained experts and/or actual casework). This study sought to (a) examine the effect of contextual bias on examiners' evaluation of forensic evidence by varying the amount of pre-comparison information available to participants, (b) compare student and expert examiners' performance and their vulnerability to contextual bias, and (c) examine the effects of contextual bias on examiners' evaluation of different types of forensic evidence. Expert fingerprint examiners and student participants were presented with varying amounts of pre-comparison case information and compared matching and non-matching fingerprint and footwear impression evidence. Results suggest no effects of blinding examiners from case information or redacting task-irrelevant information. As expected, expert fingerprint examiners were more likely to correctly identify matching fingerprints and correctly exclude non-matching fingerprints than students. However, expert fingerprint examiners were no better than student participants at comparing footwear impression evidence. These findings suggest that sample, stimulus selection, and discipline-specific training matter when investigating bias in forensic decision making. These findings suggest caution when using forensic stimuli with student samples to investigate forensic decision-making and highlight the need for more research on redaction procedures.

Unpacking workplace stress and forensic expert decision-making: From theory to practice

Workplace stress can affect forensic experts' job satisfaction and performance, which holds financial and other implications for forensic service providers. Therefore, it is important to understand and manage workplace stress, but that is not simple or straightforward. This paper explores stress as a human factor that influences forensic expert decision-making. First, we identify and highlight three factors that mitigate decisions under stress conditions: nature of decision, individual differences, and context of decision. Second, we situate workplace stress in forensic science within the Challenge-Hindrance Stressor Framework. We argue that stressors in forensic science workplaces can have a positive or a negative impact, depending on the type, level, and context of stress. Developing an understanding of the stressors, their sources, and their possible impact can help forensic service providers and researchers to implement context-specific interventions to manage stress at work and optimize expert performance.

Quality management system in forensic science: An African perspective

Critical issues in forensic science quality management have emerged in recent decades. The debate on accrediting quality management systems of forensic laboratories is relevant to the African context. Neuteboom, Ross, Bugeja, Willis, Roux, and Lothridge (2022) have conducted a comprehensive survey exploring critical issues in their article "Quality Management in Forensic Science: A Closer Inspection." Their work is a crucial foundation for our discussion, urging the African forensic community to engage in more in-depth conversations. This letter briefly describes the survey, discussing embracing the Sydney Declaration (SD) for Forensic Sciences and issues of quality management systems comprising standards, accreditation, and potential regulation, and highlights the issue of cognitive competency from an African perspective. This underscores the urgent need for critical dialogue, emphasizing that the time for action is now, and urges practitioners, particularly in Africa, to enhance quality management systems to deliver superior forensic products.

CSI-CSI: Comparing several investigative approaches toward crime scene improvement

Crime scene investigations are highly complex environments that require the CSI to engage in complex decision-making. CSIs must rely on personal experience, context information, and scientific knowledge about the fundamental principles of forensic science to both find and correctly interpret ambiguous traces and accurately reconstruct a scene. Differences in CSI decision making can arise in multiple stages of a crime scene investigation. Given its crucial role in forensic investigation, CSI decision-making must be further studied to understand how differences may arise during the stages of a crime scene investigation. The following exploratory research project is a first step at comparing how crime scene investigations of violent robberies are conducted between 25 crime scene investigators from nine countries across the world. Through a mock crime scene and semi-structured interview, we observed that CSIs have adopted a variety of investigation approaches. The results show that CSIs have different working strategies and make different decisions when it comes to the construction of relevant hypotheses, their search strategy, and the collection of traces. These different decisions may, amongst other factors, be due to the use of prior information, a CSI's knowledge and experience, and the perceived goal of their investigation. We suggest the development of more practical guidelines to aid CSIs through a hypothetico-deductive reasoning process, where (a) CSIs are supported in the correct use of contextual information, (b) outside knowledge and expertise are integrated into this process, and (c) CSIs are guided in the evaluation of the utility of their traces.

The most consistent finding in forensic science is inconsistency

The most consistent finding in many forensic science domains is inconsistency (i.e., lack of reliability, reproducibility, repeatability, and replicability). The lack of consistency is a major problem, both from a scientific and a criminal justice point of view. Examining forensic conclusion data, from across many forensic domains, highlights the underlying cognitive issues and offers a better understanding of the issues and challenges. Such insights enable the development of ways to minimize these inconsistencies and move forward. The aim is to highlight the problem, so that it can be minimized and the reliability of forensic science evidence can be improved.

The secret life of crime labs

Houston TX experienced a widely known failure of its police forensic laboratory. This gave rise to the Houston Forensic Science Center (HFSC) as a separate entity to provide forensic services to the City of Houston. HFSC is a very large forensic laboratory and has made significant progress at remediating the past failures and improving public trust in forensic testing. HFSC has a large and robust blind testing program, which has provided many insights into the challenges forensic laboratories face. HFSC's journey from a notoriously failed lab to a model also gives perspective to the resource challenges faced by all labs in the country. Challenges for labs include the pervasive reality of poor-quality evidence. Also that forensic laboratories are necessarily part of a much wider system of interdependent functions in criminal justice making blind testing something in which all parts have a role. This interconnectedness also highlights the need for an array of oversight and regulatory frameworks to function properly. The major essential databases in forensics need to be a part of blind testing programs and work is needed to ensure that the results from these databases are indeed producing correct results and those results are being correctly used. Last, laboratory reports of "inconclusive" results are a significant challenge for laboratories and the system to better understand when these results are appropriate, necessary and most importantly correctly used by the rest of the system.

The scientific reinvention of forensic science

Forensic science is undergoing an evolution in which a long-standing "trust the examiner" focus is being replaced by a "trust the scientific method" focus. This shift, which is in progress and still partial, is critical to ensure that the legal system uses forensic information in an accurate and valid way. In this Perspective, we discuss the ways in which the move to a more empirically grounded scientific culture for the forensic sciences impacts testing, error rate analyses, procedural safeguards, and the reporting of forensic results. However, we caution that the ultimate success of this scientific reinvention likely depends on whether the courts begin to engage with forensic science claims in a more rigorous way.

Cognitive bias in pathology, as exemplified in dermatopathology

Cognitive bias refers to human thinking patterns, as well as pitfalls, that are reproducible. Importantly, cognitive bias is not intentionally discriminatory and is necessary to properly interpret the world around us, including microscopic slides. Thus, it is a useful exercise to examine cognitive bias in pathology, as exemplified in dermatopathology.

The role of alternative hypotheses in reducing bias in forensic medical experts' decision making

Medical opinions are often essential evidence in criminal cases but relatively little is known about the factors that impact forensic doctors' decision making. This research examines the role and impact of having an alternative hypothesis while forming a medical opinion. A scenario-based experiment with forensic doctors (n = 20) was conducted. In two out of three scenarios, the existence of alternative hypotheses impacted the actual opinions reached, the confidence in the judgments and the perceived consistency with the plaintiff hypothesis. Investigative and legal actors should be aware of the possibility of biases and importance of having alternative hypotheses when requesting and evaluating medical opinions.

History information management strategy for minimising biases and noise for improved medical diagnosis

Despite measures for physicians' excellence in diagnosis, the need for improvement of medical history techniques has been pointed out as one of the critical elements for improving diagnosis. Specific and proactive frameworks related to methods of effective history acquisition are needed to minimise bias and optimise decision-making. Therefore, this paper uses Linear Sequential Unmasking- Expanded to develop and propose a structured medical history acquisition strategy. The strength of this lies in its reliance on cognitive psychological processes. Breaking information gatherings and decisions into smaller tasks and ordering them correctly reduces cognitive load as well as minimises noise and bias cascade. Additionally, this approach can help physicians develop diagnostic expertise regardless of specialty.

Reducing the impact of cognitive bias in decision making: Practical actions for forensic science practitioners

Previously published methods for reducing the impact of cognitive bias in forensic decision making have focused primarily on actions at the laboratory or organizational levels. This paper presents generalized and specific actions that forensic science practitioners can take to reduce the impact of cognitive bias in their work. Practical examples illustrating ways that practitioners can implement many of the specific actions are also provided, along with some suggestions for handling court testimony about cognitive bias. The actions presented in this paper provide a means through which individual practitioners can take ownership for minimizing cognitive bias in their work. Such actions can provide supporting evidence to stakeholders that forensic practitioners acknowledge the existence of cognitive bias and its potential influence on their work, and they can also stimulate implementation of methods that focus on solutions at the laboratory and organizational levels.

Operation makalu air crash: influence of cognitive and human factors on decision-making

Two onboard crew members lost their lives in the fatal Makalu Air Cessna Grand Caravan 208B domestic cargo flight crash on May 16, 2018. The Disaster Victim Identification (DVI) procedure comprises external examination, photography, DNA collection, fingerprint collection, postmortem examination, antemortem information collection from the family members, and reconciliation. The major challenge of this operation was dealing with cognitive bias. The antemortem dental information of one of the deceased was revealed to the forensic experts just before the postmortem examination. This influenced the testing strategies. There was a tendency to neglect the complete dental examination presuming the identification was established. Later, during a thorough examination, the forensic odontologist realised that the initial decision was erroneous. Furthermore, there are few experience-based resources available to resolve cognitive bias issues. The authors begin by summarising complicated operations in which they have been involved, followed by a discussion of the key sources of cognitive bias along with the solution to resolve these issues in DVI preparedness planning.

The added value of behavioural information in crime scene investigations

Forensic and behavioural science are often seen as two different disciplines. However, there is a growing realization that the two disciplines should be more strongly integrated. Incorporating psychological theories on human behaviour in forensic science could help solving investigative problems, especially at the crime scene. At the crime scene it is not just about applying scientific methods to analyse traces; these traces must first be perceived and categorized as relevant. At the crime scene, the behavioural perspective of an investigative psychologist could play an important role. In this study, we examine to what extent (1) investigative psychologists detect deviant behavioural cues compared to forensic examiners when investigating a crime scene, (2) forensic examiners can find the relevant traces that can be associated with this behaviour and (3) the availability of a psychological report highlighting these behavioural cues helps forensic examiners in finding more relevant traces. To this end, a total of 14 investigative psychologists and 40 forensic examiners investigated a virtual 3D mock crime scene. The results of this study show that investigative psychologists see significantly more deviant behavioural cues than forensic examiners, and that forensic examiners who receive a psychological report on these cues recognize and collect significantly more traces that can be linked to deviant behaviour and have a high evidential value than examiners who did not receive this information. However, the study also demonstrates that behavioural information is likely to be ignored when it contradicts existing beliefs.

Exploring decision making 'noise' when interpreting the electrocardiogram in the context of cardiac cath lab activation

In this commentary paper, we discuss the use of the electrocardiogram to help clinicians make diagnostic and patient referral decisions in acute care settings. The paper discusses the factors that are likely to contribute to the variability and noise in the clinical decision making process for catheterization lab activation. These factors include the variable competence in reading ECGs, the intra/inter rater reliability, the lack of standard ECG training, the various ECG machine and filter settings, cognitive biases (such as automation bias which is the tendency to agree with the computer-aided diagnosis or AI diagnosis), the order of the information being received, tiredness or decision fatigue as well as ECG artefacts such as the signal noise or lead misplacement. We also discuss potential research questions and tools that could be used to mitigate this 'noise' and improve the quality of ECG based decision making.

Cognitive and human factors in legal layperson decision making: Sources of bias in juror decision making

Juries in adversarial courts are tasked with several responsibilities. They are asked to: 1) assess the credibility and reliability of the evidence presented; 2) deliberate; 3) and then reach a decision. Jurors are expected to evaluate said evidence in a rational/impartial manner, thus allowing the defendant their right to a fair trial. However, psychological research has shown that jurors are not rational and can reach inaccurate decisions by being biased by certain factors. The aim of the current review was to explore the potential sources from which biases are introduced into the jury. Three main sources of bias were focussed upon: 1) pre-trial bias; 2) cognitive bias; 3) bias from external legal actors (expert witnesses). Legal scholars commonly cite deliberations as a method of attenuating individual juror bias, this claim is evaluated in the review. The review concludes that bias is a multifaceted phenomenon introduced from many different elements, and that several sources of bias may interact with one another during a jury trial to cause the effects of bias to snowball. Four recommendations are made: 1) juror selection should be utilised to create heterogenous juries that challenge problematic biases from individual jurors; 2) increase the quality of expert testimony through training; 3) procedures such as Linear Sequential Unmasking should be adopted by expert witnesses to filter out some sources of bias; 4) legal professionals and jurors should be educated about the effects that biases may have on decision making; 5) more research into bias in jurors is needed.

A practical tool for information management in forensic decisions: Using Linear Sequential Unmasking-Expanded (LSU-E) in casework

Forensic analysts often receive information from a multitude of sources. Empirical work clearly demonstrates that biasing information can affect analysts' decisions, and that the order in which task-relevant information is received impacts human cognition and decision-making. Linear Sequential Unmasking (LSU; Dror et al., 2015) and LSU-Expanded (LSU-E; Dror & Kukucka, 2021) are examples of research-based procedural frameworks to guide laboratories' and analysts' consideration and evaluation of case information. These frameworks identify parameters—such as objectivity, relevance, and biasing power—to prioritize and optimally sequence information for forensic analyses. Moreover, the LSU-E framework can be practically incorporated into any forensic discipline to improve decision quality by increasing the repeatability, reproducibility, and transparency of forensic analysts’ decisions, as well as reduce bias. Future implementation of LSU and LSU-E in actual forensic casework can be facilitated by concrete guidance. We present here a practical worksheet designed to bridge the gap between research and practice by facilitating the implementation of LSU-E.

•

Contextual information can influence how forensic analysts perceive, interpret, and evaluate evidence.

•

Proper information sequencing can reduce bias and improve the repeatability and reproducibility of forensic decisions.

•

Linear Sequential Unmasking–Expanded (LSU-E) prioritizes objective, relevant, and non-suggestive information.

•

To close the gap between research and practice, we developed a worksheet to help laboratories and analysts implement LSU-E.

•

This worksheet aims to optimize information sequencing and promote transparency in forensic decisions.

A review of the life of John Plunkett (1947–2018)

The unusual forensic pathologist John Plunkett began life in a family steeped in legal tradition, his father becoming a judge at age 29, bringing his 8-year old John to court to observe. A man of the people, Dr. Plunkett had a mind intolerant of deviations from objective truth, which he used to establish factual innocence. Initially diagnosing 2 cases as Shaken Baby Syndrome (SBS) himself, his critical mind and ability to learn made him an early apostate from SBS beliefs. He worked on 948 medico-legal cases throughout his career. While helping others, he himself was sued by a prosecutor to silence him, but Dr. Plunkett was unbowed, and found not guilty by a judge. Not a natural academic, he nevertheless published highly cited articles on basic, oft-forgotten truths such as the lethality of short falls and the existence of lucid intervals. His articles have stood the test of time. He knew science is not a democracy, and counselled other physicians attacked in courts due to holding minority views. Plunkett influenced the lives of many accused and their children, eventually becoming expert in the thinking that could lead to false allegations of child abuse. This eventually defined him, as featured in a documentary movie, The Syndrome.

Metric forensic anthropology decisions: Reliability and biasability of sectioning-point-based sex estimates

Subjective decisions make human cognitive processes more susceptible to bias and error. Specifically, research indicates that additional context biases forensic anthropologists' morphological analyses. To address whether metric analyses are also subject to bias, we conducted a pilot study in which 52 experienced osteologists measured a difficult-to-classify human femur, with or without additional contextual information. Using a metric sectioning-point sex-estimation method, participants provided a sex estimate for individual skeletal element(s) and, when given multiple elements, the combined skeletal assemblage. Control group participants (n = 24) measured only the femur. In addition to the femur, bias group participants (n = 28) either measured a female humerus and viewed a female-biasing photograph (n = 14) or measured a male humerus and viewed a male-biasing photograph (n = 14). We explored whether the experts in the different groups would differ in: (1) femoral measurements; (2) femoral sex-estimation conclusions; and (3) final sex-estimation conclusions for the skeletal assemblage. Although the femoral measurements and femoral sex estimates were comparable across groups, the overall sex estimates in the female-biased group were impacted by contextual information-differing from both the control and male-biased groups (p < 0.001). Our results demonstrate that cognitive bias can occur even in metric sex-estimation conclusions. Specifically, this occurred when the metric data and single-element sex estimates were synthesized into an overall estimate. Thus, our results suggest that metric methods are most vulnerable to bias when data are synthesized into an overall conclusion, highlighting the need for bias countermeasures and comprehensive statistical frameworks for synthesizing metric data to mitigate the effects of cognitive bias.