1
|
Morrison GS. Advancing a paradigm shift in evaluation of forensic evidence: The rise of forensic data science. Forensic Sci Int Synerg 2022; 5:100270. [PMID: 35634572 PMCID: PMC9133770 DOI: 10.1016/j.fsisyn.2022.100270] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/15/2022] [Revised: 05/06/2022] [Accepted: 05/16/2022] [Indexed: 12/05/2022]
Abstract
Widespread practice across the majority of branches of forensic science uses analytical methods based on human perception, and interpretive methods based on subjective judgement. These methods are non-transparent and are susceptible to cognitive bias, interpretation is often logically flawed, and forensic-evaluation systems are often not empirically validated. I describe a paradigm shift in which existing methods are replaced by methods based on relevant data, quantitative measurements, and statistical models; methods that are transparent and reproducible, are intrinsically resistant to cognitive bias, use the logically correct framework for interpretation of evidence (the likelihood-ratio framework), and are empirically validated under casework conditions.
Collapse
Affiliation(s)
- Geoffrey Stewart Morrison
- Forensic Data Science Laboratory, Aston University, Birmingham, UK
- Forensic Evaluation Ltd, Birmingham, UK
| |
Collapse
|
2
|
Attinger D, De Brabanter K, Champod C. Using the likelihood ratio in bloodstain pattern analysis. J Forensic Sci 2021; 67:33-43. [PMID: 34713435 DOI: 10.1111/1556-4029.14899] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/17/2021] [Revised: 07/15/2021] [Accepted: 08/25/2021] [Indexed: 11/27/2022]
Abstract
There is an apparent paradox that the likelihood ratio (LR) approach is an appropriate measure of the weight of evidence when forensic findings have to be evaluated in court, while it is typically not used by bloodstain pattern analysis (BPA) experts. This commentary evaluates how the scope and methods of BPA relate to several types of evaluative propositions and methods to which LRs are applicable. As a result of this evaluation, we show how specificities in scope (BPA being about activities rather than source identification), gaps in the underlying science base, and the reliance on a wide range of methods render the use of LRs in BPA more complex than in some other forensic disciplines. Three directions are identified for BPA research and training, which would facilitate and widen the use of LRs: research in the underlying physics; the development of a culture of data sharing; and the development of training material on the required statistical background. An example of how recent fluid dynamics research in BPA can lead to the use of LR is provided. We conclude that an LR framework is fully applicable to BPA, provided methodic efforts and significant developments occur along the three outlined directions.
Collapse
Affiliation(s)
| | - Kris De Brabanter
- Department of Statistics, Iowa State University, Ames, Iowa, USA.,Department of Industrial Manufacturing & Systems Engineering, Iowa State University, Ames, Iowa, USA
| | - Christophe Champod
- Ecole des Sciences Criminelles, Faculty of Law, Criminal Justice and Public Administration, Université de Lausanne, Lausanne, Switzerland
| |
Collapse
|
3
|
Bayesian interpretation of discrete class characteristics. Forensic Sci Int 2018; 292:125-130. [DOI: 10.1016/j.forsciint.2018.09.013] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/01/2018] [Revised: 09/02/2018] [Accepted: 09/15/2018] [Indexed: 11/21/2022]
|
4
|
Galbraith C, Smyth P. Analyzing user-event data using score-based likelihood ratios with marked point processes. DIGIT INVEST 2017. [DOI: 10.1016/j.diin.2017.06.009] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/28/2022]
|
5
|
Ishihara S. Strength of linguistic text evidence: A fused forensic text comparison system. Forensic Sci Int 2017; 278:184-197. [PMID: 28735218 DOI: 10.1016/j.forsciint.2017.06.040] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.1] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/27/2017] [Revised: 06/05/2017] [Accepted: 06/30/2017] [Indexed: 11/25/2022]
Abstract
Compared to other forensic comparative sciences, studies of the efficacy of the likelihood ratio (LR) framework in forensic authorship analysis are lagging. An experiment is described concerning the estimation of strength of linguistic text evidence within that framework. The LRs were estimated by trialling three different procedures: one is based on the multivariate kernel density (MVKD) formula, with each group of messages being modelled as a vector of authorship attribution features; the other two involve N-grams based on word tokens and characters, respectively. The LRs that were separately estimated from the three different procedures are logistic-regression-fused to obtain a single LR for each author comparison. This study used predatory chatlog messages sampled from 115 authors. To see how the number of word tokens affects the performance of a forensic text comparison (FTC) system, token numbers used for modelling each group of messages were progressively increased: 500, 1000, 1500 and 2500 tokens. The performance of the FTC system is assessed using the log-likelihood-ratio cost (Cllr), which is a gradient metric for the quality of LRs, and the strength of the derived LRs is charted as Tippett plots. It is demonstrated in this study that (i) out of the three procedures, the MVKD procedure with authorship attribution features performed best in terms of Cllr, and that (ii) the fused system outperformed all three of the single procedures. When the token length is 1500, for example, the fused system achieved a Cllr value of 0.15. Some unrealistically strong LRs were observed in the results. Reasons for these are discussed, and a possible solution to the problem, namely the empirical lower and upper bound LR (ELUB) method is trialled and applied to the LRs of the best-achieving fusion system.
Collapse
Affiliation(s)
- Shunichi Ishihara
- Department of Linguistics, The Australian National University, Canberra, Australia.
| |
Collapse
|
6
|
Morrison GS, Kaye DH, Balding DJ, Taylor D, Dawid P, Aitken CG, Gittelson S, Zadora G, Robertson B, Willis S, Pope S, Neil M, Martire KA, Hepler A, Gill RD, Jamieson A, de Zoete J, Ostrum RB, Caliebe A. A comment on the PCAST report: Skip the “match”/“non-match” stage. Forensic Sci Int 2017; 272:e7-e9. [DOI: 10.1016/j.forsciint.2016.10.018] [Citation(s) in RCA: 13] [Impact Index Per Article: 1.9] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/05/2016] [Accepted: 10/18/2016] [Indexed: 10/20/2022]
|
7
|
Abstract
Although the last forty years has seen considerable growth in the use of statistics in legal proceedings, it is primarily classical statistical methods rather than Bayesian methods that have been used. Yet the Bayesian approach avoids many of the problems of classical statistics and is also well suited to a broader range of problems. This paper reviews the potential and actual use of Bayes in the law and explains the main reasons for its lack of impact on legal practice. These include misconceptions by the legal community about Bayes' theorem, over-reliance on the use of the likelihood ratio and the lack of adoption of modern computational methods. We argue that Bayesian Networks (BNs), which automatically produce the necessary Bayesian calculations, provide an opportunity to address most concerns about using Bayes in the law.
Collapse
Affiliation(s)
- Norman Fenton
- School of Electronic Engineering and Computer Science, Queen Mary University London, London E1 4NS, United Kingdom
| | - Martin Neil
- School of Electronic Engineering and Computer Science, Queen Mary University London, London E1 4NS, United Kingdom
| | - Daniel Berger
- School of Electronic Engineering and Computer Science, Queen Mary University London, London E1 4NS, United Kingdom
| |
Collapse
|
8
|
Konigsberg LW, Frankenberg SR. Bayes in biological anthropology. AMERICAN JOURNAL OF PHYSICAL ANTHROPOLOGY 2013; 152 Suppl 57:153-84. [DOI: 10.1002/ajpa.22397] [Citation(s) in RCA: 46] [Impact Index Per Article: 4.2] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/10/2022]
Affiliation(s)
- Lyle W. Konigsberg
- Department of Anthropology; University of Illinois at Urbana-Champaign; Urbana IL 61801
| | - Susan R. Frankenberg
- Department of Anthropology; University of Illinois at Urbana-Champaign; Urbana IL 61801
| |
Collapse
|
9
|
Lambrou GI, Koultouki E, Adamaki M, Moschovi M. Resolving Sample Traces in Complex Mixtures with Microarray Analyses. Bioinformatics 2013. [DOI: 10.4018/978-1-4666-3604-0.ch055] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022] Open
Abstract
This chapter reviews the microarray technology and deal with the majority of aspects regarding microarrays. It focuses on today’s knowledge of separation techniques and methodologies of complex signal, i.e. samples. Overall, the chapter reviews the current knowledge on the topic of microarrays and presents the analyses and techniques used, which facilitate such approaches. It starts with the theoretical framework on microarray technology; second, the chapter gives a brief review on statistical methods used for microarray analyses, and finally, it contains a detailed review of the methods used for discriminating traces of nucleic acids within a complex mixture of samples.
Collapse
|
10
|
Using subsampling to estimate the strength of handwriting evidence via score-based likelihood ratios. Forensic Sci Int 2012; 216:146-57. [DOI: 10.1016/j.forsciint.2011.09.013] [Citation(s) in RCA: 20] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/15/2011] [Revised: 09/14/2011] [Accepted: 09/21/2011] [Indexed: 11/20/2022]
|
11
|
Neumann C, Ramotowski R, Genessay T. Forensic examination of ink by high-performance thin layer chromatography—The United States Secret Service Digital Ink Library. J Chromatogr A 2011; 1218:2793-811. [DOI: 10.1016/j.chroma.2010.12.070] [Citation(s) in RCA: 55] [Impact Index Per Article: 4.2] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/18/2010] [Revised: 12/12/2010] [Accepted: 12/14/2010] [Indexed: 11/30/2022]
|
12
|
|
13
|
Morrison GS. Comments on Coulthard & Johnson's (2007) portrayal of the likelihood-ratio framework. AUST J FORENSIC SCI 2009. [DOI: 10.1080/00450610903147701] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/20/2022]
|
14
|
Howard C, Gilmore S, Robertson J, Peakall R. ACannabis sativaSTR Genotype Database for Australian Seizures: Forensic Applications and Limitations. J Forensic Sci 2009; 54:556-63. [DOI: 10.1111/j.1556-4029.2009.01014.x] [Citation(s) in RCA: 35] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/30/2022]
|
15
|
Gonzalez-Rodriguez J, Rose P, Ramos D, Toledano DT, Ortega-Garcia J. Emulating DNA: Rigorous Quantification of Evidential Weight in Transparent and Testable Forensic Speaker Recognition. ACTA ACUST UNITED AC 2007. [DOI: 10.1109/tasl.2007.902747] [Citation(s) in RCA: 87] [Impact Index Per Article: 5.1] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/10/2022]
|
16
|
Cowell RG, Lauritzen SL, Mortera J. Identification and separation of DNA mixtures using peak area information. Forensic Sci Int 2006; 166:28-34. [PMID: 16650704 DOI: 10.1016/j.forsciint.2006.03.021] [Citation(s) in RCA: 50] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/13/2005] [Revised: 03/28/2006] [Accepted: 03/29/2006] [Indexed: 11/18/2022]
Abstract
We introduce a new methodology, based upon probabilistic expert systems, for analysing forensic identification problems involving DNA mixture traces using quantitative peak area information. Peak area is modelled with conditional Gaussian distributions. The expert system can be used for ascertaining whether individuals, whose profiles have been measured, have contributed to the mixture. It can also be used to predict DNA profiles of unknown contributors by separating the mixture into its individual components. The potential of our probabilistic methodology is illustrated on case data examples and compared with alternative approaches. The advantages are that identification and separation issues can be handled in a unified way within a single probabilistic model and the uncertainty associated with the analysis is quantified. Further work, required to bring the methodology to a point where it could be applied to the routine analysis of casework, is discussed.
Collapse
Affiliation(s)
- R G Cowell
- Faculty of Actuarial Science and Statistics, Cass Business School, London, UK.
| | | | | |
Collapse
|