1
|
Taylor D, Kokshoorn B, Champod C. A practical treatment of sensitivity analyses in activity level evaluations. Forensic Sci Int 2024; 355:111944. [PMID: 38277913 DOI: 10.1016/j.forsciint.2024.111944] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/08/2023] [Revised: 01/09/2024] [Accepted: 01/15/2024] [Indexed: 01/28/2024]
Abstract
Evaluations of forensic observations considering activity level propositions are becoming more common place in forensic institutions. A measure that can be taken to interrogate the evaluation for robustness is called sensitivity analysis. A sensitivity analysis explores the sensitivity of the evaluation to the data used when assigning probabilities, or to the level of uncertainty surrounding a probability assignment, or to the choice of various assumptions within the model. There have been a number of publications that describe sensitivity analysis in technical terms, and demonstrate their use, but limited literature on how that theory can be applied in practice. In this work we provide some simplified examples of how sensitivity analyses can be carried out, when they are likely to show that the evaluation is sensitive to underlying data, knowledge or assumptions, how to interpret the results of sensitivity analysis, and how the outcome can be reported. We also provide access to an application to conduct sensitivity analysis.
Collapse
Affiliation(s)
- Duncan Taylor
- Forensic Science SA, GPO Box 2790, Adelaide, SA 5001, Australia; School of Biological Sciences, Flinders University, GPO Box 2100, Adelaide, SA 5001, Australia.
| | - Bas Kokshoorn
- Netherlands Forensic Institute, P.O.Box 24044, 2490 AA The Hague, the Netherlands; Forensic Trace Dynamics, Faculty of Technology, Amsterdam University of Applied Sciences, Amsterdam, the Netherlands
| | - Christophe Champod
- Faculty of Law, Criminal Justice and Public Administration, School of Criminal Justice, University of Lausanne, Lausanne-Dorigny, Switzerland
| |
Collapse
|
2
|
Kasprzyk I. Forensic botany: who?, how?, where?, when? Sci Justice 2023; 63:258-275. [PMID: 36870705 DOI: 10.1016/j.scijus.2023.01.002] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 07/31/2022] [Revised: 01/09/2023] [Accepted: 01/15/2023] [Indexed: 01/19/2023]
Abstract
Plants are a good source of biological forensic evidence; this is due to their ubiquity, their ability to collect reference material, and their sensitivity to environmental changes. However, in many countries, botanical evidence is recognised as being scientifically. Botanical evidence is not mostly used for perpertration, instead it tends to serve as circumstantial evidence. Plant materials constitute the basis, among others, for linking a suspect or object to a crime scene or a victim, confirming or not confirming an alibi, determining the post-mortem interval, and determining the origin of food/object. Forensic botany entails field work, knowledge of plants, understanding ecosystem processes, and a basis understaning of geoscience. In this study, experiments with mammal cadavers were conducted to determine the occurence of an event. The simplest criterion characterising botanical evidence is its size. Therefore, macroremains include whole plants or their larger fragments (e.g. tree bark, leaves, seeds, prickles, and thorns), whereas microscopic evidence includes palynomorphs (spores and pollen grains), diatoms, and tissues. Botanical methods allow for an analysis to be repeated multiple times and the test material is easy to collect in the field. Forensic botany can be supplemented with molecular analyses, which, although specific and sensitive, still require validation.
Collapse
Affiliation(s)
- Idalia Kasprzyk
- Institute of Biology and Biotechnology, College of Natural Sciences, University of Rzeszów, Al. Rejtana 16c, 35-959 Rzeszów, Poland.
| |
Collapse
|
3
|
Gill P, Benschop C, Buckleton J, Bleka Ø, Taylor D. A Review of Probabilistic Genotyping Systems: EuroForMix, DNAStatistX and STRmix™. Genes (Basel) 2021; 12:1559. [PMID: 34680954 PMCID: PMC8535381 DOI: 10.3390/genes12101559] [Citation(s) in RCA: 9] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/22/2021] [Revised: 09/24/2021] [Accepted: 09/28/2021] [Indexed: 11/24/2022] Open
Abstract
Probabilistic genotyping has become widespread. EuroForMix and DNAStatistX are both based upon maximum likelihood estimation using a γ model, whereas STRmix™ is a Bayesian approach that specifies prior distributions on the unknown model parameters. A general overview is provided of the historical development of probabilistic genotyping. Some general principles of interpretation are described, including: the application to investigative vs. evaluative reporting; detection of contamination events; inter and intra laboratory studies; numbers of contributors; proposition setting and validation of software and its performance. This is followed by details of the evolution, utility, practice and adoption of the software discussed.
Collapse
Affiliation(s)
- Peter Gill
- Forensic Genetics Research Group, Department of Forensic Sciences, Oslo University Hospital, 0372 Oslo, Norway;
- Department of Forensic Medicine, Institute of Clinical Medicine, University of Oslo, 0315 Oslo, Norway
| | - Corina Benschop
- Division of Biological Traces, Netherlands Forensic Institute, P.O. Box 24044, 2490 AA The Hague, The Netherlands;
| | - John Buckleton
- Department of Statistics, University of Auckland, Private Bag 92019, Auckland 1142, New Zealand;
- Institute of Environmental Science and Research Limited, Private Bag 92021, Auckland 1142, New Zealand
| | - Øyvind Bleka
- Forensic Genetics Research Group, Department of Forensic Sciences, Oslo University Hospital, 0372 Oslo, Norway;
| | - Duncan Taylor
- Forensic Science SA, GPO Box 2790, Adelaide, SA 5001, Australia;
- School of Biological Sciences, Flinders University, GPO Box 2100, Adelaide, SA 5001, Australia
| |
Collapse
|
4
|
Ommen DM, Saunders CP. A Problem in Forensic Science Highlighting the Differences between the Bayes Factor and Likelihood Ratio. Stat Sci 2021. [DOI: 10.1214/20-sts805] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/19/2022]
Affiliation(s)
- Danica M. Ommen
- Danica M. Ommen is Assistant Professor, Department of Statistics, Iowa State University, Ames, Iowa 50011, USA
| | - Christopher P. Saunders
- Christopher P. Saunders is Associate Professor, Department of Mathematics & Statistics, South Dakota State University, Brookings, South Dakota 57007, USA
| |
Collapse
|
5
|
Linden J, Taroni F, Marquis R, Bozza S. Bayesian multivariate models for case assessment in dynamic signature cases. Forensic Sci Int 2020; 318:110611. [PMID: 33290986 DOI: 10.1016/j.forsciint.2020.110611] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/16/2020] [Revised: 11/02/2020] [Accepted: 11/20/2020] [Indexed: 10/22/2022]
Abstract
Dynamic signatures are recordings of signatures made on digitizing devices such as tablet PCs. These handwritten signatures contain both dynamic and spatial information on every data point collected during the signature movement and can therefore be described in the form of multivariate data. The management of dynamic signatures represents a challenge for the forensic science community through its novelty and the volume of data available. Much as for static signatures, the authenticity of dynamic signatures may be doubted, which leads to a forensic examination of the unknown source signature. The Bayes' factor, as measure of evidential support, can be assigned with statistical models to discriminate between competing propositions. In this respect, the limitations of existing probabilistic solutions to deal with dynamic signature evidence is pointed out and explained in detail. In particular, the necessity to remove the independence assumption between questioned and reference material is emphasized.
Collapse
Affiliation(s)
- Jacques Linden
- School of Criminal Justice, University of Lausanne, CH-1015 Lausanne Dorigny, Switzerland.
| | - Franco Taroni
- School of Criminal Justice, University of Lausanne, CH-1015 Lausanne Dorigny, Switzerland
| | - Raymond Marquis
- School of Criminal Justice, University of Lausanne, CH-1015 Lausanne Dorigny, Switzerland
| | - Silvia Bozza
- Dipartimento di Economia, Università Ca' Foscari Venezia, Dorsoduro, 3246, 30123 Venezia VE, Italy; School of Criminal Justice, University of Lausanne, CH-1015 Lausanne Dorigny, Switzerland
| |
Collapse
|
6
|
Probabilistic reporting in criminal cases in the United States: A baseline study. Sci Justice 2020; 60:406-414. [DOI: 10.1016/j.scijus.2020.06.001] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 03/10/2020] [Revised: 06/02/2020] [Accepted: 06/07/2020] [Indexed: 11/22/2022]
|
7
|
Taylor D, Balding D. How can courts take into account the uncertainty in a likelihood ratio? Forensic Sci Int Genet 2020; 48:102361. [PMID: 32769057 DOI: 10.1016/j.fsigen.2020.102361] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/16/2020] [Revised: 05/17/2020] [Accepted: 07/22/2020] [Indexed: 11/19/2022]
Abstract
As legal practitioners and courts become more aware of scientific methods and evidence evaluation, they are demanding measures of the reliability of expert opinion. In particular, there are calls for error rates to accompany opinion evidence in comparative forensic sciences. While error rates or confidence intervals can be useful for those disciplines that claim to identify the source of a trace, the call for these statistical tools has extended to sciences that present opinions in the form of a likelihood ratio. In this article we argue against presenting both a likelihood ratio and numerical measures of its uncertainty. We explain how the LR already encapsulates uncertainty. Instead we consider how sensitivity analyses can be used to guide the presentation of LRs that are informative to the court and not unfair to defendants.
Collapse
Affiliation(s)
- Duncan Taylor
- School of Biological Sciences, Flinders University, GPO Box 2100 Adelaide, SA, 5001, Australia; Forensic Science SA, PO Box 2790, Adelaide, SA, 5000, Australia.
| | - David Balding
- Melbourne Integrative Genomics, School of BioSciences and School of Mathematics & Statistics, University of Melbourne, Australia
| |
Collapse
|
8
|
Buckleton JS, Bright JA, Ciecko A, Kruijver M, Mallinder B, Magee A, Malsom S, Moretti T, Weitz S, Bille T, Noël S, Oefelein RH, Peck B, Kalafut T, Taylor DA. Response to: Commentary on: Bright et al. (2018) Internal validation of STRmix™ - A multi laboratory response to PCAST, Forensic Science International: Genetics, 34: 11-24. Forensic Sci Int Genet 2019; 44:102198. [PMID: 31710898 DOI: 10.1016/j.fsigen.2019.102198] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/18/2019] [Revised: 09/28/2019] [Accepted: 10/30/2019] [Indexed: 10/25/2022]
Affiliation(s)
- John S Buckleton
- Institute of Environmental Science and Research Limited, Private Bag 92021, Auckland, 1142, New Zealand; University of Auckland, Department of Statistics, Auckland, New Zealand
| | - Jo-Anne Bright
- Institute of Environmental Science and Research Limited, Private Bag 92021, Auckland, 1142, New Zealand.
| | - Anne Ciecko
- Midwest Regional Forensic Laboratory, Andover, Minnesota, United States
| | - Maarten Kruijver
- Institute of Environmental Science and Research Limited, Private Bag 92021, Auckland, 1142, New Zealand
| | | | | | - Simon Malsom
- Key Forensic Services Ltd., UK, Norwich Laboratory, United Kingdom
| | | | - Steven Weitz
- US Bureau of Alcohol, Tobacco, Firearms, Explosives Laboratory (ATF), United States
| | - Todd Bille
- US Bureau of Alcohol, Tobacco, Firearms, Explosives Laboratory (ATF), United States
| | - Sarah Noël
- Laboratoire de Sciences Judiciaires et de Médecine Légale, Direction Biologie/ADN, 1701 Parthenais, Montréal, Québec, H2K 3S7, Canada
| | | | - Brian Peck
- Center of Forensic Science Toronto, Canada
| | | | - Duncan A Taylor
- Forensic Science South Australia, Australia; University of Adelaide, South Australia, Australia
| |
Collapse
|
9
|
Ostrum RB. CSFS Document Section Position on the Logical Approach to Evidence Evaluation and Corresponding Wording of Conclusions. CANADIAN SOCIETY OF FORENSIC SCIENCE JOURNAL 2019. [DOI: 10.1080/00085030.2019.1635736] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/26/2022]
Affiliation(s)
- R. Brent Ostrum
- Chairman, QD Section, Canadian Society of Forensic Science, Ottawa, Canada
| |
Collapse
|
10
|
Ostrum RB. La position de la Section des documents de la SCSJ sur l'approche logique de l'évaluation de la preuve et le libellé des conclusions. CANADIAN SOCIETY OF FORENSIC SCIENCE JOURNAL 2019. [DOI: 10.1080/00085030.2019.1635738] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/26/2022]
Affiliation(s)
- R. Brent Ostrum
- Président, Section des documents de la Société canadienne des sciences judiciaires, Ottawa, Canada
| |
Collapse
|
11
|
|
12
|
Konigsberg LW, Frankenberg SR, Liversidge HM. Status of Mandibular Third Molar Development as Evidence in Legal Age Threshold Cases. J Forensic Sci 2018; 64:680-697. [DOI: 10.1111/1556-4029.13926] [Citation(s) in RCA: 10] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/08/2018] [Revised: 08/31/2018] [Accepted: 09/19/2018] [Indexed: 11/29/2022]
Affiliation(s)
- Lyle W. Konigsberg
- Department of Anthropology University of Illinois at Urbana‐Champaign Urbana IL 61801
| | - Susan R. Frankenberg
- Department of Anthropology University of Illinois at Urbana‐Champaign Urbana IL 61801
| | - Helen M. Liversidge
- Institute of Dentistry, Barts and the London School of Medicine and Dentistry Queen Mary University of London London E1 2AD U.K
| |
Collapse
|
13
|
Evaluation of forensic genetics findings given activity level propositions: A review. Forensic Sci Int Genet 2018; 36:34-49. [DOI: 10.1016/j.fsigen.2018.06.001] [Citation(s) in RCA: 67] [Impact Index Per Article: 11.2] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/05/2018] [Revised: 05/31/2018] [Accepted: 06/01/2018] [Indexed: 12/31/2022]
|
14
|
|
15
|
Ommen DM, Saunders CP, Neumann C. The characterization of Monte Carlo errors for the quantification of the value of forensic evidence. J STAT COMPUT SIM 2017. [DOI: 10.1080/00949655.2017.1280036] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/20/2022]
Affiliation(s)
- Danica M. Ommen
- Department of Mathematics and Statistics, South Dakota State University, Brookings, SD, USA
| | | | - Cedric Neumann
- Department of Mathematics and Statistics, South Dakota State University, Brookings, SD, USA
| |
Collapse
|
16
|
|
17
|
Use of relevant data, quantitative measurements, and statistical models to calculate a likelihood ratio for a Chinese forensic voice comparison case involving two sisters. Forensic Sci Int 2016; 267:115-124. [DOI: 10.1016/j.forsciint.2016.08.017] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/08/2016] [Revised: 08/02/2016] [Accepted: 08/08/2016] [Indexed: 11/23/2022]
|