Evaluating forensic DNA profiles using peak heights, allowing for multiple donors, allelic dropout and stutters

An exploratory view into allelic drop-out of sequenced autosomal STRs

As massively parallel sequencing is implemented in forensic genetics, an understanding of sequence data must accompany these advancements, that is, accurate modeling of data for proper statistical analysis. Allelic drop-out, a common stochastic effect seen in genetic data, is often modeled in statistical analysis of STR results. This proof-of-concept study sequenced several serial dilutions of a standard sample ranging from 4 ng to 7.82 pg to evaluate allelic drop-out trends on a select panel of autosomal STRs using the ForenSeq™ DNA Signature Prep Kit, Primer Set A on the Illumina MiSeq FGx. Parameters assessed included locus, profile, and run specific information. A majority of the allelic drop-out occurred in DNA concentrations less than 31.25 pg. Statistical results indicated a need for locus-specific modeling based on STR descriptors, like simple versus compound repeat patterns. No correlation was seen between average read count of scored alleles and allelic drop-out at a locus. A statistical correlation was observed between the amount of allelic drop-out and the starting amount of DNA in a sample, average read count of a sample, and total read count generated on a flow cell. This study supports using common allelic drop-out factors used in fragment length analysis on sequenced STRs while including additional locus, sample, and run specific information. Results demonstrate multiple factors that can be considered when developing probability of allelic drop-out models for sequenced autosomal STRs including locus-specific analysis, total read count of a profile, and total read count sequenced on a flow cell.

Effect existence of aging on stutter ratio evaluated via Bayesian inference

The stochastic behavior of the stutter ratio (SR) in capillary electrophoresis-based DNA typing is currently described and predicted using statistical models in forensic genetics. Clarifying this behavior can help obtain more objective and robust evidence to the court in terms of mixture interpretation. This study aimed to investigate the effect existence of aging on SR via a Bayesian framework. Nail scrapings and clippings were collected from 68 healthy individuals with informed consent. Samples were classified by age-class: young group (0-16 years; n = 36) and older-adult group (>61 years; n = 32). Then, they were compared in terms of their SRs for each simple repeat locus included in GlobalFiler Kit. Bayesian modeling was performed with lognormal distribution model, which implemented multiple linear regression, allele and age-class as explanatory variables. For all simple repeat loci, the median of the posterior distribution of the age-class parameter was a positive value. For CSF1PO and D7S820, the 95% credible interval of the posterior distribution did not include 0. Our data suggested that aging slightly increases the SR. These findings might help elucidate the stochastic behavior of SR.

A lights-out forensic DNA analysis workflow for no-suspect crime

An automated system of DNA profile processing (termed a 'lights-out' workflow) was trialled for no-suspect cases over a three-month period at Forensic Science SA (FSSA). The lights-out workflow utilised automated DNA profile reading using the neural network reading feature in FaSTR™ DNA with no analytical threshold. The profile information from FaSTR™ DNA was then processed in STRmix™ using a top-down analysis and automatically compared to a de-identified South Australian searchable DNA database. Computer scripts were used to generate link reports and upload reports and these were compared to the links and uploads that were obtained for the cases during their standard processing within the laboratory. The results of the lights-out workflow was an increase in both uploads and links compared to the standard workflow, with minimal adventitious links or erroneous uploads. Overall, the proof-of-concept study shows the potential for using automated DNA profile reading and top-down analysis to improve workflow efficiency in a no-suspect workflow.

Development and validation of Kongoh ver. 3.0.1: Open-source software for DNA mixture interpretation in the GlobalFiler system based on a quantitative continuous model

Probabilistic genotyping software based on continuous models is effective for interpreting DNA profiles derived from DNA mixtures and small DNA samples. In this study, we updated our previously developed Kongoh software (to ver. 3.0.1) to interpret DNA profiles typed using the GlobalFiler™ PCR Amplification Kit. Recently, highly sensitive typing systems such as the GlobalFiler system have facilitated the detection of forward, double-back, and minus 2-nt stutters; therefore, we implemented statistical models for these stutters in Kongoh. In addition, we validated the new version of Kongoh using 2-4-person mixtures and DNA profiles with degradation in the GlobalFiler system. The likelihood ratios (LRs) for true contributors and non-contributors were well separated as the information increased (i.e., larger peak height and fewer contributors), and these LRs tended to neutrality as the information decreased. These trends were observed even in profiles with DNA degradation. The LR values were highly reproducible, and the accuracy of the calculation was also confirmed. Therefore, Kongoh ver. 3.0.1 is useful for interpreting DNA mixtures and degraded DNA samples in the GlobalFiler system.

A Review of Probabilistic Genotyping Systems: EuroForMix, DNAStatistX and STRmix™

Probabilistic genotyping has become widespread. EuroForMix and DNAStatistX are both based upon maximum likelihood estimation using a γ model, whereas STRmix™ is a Bayesian approach that specifies prior distributions on the unknown model parameters. A general overview is provided of the historical development of probabilistic genotyping. Some general principles of interpretation are described, including: the application to investigative vs. evaluative reporting; detection of contamination events; inter and intra laboratory studies; numbers of contributors; proposition setting and validation of software and its performance. This is followed by details of the evolution, utility, practice and adoption of the software discussed.

Examining performance and likelihood ratios for two likelihood ratio systems using the PROVEDIt dataset

A likelihood ratio (LR) system is defined as the entire pipeline of the measurement and interpretation processes where probabilistic genotyping software (PGS) is a piece of the whole LR system. To gain understanding on how two LR systems perform, a total of 154 two-person, 147 three-person, and 127 four-person mixture profiles of varying DNA quality, DNA quantity, and mixture ratios were obtained from the filtered (.CSV) files of the GlobalFiler 29 cycles 15s PROVEDIt dataset and deconvolved in two independently developed fully continuous programs, STRmix v2.6 and EuroForMix v2.1.0. Various parameters were set in each software and LR computations obtained from the two software were based on same/fixed EPG features, same pair of propositions, number of contributors, theta, and population allele frequencies. The ability of each LR system to discriminate between contributor (H1-true) and non-contributor (H2-true) scenarios was evaluated qualitatively and quantitatively. Differences in the numeric LR values and their corresponding verbal classifications between the two LR systems were compared. The magnitude of the differences in the assigned LRs and the potential explanations for the observed differences greater than or equal to 3 on the log10 scale were described. Cases of LR < 1 for H1-true tests and LR > 1 for H2-true tests were also discussed. Our intent is to demonstrate the value of using a publicly available ground truth known mixture dataset to assess discrimination performance of any LR system and show the steps used to understand similarities and differences between different LR systems. We share our observations with the forensic community and describe how examining more than one PGS with similar discrimination power can be beneficial, help analysts compare interpretation especially with low-template profiles or minor contributor cases, and be a potential additional diagnostic check even if software in use does contain certain diagnostic statistics as part of the output.

Novel scientific methods in court

In recent decades the use of forensic science in investigations and therefore its subsequent presentation within the courts has increased exponentially, fuelled by an increase in scientific advances, development of databases and greater access to scientists and their expertise. This explosion in the use of forensic evidence has not been limited to one single scientific domain, as there are a broad range of scientific disciplines, encompassed by the general umbrella term' forensic science'. Many of these involve commonly applied methodologies and are accepted by the courts with limited scrutiny. Where tensions exist concerning the use of science in the courtroom is when novel or emerging sciences and scientific techniques are introduced. This may be particularly evident when the demands of the investigatory phase, where those working want to apply all possible tools at their disposal to gather as much evidence as possible and the needs of the courts, where the evidence must scientifically robust and admissible for it to be presented before a jury, come together. This paper examines the implications for the court for emerging or novel sciences and scientific techniques. In such cases, the potential rewards of implementing the scientific process and the information these may contribute to an investigation provides a temptation to investigators to push for their operational use, with the unintended consequence of posing an issue to the court when considering whether to admit the evidence into the judicial process.

A series of developmental validation tests for Number of Contributors platforms: Exemplars using NOCIt and a neural network

Complex DNA mixtures are challenging to interpret and require computational tools that aid in that interpretation. Recently, several computational methods that estimate the number of contributors (NOC) to a sample have been developed. Unlike analogous tools that interpret profiles and report LRs, NOC tools vary widely in their operational principle where some are Bayesian and others are machine learning tools. Conjunctionally, NOC tools may return a single n estimate, or a distribution on n. This vast array of constructs, coupled with a gap in standardized methods by which to validate NOC systems, warrants an exploration into the measures by which differing NOC systems might be tested for operations. In the current paper, we use two exemplar NOC systems: a probabilistic system named NOCIt, which renders an a posteriori probability (APP) distribution on the number of contributors given an electropherogram and an artificial neural network (ANN). NOCIt is a continuous Bayesian inference system incorporating models of peak height, degradation, differential degradation, forward and reverse stutter, noise and allelic drop-out while considering allele frequencies in a reference population. The ANN is also a continuous method, taking all the same features (barring degradation) into account. Unlike its Bayesian counterpart, it demands substantively more data to parameterize, requiring synthetic data. We explore each system's performance by conducting tests on 214 PROVEDIt mixtures where the limit of detection was 1-copy of DNA. We found that after a lengthy training period of approximately 24 h, the ANN's evaluation process was very fast and perfectly repeatable. In contrast, NOCIt only took a few minutes to train but took tens of minutes to complete each sample and was less repeatable. In addition, it rendered a probability distribution that was more sensitive and specific, affording a reasonable method by which to report all reasonable n that explain the evidence for a given sample. Whatever the method, by acknowledging the inherent differences between NOC systems, we demonstrate that validation constructs will necessarily be guided by the needs of the forensic domain and be dependent upon whether the laboratory seeks to assign a single n or range of n.

Evaluation of probability distribution models for stutter ratios in the typing system of GlobalFiler and 3500xL Genetic Analyzer

As DNA typing systems have become increasingly sensitive in recent years, probability distribution models for back, forward, double-back, and minus 2-nt stutter ratios have been desired to be considered in DNA evidence interpretation using specific software programs. However, experimental investigations have been insufficient, especially for forward, double-back, and minus 2-nt stutters. In this study, we experimentally reevaluated the probability distribution models for each stutter ratio in the typing systems of GlobalFiler™ PCR Amplification Kit and 3500xL Genetic Analyzer from Thermo Fisher Scientific. In addition, to enhance the reliability of longest uninterrupted stretch (LUS) values and corrected allele numbers used in previously developed models for stutter ratios using sequence information (i.e., LUS model and multi-seq model), we propose the weighted average of LUS values and corrected allele numbers based on the number of observations in sequence-based population data. Back stutter ratios demonstrated a positive correlation with allele numbers (allele model) in eight loci, LUS values (LUS model) in eight loci, and corrected allele numbers (multi-seq model) in five loci. The forward stutter ratios (FSRs) of D22S1045 followed the LUS model. FSRs other than D22S1045 and double-back stutter ratios followed the LUS model by considering multiple loci together. Minus 2-nt stutter ratios observed in SE33 and D1S1656 did not increase with the increase in the allele numbers. The adopted models for each stutter ratio can be implemented in software programs for DNA evidence interpretation and enable a reliable interpretation of crime stain profiles in forensic caseworks.

Validating TrueAllele® Interpretation of DNA Mixtures Containing up to Ten Unknown Contributors

Most DNA evidence is a mixture of two or more people. Cybergenetics TrueAllele^® system uses Bayesian computing to separate genotypes from mixture data and compare genotypes to calculate likelihood ratio (LR) match statistics. This validation study examined the reliability of TrueAllele computing on laboratory‐generated DNA mixtures containing up to ten unknown contributors. Using log(LR) match information, the study measured sensitivity, specificity, and reproducibility. These reliability metrics were assessed under different conditions, including varying the number of assumed contributors, statistical sampling duration, and setting known genotypes. The main determiner of match information and variability was how much DNA a person contributed to a mixture. Observed contributor number based on data peaks gave better results than the number known from experimental design. The study found that TrueAllele is a reliable method for analyzing DNA mixtures containing up to ten unknown contributors.

Probabilistic approaches to interpreting two-person DNA mixtures from post-coital specimens

Biological samples submitted for sexual assault investigation typically involve mixtures of DNA from the victim and the assailant/s. Providing a statistical weight to such evidence may be mathematically complex and may be affected by subjective judgment of a human analyst. Software tools have been developed to address these issues. To contribute towards improving the system for routine DNA testing of sexual assault cases, we evaluated two likelihood ratio (LR) approaches: a semi-continuous model using LRmix Studio and a fully continuous approach employed in STRmix™ for interpreting two-person DNA mixtures. LRs conditioned on the presence of the receptive partner's DNA were calculated for a total of 102 two-person DNA samples from simulated mixtures and various post-coital samples. Our results highlight the importance of maximising information provided into the LR calculation to generate strong support for the true hypothesis. This can be achieved by recovering sufficient DNA from a sample to minimise risk of drop-out and increase peak intensities and by implementing a statistical model that utilises as much of the electropherogram information as possible. LRmix is open-source and can handle profiles with allelic drop-out and drop-ins, however stuttering is not modelled and requires manual removal by a DNA analyst especially for mixtures with low template components. STRmix™ makes effective use of all available information by incorporating into its biological model complicating aspects of a DNA profile such as degradation, allele drop-out and drop-in, stutters, and peak height variability.

Probabilistic genotyping software: An overview

The interpretation of mixed profiles from DNA evidentiary material is one of the more challenging duties of the forensic scientist. Traditionally, analysts have used a "binary" approach to interpretation where inferred genotypes are either included or excluded from the mixture using a stochastic threshold and other biological parameters such as heterozygote balance, mixture ratio, and stutter ratios. As the sensitivity of STR multiplexes and capillary electrophoresis instrumentation improved over the past 25 years, coupled with the change in the type of evidence being submitted for analysis (from high quality and quantity (often single-source) stains to low quality and quantity (often mixed) "touch" samples), the complexity of DNA profile interpretation has equally increased. This review provides a historical perspective on the movement from binary methods of interpretation to probabilistic methods of interpretation. We describe the two approaches to probabilistic genotyping (semi-continuous and fully continuous) and address issues such as validation and court acceptance. Areas of future needs for probabilistic software are discussed.

Four model variants within a continuous forensic DNA mixture interpretation framework: Effects on evidential inference and reporting

Continuous mixture interpretation methods that employ probabilistic genotyping to compute the Likelihood Ratio (LR) utilize more information than threshold-based systems. The continuous interpretation schemes described in the literature, however, do not all use the same underlying probabilistic model and standards outlining which probabilistic models may or may not be implemented into casework do not exist; thus, it is the individual forensic laboratory or expert that decides which model and corresponding software program to implement. For countries, such as the United States, with an adversarial legal system, one can envision a scenario where two probabilistic models are used to present the weight of evidence, and two LRs are presented by two experts. Conversely, if no independent review of the evidence is requested, one expert using one model may present one LR as there is no standard or guideline requiring the uncertainty in the LR estimate be presented. The choice of model determines the underlying probability calculation, and changes to it can result in non-negligible differences in the reported LR or corresponding verbal categorization presented to the trier-of-fact. In this paper, we study the impact of model differences on the LR and on the corresponding verbal expression computed using four variants of a continuous mixture interpretation method. The four models were tested five times each on 101, 1-, 2- and 3-person experimental samples with known contributors. For each sample, LRs were computed using the known contributor as the person of interest. In all four models, intra-model variability increased with an increase in the number of contributors and with a decrease in the contributor’s template mass. Inter-model variability in the associated verbal expression of the LR was observed in 32 of the 195 LRs used for comparison. Moreover, in 11 of these profiles there was a change from LR > 1 to LR < 1. These results indicate that modifications to existing continuous models do have the potential to significantly impact the final statistic, justifying the continuation of broad-based, large-scale, independent studies to quantify the limits of reliability and variability of existing forensically relevant systems.

The Probabilistic Genotyping Software STRmix: Utility and Evidence for its Validity

Forensic DNA interpretation is transitioning from manual interpretation based usually on binary decision-making toward computer-based systems that model the probability of the profile given different explanations for it, termed probabilistic genotyping (PG). Decision-making by laboratories to implement probability-based interpretation should be based on scientific principles for validity and information that supports its utility, such as criteria to support admissibility. The principles behind STRmix™ are outlined in this study and include standard mathematics and modeling of peak heights and variability in those heights. All PG methods generate a likelihood ratio (LR) and require the formulation of propositions. Principles underpinning formulations of propositions include the identification of reasonably assumed contributors. Substantial data have been produced that support precision, error rate, and reliability of PG, and in particular, STRmix™. A current issue is access to the code and quality processes used while coding. There are substantial data that describe the performance, strengths, and limitations of STRmix™, one of the available PG software.

Separation/extraction, detection, and interpretation of DNA mixtures in forensic science (review)

Interpreting mixed DNA samples containing material from multiple contributors has long been considered a major challenge in forensic casework, especially when encountering low-template DNA (LT-DNA) or high-order mixtures that may involve missing alleles (dropout) and unrelated alleles (drop-in), among others. In the last decades, extraordinary progress has been made in the analysis of mixed DNA samples, which has led to increasing attention to this research field. The advent of new methods for the separation and extraction of DNA from mixtures, novel or jointly applied genetic markers for detection and reliable interpretation approaches for estimating the weight of evidence, as well as the powerful massively parallel sequencing (MPS) technology, has greatly extended the range of mixed samples that can be correctly analyzed. Here, we summarized the investigative approaches and progress in the field of forensic DNA mixture analysis, hoping to provide some assistance to forensic practitioners and to promote further development involving this issue.

Determining the number of contributors to DNA mixtures in the low-template regime: Exploring the impacts of sampling and detection effects

The interpretation of DNA evidence may rely upon the assumption that the forensic short tandem repeat (STR) profile is composed of multiple genotypes, or partial genotypes, originating from n contributors. In cases where the number of contributors (NOC) is in dispute, it may be justifiable to compute likelihood ratios that utilize different NOC parameters in the numerator and denominator, or present different likelihoods separately. Therefore, in this work, we evaluate the impact of allele dropout on estimating the NOC for simulated mixtures with up to six contributors in the presence or absence of a major contributor. These simulations demonstrate that in the presence of dropout, or with the application of an analytical threshold (AT), estimating the NOC using counting methods was unreliable for mixtures containing one or more minor contributors present at low levels. The number of misidentifications was only slightly reduced when we expand the number of STR loci from 16 to 21. In many of the simulations tested herein, the minimum and actual NOC differed by more than two, suggesting that low-template, high-order mixtures with allele counts fewer than six may be originating from as many as four-, five-, or six-persons. Thus, there is justification for the use of differing or multiple assumptions on the NOC when computing the weight of DNA evidence for low-template mixtures, particularly when the peak heights are in the vicinity of the signal threshold or allele counting methods are the mechanism by which the NOC is assessed.

Development and validation of open-source software for DNA mixture interpretation based on a quantitative continuous model

In criminal investigations, forensic scientists need to evaluate DNA mixtures. The estimation of the number of contributors and evaluation of the contribution of a person of interest (POI) from these samples are challenging. In this study, we developed a new open-source software “Kongoh” for interpreting DNA mixture based on a quantitative continuous model. The model uses quantitative information of peak heights in the DNA profile and considers the effect of artifacts and allelic drop-out. By using this software, the likelihoods of 1–4 persons’ contributions are calculated, and the most optimal number of contributors is automatically determined; this differs from other open-source software. Therefore, we can eliminate the need to manually determine the number of contributors before the analysis. Kongoh also considers allele- or locus-specific effects of biological parameters based on the experimental data. We then validated Kongoh by calculating the likelihood ratio (LR) of a POI’s contribution in true contributors and non-contributors by using 2–4 person mixtures analyzed through a 15 short tandem repeat typing system. Most LR values obtained from Kongoh during true-contributor testing strongly supported the POI’s contribution even for small amounts or degraded DNA samples. Kongoh correctly rejected a false hypothesis in the non-contributor testing, generated reproducible LR values, and demonstrated higher accuracy of the estimated number of contributors than another software based on the quantitative continuous model. Therefore, Kongoh is useful in accurately interpreting DNA evidence like mixtures and small amounts or degraded DNA samples.

Evaluation of low-template DNA profiles using peak heights

In recent years statistical models for the analysis of complex (low-template and/or mixed) DNA profiles have moved from using only presence/absence information about allelic peaks in an electropherogram, to quantitative use of peak heights. This is challenging because peak heights are very variable and affected by a number of factors. We present a new peak-height model with important novel features, including over- and double-stutter, and a new approach to dropin. Our model is incorporated in open-source

Evaluating forensic biology results given source level propositions

The evaluation of forensic evidence can occur at any level within the hierarchy of propositions depending on the question being asked and the amount and type of information that is taken into account within the evaluation. Commonly DNA evidence is reported given propositions that deal with the sub-source level in the hierarchy, which deals only with the possibility that a nominated individual is a source of DNA in a trace (or contributor to the DNA in the case of a mixed DNA trace). We explore the use of information obtained from examinations, presumptive and discriminating tests for body fluids, DNA concentrations and some case circumstances within a Bayesian network in order to provide assistance to the Courts that have to consider propositions at source level. We use a scenario in which the presence of blood is of interest as an exemplar and consider how DNA profiling results and the potential for laboratory error can be taken into account. We finish with examples of how the results of these reports could be presented in court using either numerical values or verbal descriptions of the results.

Exploring the Impacts of Ordinary Laboratory Alterations During Forensic DNA Processing on Peak Height Variation, Thresholds, and Probability of Dropout

Impacts of validation design on DNA signal were explored, and the level of variation introduced by injection, capillary changes, amplification, and kit lot was surveyed by examining a set of replicate samples ranging in mass from 0.25 to 0.008 ng. The variations in peak height, heterozygous balance, dropout probabilities, and baseline noise were compared using common statistical techniques. Data indicate that amplification is the source of the majority of the variation observed in the peak heights, followed by capillary lots. The use of different amplification kit lots did not introduce variability into the peak heights, heterozygous balance, dropout, or baseline. Thus, if data from case samples run over a significant time period are not available during validation, the validation must be designed to, at a minimum, include the amplification of multiple samples of varying quantity, with known genotype, amplified and run over an extended period of time using multiple pipettes and capillaries.

Uncertainty in the number of contributors in the proposed new CODIS set

The probability that multiple contributors are detected within a forensic DNA profile improves as more highly polymorphic loci are analysed. The assignment of the correct number of contributors to a profile is important when interpreting the DNA profiles. In this work we investigate the probability of a mixed DNA profile appearing as having originated from a fewer number of contributors for the African American, Asian, Caucasian and Hispanic US populations. We investigate a range of locus configurations from the proposed new CODIS set. These theoretical calculations are based on allele frequencies only and ignore peak heights. We show that the probability of a higher order mixture (five or six contributors) appearing as having originated from one less individual is high. This probability decreases as the number of loci tested increases.

Genotyping and interpretation of STR-DNA: Low-template, mixtures and database matches-Twenty years of research and development

The introduction of Short Tandem Repeat (STR) DNA was a revolution within a revolution that transformed forensic DNA profiling into a tool that could be used, for the first time, to create National DNA databases. This transformation would not have been possible without the concurrent development of fluorescent automated sequencers, combined with the ability to multiplex several loci together. Use of the polymerase chain reaction (PCR) increased the sensitivity of the method to enable the analysis of a handful of cells. The first multiplexes were simple: 'the quad', introduced by the defunct UK Forensic Science Service (FSS) in 1994, rapidly followed by a more discriminating 'six-plex' (Second Generation Multiplex) in 1995 that was used to create the world's first national DNA database. The success of the database rapidly outgrew the functionality of the original system - by the year 2000 a new multiplex of ten-loci was introduced to reduce the chance of adventitious matches. The technology was adopted world-wide, albeit with different loci. The political requirement to introduce pan-European databases encouraged standardisation - the development of European Standard Set (ESS) of markers comprising twelve-loci is the latest iteration. Although development has been impressive, the methods used to interpret evidence have lagged behind. For example, the theory to interpret complex DNA profiles (low-level mixtures), had been developed fifteen years ago, but only in the past year or so, are the concepts starting to be widely adopted. A plethora of different models (some commercial and others non-commercial) have appeared. This has led to a confusing 'debate' about the 'best' to use. The different models available are described along with their advantages and disadvantages. A section discusses the development of national DNA databases, along with details of an associated controversy to estimate the strength of evidence of matches. Current methodology is limited to searches of complete profiles - another example where the interpretation of matches has not kept pace with development of theory. STRs have also transformed the area of Disaster Victim Identification (DVI) which frequently requires kinship analysis. However, genotyping efficiency is complicated by complex, degraded DNA profiles. Finally, there is now a detailed understanding of the causes of stochastic effects that cause DNA profiles to exhibit the phenomena of drop-out and drop-in, along with artefacts such as stutters. The phenomena discussed include: heterozygote balance; stutter; degradation; the effect of decreasing quantities of DNA; the dilution effect.

Testing likelihood ratios produced from complex DNA profiles

The performance of any model used to analyse DNA profile evidence should be tested using simulation, large scale validation studies based on ground-truth cases, or alignment with trends predicted by theory. We investigate a number of diagnostics to assess the performance of the model using Hd true tests. Of particular focus in this work is the proportion of comparisons to non-contributors that yield a likelihood ratio (LR) higher than or equal to the likelihood ratio of a known contributor (LRPOI), designated as p, and the average LR for Hd true tests. Theory predicts that p should always be less than or equal to 1/LRPOI and hence the observation of this in any particular case is of limited use. A better diagnostic is the average LR for Hd true which should be near to 1. We test the performance of a continuous interpretation model on nine DNA profiles of varying quality and complexity and verify the theoretical expectations.