Quality standards and guidelines for test validation for infectious diseases in veterinary laboratories

The World Organisation for Animal Health Manual of Diagnostic Tests and Vaccines for Terrestrial Animals, Chapter 1.1.1. summarises the most relevant governance and managerial aspects of veterinary testing laboratories, and Chapter 1.1.5. introduces quality management. Both chapters are based on the International Organization for Standardization/International Electrotechnical Commission standard, ISO/IEC 17025:2005 'General requirements for the competence of testing and calibration laboratories'. This paper provides an update of standards and regulatory bodies relevant for accreditation of quality management systems (QMS), with a focus on ISO/IEC 17025:2017 for testing and calibration laboratories. Important issues and considerations that a laboratory should address in the design and maintenance of its QMS are highlighted and examples provided, in particular aspects of test validation and verification, including measurement uncertainty (MU). A QMS aims to address all aspects of the laboratory operation, including staff, organisational structure, processes, and procedures. Accreditation of a diagnostic laboratory requires three notable components: (a) independent or third-party assessment; (b) suitably validated tests performed by proficient laboratory operators in an adequately equipped laboratory; and (c) ongoing internal and external quality control. Together, these components ensure a test outcome is the result of a standardised process and structured peer review, and demonstrate both competency and ability to produce technically valid diagnostic results that will meet the needs of customers - veterinarians, animal owners, regulators, organisations and industry - as well as the needs of decision-makers involved in animal health and surveillance programmes.

Introduction - Validation of tests for OIE-listed diseases as fit-for-purpose in a world of evolving diagnostic technologies

The World Organisation for Animal Health (OIE) has made leading contributions to the discipline of test validation science by providing standards and guidelines that inform the test validation process in terrestrial and aquatic animals. The OIE Manual of Diagnostic Tests and Vaccines for Terrestrial Animals, and the Manual of Diagnostic Tests for Aquatic Animals describe the test validation pathway in the context of fitness for purpose, elaborate on the importance of diagnostic sensitivity (DSe) and specificity (DSp) as measures of test accuracy, and designate additional factors (e.g. test cost, laboratory throughput capacity and rapidity of test results) that influence choices of a single test over others or the inclusion of a new test in a diagnostic process that includes multiple tests. This paper provides examples of each of the six main testing purposes listed in the Terrestrial Manual and describes additional metrics such as ruggedness and robustness that should be included in the validation of point-of-care tests. Challenges associated with new diagnostic technologies and platforms are described. Validated tests with estimates of DSe and DSp are needed to measure confidence in test results for OIE-listed diseases, to facilitate risk assessments related to animal movement, to estimate true prevalence, and for certification of disease freedom and use in epidemiological (risk factor) studies.

Validation, certification and registration of veterinary diagnostic test kits by the World Organisation for Animal Health Secretariat for Registration of Diagnostic Kits

In the field of diagnostic test validation, World Organisation for Animal Health (OIE) Reference Laboratories (RLs) have a pivotal role and provide the international community with impartial advice and support in the selection, development and validation of diagnostic tests, which can be applied to the specialist diseases for which they are designated. National RLs provide an invaluable function in supporting the introduction, ongoing validation and application of validated diagnostic tests in line with international standards. Experienced staff with extensive knowledge of such systems and access to specialist facilities for conducting work are available to monitor changes or advancements in technology. They consider their relevance and value to evolving diagnostic test requirements. Reference Laboratories often have a broad mandate of activity linking research or development programmes and surveillance activities to benefit the continual assessment and, if necessary, improvement of diagnostic tools. Reference Laboratories maintain or have access to unique biological archives (known positive and negative sample populations) and produce international reference standards, both of which are vital in establishing the necessary and detailed validation of any diagnostic test. Reference Laboratories act either singularly or in collaborative partnerships with other RLs or science institutes, but also, when required, and with impartiality, with the commercial sector, to ensure new tests are validated according to OIE standards. They promote and apply formal programmes of quality assurance (including proficiency testing programmes) for newly validated tests, ensuring ongoing monitoring and compliance with standards, or as required set out any limitations or uncertainties. Reference Laboratories publish information on test validation in the scientific literature and on relevant websites, as well as disseminating information at workshops and international conferences. Furthermore, they can offer training in the processes and systems underpinning test validation.

Diagnostic likelihood ratio - the next-generation of diagnostic test accuracy measurement

To select, interpret, and assess the fitness-for-purpose of diagnostic tests, we need to compare the likelihoods of test results being true vs. false across both infected and non-infected individuals. Diagnostic sensitivity (DSe) and specificity (DSp) report the accuracy of classification in infected and non-infected individuals separately and do not compare these likelihoods directly. Positive and negative predictive values combine these likelihoods, but they also heavily depend on the prevalence in the tested populations and, therefore, cannot be generalised. We propose the adoption of the diagnostic likelihood ratio (LR), which balances the likelihoods of true vs. false results and is population independent. As a relative measure, LR ignores the absolute accuracy of tests, and two tests with different accuracy profiles may have the same LR. This can be easily mitigated by using listed complementary measures of accuracy, including DSe and DSp, or ancillary selection criteria. Overall, LR is a more relevant and universal measure of diagnostic test accuracy, which makes it the logical next-generation measure to adopt. We illustrate the applications and benefits of LR using three assays certified by the World Organisation for Animal Health as serological tests for bovine tuberculosis.

Optimization and diagnostic evaluation of monoclonal antibody-based blocking ELISA formats for detection of neutralizing antibodies to Hendra virus in mammalian sera

Maintenance of Hendra virus (HeV) in pteropid bat populations has been associated with spillover events in horses, humans and dogs. Experimental studies have demonstrated infections for several other species including guinea pigs, cats and ferrets. The criteria of a sensitive and specific serological test that is effective for a range of species, but which does not require use of live virus, has not been satisfactorily addressed by currently available tests. We have evaluated the use of two HeV neutralizing monoclonal antibodies (mAbs) in a blocking format enzyme-linked immunosorbent assay (bELISA) to detect serum antibody against a recombinant expressed HeV G protein (sol G) in several animal species. The human mAb m102.4 neutralises both HeV and the closely related Nipah virus (NiV); the mouse mAb 1.2 neutralises only HeV. Given these functional differences, we have investigated both antibodies using a bELISA format. Diagnostic sensitivity (DSe) and diagnostic specificity (DSp) were optimized using individual thresholds for mAb 1.2 and m102.4. For mAb 1.2 the positive threshold of >33% inhibition yielded DSe and DSp values of 100% (95% CI 95.3-100.0) and 99.5 (95% CI 98.8-99.8) respectively; for mAb m102.4 a positive threshold of >49% inhibition gave DSe and DSp values of 100 (95% CI 95.3-100.0) and 99.8 (95% CI 99.2-100.0) respectively. At these thresholds the DSe was 100% for both tests relative to the virus neutralization test. Importantly, the occurrence of false positive reactions did not overlap across the assays. Therefore, by sequential and selective application of these assays, it is possible to identify false positive reactions and achieve a DSp that approximates 100% in the test population.

Next-generation sequencing workflows in veterinary infection biology: towards validation and quality assurance

Recent advancements in DNA sequencing methodologies and sequence data analysis have revolutionised research in many areas of biology and medicine, including veterinary infection biology. New technology is poised to bridge the gap between the research and diagnostic laboratory. This paper defines the potential diagnostic value and purposes of next-generation sequencing (NGS) applications in veterinary infection biology and explores their compatibility with the existing validation principles and methods of the World Organisation for Animal Health. Critical parameters for validation and quality control (quality metrics) are suggested, with reference to established validation and quality assurance guidelines for NGS-based methods of diagnosing human heritable diseases. Although most currently described NGS applications in veterinary infection biology are not primary diagnostic tests that directly result in control measures, this critical reflection on the advantages and remaining challenges of NGS technology should stimulate discussion on its diagnostic value and on the potential to validate NGS methods and monitor their diagnostic performance.

Henipavirus microsphere immuno-assays for detection of antibodies against Hendra virus

Hendra and Nipah viruses (HeV and NiV) are closely related zoonotic pathogens of the Paramyxoviridae family. Both viruses belong to the Henipavirus genus and cause fatal disease in animals and humans, though only HeV is endemic in Australia. In general and due to the acute nature of the disease, agent detection by PCR and virus isolation are the primary tools for diagnostic investigations. Assays for the detection of antibodies against HeV are fit more readily for the purpose of surveillance testing in disease epidemiology and to meet certification requirements in the international movement of horses. The first generation indirect ELISA has been affected by non-specific reactions which must be resolved using virus neutralisation serology conducted at laboratory bio-safety level 4 containment (PC4). Recent developments have enabled improvements in the available serology assays. The production of an expressed recombinant truncated HeV G protein has been utilised in ELISA and in Luminex-based multiplexed microsphere assays. In the latter format, two Luminex assays have been developed for use in henipavirus serology: a binding assay (designed for antibody detection and differentiation) and a blocking assay (designed as a surrogate for virus neutralisation). Equine and canine field sera were used to evaluate the two Luminex assays relative to ELISA and virus neutralisation serology. Results showed that Luminex assays can be effective as rapid, sensitive and specific tests for the detection of HeV antibody in horse and dog sera. The tests do not require PC4 containment and are appropriate for high throughput applications as might be required for disease investigations and other epidemiological surveillance. Also, the results show that the Luminex assays detect effectively HeV vaccine-induced antibodies.

Foot and mouth disease in the Lao People's Democratic Republic: II. Seroprevalence estimates, using structured surveillance and surveys of abattoirs

An examination of the seroprevalence of foot and mouth disease (FMD) virus was conducted in the Lao People's Democratic Republic (Lao PDR) from 1996 to 2005, using structured surveillance and abattoir-based studies. Under structured surveillance, seropositivity ranged from 65.7% (Vientiane Capital, 1996) to 3% (Houaphan, 2005) for cattle and buffalo; and from 2.8% (Vientiane Capital, 1998) to 0% in separate studies of pigs. In each study, species composition was significantly associated with seroprevalence rates. For abattoir surveys, the majority of samples (60.5%) came from Vientiane Capital (33.0%), Savannakhet (14.0%) and Champasak (13.5%) provinces. The overall proportion of animals testing positive for the presence of antibodies against the FMD virus was 18.7% (ranging from 50.8% in Vientiane Province to 1% in Phongsali). Generally, antibodies against serotype O were the most prevalent. Cattle and buffalo that tested as seropositive were significantly older than the seronegative animals (p < 0.00005). The overall proportional seropositivity was significantly different for different species, as was the case with the antibodies against serotypes O, A and Asia 1. Some 22% of cattle, 55% of buffalo and 23% of pigs demonstrated seropositivity but this varied significantly between provinces.

Foot and mouth disease in the Lao People's Democratic Republic: I. A review of recent outbreaks and lessons from control programmes

Foot and mouth disease (FMD) causes sporadic disease outbreaks in the Lao People's Democratic Republic (Lao PDR). As the Lao PDR is a major thoroughfare for transboundary animal movements, regular FMD outbreaks occur, causing economic hardship for farmers and their families. In this review of the recent history of FMD in the Lao PDR between 1997 and 2006, the authors examine the virological and epidemiological aspects of the disease and appropriate control measures, including the distribution of outbreaks, causative serotypes and the molecular epidemiology of the viruses, as well as large-scale vaccination programmes. The dominant serotype, type O, was reported every year from 1998 to 2005. The majority of outbreaks occurred in Vientiane Capital (n = 42; 28%) and the highest number of outbreaks were reported in cattle (n = 94; 61%); followed by buffalo (n = 41; 27%) and pigs (n = 18; 12%). All type A outbreaks occurred in cattle. Type Asia 1 outbreaks were reported in the central provinces around Vientiane Capital between 1996 and 1998.

Rapid serological profiling by enzyme-linked immunosorbent assay and its use as an epidemiological indicator of foot-and-mouth disease viral activity

Frequency distribution of reactivity levels of foot-and-mouth disease infection-specific antibodies in livestock populations was analysed. Specific antibody responses against non-capsid polyprotein 3ABC were assessed through a highly sensitive indirect enzyme-linked immonosorbent assay (I-ELISA 3ABC). A graphic display of data was designed based on three negative and three positive categories to illustrate reactivity patterns. The resulting patterns were correlated to the epidemiological status. On this basis, results of over 100,000 sera derived from cattle populations in regions with various well-documented epidemiological situations were compiled and are exemplified in this paper.Distinct distributions of antibody reactivity patterns reflecting the various epidemiological situations were attained. Whereas non-affected areas presented a rather homogenous negative pattern with very limited test-positive reactions, affected regions revealed quite heterogeneous profiles, including positive and negative categories, with distributions that varied according to the region. The use of graphic prints encompassing I-ELISA 3ABC antibody profile responses constituted an adequate epidemiological indicator of the risk of foot-and-mouth disease viral activity, providing immediate visualization for a rapid inference of the epidemiological situation of a region. Moreover, such profiles allowed for convenient follow-up of infection after a focus as a function of time and geographical spread.

Enzyme immunoassays for serological diagnosis of bovine brucellosis: A trial in Latin America

The results of a field trial conducted in Latin America with two indirect enzyme-linked immunosorbent assays (ELISAs) and two competitive ELISAs (CELISAs) for the detection of bovine antibody to Brucella abortus are reported. One of the CELISA formats performed most accurately. The percentage of positive reactions in the CELISA relative to the selected positive rose bengal agglutination test (RBT) and complement fixation test (CFT) results was 97.47%, the percentage of negatives relative to the selected negative RBT and CFT results for unexposed cattle was 98.32%, and the percentage of negatives in cattle vaccinated with B. abortus 19 was 96.51%. The same assay format under Canadian conditions had an actual sensitivity of 100%, a specificity of 99.90% in nonvaccinates, and a specificity of 97.7% in a strain 19-vaccinated population. Overall, the CELISA performed as expected and the results were not dissimilar from the results obtained in the Canadian study. This provided further evidence that this CELISA can in many instances differentiate infected cattle from those that are vaccinated or infected with a cross-reacting organism while still giving very few false-positive or false-negative results.

Minimum amount of penicillin prophylaxis required to control Streptococcus pyogenes epidemic in closed community

The prophylaxis required to control an epidemic of Streptococcus pyogenes throat infection in a junior detention centre has been reported. In a further epidemic an attempt was made to determine the minimum amount of penicillin required to control the outbreak. Oral penicillin (0.5 g) given as a single daily dose for 10 days to all boys after entry proved effective. The added risk of relatively deprived adolescent boys developing rheumatic fever is stressed.

Streptococcal infection in a Junior Detention Centre: a five-year study

In 1972 more than 20% of boys admitted to a closed community (Junior Detention Centre) developed acute tonsillitis and group-A streptococci were isolated from more than 40% of all boys at some time during their stay of two months. The most common serotype was M-type 5, which has frequently been associated with rheumatic fever in other epidemics; four cases of rheumatic fever occurred between 1972 and 1977. Various methods were tried to eliminate the infection, but only full penicillin prophylaxis (0.25 g oral penicillin 4 times a day for 10 days) to all boys on entry appeared to be effective. In a sample of cases of acute tonsillitis, group-A haemolytic streptococci were isolated from 31.7% by the use of dry swabs or unenriched transport medium, but with enrichment medium duplicate swabs, 77.6% yielded positive results. We question the current practice in some laboratories of reporting positive cultures only when more than ten colonies of beta-haemolytic streptococci are present. In this survey viruses did not appear to be an important cause of acute tonsillitis. High titres of streptococcal antibodies (antistreptolysin O, anti-desoxyribonuclease B and anti-M associated protein) were found, not only in cases and carriers, but in boys on entry to the centre. This supports epidemiological evidence that adolescent boys are particularly prone to streptococcal throat infections.

Hypothyroidism following partial thyroidectomy for thyrotoxicosis and its relationship to thyroid remnant size

One hundred and twenty-two patients were reviewed 1-7 years after partial thyroidectomy for thyrotoxicosis by two surgeons who had left thyroid remnants of different size. There was no significant difference in the prevalence of hypothyroidism or in the serum levels of thyroxine, tri-iodothyronine or thyroid-stimulating hormone between the two groups of patients. The overall prevalence of hypothyroidism was 16 per cent.

Study on a family with anderson--Fabry's disease and associated familial spastic paraplegia

A family in the north-east of England with Anderson--Fabry's disease is presented. Alpha-galactosidase activity in plasma and white cells was significantly reduced in three adult male members of the family. One of them had an abnormal chromosome karyotype pattern with an extra Y chromosome (47,XYY) and he was clinically less severely affected than his brothers. Coincidentally five other members of the family suffered from a form of familial spastic paraplegia.

Teesside coronary survey: an epidemiological study of acute attacks of myocardial infarction

A 12-month epidemiological survey of attacks of acute myocardial infarction was carried out in a large urban population. The incidence and mortality at all ages and in both sexes were examined. Altogether, 1938 attacks were diagnosed--an overall incidence of 4-89 per 1000 population. The 28-day fatality rate was 50-5%. A third of the patients were treated at home and these patients had a lower fatality rate than those in hospital, a difference that could not be attributed to age, sex, or severity of attack. Half of the deaths that were witnessed occurred suddenly and a further 21% occurred within the next two hours. The median time to patients coming under care was about three hours. As used at present, coronary care units are unlikely to improve fatality rates. Future advances in treatment must take place outside hospital and will require re-education of the public and the general practitioner.

Home or hospital care after myocardial infarction: is this the right question?

This article attempts to lay down guide-lines for the general practitioner faced with a patient with a myocardial infarction in his home. A too rigid distinction between home or hospital care should not be attempted. Rather the general practitioner should look at home and hospital care and decide which is more appropriate in a particular case. In particular, he must distinguish clearly between cases he sees very soon after an attack and those he sees some hours later. Two hours is suggested as a useful dividing time between the two groups of patients.

Anticoagulant therapy after myocardial infarction

Images