Comparison of the Performance of Two Galactomannan Detection Tests: Platelia Aspergillus Ag and Aspergillus Galactomannan Ag Virclia Monotest

How to verify and validate a clinical microbiology test before it can be used in routine diagnostics: a practical guide

BACKGROUND

Before a new test can be routinely used in your laboratory, its reliability must be established in the laboratory where it will be used. International standards demand validation and verification procedures for new tests. The International Organization for Standardization (ISO) 15189 was recently updated, and the European Commission's In Vitro Diagnostic Regulation (IVDR) came into effect. These events will likely increase the need for validation and verification procedures.

OBJECTIVES

This paper aims to provide practical guidance in validating or verifying microbiology tests, including antimicrobial susceptibility tests in a clinical microbiology laboratory.

SOURCES

It summarizes and interprets certain parts of standards such as ISO 15189:2022, and regulations, such as IVDR 2017/746 regarding validation or verification of a new test in a routine clinical microbiology laboratory.

CONTENT

The reasons for choosing a new test and the outline of the validation and verification plan are discussed. Furthermore, the following topics are touched upon: the choice of reference standard, number of samples, testing procedures, how to solve the discrepancies between results from new test and reference standard, and acceptance criteria. Arguments for selecting certain parameters (such as reference standard and sample size) and examples are given.

IMPLICATIONS

With the expected increase in validation and verification procedures because of the implementation of IVDR, this paper may aid in planning and executing these procedures.

Diagnostic Value of Serum Biomarkers for Invasive Aspergillosis in Haematologic Patients

BACKGROUND

Invasive aspergillosis (IA) is a significant cause of morbidity and mortality in patients with haematological malignancies. Accurate diagnosis of IA is challenging due to non-specific symptoms and the impact of antifungal prophylaxis on biomarker sensitivity.

METHODS

This retrospective study evaluated the diagnostic performance of three serum biomarkers: Aspergillus Galactomannan Ag VirClia Monotest® (VirClia), Wako β-D-Glucan Test® (Wako BDG), and MycoGENIE Real-Time PCR® (MycoGENIE PCR). True positives were defined as patients with proven or probable IA (n = 14), with a positive Platelia Aspergillus Antigen® (Platelia) serving as a mycological criterion. True negatives were identified as patients with a positive Platelia assay but classified as non-probable IA (n = 10) and outpatients who consistently tested negative with the Platelia test throughout the study period (n = 20).

RESULTS

Most patients diagnosed with proven or probable IA were acute myeloid leukaemia or myelodysplastic syndrome patients receiving mould-active antifungal prophylaxis or treatment (71%). VirClia demonstrated high sensitivity (100%) for detecting IA, with a specificity of 83%. Wako BDG and MycoGENIE PCR showed lower sensitivities for IA (57% and 64%, respectively). MycoGENIE PCR detected Aspergillus spp. and Mucorales in two patients.

CONCLUSIONS

Accurate diagnosis of IA remains challenging, especially in patients who have received mould-active antifungal treatment. VirClia showed comparable performance to Platelia, suggesting its potential for routine use. However, Wako BDG and MycoGENIE PCR results were less favourable in our study cohort. Nevertheless, MycoGENIE PCR detected two probable co-infections with Aspergillus spp. and Mucorales.

Progress on nonculture based diagnostic tests for invasive mould infection

PURPOSE OF REVIEW

This review describes the current status of diagnosing invasive mould disease and Pneumocystis pneumonia using nonconventional diagnostics methods.

RECENT FINDINGS

There has been significant development in the range of nonculture mycological tests. Lateral flow tests (LFTs) for diagnosing aspergillosis complement galactomannan ELISA testing, and LFTs for other fungal diseases are in development. Rapid and low through-put B-D-Glucan assays increase access to testing and there has been significant progress in the standardization/development of molecular tests. Despite this, no single perfect test exists and combining tests (e.g., antigen and molecular testing) is likely required for the optimal diagnosis of most fungal diseases.

SUMMARY

Based on established clinical performance few mycological tests can be used alone for optimal diagnosis of fungal disease (FD) and combining tests, including classical approaches is the preferred route for confirming and excluding disease. Next-generation sequencing will likely play an increasing role in how we diagnose disease, but optimization, standardization and validation of the entire molecular process is needed and we must consider how host biomarkers can stratify risk. Given the burden of FD in low- and medium-income countries, improved access to novel but more so existing diagnostic testing is critical along with simplification of testing processes.

Comparative performance of the Platelia Aspergillus Antigen and Aspergillus Galactomannan antigen Virclia Monotest immunoassays in serum and lower respiratory tract specimens: a "real-life" experience

The Platelia Aspergillus Antigen immunoassay is the "gold standard" for Aspergillus galactomannan (GLM) measurement in sera and bronchoalveolar lavage (BAL) for the diagnosis of invasive pulmonary aspergillosis (IPA). We evaluated the performance of the Aspergillus GLM antigen Virclia Monotest compared to the Platelia assay. A total of 535 specimens [320 sera, 86 bronchial aspirates (BAs), 70 BAL, and 59 tracheal aspirates (TAs)] from 177 adult patients (72 hematological, 32 Intensive Care Unit, and 73 hospitalized in other wards) were processed for GLM testing upon clinical request. One patient had proven IPA, and 11 had probable disease. After excluding indeterminate Virclia results (n = 38), 396 specimens yielded concordant results (56 positive and 340 negative) and 101 discordant results (Virclia positive/Platelia negative, n = 95). The overall agreement between immunoassays was higher for sera (κ 0.56) than for BAL (κ ≤ 0.24) or BAS and TA (κ ≤ 0.22). When considering all specimen types in combination, the overall sensitivity and specificity of the Virclia assay for the diagnosis of proven/probable IPA were 100% and 65%, respectively, and for the Platelia immunoassay, sensitivity and specificity were 91.7% and 89.4%, respectively. The correlation between index values by both immunoassays was strong for serum/BAL (ρ = 0.73; P < 0.001) and moderate for BAS/TA (Rho = 0.52; P = 0.001). The conversion of Virclia index values into the Platelia index could be derived by the formula y = (11.97 * X)/3.62 + X). Data from GLM-positive serum/BAL clinical specimens fitted the regression model optimally (R2 = 0.94), whereas that of BAS and TA data did not (R2 = 0.11). Further studies are needed to determine whether the Virclia assay may be an alternative to the Platelia assay for GLM measurement in sera and lower respiratory tract specimens.IMPORTANCEGalactomannan detection in serum or bronchoalveolar fluid specimens is pivotal for the diagnosis of invasive pulmonary aspergillosis (IPA). The Platelia Aspergillus Antigen immunoassay has become the "gold standard" for Aspergillus GLM measurement. Here, we provide data suggesting that the Virclia Monotest assay, which displays several operational advantages compared with the Platelia assay, may become an alternative to the Platelia assay, although further studies are needed to validate this assumption. We also provide a formula allowing the conversion of Virclia index values into Platelia values. The study may contribute toward positioning the Virclia assay within the diagnostic algorithm of IPA.

Evaluation of the JF5-based Aspergillus galactomannoprotein lateral flow device for diagnosing invasive aspergillosis in cancer patients

PURPOSE

Cancer patients are at heightened risk for invasive aspergillosis (IA), a condition associated with elevated mortality risk. The JF5-based Aspergillus Galactomannoprotein Lateral Flow Device (AspLFD) offers rapid point-of-care testing (POCT) for IA. This study evaluated the diagnostic performance of AspLFD in cancer populations.

METHODS

This retrospective study examined cancer patient bronchoalveolar lavage fluid (BALF) and serum samples collected between September 2021 and January 2023. Both AspLFD and galactomannan (GM) assays were conducted, and the results were analysed by two independent researchers.

RESULTS

This study included 242 samples from 218 cancer patients, with 58 BALF and 184 serum samples. The overall agreement between AspLFD and GM assay results was 92.1%, with a kappa value of 0.552. AspLFD diagnosed proven/probable IA with a sensitivity and specificity of 91.7% and 95.3%, respectively, whereas GM exhibited sensitivity and specificity values of 83.3% and 93.7%, respectively. There were no statistical differences in the sensitivity and specificity between the two methods (P > 0.05). For serum analyses, AspLFD and GM exhibited similar sensitivity (66.7% vs. 66.7%, P > 0.05) and specificity (98.6% vs. 96.6%, P > 0.05) values. However, the sensitivity of the AspLFD was superior to the GM assay (100% vs. 88.9%) in BALF analyses but the difference was not statistically significant (P > 0.05), with no difference in specificity (83.7% vs. 83.7%, P > 0.05). In the solid-tumour cohort, both the AspLFD and GM assay exhibited high sensitivity (100% for both) and specificity (94.2% vs. 92.8%, P > 0.05).

CONCLUSION

The AspLFD demonstrated good performance in diagnosing IA in cancer patients, especially those with solid tumours. The AspLFD is thus an alternative POCT, particularly when GM evaluations are not readily available.

Acute Invasive Pulmonary Aspergillosis: Clinical Presentation and Treatment

Among all clinical manifestations of pulmonary aspergillosis, invasive pulmonary aspergillosis (IPA) is the most acute presentation. IPA is caused by Aspergillus hyphae invading the pulmonary tissue, causing either tracheobronchitis and/or bronchopneumonia. The degree of fungal invasion into the respiratory tissue can be seen as a spectrum, going from colonization to deep tissue penetration with angio-invasion, and largely depends on the host's immune status. Patients with prolonged, severe neutropenia and patients with graft-versus-host disease are at particularly high risk. However, IPA also occurs in other groups of immunocompromised and nonimmunocompromised patients, like solid organ transplant recipients or critically ill patients with severe viral disease. While a diagnosis of proven IPA is challenging and often warranted by safety and feasibility, physicians must rely on a combination of clinical, radiological, and mycological features to assess the likelihood for the presence of IPA. Triazoles are the first-choice regimen, and the choice of the drug should be made on an individual basis. Adjunctive therapy such as immunomodulatory treatment should also be taken into account. Despite an improving and evolving diagnostic and therapeutic armamentarium, the burden and mortality of IPA still remains high. This review aims to give a comprehensive and didactic overview of the current knowledge and best practices regarding the epidemiology, clinical presentation, diagnosis, and treatment of acute IPA.

Microbiological Diagnosis of Pulmonary Aspergillus Infections

As microbiological tests play an important role in our diagnostic algorithms and clinical approach towards patients at-risk for pulmonary aspergillosis, a good knowledge of the diagnostic possibilities and especially their limitations is extremely important. In this review, we aim to reflect critically on the available microbiological diagnostic modalities for diagnosis of pulmonary aspergillosis and formulate some future prospects. Timely start of adequate antifungal treatment leads to a better patient outcome, but overuse of antifungals should be avoided. Current diagnostic possibilities are expanding, and are mainly driven by enzyme immunoassays and lateral flow device tests for the detection of Aspergillus antigens. Most of these tests are directed towards similar antigens, but new antibodies towards different targets are under development. For chronic forms of pulmonary aspergillosis, anti-Aspergillus IgG antibodies and precipitins remain the cornerstone. More studies on the possibilities and limitations of molecular testing including targeting resistance markers are ongoing. Also, metagenomic next-generation sequencing is expanding our future possibilities. It remains important to combine different test results and interpret them in the appropriate clinical context to improve performance. Test performances may differ according to the patient population and test results may be influenced by timing, the tested matrix, and prophylactic and empiric antifungal therapy. Despite the increasing armamentarium, a simple blood or urine test for the diagnosis of aspergillosis in all patient populations at-risk is still lacking. Research on diagnostic tools is broadening from a pathogen focus on biomarkers related to the patient and its immune system.

Rational design of antibodies and development of a novel method for (1-3)-β-D glucan detection as an alternative to Limulus amebocyte lysate assay

With advances in medicine, increasing medical interventions have increased the risk of invasive fungal disease development. (1-3)-β-D glucan (BDG) is a common fungal biomarker in serological tests. However, the scarcity of Limulus resources for BDG detection poses a challenge. This study addresses the need for an alternative to Limulus amebocyte lysate by using BDG mutant antibody for chemiluminescence detection. The wild-type BDG antibody was obtained by immunizing rabbits. An optimal V52HI/N34L Y mutant antibody, which has increased 3.7-fold of the testing efficiency compared to the wild-type antibody, was first achieved by mutating "hot-spot" residues that contribute to strong non-covalent bonds, as determined by alanine scanning and molecular dynamics simulation. The mutant was then applied to develop the magnetic particle chemiluminescence method. 574 clinical samples were tested using the developed method, with a cutoff value of 95 pg/mL set by Limulus amebocyte lysate. The receiver operating characteristic curve demonstrated an area under the curve of 0.905 (95% CI: 0.880-0.929). Chemiluminescence detected an antigen concentration of 89.98 pg/mL, exhibiting a sensitivity of 83.33% and specificity of 89.76%. In conclusion, the results showed a good agreement with Limulus amebocyte lysate and demonstrated the feasibility of using BDG mutant antibodies for invasive fungal disease diagnosis. The new method based on chemiluminescence for detecting BDG could shorten the sample-to-result time to approximately 30 min, rescue Limulus from being endangered and is resource efficient in terms of equipment and the non-use of a skilled technician.

Implementation of Lateral Flow Assays for the Diagnosis of Invasive Aspergillosis in European Hospitals: A Survey from Belgium and a Literature Review of Test Performances in Different Patient Populations

OBJECTIVES

Diagnosis of invasive aspergillosis is based on a combination of criteria, of which the detection of Aspergillus galactomannan (GM) often is decisive. To date, the most commonly used method to determine GM is an enzyme-linked immune assay (EIA). But since a few years lateral flow assays (LFAs) were introduced, providing the possibility for rapid single sample testing. More and more LFAs are entering the market, but, although often being equated, all use their own antibodies, procedures and interpretation criteria. A recent European survey revealed that about 24-33% of laboratories implemented a lateral flow assay on-site.

METHODS

We conducted a survey at 81 Belgian hospital laboratories regarding the implementation of LFAs in their centre. In addition, we performed an extensive review of all publicly available studies on the performance of lateral flow assays to diagnose invasive aspergillosis.

RESULTS

Response rate to the survey was 69%. Of the 56 responding hospital laboratories, 6 (11%) used an LFA. The Soña Aspergillus galactomannan LFA (IMMY, Norman, Oklahoma, USA) was used in 4/6 centres, while two centres used the QuicGM (Dynamiker, Tianjin, China) and one centre used the FungiXpert Aspergillus Galactomannan Detection K-set LFA (Genobio [Era Biology Technology], Tianjin, China). One centre used 2 distinct LFAs. In 3/6 centres, the sample is sent to another lab for confirmation with GM-EIA when the LFA result is positive and in 2/6 when the LFA results is negative. In one centre, a confirmatory GM-EIA is always performed in house. In three centres the LFA result is used as a complete substitute for GM-EIA. Available LFA performance studies are very diverse and results vary in function of the study population and type of LFA. Apart from the IMMY and OLM LFA, only very limited performance data are available. From two out of three LFAs used in Belgium, no clinical performance studies are published in literature.

CONCLUSIONS

A large variety of LFAs are used in Belgian Hospitals, some of which no clinical validation studies are published. These results do likely have implications for other parts of Europe and for the rest of the world as well. Due to the variable performance of LFA tests and the limited validation data available, each laboratory must check the available performance information of the specific test considered for implementation. In addition, laboratories should perform an implementation verification study.

Retrospective Multicenter Evaluation of the VirClia Galactomannan Antigen Assay for the Diagnosis of Pulmonary Aspergillosis with Bronchoalveolar Lavage Fluid Samples from Patients with Hematological Disease

Galactomannan (GM) testing of bronchoalveolar lavage (BAL) fluid samples has become an essential tool to diagnose invasive pulmonary aspergillosis (IPA) and is part of diagnostic guidelines. Enzyme-linked immunosorbent assays (ELISAs) (enzyme immunoassays [EIAs]) are commonly used, but they have a long turnaround time. In this study, we evaluated the performance of an automated chemiluminescence immunoassay (CLIA) with BAL fluid samples. This was a multicenter retrospective study in the Netherlands and Belgium. BAL fluid samples were collected from patients with underlying hematological diseases with a suspected invasive fungal infection. Diagnosis of IPA was based on the 2020 European Organisation for Research and Treatment of Cancer (EORTC)/Mycoses Study Group Education and Research Consortium (MSGERC) consensus definitions. GM results were reported as optical density index (ODI) values. ODI cutoff values for positive results that were evaluated were 0.5, 0.8, and 1.0 for the EIA and 0.16, 0.18, and 0.20 for the CLIA. Probable IPA cases were compared with two control groups, one with no evidence of IPA and another with no IPA or possible IPA. Qualitative agreement was analyzed using Cohen's κ, and quantitative agreement was analyzed by Spearman's correlation. We analyzed 141 BAL fluid samples from 141 patients; 66 patients (47%) had probable IPA, and 56 cases remained probable IPA when the EIA GM result was excluded as a criterion, because they also had positive culture and/or duplicate positive PCR results. Sixty-three patients (45%) had possible IPA and 12 (8%) had no IPA. The sensitivity and specificity of the two tests were quite comparable, and the overall qualitative agreement between EIA and CLIA results was 81 to 89%. The correlation of the actual CLIA and EIA values was strong at 0.72 (95% confidence interval, 0.63 to 0.80). CLIA has similar performance, compared to the gold-standard EIA, with the benefits of faster turnaround because batching is not required. Therefore, CLIA can be used as an alternative GM assay for BAL fluid samples.

Developments in Fungal Serology

Purpose of Review

The true incidence of fungal disease is hampered by conventionally poor diagnostic tests, limited access to advanced diagnostics, and limited surveillance. The availability of serological testing has been available for over two decades and generally underpins the modern diagnosis of the most common forms of fungal disease. This review will focus on technical developments of serological tests for the diagnosis of fungal disease, describing advances in clinical performance when available.

Recent Findings

Despite their longevity, technical, clinical, and performance limitations remain, and tests specific for fungal pathogens outside the main pathogens are lacking. The availability of LFA and automated systems, capable of running multiple different tests, represents significant developments, but clinical performance data is variable and limited.

Summary

Fungal serology has significantly advanced the diagnosis of the main fungal infections, with LFA availability increasing accessibility to testing. Combination testing has the potential to overcome performance limitations.

Monoclonal Antibodies and Invasive Aspergillosis: Diagnostic and Therapeutic Perspectives

Invasive aspergillosis (IA) is a life-threatening fungal disease that causes high morbidity and mortality in immunosuppressed patients. Early and accurate diagnosis and treatment of IA remain challenging. Given the broad range of non-specific clinical symptoms and the shortcomings of current diagnostic techniques, most patients are either diagnosed as “possible” or “probable” cases but not “proven”. Moreover, because of the lack of sensitive and specific tests, many high-risk patients receive an empirical therapy or a prolonged treatment of high-priced antifungal agents, leading to unnecessary adverse effects and a high risk of drug resistance. More precise diagnostic techniques alongside a targeted antifungal treatment are fundamental requirements for reducing the morbidity and mortality of IA. Monoclonal antibodies (mAbs) with high specificity in targeting the corresponding antigen(s) may have the potential to improve diagnostic tests and form the basis for novel IA treatments. This review summarizes the up-to-date application of mAb-based approaches in assisting IA diagnosis and therapy.