Performance evaluation of the MBio Diagnostics point-of-care CD4 counter

Preclinical Assessment of a Cartridge-Based Flow-Through Assay for Determination of Adult CD4 T-Cell Count

Background:

Despite the emphasis on viral load testing, current HIV testing guidelines consider CD4 T-cell count measurement as an important criterion for assessing disease progression, making decisions about anti-retroviral therapy regime changes, and treating HIV infected individuals with opportunistic infections. The CD4 counting by established methods (e.g., flow cytometry) presents challenges not only in resource-scarce settings due to cost and lack of skilled technicians but also in resource-rich areas where it is limited to centralized facilities.

Objective:

Current options for Point-Of-Care (POC) CD4 enumeration are few and labor-intensive, prompting the need for newer technological methods that can overcome the aforementioned challenges.

Methods:

The novel and patented flow-through cell counting assay (FTCA) described previously (Bystryak et al., 2019) was developed further into a point-of-care CD4 testing system using a disposable cartridge device and a portable imaging instrument. A pilot study with ~100 samples using this device was conducted to assess the validity of FTCA as a POC test for the measurement of CD4 count.

Results:

The FTCA signal was found to be linear over a wide range (17 - 1540 cells/μL) of CD4 T-cell concentration. The FTCA method also exhibits a strong agreement with flow cytometry, with very low bias (− 7 cells/μL) towards CD4 count measurement.

Conclusion:

The cartridge-based FTCA method has great potential to be a fully quantitative method with low complexity, portability, low-cost, and wide applicability in clinical practice.

A flow-through cell counting assay for point-of-care enumeration of CD4 T-cells

CD4 T-cell count is a priority for staging HIV disease and guiding clinical management as part of HIV care. Conventional CD4 T-cell enumeration methods based on flow cytometry are expensive, require well-trained personnel, and are challenging to use in rural, resource-scarce areas. A simple CD4 T-cell count test that can be used at point-of care, the Flow-Through cell Counting Assay (FTCA), is described in this article. The FTCA is based on the use of: 1) a special membrane that selectively retains white blood cells (WBCs); 2) a sample delivery system; and 3) optical signal detection. To show the feasibility of the FTCA, a proof-of-concept prototype of the FTCA cassette and digital camera or handheld reflectance meter were used for obtaining quantitative assay results within 30 min. The results show that the FTCA allows for quantitative enumeration of CD4 T-cells in the clinically relevant range of CD4 T-cell concentrations. The advantages of the FTCA technology, including simplicity, short analysis time, and portability, suggest that FTCA has great potential for use in clinical practice and wide applicability for other cell-based diagnostic tests.

Cytocoded passwords: BioMEMS based barcoding of biological samples for user authentication in microfluidic diagnostic devices

Smart and connected point-of-care (POC) medical devices are becoming ever more ubiquitous and have the potential to radically improve disease diagnosis and health monitoring. This emerging connectivity can potentially create serious security issues where patient privacy can be easily compromised. Protection of patient data from malicious cyber-physical attackers requires radical solutions at the BioMEMS level. Ideally, the information exchange between the patient and practitioner is an automated and transparent process for the patient. In practice, this exchange requires both the patient and the test results to be authenticated and validated respectively on the storage service to ensure that the medical diagnostic results are properly stored and their access is protected. This secure authentication phase is particularly critical for medical diagnostics: patient data exposure could lead to negative social effects. This work focuses on providing a transparent authentication mechanism for patient blood tests performed using impedance flow cytometry. The goal is twofold: first, to alleviate the user from security procedures, precisely an authentication step, while using the medical device; second, to provide a unique identifier for the test results when stored in a remote server. This paper describes a domain specific authentication method for impedance flow cytometry devices. We spike into the blood samples synthetic micro-beads of different sizes, at determined concentrations, to generate a unique authentication string that uniquely identify a test result on the remote storage service. These authentication strings are embedded in the test devices and can be used as a convenient alternative to generic authentication methods, such as logins and passwords. This alternative method removes the authentication burden from the user and protects patient's privacy further by preventing them from linking their personal information to their test results.

Point of Care Diagnostics for HIV in Resource Limited Settings: An Overview

Human immunodeficiency virus (HIV) is a global health problem. Early diagnosis, rapid antiretroviral therapy (ART) initiation and monitoring of viral load are the key strategies for effective HIV management. Many people in resource limited settings where timely access to medical care is a challenge and healthcare infrastructure is poor have no access to laboratory facilities and diagnosis is dependent on the presence of point of care (POC) devices. POC instruments have shown to be easy to operate, maintain and transport and can easily be operated by less skilled health workers. Additionally, POC tests do not require laboratory technicians to operate. POC devices have resulted in a growing number of people testing for HIV and thereby receiving treatment early. In recent years, there has been great improvement in the development of POC technologies for early HIV diagnosis, HIV viral load and cluster of differentiation 4 (CD4) measurement. This review discusses POC technologies that are currently available and in the pipeline for diagnosing and monitoring HIV. We also give an overview of the technical and commercialization challenges in POC diagnostics for HIV.

Performance verification of the new fully automated Aquios flow cytometer PanLeucogate (PLG) platform for CD4-T-lymphocyte enumeration in South Africa

BACKGROUND

The National Health Laboratory Service (NHLS) offers wide-scale CD4 testing through a network of laboratories in South Africa. A new "load and go" cytometer (Aquios CL, Beckman Coulter), developed with a PLG protocol, was validated against the predicate PLG method on the Beckman Coulter FC500 MPL/CellMek platform.

METHODS

Remnant routine EDTA blood CD4 reference results were compared to results from two Aquios/PLG instruments (n = 205) and a further n = 1885 samples tested to assess daily testing capacity. Reproducibility was assessed using ImmunotrolTM and patient samples with low, medium, high CD4 counts. Data was analyzed using GraphPad software for general statistics and Bland-Altman (BA) analyses. The percentage similarity (%Sim) was used to measure the level of agreement (accuracy) of the new platform versus the predicate and variance (%SimCV) reported to indicate precision of difference to predicate.

RESULTS

205 samples were tested with a CD4 count range of 2-1228 cells/μl (median 365cells/μl). BA analysis revealed an overall -40.5±44.0cells/μl bias (LOA of 126.8 to 45.8cells/μl) and %Sim showing good agreement and tight precision to predicate results (94.83±5.39% with %SimCV = 5.69%). Workflow analysis (n = 1885) showed similar outcomes 94.9±8.9% (CV of 9.4%) and 120 samples/day capacity. Excellent intra-instrument reproducibility was noted (%Sim 98.7±2.8% and %SimCV of 2.8%). 5-day reproducibility using internal quality control material (Immunotrol™) showed tight precision (reported %CV of 4.69 and 7.62 for Normal and Low material respectively) and instrument stability.

CONCLUSION

The Aquios/PLG CD4 testing platform showed clinically acceptable result reporting to existing predicate results, with good system stability and reproducibility with a slight negative but precise bias. This system can replace the faded XL cytometers in low- to medium volume CD4 testing laboratories, using the standardized testing protocol, with better staff utilization especially where technical skills are lacking. Central monitoring of on-board quality assessment data facilitates proactive maintenance and networked instrument performance monitoring.

Performance Evaluation of the Becton Dickinson FACSPresto™ Near-Patient CD4 Instrument in a Laboratory and Typical Field Clinic Setting in South Africa

Background

The BD-FACSPresto^™ CD4 is a new, point-of-care (POC) instrument utilising finger-stick capillary blood sampling. This study evaluated its performance against predicate CD4 testing in South Africa.

Methods

Phase-I testing: HIV+ patient samples (n = 214) were analysed on the Presto^™ under ideal laboratory conditions using venous blood. During Phase-II, 135 patients were capillary-bled for CD4 testing on FACSPresto^™, performed according to manufacturer instruction. Comparative statistical analyses against predicate PLG/CD4 method and industry standards were done using GraphPad Prism 6. It included Bland-Altman with 95% limits of agreement (LOA) and percentage similarity with coefficient of variation (%CV) analyses for absolute CD4 count (cells/μl) and CD4 percentage of lymphocytes (CD4%).

Results

In Phase-I, 179/217 samples yielded reportable results with Presto^™ using venous blood filled cartridges. Compared to predicate, a mean bias of 40.4±45.8 (LOA of -49.2 to 130.2) and %similarity (%CV) of 106.1%±7.75 (7.3%) was noted for CD4 absolute counts. In Phase-2 field study, 118/135 capillary-bled Presto^™ samples resulted CD4 parameters. Compared to predicate, a mean bias of 50.2±92.8 (LOA of -131.7 to 232) with %similarity (%CV) 105%±10.8 (10.3%), and 2.87±2.7 (LOA of -8.2 to 2.5) with similarity of 94.7±6.5% (6.83%) noted for absolute CD4 and CD4% respectively. No significant clinical differences were indicated for either parameter using two sampling methods.

Conclusion

The Presto^™ produced remarkable precision to predicate methods, irrespective of venous or capillary blood sampling. A consistent, clinically insignificant over-estimation (5–7%) of counts against PLG/CD4 and equivalency to FACSCount^™ was noted. Further field studies are awaited to confirm longer-term use.

Evanescent wave fluorescence biosensors: Advances of the last decade

Biosensor development has been a highly dynamic field of research and has progressed rapidly over the past two decades. The advances have accompanied the breakthroughs in molecular biology, nanomaterial sciences, and most importantly computers and electronics. The subfield of evanescent wave fluorescence biosensors has also matured dramatically during this time. Fundamentally, this review builds on our earlier 2005 review. While a brief mention of seminal early work will be included, this current review will focus on new technological developments as well as technology commercialized in just the last decade. Evanescent wave biosensors have found a wide array applications ranging from clinical diagnostics to biodefense to food testing; advances in those applications and more are described herein.

Status and perspective of lab-on-a-chip systems for common diseases: a systematic review from 2003 to 2013

BACKGROUND

Lab-on-a-chip systems (LOCs) are a useful aid for the individualization of therapeutic algorithms at the point-of-care.

MATERIALS & METHODS

We performed a systematic literature review on LOCs for diseases with a global impact for healthcare.

RESULTS

A total of 1007 articles matched the previously specified search criteria, thereof 65 studies could be included in this review. A total of 55 different LOCs were evaluated, most for diagnosis or monitoring of cancer (n = 24). For other diseases we found considerably less analyzed LOCs. The analytical performance of the LOCs was usually very good, 37 (67%) LOCs had a sensitivity higher than 90%.

CONCLUSION

Although LOC systems performance has been positively evaluated in the great majority of studies, the testing was mostly limited to the research laboratory setting rather than real-world scenarios.

Near patient CD4 count in a hospitalized HIV patient population

BACKGROUND

Point-of-care (POC) CD4 T-cell counting is increasingly recognized as providing improved linkage-to-care during management of HIV infection, particularly in resource-limited settings where disease burden is highest. This study evaluated prototype POC CD4 T-cell counters from MBio Diagnostics in the context of low CD4 count, hospitalized patients in Mozambique. This study measured system performance when presented with challenging, low count samples from HIV/AIDS patients with acute illnesses resulting in hospitalization.

METHODS

Forty whole blood samples were collected from donors on the medical service at Maputo Central Hospital and absolute CD4 counts were generated on the MBio CD4 system and a reference laboratory using flow cytometry.

RESULTS

The mean and median CD4 counts by the flow cytometry reference were 173 and 80 cells/µL, respectively. Correlation between the MBio CD4 System and the reference was good. Bland-Altman analysis showed a mean bias of +15 cells/µL (+9 to +21 cells/µL, 95% CI), and limits of agreement of -47 to 77 cells/µL. For samples with counts >100 cells/µL (N = 14), the mean coefficient of variation was 7.3%. For samples with counts <50 cells/µL, mean absolute bias of replicate samples was 4.8 cells/µL. When two MBio readers were compared, Bland-Altman bias was -4 cells/µL (-13 to +6 cells/µL, 95% CI), and limits of agreement of -63 and +55 cells/µL.

CONCLUSIONS

The MBio System holds promise as a POC system for quantitation of CD4 T cells in resource-limited settings given system throughput (80-100 cartridges/day), design simplicity, and ease-of-use. © 2015 International Clinical Cytometry Society.

CD4 enumeration technologies: a systematic review of test performance for determining eligibility for antiretroviral therapy

Background

Measurement of CD4⁺ T-lymphocytes (CD4) is a crucial parameter in the management of HIV patients, particularly in determining eligibility to initiate antiretroviral treatment (ART). A number of technologies exist for CD4 enumeration, with considerable variation in cost, complexity, and operational requirements. We conducted a systematic review of the performance of technologies for CD4 enumeration.

Methods and Findings

Studies were identified by searching electronic databases MEDLINE and EMBASE using a pre-defined search strategy. Data on test accuracy and precision included bias and limits of agreement with a reference standard, and misclassification probabilities around CD4 thresholds of 200 and 350 cells/μl over a clinically relevant range. The secondary outcome measure was test imprecision, expressed as % coefficient of variation. Thirty-two studies evaluating 15 CD4 technologies were included, of which less than half presented data on bias and misclassification compared to the same reference technology. At CD4 counts <350 cells/μl, bias ranged from -35.2 to +13.1 cells/μl while at counts >350 cells/μl, bias ranged from -70.7 to +47 cells/μl, compared to the BD FACSCount as a reference technology. Misclassification around the threshold of 350 cells/μl ranged from 1-29% for upward classification, resulting in under-treatment, and 7-68% for downward classification resulting in overtreatment. Less than half of these studies reported within laboratory precision or reproducibility of the CD4 values obtained.

Conclusions

A wide range of bias and percent misclassification around treatment thresholds were reported on the CD4 enumeration technologies included in this review, with few studies reporting assay precision. The lack of standardised methodology on test evaluation, including the use of different reference standards, is a barrier to assessing relative assay performance and could hinder the introduction of new point-of-care assays in countries where they are most needed.

Laboratory and field evaluation of the Partec CyFlow miniPOC for absolute and relative CD4 T-cell enumeration

Background

A new CD4 point-of-care instrument, the CyFlow miniPOC, which provides absolute and percentage CD4 T-cells, used for screening and monitoring of HIV-infected patients in resource-limited settings, was introduced recently. We assessed the performance of this novel instrument in a reference laboratory and in a field setting in Senegal.

Methodology

A total of 321 blood samples were obtained from 297 adults and 24 children, all HIV-patients attending university hospitals in Dakar, or health centers in Ziguinchor. Samples were analyzed in parallel on CyFlow miniPOC, FACSCount CD4 and FACSCalibur to assess CyFlow miniPOC precision and accuracy.

Results

At the reference lab, CyFlow miniPOC, compared to FACSCalibur, showed an absolute mean bias of -12.6 cells/mm³ and a corresponding relative mean bias of -2.3% for absolute CD4 counts. For CD4 percentages, the absolute mean bias was -0.1%. Compared to FACSCount CD4, the absolute and relative mean biases were -31.2 cells/mm³ and -4.7%, respectively, for CD4 counts, whereas the absolute mean bias for CD4 percentages was 1.3%. The CyFlow miniPOC was able to classify HIV-patients eligible for ART with a sensitivity of ≥ 95% at the different ART-initiation thresholds (200, 350 and 500 CD4 cells/mm3). In the field lab, the room temperature ranged from 30 to 35°C during the working hours. At those temperatures, the CyFlow miniPOC, compared to FACSCount CD4, had an absolute and relative mean bias of 7.6 cells/mm³ and 2.8%, respectively, for absolute CD4 counts, and an absolute mean bias of 0.4% for CD4 percentages. The CyFlow miniPOC showed sensitivity equal or greater than 94%.

Conclusion

The CyFlow miniPOC showed high agreement with FACSCalibur and FACSCount CD4. The CyFlow miniPOC provides both reliable absolute CD4 counts and CD4 percentages even under the field conditions, and is suitable for monitoring HIV-infected patients in resource-limited settings.

Feasibility of HIV point-of-care tests for resource-limited settings: challenges and solutions

Improved access to anti-retroviral therapy increases the need for affordable monitoring using assays such as CD4 and/or viral load in resource-limited settings. Barriers to accessing treatment, high rates of loss to initiation and poor retention in care are prompting the need to find alternatives to conventional centralized laboratory testing in certain countries. Strong advocacy has led to a rapidly expanding repertoire of point-of-care tests for HIV. point-of-care testing is not without its challenges: poor regulatory control, lack of guidelines, absence of quality monitoring and lack of industry standards for connectivity, to name a few. The management of HIV increasingly requires a multidisciplinary testing approach involving hematology, chemistry, and tests associated with the management of non-communicable diseases, thus added expertise is needed. This is further complicated by additional human resource requirements and the need for continuous training, a sustainable supply chain, and reimbursement strategies. It is clear that to ensure appropriate national implementation either in a tiered laboratory model or a total decentralized model, clear country-specific assessments need to be conducted.

WHO multicenter evaluation of FACSCount CD4 and Pima CD4 T-cell count systems: instrument performance and misclassification of HIV-infected patients

BACKGROUND

CD4⁺ T-cell counts are used to screen and follow-up HIV-infected patients during treatment. As part of the World Health Organization prequalification program of diagnostics, we conducted an independent multicenter evaluation of the FACSCount CD4 and the Pima CD4, using the FACSCalibur as reference method.

METHODS

A total of 440 paired capillary and venous blood samples were collected from HIV-infected patients attending the HIV outpatient clinic in Antwerp, Belgium, and the HIV care and treatment center in Dar es Salam, Tanzania. Capillary blood was run on Pima analyzer, whereas venous blood was analyzed on FACSCount, Pima, and FACSCalibur instruments. Precision and agreement between methods were assessed.

RESULTS

The FACSCount CD4 results were in agreement with the FACSCalibur results with relative bias of 0.4% and 3.1% on absolute CD4 counts and an absolute bias of -0.6% and -1.1% on CD4% in Antwerp and Dar es Salam, respectively. The Pima CD4 results were in agreement with the FACSCalibur results with relative bias of -4.1% and -9.4% using venous blood and of -9.5% and -0.9% using capillary blood in Antwerp and Dar es Salam, respectively. At the threshold of 350 cells per microliter, the FACSCount CD4 and Pima CD4 using venous and capillary blood misclassified 7%, 9%, and 13% of patients, respectively.

CONCLUSIONS

The FACSCount CD4 provides reliable CD4 counts and CD4% and is suitable for monitoring adult and pediatric HIV patients in moderate-volume settings. The Pima CD4 is more suitable for screening eligible adult HIV patients for antiretroviral treatment initiation in low-volume laboratories.

Developments in CD4 and viral load monitoring in resource-limited settings

CD4 counts and human immunodeficiency virus (HIV) load testing are essential components of HIV care, and making these tests available in resource-limited settings is critical to the roll-out of HIV treatment globally. Until recently, the evidence supporting the importance of laboratory monitoring in resource-limited settings was lacking, but there is now a consensus emerging that testing should become routine to ensure the longevity of treatment programs. Low-cost, point-of-care testing offers the potential to fill this role as it potentially improves all aspects of HIV care, ranging from the diagnosis and staging of HIV infection in both infants and adults to monitoring for treatment failure once antiretroviral therapy has been initiated. It is imperative for low-cost solutions to become a reality, but it is equally imperative that close scrutiny be given to each new device that hits the market to ensure they perform optimally in all settings.

Reconfigurable acquisition system with integrated optics for a portable flow cytometer

Portable and inexpensive scientific instruments that are capable of performing point of care diagnostics are needed for applications such as disease detection and diagnosis in resource-poor settings, for water quality and food supply monitoring, and for biosurveillance activities in autonomous vehicles. In this paper, we describe the development of a compact flow cytometer built from three separate, customizable, and interchangeable modules. The instrument as configured in this work is being developed specifically for the detection of selected Centers for Disease Control (CDC) category B biothreat agents through a bead-based assay: E. coli O157:H7, Salmonella, Listeria, and Shigella. It has two-color excitation, three-color fluorescence and light scattering detection, embedded electronics, and capillary based flow. However, these attributes can be easily modified for other applications such as cluster of differentiation 4 (CD4) counting. Proof of concept is demonstrated through a 6-plex bead assay with the results compared to a commercially available benchtop-sized instrument.

CD4 counting technologies for HIV therapy monitoring in resource-poor settings--state-of-the-art and emerging microtechnologies

Modern advancements in pharmaceuticals have provided individuals who have been infected with the human immunodeficiency virus (HIV) with the possibility of significantly extending their survival rates. When administered sufficiently soon after infection, antiretroviral therapy (ART) allows medical practitioners to control onset of the symptoms of the associated acquired immune deficiency syndrome (AIDS). Active monitoring of the immune system in both HIV patients and individuals who are regarded as "at-risk" is critical in the decision making process for when to start a patient on ART. A reliable and common method for such monitoring is to observe any decline in the number of CD4 expressing T-helper cells in the blood of a patient. However, the technology, expertise, infrastructure and costs to carry out such a diagnostic cannot be handled by medical services in resource-poor regions where HIV is endemic. Addressing this shortfall, commercialized point-of-care (POC) CD4 cell count systems are now available in such regions. A number of newer devices will also soon be on the market, some the result of recent maturing of charity-funded initiatives. Many of the current and imminent devices are enabled by microfluidic solutions, and this review will critically survey and analyze these POC technologies for CD4 counting, both on-market and near-to-market deployment. Additionally, promising technologies under development that may usher in a new generation of devices will be presented.