WHO multicenter evaluation of FACSCount CD4 and Pima CD4 T-cell count systems: instrument performance and misclassification of HIV-infected patients

Immunovirological discordance among female sex workers who start antiretroviral therapy in Burkina Faso

Background

In people living with HIV/AIDS (PLWHA), initiation of antiretroviral therapy (ART) leads to sustained effective suppression of viral replication and increasing CD4 + T cell count. However, a fraction of ART-treated patients still fail to reach adequate CD4 + T cell number despite a suppressed viral load (VL), and this phenomenon is defined as immunovirological discordance (IVD). In Africa, several studies have reported immunovirological outcomes of antiretroviral therapy, but little is known about IVD occurrence in Female sex workers (FSW). This study aimed to assess the prevalence of IVD and associated factors among a cohort of HIV infected FSW in Burkina Faso.

Methods

We conducted a cohort study from December 2003 to October 2016. Immunovirological discordance was defined as CD4 + T cell gain < 100 cells/µL despite a suppressed VL (VL < 1000 copies/mL) 12 months after ART initiation. The CD4 + T cells were counted using BD FACSCount™ System and point of care Pima™ CD4 + Analyzer. HIV-1 RNA was quantified by real-time polymerase-chain-reaction assay with the use of the ABI 7000 system. We conducted a logistic regression to identify factors associated with discordant responses.

Results

Among the 123 HIV-1 infected FSW having at least 12 months follow-up on ART, 105 (85.4%) achieved HIV-1 RNA suppression. Among the latter 25 gained less than 100 CD4 + T cells within 12 months follow-up. The IVD rate was 23.8% (95%CI 16.04%–33.11%). After adjustment for age, WHO clinical stage and ART regimen including nucleoside/nucleotide reverse transcriptase inhibitors, only baseline CD4 + T cell count between 200 to 350 cells/µL (adjusted OR: 4.15; 95%CI 1.13–15.22) and 350 to 500 cells/µL (adjusted OR: 17.50; 95%CI 2.68–114.31) remain significantly associated with IVD occurrence.

Conclusions

Immunovirological discordance response was common in FSW with proportions close to those observed in the general population. A diagnosis and personalized follow-up of patients who do not achieve full immune reconstitution would make it possible to avoid complications in terms of morbidity and mortality.

Performance of the BD FACSPresto near to patient analyzer in comparison with representative conventional CD4 instruments in Cameroon

BACKGROUND

In the context of scaling the viral load in resource limited settings, following HIV infected patient's adults and children with CD4+ T-lymphocyte count still very important in settings where the decentralization of treatment still has some challenges. Effective HIV monitoring in these resource-constrained settings needs affordable and reliable CD4+ T lymphocytes enumeration methods. We investigated the validity of a BD FACSPresto POC which is a dedicated system for enumeration that uses immunofluorescent technologies. In this study, we have assessed the sensitivity, specificity and correlation between most representative flow cytometry instruments present in Cameroon with more than 5000 CD4 T cells tests per year including FACSCalibur, FACSCount, and PIMA POC from Becton-Dickinson and ALERE respectively.

METHODS

268 patients aged from 1 to 72 years old were enrolled and included in the study after inform consent. The BD FACSPresto POC CD4+ T cell technology was placed at CIRCB and operated by technician staff. HIV infected patients were from Chantal BIYA international reference Center (CIRCB), Centre de Sante Catholique de NKOLODOM, Centre de Sante Catholique de BIKOP and CASS de Nkolndongo-Yaounde We compared the accuracy of the BD FACSPresto and three existing reference technologies with more than 5000 tests per year like FACSCalibur, FACSCount and PIMA according to the number of CD4 test done per year and their repartition in the country. Bland-Altman method and correlation analysis were used to estimate mean bias and 95% limits of agreement and to compare the methods, including analysis by subgroup of participant gestational age. In addition sensitivity and specificity were determined. Statistical significance was set at P-value < 0.05.

RESULTS

The BD FACSPresto POC system has excellent precision, accuracy and linearity for CD4+ T lymphocytes enumeration. Good correlations were obtained between the BD FACSPresto poc system and other single platform methods. Bland-Altman plots showed interchangeability between two machines mean bias BD-FACSPresto vs PIMA = - 126,522(- 161,221 to - 91,822) BD-FACSPresto vs FACSCount = - 38,708 (- 58,935 to - 18,482) and FACSPresto vs FACSCALIBUR = 0.791(- 11,908 to 13,491). Mean difference with Absolute CD4+ T-lymphocyte values obtained from the BD FACSPresto system correlated well with PIMA, FACSCount, and FACSCalibur method with R² equal to 0.88, 0.92 and 0.968 respectively with P < 0.001 for all. The mean comparison between values obtained from BD FACSPresto with PIMA, FACSCount, and FACSCalibur using paired T test give P = 0.17, P = 0.5 and P = 0.6 respectively meaning that there is no significant differences between values obtained with BD FACSPresto and PIMA, FACSCount or FACSCalibur CD4 enumeration machines. Further analysis revealed close agreement between all the three instruments with no significant difference between the forth methods (P = 0.91).

CONCLUSION

This BD-FACSPresto POC system is a simple, robust and reliable system for enumeration of absolute and percentage of CD4+ T-lymphocytes especially suitable for remote areas with limited resources. Having one BD-FACSPresto POC system easy to use, should reduce the cost and thus increase and improved access to CD4 testing for HIV infected patients in resource-constrained countries. BD-FACSPresto POC CD4 will enable reduction in patient time and improve the overall quality of ART service count and may improve test access in remote areas. This technology can allow for greater decentralization and wider access to CD4 testing and ART.

Assessment of two POC technologies for CD4 count in Morocco

Background

In the era of “test and treat strategy”, CD4 testing remains an important tool for monitoring HIV-infected individuals. Since conventional methods of CD4 count measurement are costly and cumbersome, POC CD4 counting technique are more affordable and practical for countries with limited resources. Before introducing such methods in Morocco, we decided to assess their reliability.

Methods

In this study 92 blood samples from HIV-infected patients, were tested by PIMA and FACSPresto to derive CD4 count. Flow cytometry using FacsCalibur, was used as reference method for CD4 count comparison. Linear regression, Bland–Altman analysis were performed to assess correlation and agreement between these POC methods and the reference method. In addition, sensitivity and specificity, positive predictive value (PPV), negative predictive value (NPV) and misclassification percentage at 350 and 200 CD4 count thresholds; were also determined. Finally, because FACSPresto can also measure hemoglobin (Hb) concentration, 52 samples were used to compare FACSPresto against an automated hematology analyzer.

Results

The coefficient of determination R² was 0.93 for both methods. Bland–Altman analysis displayed a mean bias of − 32.3 and − 8.1 cells/µl for PIMA and FACSPresto, respectively. Moreover, with a threshold of 350 CD4 count, PIMA displayed a sensitivity, specificity, PPV, NPV, were 88.57%, 94.12%, 91.18%, 92.31%; respectively. FACSPresto showed 88.23%, 96.23%, 93.75% and 92.73%; respectively. Furthermore, the upward misclassification percentage was 8.57 and 5.88%, for PIMA and FACSPresto, respectively; whereas the downward misclassification percentage was 7.84% and 7.54%; respectively. With 200 cells/µl threshold, PIMA had a sensitivity, specificity, PPV and NPV of 83.33%, 98.53%, 93.75% and 95.71%, respectively. Regarding FACSPresto, sensitivity, specificity, PPV and NPV was 82.35%, 98.57%, 88.57% and 95.83%; respectively. Upward misclassification percentage was 5.56% and 5.88%, for PIMA and FACSPresto, respectively; whereas downward misclassification percentage was 4.41% and 4.29%; respectively. Finally, the hemoglobin measurement evaluation displayed an R² of 0.80 and a mean bias of − 0.12 with a LOA between − 1.75 and 1.51.

Conclusion

When compared to the reference method, PIMA and FACSPresto have shown good performance, for CD4 counting. The introduction of such POC technology will speed up the uptake of patients in the continuum of HIV care, in our country.

CD4-T cell enumeration in human immunodeficiency virus (HIV)-infected patients: A laboratory performance evaluation of Muse Auto CD4/CD4% system by World Health Organization prequalification of in vitro diagnostics

Background

CD4 T-cell counts are still widely used to assess treatment eligibility and follow-up of HIV-infected patients. The World Health Organization (WHO) prequalification of in vitro diagnostics requested a manufacturer independent laboratory evaluation of the analytical performance at the Institute of Tropical Medicine (ITM) Antwerp, Belgium, of the Muse Auto CD4/CD4% system (Millipore), a new small capillary-flow cytometer dedicated to count absolute CD4-T cells and percentages in venous blood samples from HIV-infected patients.

Methods

Two hundred and fifty (250) patients were recruited from the HIV outpatient clinic at ITM. Accuracy and precision of CD4 T cell counting on fresh EDTA anticoagulated venous blood samples were assessed in the laboratory on a Muse Auto CD4/CD4% system. Extensive precision analyses were performed both on fresh blood and on normal and low stabilized whole blood controls. Accuracy ((bias) was assessed by comparing results from Muse CD4/CD4% to the reference (single-platform FACSCalibur). Clinical misclassification was measured at 500, 350, 200 and 100 cells/μL thresholds.

Results

Intra-assay precision was < 5%, and inter-assay was < 9%. CD4 T cell counts measured on Muse Auto CD4/CD4% System and on the reference instrument resulted in regression slopes of 0.97 for absolute counts and 1.03 for CD4 T cell percentages and a correlation coefficient of 0.99 for both. The average absolute bias as compared to the reference was negligible (4 cells/μL or 0.5%). The absolute average bias on CD4 T cell percentages was < 1%. Clinical misclassification at different CD4 T cell thresholds was small resulting in sensitivities and specificities equal or >90% at all thresholds except at 100 cells/μL (sensitivity = 87%). All samples could be analyzed as there was no repetitive rejection errors recorded.

Conclusions

The Muse Auto CD4/CD4% System performed very well on fresh venous blood samples and met all WHO acceptance criteria for analytical performance of CD4 technologies.

Diagnosis of Human Immunodeficiency Virus Infection

HIV diagnostics have played a central role in the remarkable progress in identifying, staging, initiating, and monitoring infected individuals on life-saving antiretroviral therapy. They are also useful in surveillance and outbreak responses, allowing for assessment of disease burden and identification of vulnerable populations and transmission "hot spots," thus enabling planning, appropriate interventions, and allocation of appropriate funding. HIV diagnostics are critical in achieving epidemic control and require a hybrid of conventional laboratory-based diagnostic tests and new technologies, including point-of-care (POC) testing, to expand coverage, increase access, and positively impact patient management. In this review, we provide (i) a historical perspective on the evolution of HIV diagnostics (serologic and molecular) and their interplay with WHO normative guidelines, (ii) a description of the role of conventional and POC testing within the tiered laboratory diagnostic network, (iii) information on the evaluations and selection of appropriate diagnostics, (iv) a description of the quality management systems needed to ensure reliability of testing, and (v) strategies to increase access while reducing the time to return results to patients. Maintaining the central role of HIV diagnostics in programs requires periodic monitoring and optimization with quality assurance in order to inform adjustments or alignment to achieve epidemic control.

All-printed cell counting chambers with on-chip sample preparation for point-of-care CD4 counting

We demonstrate the fabrication of fully printed microfluidic CD4 counting chips with complete on-chip sample preparation and their applicability as a CD4 counting assay using samples from healthy donors and HIV-infected patients. CD4 counting in low-income and resource-limited point-of-care settings is only practical and affordable, if disposable tests can be fabricated at very low cost and all manual sample preparation is avoided, while operation as well as quantification is fully automated and independent of the skills of the operator. Here, we show the successful use of (inkjet) printing methods both to fabricate microfluidic cell counting chambers with controlled heights, and to deposit hydrogel layers with embedded fluorophore-labeled antibodies for on-chip sample preparation and reagent storage. The maturation process of gelatin after deposition prevents antibody wash-off during blood inflow very well, while temperature-controlled dissolution of the matrix ensures complete antibody release for immunostaining after the inflow has stopped. The prevention of antibody wash-off together with the subsequent complete antibody release guarantees a homogeneous fluorescence background, making rapid and accurate CD4 counting possible. We show the successful application of our fully printed CD4 counting chips on samples from healthy donors as well as from HIV-infected patients and find an excellent agreement between results from our method and from the gold standard, flow cytometry, in both cases.

CD4 cell count variability with repeat testing in South Africa: Should reporting include both absolute counts and ranges of plausible values?

Although eligibility for antiretroviral treatment is no longer based on CD4 thresholds, CD4 testing remains important. Variation in CD4 cell count complicates initiation of antibiotic prophylaxis, differential diagnoses and assessments of immunological recovery. Five hundred and fifty-three HIV-positive antiretroviral-naïve adults, recruited from inner-city clinics, had three serial CD4 cell count tests. Test 1 was mostly done in a laboratory network supporting primary care clinics, while Tests 2 and 3 were performed in a tertiary-level laboratory. Reproducibility was assessed through Bland-Altman limits of agreement and coefficients of variation. Participants, a mean age of 34 years and mostly female (57%), had a median 203 CD4 cells/μL (Test 1). Seventeen per cent classified as having advanced HIV disease (CD4 cell count  < 200 cells/µL) on Test 1 had a CD4 cell count > 200 cells/µL on Tests 2 and 3. Mean differences between tests were <10 cells/µL for all comparisons. Limits of agreement for Tests 1 and 2 were -106.9 to 112.7 and coefficient of variation 15. Corresponding figures for Tests 2 and 3 were -88.2 to 103.4, and 13. Means of tests were similar, suggesting no systematic measurement differences, despite testing being done at different times. Variations were, however, considerable in many instances, though smaller in testing done in the same laboratory. CD4 cut-offs must not be applied rigidly, but rather constitute one amongst many factors used to guide patient care. Moreover, given the difficulties in determining whether CD4 changes are due to HIV disease, or other biological and laboratory factors, CD4 laboratory reports should include a range of plausible values, not only the absolute count.

The performance of BD FACSPresto™ for CD4 T-cell count, CD4% and hemoglobin concentration test in Ethiopia

Introduction

In Ethiopia, CD4+ T-cell counting is still required for all patients at baseline before antiretroviral therapy (ART) and to determine eligibility and follow-up of opportunistic infection prophylaxis. However, access to CD4+ T cell count in rural health facilities remains a major challenge in Ethiopia like other resource-limited settings.

Methodology

Both capillary and venous blood was drawn from each of 325 study participant recruited in Addis Ababa and surroundings. The CD4+ T-cell count, CD4%, and hemoglobin (Hgb) were tested at one of the four study health facilities using capillary blood and BD FACSPresto™ device. These tests were also done at the national HIV reference laboratory, using venous blood with BD FACSCalibur™, Sysmex XT-1800i™, and BD FACSPresto™.

Results

BD FACSPresto™ had an absolute mean bias of -13.3 cells/ul (-2.99%) and 28.3 cells/μl (6.4%) using venous and capillary blood, respectively, compared with BD FACSCalibur™. The absolute CD4 assay on the BD FACSPresto™ had a regression coefficient (R²) of 0.87 and 0.92 using capillary blood and venous blood samples, respectively, compared with BD FACSCalibur™. The percentage similarity of the BD FACSPresto™ using capillary and venous blood was 105.2% and 99.3%, respectively. The sensitivity of the FACSPresto™ using threshold of 500 cells/μl for ART eligibility using capillary and venous blood was 87.9 and 94.3%, while the specificity was 91.4 and 83.8%, respectively. Furthermore, the BD FACSPresto™ had an absolute mean bias of -0.2 dl/μl (0.0%) (95% LOA: -1.7, 1.3) and -0.59 dl/μl (0.1%) (95% LOA: -1.49, 0.31) for Hgb using capillary and venous blood compared with the Sysmex XT-1800i™, respectively.

Conclusion

Our results showed acceptable agreement between the BD FACSPresto™ and BD FACSCalibur™ for CD4+ T-cell counting and CD4%; and between the BD FACSPresto™ and Sysmex XT-1800i™for measuring Hgb concentration.

Performance of FACSPresto Point-of-Care Instrument for CD4-T Cell Enumeration in Human Immunodeficiency Virus (HIV)-Infected Patients Attending Care and Treatment Clinics in Belgium and Tanzania

BACKGROUND

CD4 T-cell counts are widely used to assess treatment eligibility and to follow-up HIV-infected patients. The World Health Organization prequalification of in vitro diagnostics program conducted a performance evaluation of the FACSPresto (BD Biosciences), a new point-of-care instrument to measure absolute CD4-T cell (CD4) counts and percentages in venous and capillary blood samples from HIV-infected patients.

METHODS

Patients were recruited in Belgium (200 patients) and in Tanzania (247 patients). Venous blood samples were analyzed in two nearby reference laboratories. In addition, nurses/technicians collected a capillary blood sample by finger prick directly into a FACSPresto CD4 cartridge. Assay precision was assessed on fresh blood and on external quality control samples. Trueness (bias) was assessed by comparing results from FACSPresto with the reference (single-platform FACSCalibur). Clinical misclassification was measured at 200, 350 and 500 cells/μL thresholds.

RESULTS

Intra-assay precision was < 6%, and inter-assay < 8%. CD4 results from FACSPresto and reference method resulted in regression slopes of 0.99-1.11 using either venous or capillary blood. Correlation was better for venous than for capillary blood (minimum 0.97 vs 0.93 respectively). Capillary blood resulted in a larger bias than venous blood, with 24 and 83 cells/μL for absolute CD4 counts on capillary blood in Antwerp and Dar es Salaam respectively, vs 12 and 41 cells/μL on venous blood. Bias on CD4% was < 1% on both venous and capillary blood, and was proportionally better than for absolute CD4 counts. Clinical misclassification was in line with the average overestimation, showing a very good specificity, but sensitivity around 70-90%. The rejection rate was 11% on first reading, leading to 6% of all samples without final result after a second reading.

CONCLUSIONS

The FACSPresto performed very well on venous blood samples, and well on capillary blood samples.

Performance evaluation of the touchscreen-based Muse™ Auto CD4/CD4% single-platform system for CD4 T cell numeration in absolute number and in percentage using blood samples from children and adult patients living in the Central African Republic

Background

The new microcapillary and fluorescence-based EC IVD-qualified Muse™ Auto CD4/CD4% single-platform assay (EMD Millipore Corporation, Merck Life Sciences, KGaA, Darmstadt, Germany) for CD4 T cell numeration in absolute number and in percentage was evaluated using Central African patients’ samples compared against the reference EC IVD-qualified BD FACSCount (Becton–Dickinson, USA) flow cytometer.

Methods

EDTA-blood samples from 124 adults, 10 adolescents, 13 children and 3 infants were tested in parallel at 2 reference laboratories in Bangui.

Results

The Muse™ technique was highly reproducible, with low intra- and inter-run variabilities less than 15%. CD4 T cell counts of Muse™ and BD FACSCount in absolute number and percentage were highly correlated (r² = 0.99 and 0.98, respectively). The mean absolute bias between Muse™ and BD FACSCount cells in absolute number and percentage were −5.91 cells/µl (95% CI −20.90 to 9.08) with limits of agreement from −77.50 to 202.40 cells/µl, and +1.69 %CD4 (95% CI ±1.29 to +2.09), respectively. The percentages of outliers outside the limits of agreement were nearly similar in absolute number (8%) and percentage (10%). CD4 T cell counting by Muse™ allowed identifying the majority of individuals with CD4 T cell <200, <350 or <750 cells/µl corresponding to the relevant thresholds of therapeutic care, with sensitivities of 95.5–100% and specificities of 83.9–100%.

Conclusions

The Muse™ Auto CD4/CD4% Assay analyzer is a reliable alternative flow cytometer for CD4 T lymphocyte enumeration to be used in routine immunological monitoring according to World Health Organization recommendations in HIV-infected adults as well as children living in resource-constrained settings.

Performance of point-of-care CD4 testing technologies in resource-constrained settings: a systematic review and meta-analysis

Background

Point-of-care (POC) CD4 testing increases patient accessibility to assessment of antiretroviral therapy eligibility. This review evaluates field performance in low and middle-income countries (LMICs) of currently available POC CD4 technologies.

Methods

Eight electronic databases were searched for field studies published between January 2005 and January 2015 of six POC CD4 platforms: PointCare NOW™, Alere Pima™ CD4, Daktari™ CD4 Counter, CyFlow® CD4 miniPOC, BD FACSPresto™, and MyT4™ CD4. Due to limited data availability, meta-analysis was conducted only for diagnostic performance of Pima at a threshold of 350 cells/μl, applying a bivariate multi-level random-effects modelling approach. A covariate extended model was also explored to test for difference in diagnostic performance between capillary and venous blood.

Results

Twenty seven studies were included. Published field study results were found for three of the six POC CD4 tests, 24 of which used Pima. For Pima, test failure rates varied from 2 to 23 % across study settings. Pooled sensitivity and specificity were 0.92 (95 % CI = 0.88–0.95) and 0.87 (95 % CI = 0.85–0.88) respectively. Diagnostic performance by blood sample type (venous vs. capillary) revealed non-significant differences in sensitivity (0.94 vs 0.89) and specificity (0.86 vs 0.87), respectively in the extended model (Wald χ²(2) = 4.77, p = 0.09).

Conclusions

POC CD4 testing can provides reliable results for making treatment decision under field conditions in low-resource settings. The Pima test shows a good diagnostic performance at CD4 cut-off of 350 cells/μl. More data are required to evaluate performance of POC CD4 testing using venous versus capillary blood in LMICs which might otherwise influence clinical practice.

Electronic supplementary material

The online version of this article (doi:10.1186/s12879-016-1931-2) contains supplementary material, which is available to authorized users.

CD4 Variability in Malawi: Implications for Use of a CD4 Threshold of 500 Cells/mm3 Versus Universal Eligibility for Antiretroviral Therapy

Background.  Given the uncertainty about the ability of a single CD4 count to accurately classify a patient as antiretroviral therapy (ART) eligible, we sought to understand the extent to which CD4 variability results in misclassification at a CD4 threshold of 500 cells/mm³. Methods.  We performed a prospective study of CD4 variability in Malawian human immunodeficiency virus-infected, ART-naive, World Health Organization (WHO) stage 1 or 2, nonpregnant adults. CD4 counts were performed daily for 8 days. We fit a Bayesian linear mixed-effects model of log-transformed CD4 cell counts to the data. We used Monte Carlo approximations to estimate misclassification rates for different observed values of CD4. The misclassification rate was calculated based on the conditional probability of true CD4 given the geometric mean of observed CD4 measurements. Results.  Fifty patients were enrolled from 2 sites. The median age was 33.5 years (interquartile range, 27.5-40.0) and 34 (68%) were female. Misclassification rates were <1% when the observed CD4 counts were ≤250 or ≥750 cells/mm³. Rates of misclassification were high at observed CD4 counts between 350 and 650 cells/mm³, particularly when a single measurement was used (up to 46.7%). Conclusions.  Our data show that ART eligibility based on a single CD4 count results in highest risk of misclassification when observed CD4 counts are in the range of 350-650 cells/mm³. Given the benefits of early ART, countries should weigh the costs and complexity of CD4 testing using a 500 cell/mm³ threshold against the cost savings and public health benefits of universal eligibility.

Human Immunodeficiency Virus (HIV)-Infected Patients Accept Finger Stick Blood Collection for Point-Of-Care CD4 Testing

Introduction

HIV-infected patients require antiretroviral treatment for life. To improve access to care, CD4 enumeration and viral load tests have been redesigned to be used as point-of-care techniques using finger-stick blood. Accurate CD4 counting in capillary blood requires a free flowing blood drop that is achieved by blade incision. The aim of this study was to assess the attitude of the patients toward blade-based finger-stick blood donation.

Methods

Four hundred and ninety-nine patients were included (299 patients from South Africa and 200 from Belgium). They completed a questionnaire to express their preference for finger stick or venipuncture, after undergoing both. The South African patient cohort was divided in two groups, receiving either single or multiple finger stick for CD4 and other HIV-related tests. The Belgian patients received a single finger stick for CD4 testing, and were asked to respond directly and again after two days.

Results

The majority of the patients preferred the finger stick to the venipuncture. The perceived pain using the blade was superior to a small needle, but similar to a large needle. They preferred up to three finger sticks over one venipuncture. Up to 30% of the patients changed their mind over two days. The main reason for choosing a finger stick was continued bleeding after venipuncture. The most cited objection to finger stick was pain/soreness.

Conclusion

Patient perceptions support the implementation of donating capillary blood with blade-based finger stick during CD4 point-of-care testing.

Thirty-five years of CD4 T-cell counting in HIV infection: From flow cytometry in the lab to point-of-care testing in the field

CD4 T-cell counting was introduced in clinical laboratories shortly after the discovery of the human immune deficiency virus (HIV) in the early eighties. In western clinical laboratories, improvements in the CD4 T-cell counting methods were mainly driven by progress in the field of flow cytometry and immunology. In contrast, the development of dedicated CD4 T-cell counting technologies were needs driven. When antiretroviral treatment (ART) was made available on a large scale by international Acquired Immune Deficiency Syndrome (AIDS) relief programs to HIV+ patients living in low income countries in 2003, there was a distinct need for simplified and affordable CD4 T-cell counting technologies. The first decade of 2000, several compact flow cytometers appeared on the market, mainly to the benefit of low income countries with limited resources. More recently, however, portable point-of-care (POC) CD4 T-cell counting devices have been developed especially to improve access to affordable monitoring of HIV+ patients in low income countries. The accuracy of these POC instruments is not yet very well documented as many are still under development and clinical validation but preliminary evidence is encouraging. The new HIV treatment guidelines released by the World Health Organization in 2016 give CD4 T-cell counting a less central role in the management of HIV infection. It is, therefore, to be expected that CD4 T-cell counting will be phased out as a tool to assess eligibility of HIV+ patients for ART in the future. However, CD4 T-cell counting will remain a valuable tool for directing treatment against opportunistic infections. © 2016 International Clinical Cytometry Society.

Acceptability and feasibility of point-of-care CD4 testing on HIV continuum of care in low and middle income countries: a systematic review

BACKGROUND

CD4 testing is, and will remain an important part of HIV treatment and care in low and middle income countries (LMICs). We report the findings of a systematic review assessing acceptability and feasibility of POC CD4 testing in field settings.

METHODS

Electronic databases were searched for studies published in English between 2005 and 2015 that describe POC CD4 platforms. Studies conducted in LMICs and under field conditions outside a laboratory environment were eligible. Qualitative and descriptive data analysis was used to present the findings.

RESULTS

Twelve studies were included, 11 of which were conducted in sub-Saharan countries and used one POC CD4 test (The Alere Pima CD4). Patients reported positively regarding the implementation of POC CD4 testing at primary health care and community level with ≥90 % of patients accepting the test across various study settings. Health service providers expressed preference toward POC CD4 testing as it is easy-to-use, efficient and satisfied patients' needs to a greater extent as compared to conventional methods. However, operational challenges including preference toward venous blood rather than finger-prick sampling, frequent device failures and operator errors, quality of training for test operators and supervisors, and increased staff workload were also identified.

CONCLUSIONS

POC CD4 testing seems acceptable and feasible in LIMCs under field conditions. Further studies using different POC CD4 tests available on the market are required to provide critical data to support countries in selection and implementation of appropriate POC CD4 technologies.

Evaluation of the FACSPresto, a New Point of Care Device for the Enumeration of CD4% and Absolute CD4+ T Cell Counts in HIV Infection

INTRODUCTION

Enumeration of CD4+ T lymphocytes is important for pre-ART disease staging and screening for opportunistic infections, however access to CD4 testing in resource limited settings is poor. Point of care (POC) technologies can facilitate improved access to CD4 testing. We evaluated the analytical performance of a novel POC device the FACSPresto compared to the FACSCalibur as a reference standard and to the PIMA, a POC device in widespread use in sub-Saharan Africa.

METHOD

Specimens were obtained from 253 HIV infected adults. Venous blood samples were analyzed on the FACSPresto and the FACSCalibur, in a subset of 41 samples additional analysis was done on the PIMA.

RESULTS

The absolute CD4 count results obtained on the FACSPresto were comparable to those on the FACSCalibur with low absolute (9.5cells/μl) and relative bias (3.2%). Bias in CD4% values was also low (1.06%) with a relative bias of 4.9%. The sensitivity was lower at a CD4 count threshold of ≤350cells/μl compared with ≤500cells/μl (84.9% vs. 92.8%) resulting in a high upward misclassification rate at low CD4 counts. Specificity at thresholds of ≤350cells/μl and ≤500cells/μl were 96.6% and 96.8% respectively. The PIMA had a high absolute (-68.6cells/μl) and relative bias (-10.5%) when compared with the FACSCalibur. At thresholds of ≤350cells/μl and ≤500cells/μl the sensitivity was 100% and 95.5% respectively; specificity was 85.7% and 84.2% respectively. The coefficients of repeatability were 4.13%, 5.29% and 9.8% respectively.

DISCUSSION

The analytic performance of the FACSPresto against the reference standard was very good with better agreement and precision than the PIMA. The FACSPresto had comparable sensitivity at a threshold of 500 cells/μl and better specificity than the PIMA. However the FACSPresto showed reduced sensitivity at low CD4 count thresholds.

CONCLUSION

The FACSPresto can be reliably used as a POC device for enumerating absolute CD4 count and CD4% values.

PIMA™ point-of-care testing for CD4 counts in predicting antiretroviral initiation in HIV-infected individuals in KwaZulu-Natal, Durban, South Africa

Introduction

Limited information is available on the usefulness of the PIMA™ analyser in predicting antiretroviral treatment eligibility and outcome in a primary healthcare clinic setting in disadvantaged communities in KwaZulu-Natal, South Africa.

Materials and methods

The study was conducted under the eThekwini Health Unit, Durban, KwaZulu-Natal. Comparison of the enumeration of CD4+ T-cells in 268 patients using the PIMA™ analyser and the predicate National Health Laboratory Services (NHLS) was undertaken during January to July 2013. Bland-Altman analysis to calculate bias and limits of agreement, precision and levels of clinical misclassification at various CD4+ T-cell count thresholds was performed.

Results

There was high precision of the PIMA™ control bead cartridges with low and normal CD4+ T-cell counts using three different PIMA™ analysers (%CV < 5). Under World Health Organization (WHO) guidelines (≤ 500 cells/mm³), the sensitivity of the PIMA™ analyser was 94%, specificity 78% and positive predictive value (PPV) 95%. There were 24 (9%) misclassifications, of which 13 were false-negative in whom the mean bias was 149 CD4+ T-cells/mm³. Most (87%) patients returned for their CD4 test result but only 67% (110/164) of those eligible (≤ 350 cells/mm³) were initiated on antiretroviral therapy (ART) with a time to treatment of 49 days (interquartile range [IQR], 42–64 days).

Conclusion

There was adequate agreement between PIMA™ analyser and predicate NHLS CD4+ T-cell count enumeration (≤ 500 cells/mm³) in adult HIV-positive individuals. The high PPV, sensitivity and acceptable specificity of the PIMA™ analyser technology lend it as a reliable tool in predicting eligibility and rapid linkage to care in ART programmes.

Performance Evaluation of the Becton Dickinson FACSPresto™ Near-Patient CD4 Instrument in a Laboratory and Typical Field Clinic Setting in South Africa

Background

The BD-FACSPresto^™ CD4 is a new, point-of-care (POC) instrument utilising finger-stick capillary blood sampling. This study evaluated its performance against predicate CD4 testing in South Africa.

Methods

Phase-I testing: HIV+ patient samples (n = 214) were analysed on the Presto^™ under ideal laboratory conditions using venous blood. During Phase-II, 135 patients were capillary-bled for CD4 testing on FACSPresto^™, performed according to manufacturer instruction. Comparative statistical analyses against predicate PLG/CD4 method and industry standards were done using GraphPad Prism 6. It included Bland-Altman with 95% limits of agreement (LOA) and percentage similarity with coefficient of variation (%CV) analyses for absolute CD4 count (cells/μl) and CD4 percentage of lymphocytes (CD4%).

Results

In Phase-I, 179/217 samples yielded reportable results with Presto^™ using venous blood filled cartridges. Compared to predicate, a mean bias of 40.4±45.8 (LOA of -49.2 to 130.2) and %similarity (%CV) of 106.1%±7.75 (7.3%) was noted for CD4 absolute counts. In Phase-2 field study, 118/135 capillary-bled Presto^™ samples resulted CD4 parameters. Compared to predicate, a mean bias of 50.2±92.8 (LOA of -131.7 to 232) with %similarity (%CV) 105%±10.8 (10.3%), and 2.87±2.7 (LOA of -8.2 to 2.5) with similarity of 94.7±6.5% (6.83%) noted for absolute CD4 and CD4% respectively. No significant clinical differences were indicated for either parameter using two sampling methods.

Conclusion

The Presto^™ produced remarkable precision to predicate methods, irrespective of venous or capillary blood sampling. A consistent, clinically insignificant over-estimation (5–7%) of counts against PLG/CD4 and equivalency to FACSCount^™ was noted. Further field studies are awaited to confirm longer-term use.

Initiating Antiretroviral Therapy for HIV at a Patient's First Clinic Visit: The RapIT Randomized Controlled Trial

BACKGROUND

High rates of patient attrition from care between HIV testing and antiretroviral therapy (ART) initiation have been documented in sub-Saharan Africa, contributing to persistently low CD4 cell counts at treatment initiation. One reason for this is that starting ART in many countries is a lengthy and burdensome process, imposing long waits and multiple clinic visits on patients. We estimated the effect on uptake of ART and viral suppression of an accelerated initiation algorithm that allowed treatment-eligible patients to be dispensed their first supply of antiretroviral medications on the day of their first HIV-related clinic visit.

METHODS AND FINDINGS

RapIT (Rapid Initiation of Treatment) was an unblinded randomized controlled trial of single-visit ART initiation in two public sector clinics in South Africa, a primary health clinic (PHC) and a hospital-based HIV clinic. Adult (≥18 y old), non-pregnant patients receiving a positive HIV test or first treatment-eligible CD4 count were randomized to standard or rapid initiation. Patients in the rapid-initiation arm of the study ("rapid arm") received a point-of-care (POC) CD4 count if needed; those who were ART-eligible received a POC tuberculosis (TB) test if symptomatic, POC blood tests, physical exam, education, counseling, and antiretroviral (ARV) dispensing. Patients in the standard-initiation arm of the study ("standard arm") followed standard clinic procedures (three to five additional clinic visits over 2-4 wk prior to ARV dispensing). Follow up was by record review only. The primary outcome was viral suppression, defined as initiated, retained in care, and suppressed (≤400 copies/ml) within 10 mo of study enrollment. Secondary outcomes included initiation of ART ≤90 d of study enrollment, retention in care, time to ART initiation, patient-level predictors of primary outcomes, prevalence of TB symptoms, and the feasibility and acceptability of the intervention. A survival analysis was conducted comparing attrition from care after ART initiation between the groups among those who initiated within 90 d. Three hundred and seventy-seven patients were enrolled in the study between May 8, 2013 and August 29, 2014 (median CD4 count 210 cells/mm3). In the rapid arm, 119/187 patients (64%) initiated treatment and were virally suppressed at 10 mo, compared to 96/190 (51%) in the standard arm (relative risk [RR] 1.26 [1.05-1.50]). In the rapid arm 182/187 (97%) initiated ART ≤90 d, compared to 136/190 (72%) in the standard arm (RR 1.36, 95% confidence interval [CI], 1.24-1.49). Among 318 patients who did initiate ART within 90 d, the hazard of attrition within the first 10 mo did not differ between the treatment arms (hazard ratio [HR] 1.06; 95% CI 0.61-1.84). The study was limited by the small number of sites and small sample size, and the generalizability of the results to other settings and to non-research conditions is uncertain.

CONCLUSIONS

Offering single-visit ART initiation to adult patients in South Africa increased uptake of ART by 36% and viral suppression by 26%. This intervention should be considered for adoption in the public sector in Africa.

TRIAL REGISTRATION

ClinicalTrials.gov NCT01710397, and South African National Clinical Trials Register DOH-27-0213-4177.

CD4 results with a bias larger than hundred cells per microliter can have a significant impact on the clinical decision during treatment initiation of HIV patients

BACKGROUND

CD4 counts are currently used to assess HIV patients for treatment eligibility and to monitor antiretroviral response to treatment. The emerging point-of-care devices could fill an important gap in resource-limited settings. However, the accuracy of CD4-counting instruments is diverse and data on how CD4 measurement errors have an impact on clinical decisions are lacking.

METHODS

Clinicians were queried on the use of CD4 results in their clinical setting. Subsequently, the effect of CD4 measurement errors on treatment initiation was put in a statistical model. Based on clinical CD4 databases from Belgium, Cambodia, and Senegal, the percentage of unchanged clinical decisions was calculated (treatment initiation should start within a 3-month delay [one visit]) for escalating CD4 measurement errors, taking into account the strict or preventive application of CD4 thresholds at 350 or 500 cells/µl used by clinicians.

RESULTS

To ensure that the treatment was initiated appropriately for at least 95% of patients, an error of 5 - 10 cells/µl was allowed. This is significantly smaller than the bias of ±50 cells/µl most clinicians considered acceptable. For limits of agreement (LOA, 1.96 x error) of 100 cells/µl, corresponding to most CD4 instrument evaluations, the misclassification rate of patients was found to be 3 - 28% at the threshold of 350 cells/µl (strict or flexible), and 13 - 20% at 500 cells/µl.

CONCLUSIONS

The maximum allowed CD4 bias on results from new CD4 technologies should not exceed 50 cells/µl (LOA 100 cells/µl) when applied for treatment initiation, to ensure at least 72% of correct clinical decisions. © 2016 International Clinical Cytometry Society.

Advances in addressing technical challenges of point-of-care diagnostics in resource-limited settings

The striking prevalence of HIV, TB and malaria, as well as outbreaks of emerging infectious diseases, such as influenza A (H7N9), Ebola and MERS, poses great challenges for patient care in resource-limited settings (RLS). However, advanced diagnostic technologies cannot be implemented in RLS largely due to economic constraints. Simple and inexpensive point-of-care (POC) diagnostics, which rely less on environmental context and operator training, have thus been extensively studied to achieve early diagnosis and treatment monitoring in non-laboratory settings. Despite great input from material science, biomedical engineering and nanotechnology for developing POC diagnostics, significant technical challenges are yet to be overcome. Summarized here are the technical challenges associated with POC diagnostics from a RLS perspective and the latest advances in addressing these challenges are reviewed.

"Can't you initiate me here?": Challenges to timely initiation on antiretroviral therapy among methadone clients in Dar es Salaam, Tanzania

BACKGROUND

Despite dramatic improvement in antiretroviral therapy (ART) access globally, people living with HIV who inject drugs continue to face barriers that limit their access to treatment. This paper explores barriers and facilitators to ART initiation among clients attending a methadone clinic in Dar es Salaam, Tanzania.

METHODS

We interviewed 12 providers and 20 clients living with HIV at the Muhimbili National Hospital methadone clinic between January and February 2015. We purposively sampled clients based on sex and ART status and providers based on job function. To analyze interview transcripts, we adopted a content analysis approach.

RESULTS

Participants identified several factors that hindered timely ART initiation for clients at the methadone clinic. These included delays in CD4 testing and receiving CD4 test results; off-site HIV clinics; stigma operating at the individual, social and institutional levels; insufficient knowledge of the benefits of early ART initiation among clients; treatment breakdown at the clinic level possibly due to limited staff; and initiating ART only once one feels physically ill. Participants perceived social support as a buffer against stigma and facilitator of HIV treatment. Some clients also reported that persistent monitoring and follow-up on their HIV care and treatment by methadone clinic providers led them to initiate ART.

CONCLUSION

Health system factors, stigma and limited social support pose challenges for methadone clients living with HIV to initiate ART. Our findings suggest that on-site point-of-care CD4 testing, a peer support system, and trained HIV treatment specialists who are able to counsel HIV-positive clients and initiate them on ART at the methadone clinic could help reduce barriers to timely ART initiation for methadone clients.

A meta-analysis of the performance of the Pima™ CD4 for point of care testing

BACKGROUND

The Alere point-of-care (POC) Pima™ CD4 analyzer allows for decentralized testing and expansion to testing antiretroviral therapy (ART) eligibility. A consortium conducted a pooled multi-data technical performance analysis of the Pima CD4.

METHODS

Primary data (11,803 paired observations) comprised 22 independent studies between 2009-2012 from the Caribbean, Asia, Sub-Saharan Africa, USA and Europe, using 6 laboratory-based reference technologies. Data were analyzed as categorical (including binary) and numerical (absolute) observations using a bivariate and/or univariate random effects model when appropriate.

RESULTS

At a median reference CD4 of 383 cells/μl the mean Pima CD4 bias is -23 cells/μl (average bias across all CD4 ranges is 10 % for venous and 15% for capillary testing). Sensitivity of the Pima CD4 is 93% (95% confidence interval [CI] 91.4% - 94.9%) at 350 cells/μl and 96% (CI 95.2% - 96.9%) at 500 cells/μl, with no significant difference between venous and capillary testing. Sensitivity reduced to 86% (CI 82% - 89%) at 100 cells/μl (for Cryptococcal antigen (CrAg) screening), with a significant difference between venous (88%, CI: 85% - 91%) and capillary (79%, CI: 73% - 84%) testing. Total CD4 misclassification is 2.3% cases at 100 cells/μl, 11.0% at 350 cells/μl and 9.5 % at 500 cells/μl, due to higher false positive rates which resulted in more patients identified for treatment. This increased by 1.2%, 2.8% and 1.8%, respectively, for capillary testing. There was no difference in Pima CD4 misclassification between the meta-analysis data and a population subset of HIV+ ART naïve individuals, nor in misclassification among operator cadres. The Pima CD4 was most similar to Beckman Coulter PanLeucogated CD4, Becton Dickinson FACSCalibur and FACSCount, and less similar to Partec CyFlow reference technologies.

CONCLUSIONS

The Pima CD4 may be recommended using venous-derived specimens for screening (100 cells/μl) for reflex CrAg screening and for HIV ART eligibility at 350 cells/μl and 500 cells/μl thresholds using both capillary and venous derived specimens. These meta-analysis findings add to the knowledge of acceptance criteria of the Pima CD4 and future POC tests, but implementation and impact will require full costing analysis.

Errors generated by a point-of-care CD4+ T-lymphocyte analyser: a retrospective observational study in nine countries

OBJECTIVE

To estimate the proportion of invalid results generated by a CD4+ T-lymphocyte analyser used by Médecins Sans Frontières (MSF) in field projects and identify factors associated with invalid results.

METHODS

We collated 25,616 CD4+ T-lymphocyte test results from 39 sites in nine countries for the years 2011 to 2013. Information about the setting, user, training, sampling technique and device repair history were obtained by questionnaire. The analyser performs a series of checks to ensure that all steps of the analysis are completed successfully; if not, an invalid result is reported. We calculated the proportion of invalid results by device and by operator. Regression analyses were used to investigate factors associated with invalid results.

FINDINGS

There were 3354 invalid test results (13.1%) across 39 sites, for 58 Alere PimaTM devices and 180 operators. The median proportion of errors per device and operator was 12.7% (interquartile range, IQR: 10.3-19.9) and 12.1% (IQR: 7.1-19.2), respectively. The proportion of invalid results varied widely by country, setting, user and device. Errors were not associated with settings, user experience or the number of users per device. Tests performed on capillary blood samples were significantly less likely to generate errors compared to venous whole blood.

CONCLUSION

The Alere Pima CD4+ analyser generated a high proportion of invalid test results, across different countries, settings and users. Most error codes could be attributed to the operator, but the exact causes proved difficult to identify. Invalid results need to be factored into the implementation and operational costs of routine CD4+ T-lymphocyte testing.

Field Evaluation of a Point-of-Care CD4 Analyzer for Monitoring HIV Patients in the Interior of the Amazon Region, Brazil

Objective

To evaluate the accuracy of the PIMA point-of-care CD4 analyzer (PIMA) under field conditions in comparison to the current CD4 count system (FACSCalibur), and to evaluate the operational suitability and acceptability of health professionals (HP) and HIV-patients in using the PIMA in health clinics in the Amazon Region.

Methods

CD4 counts were measured onsite by the PIMA using fingerprick blood and in the reference laboratory by both the PIMA and FACSCalibur using venous blood. We used the Bland–Altman method to estimate the mean bias, and calculated the sensitivity and specificity at <200 and <500 cell/μL thresholds. Patients (n = 404) and HP (n = 7) were interviewed on the acceptability and operational suitability of the PIMA.

Results

Using fingerprick blood (n = 337), the PIMA showed a concordance correlation coefficient (Rc) of 0.81, mean difference of -111.9 cell/μL, 93.1%/98.5% sensitivity, and 89.2%/56.7% specificity at <200 and <500 cell/μL thresholds, respectively. Venous blood (n = 340) showed an Rc of 0.89, mean difference of -83.4 cell/μL, 98.3%/97.5% sensitivity, and 93.9%/66.0% specificity at <200 and <500 cell/μL thresholds, respectively. The capillary PIMA was well accepted and found operationally appropriate by patients and HP.

Conclusions

The agreement between both instruments was poor and the PIMA underestimated CD4 cell counts, which was more pronounced at CD4 counts ≥500 cell/μl. The PIMA’s performance with fingerprick blood was less reliable than its performance with venous blood. In Brazil, where antiretroviral treatment is initiated regardless of CD4 counts, the PIMA’s systematic bias towards CD4 underestimation may limit its role for monitoring HIV-patients.

Laboratory and field evaluation of the Partec CyFlow miniPOC for absolute and relative CD4 T-cell enumeration

Background

A new CD4 point-of-care instrument, the CyFlow miniPOC, which provides absolute and percentage CD4 T-cells, used for screening and monitoring of HIV-infected patients in resource-limited settings, was introduced recently. We assessed the performance of this novel instrument in a reference laboratory and in a field setting in Senegal.

Methodology

A total of 321 blood samples were obtained from 297 adults and 24 children, all HIV-patients attending university hospitals in Dakar, or health centers in Ziguinchor. Samples were analyzed in parallel on CyFlow miniPOC, FACSCount CD4 and FACSCalibur to assess CyFlow miniPOC precision and accuracy.

Results

At the reference lab, CyFlow miniPOC, compared to FACSCalibur, showed an absolute mean bias of -12.6 cells/mm³ and a corresponding relative mean bias of -2.3% for absolute CD4 counts. For CD4 percentages, the absolute mean bias was -0.1%. Compared to FACSCount CD4, the absolute and relative mean biases were -31.2 cells/mm³ and -4.7%, respectively, for CD4 counts, whereas the absolute mean bias for CD4 percentages was 1.3%. The CyFlow miniPOC was able to classify HIV-patients eligible for ART with a sensitivity of ≥ 95% at the different ART-initiation thresholds (200, 350 and 500 CD4 cells/mm3). In the field lab, the room temperature ranged from 30 to 35°C during the working hours. At those temperatures, the CyFlow miniPOC, compared to FACSCount CD4, had an absolute and relative mean bias of 7.6 cells/mm³ and 2.8%, respectively, for absolute CD4 counts, and an absolute mean bias of 0.4% for CD4 percentages. The CyFlow miniPOC showed sensitivity equal or greater than 94%.

Conclusion

The CyFlow miniPOC showed high agreement with FACSCalibur and FACSCount CD4. The CyFlow miniPOC provides both reliable absolute CD4 counts and CD4 percentages even under the field conditions, and is suitable for monitoring HIV-infected patients in resource-limited settings.