A model for continuous quality control incorporating sample-to-sample assessment of optical alignment, fluorescence sensitivity, and volumetric operation of flow cytometers

Categorizing and Establishing CD4 Service Equivalency: Testing of Residual, Archived External Quality Assessment Scheme Sample Panels Enables Accelerated Virtual Peer Laboratory Review

BACKGROUND

Testing of collated, curated residual archived external quality assessment (EQA) trial material, with pre-established true (consensus) values collated into 25-sample panels enables virtual peer review of a laboratory's proficiency. In this study, we introduce how archived EQAS samples/panels can establish equivalency of CD4 reporting across multiple laboratories in a national program.

METHODS

Curated unused trial material from archived EQAS CD4 trials were collated into 25-sample panels comprising three sets of five-sample replicates and at least three duplicate samples. Panel-samples were tested using predicate methods of participating laboratories and proficiency determined by calculating a Standard Deviation Index (SDI) for each panel-sample reported according to retrospective consensus pooled trial outcomes. All data were plotted using MS Excel and Graphpad-Prism with SDI limits between -2 and +2 SDI to define acceptable performance. Percentage similarity analysis determined agreement. Bead-count-rate data was used to determine pipetting error.

RESULTS

Tight clustering of SDI outcomes predicted acceptable laboratory proficiency with acceptable accuracy and precision as evidenced by mean SDI < 0.5 and SD of SDI < 0.5. Random pipetting error was identified with aberrant BCR. Systematic under-reading of results was noted in one lab with excellent precision but mean SDI > 1.6. Additional training requirements were evident where a respective laboratory's SD of SDI exceeded 0.7.

CONCLUSIONS

Archival panel testing undertaken across a network of CD4 laboratories using the same CD4 method to simultaneously test the same panel prior to national implementation highlighted proficient laboratories and was useful for identifying sites with service deficiencies and immediate additional training needs. © 2019 International Clinical Cytometry Society.

Performance verification of the new fully automated Aquios flow cytometer PanLeucogate (PLG) platform for CD4-T-lymphocyte enumeration in South Africa

BACKGROUND

The National Health Laboratory Service (NHLS) offers wide-scale CD4 testing through a network of laboratories in South Africa. A new "load and go" cytometer (Aquios CL, Beckman Coulter), developed with a PLG protocol, was validated against the predicate PLG method on the Beckman Coulter FC500 MPL/CellMek platform.

METHODS

Remnant routine EDTA blood CD4 reference results were compared to results from two Aquios/PLG instruments (n = 205) and a further n = 1885 samples tested to assess daily testing capacity. Reproducibility was assessed using ImmunotrolTM and patient samples with low, medium, high CD4 counts. Data was analyzed using GraphPad software for general statistics and Bland-Altman (BA) analyses. The percentage similarity (%Sim) was used to measure the level of agreement (accuracy) of the new platform versus the predicate and variance (%SimCV) reported to indicate precision of difference to predicate.

RESULTS

205 samples were tested with a CD4 count range of 2-1228 cells/μl (median 365cells/μl). BA analysis revealed an overall -40.5±44.0cells/μl bias (LOA of 126.8 to 45.8cells/μl) and %Sim showing good agreement and tight precision to predicate results (94.83±5.39% with %SimCV = 5.69%). Workflow analysis (n = 1885) showed similar outcomes 94.9±8.9% (CV of 9.4%) and 120 samples/day capacity. Excellent intra-instrument reproducibility was noted (%Sim 98.7±2.8% and %SimCV of 2.8%). 5-day reproducibility using internal quality control material (Immunotrol™) showed tight precision (reported %CV of 4.69 and 7.62 for Normal and Low material respectively) and instrument stability.

CONCLUSION

The Aquios/PLG CD4 testing platform showed clinically acceptable result reporting to existing predicate results, with good system stability and reproducibility with a slight negative but precise bias. This system can replace the faded XL cytometers in low- to medium volume CD4 testing laboratories, using the standardized testing protocol, with better staff utilization especially where technical skills are lacking. Central monitoring of on-board quality assessment data facilitates proactive maintenance and networked instrument performance monitoring.

Performance Evaluation of the Becton Dickinson FACSPresto™ Near-Patient CD4 Instrument in a Laboratory and Typical Field Clinic Setting in South Africa

Background

The BD-FACSPresto^™ CD4 is a new, point-of-care (POC) instrument utilising finger-stick capillary blood sampling. This study evaluated its performance against predicate CD4 testing in South Africa.

Methods

Phase-I testing: HIV+ patient samples (n = 214) were analysed on the Presto^™ under ideal laboratory conditions using venous blood. During Phase-II, 135 patients were capillary-bled for CD4 testing on FACSPresto^™, performed according to manufacturer instruction. Comparative statistical analyses against predicate PLG/CD4 method and industry standards were done using GraphPad Prism 6. It included Bland-Altman with 95% limits of agreement (LOA) and percentage similarity with coefficient of variation (%CV) analyses for absolute CD4 count (cells/μl) and CD4 percentage of lymphocytes (CD4%).

Results

In Phase-I, 179/217 samples yielded reportable results with Presto^™ using venous blood filled cartridges. Compared to predicate, a mean bias of 40.4±45.8 (LOA of -49.2 to 130.2) and %similarity (%CV) of 106.1%±7.75 (7.3%) was noted for CD4 absolute counts. In Phase-2 field study, 118/135 capillary-bled Presto^™ samples resulted CD4 parameters. Compared to predicate, a mean bias of 50.2±92.8 (LOA of -131.7 to 232) with %similarity (%CV) 105%±10.8 (10.3%), and 2.87±2.7 (LOA of -8.2 to 2.5) with similarity of 94.7±6.5% (6.83%) noted for absolute CD4 and CD4% respectively. No significant clinical differences were indicated for either parameter using two sampling methods.

Conclusion

The Presto^™ produced remarkable precision to predicate methods, irrespective of venous or capillary blood sampling. A consistent, clinically insignificant over-estimation (5–7%) of counts against PLG/CD4 and equivalency to FACSCount^™ was noted. Further field studies are awaited to confirm longer-term use.

Estimating implementation and operational costs of an integrated tiered CD4 service including laboratory and point of care testing in a remote health district in South Africa

BACKGROUND

An integrated tiered service delivery model (ITSDM) has been proposed to provide 'full-coverage' of CD4 services throughout South Africa. Five tiers are described, defined by testing volumes and number of referring health-facilities. These include: (1) Tier-1/decentralized point-of-care service (POC) in a single site; Tier-2/POC-hub servicing processing < 30-40 samples from 8-10 health-clinics; Tier-3/Community laboratories servicing ∼ 50 health-clinics, processing < 150 samples/day; high-volume centralized laboratories (Tier-4 and Tier-5) processing < 300 or > 600 samples/day and serving > 100 or > 200 health-clinics, respectively. The objective of this study was to establish costs of existing and ITSDM-tiers 1, 2 and 3 in a remote, under-serviced district in South Africa.

METHODS

Historical health-facility workload volumes from the Pixley-ka-Seme district, and the total volumes of CD4 tests performed by the adjacent district referral CD4 laboratories, linked to locations of all referring clinics and related laboratory-to-result turn-around time (LTR-TAT) data, were extracted from the NHLS Corporate-Data-Warehouse for the period April-2012 to March-2013. Tiers were costed separately (as a cost-per-result) including equipment, staffing, reagents and test consumable costs. A one-way sensitivity analyses provided for changes in reagent price, test volumes and personnel time.

RESULTS

The lowest cost-per-result was noted for the existing laboratory-based Tiers- 4 and 5 ($6.24 and $5.37 respectively), but with related increased LTR-TAT of > 24-48 hours. Full service coverage with TAT < 6-hours could be achieved with placement of twenty-seven Tier-1/POC or eight Tier-2/POC-hubs, at a cost-per-result of $32.32 and $15.88 respectively. A single district Tier-3 laboratory also ensured 'full service coverage' and < 24 hour LTR-TAT for the district at $7.42 per-test.

CONCLUSION

Implementing a single Tier-3/community laboratory to extend and improve delivery of services in Pixley-ka-Seme, with an estimated local ∼ 12-24-hour LTR-TAT, is ∼ $2 more than existing referred services per-test, but 2-4 fold cheaper than implementing eight Tier-2/POC-hubs or providing twenty-seven Tier-1/POCT CD4 services.

An integrated tiered service delivery model (ITSDM) based on local CD4 testing demands can improve turn-around times and save costs whilst ensuring accessible and scalable CD4 services across a national programme

Background

The South African National Health Laboratory Service (NHLS) responded to HIV treatment initiatives with two-tiered CD4 laboratory services in 2004. Increasing programmatic burden, as more patients access anti-retroviral therapy (ART), has demanded extending CD4 services to meet increasing clinical needs. The aim of this study was to review existing services and develop a service-model that integrated laboratory-based and point-of-care testing (POCT), to extend national coverage, improve local turn-around/(TAT) and contain programmatic costs.

Methods

NHLS Corporate Data Warehouse CD4 data, from 60–70 laboratories and 4756 referring health facilities was reviewed for referral laboratory workload, respective referring facility volumes and related TAT, from 2009–2012.

Results

An integrated tiered service delivery model (ITSDM) is proposed. Tier-1/POCT delivers CD4 testing at single health-clinics providing ART in hard-to-reach areas (<5 samples/day). Laboratory-based testing is extended with Tier-2/POC-Hubs (processing ≤30–40 CD4 samples/day), consolidating POCT across 8–10 health-clinics with other HIV-related testing and Tier-3/‘community’ laboratories, serving ≤40 health-clinics, processing ≤150 samples/day. Existing Tier-4/‘regional’ laboratories serve ≤100 facilities and process <350 samples/day; Tier-5 are high-volume ‘metro’/centralized laboratories (>350–1500 tests/day, serving ≥200 health-clinics). Tier-6 provides national support for standardisation, harmonization and quality across the organization.

Conclusion

The ITSDM offers improved local TAT by extending CD4 services into rural/remote areas with new Tier-3 or Tier-2/POC-Hub services installed in existing community laboratories, most with developed infrastructure. The advantage of lower laboratory CD4 costs and use of existing infrastructure enables subsidization of delivery of more expensive POC services, into hard-to-reach districts without reasonable access to a local CD4 laboratory. Full ITSDM implementation across 5 service tiers (as opposed to widespread implementation of POC testing to extend service) can facilitate sustainable ‘full service coverage’ across South Africa, and save>than R125 million in HIV/AIDS programmatic costs. ITSDM hierarchical parental-support also assures laboratory/POC management, equipment maintenance, quality control and on-going training between tiers.

Performance evaluation of the Pima™ point-of-care CD4 analyser using capillary blood sampling in field tests in South Africa

Background

Point-of-care CD4 testing can provide immediate CD4 reporting at HIV-testing sites. This study evaluated performance of capillary blood sampling using the point-of-care Pima™ CD4 device in representative primary health care clinics doing HIV testing.

Methods

Prior to testing, prescribed capillary-sampling and instrument training was undertaken by suppliers across all sites. Matching venous EDTA samples were drawn throughout for comparison to laboratory predicate methodology (PLG/CD4). In Phase I, Pima™ cartridges were pipette-filled with EDTA venous blood in the laboratory (N = 100). In Phase II (N = 77), Pima™ CD4 with capillary sampling was performed by a single operator in a hospital-based antenatal clinic. During subsequent field testing, Pima™ CD4 with capillary sampling was performed in primary health care clinics on HIV-positive patients by multiple attending nursing personnel in a rural clinic (Phase-IIIA, N = 96) and an inner-city clinic (Phase-IIIB, N = 139).

Results

Pima™ CD4 compared favourably to predicate/CD4 when cartridges were pipette-filled with venous blood (bias -17.3 ± STDev = 36.7 cells/mm³; precision-to-predicate %CV < 6%). Decreased precision of Pima™ CD4 to predicate/CD4 (varying from 17.6 to 28.8%SIM CV; mean bias = 37.9 ± STDev = 179.5 cells/mm³) was noted during field testing in the hospital antenatal clinic. In the rural clinic field-studies, unacceptable precision-to-predicate and positive bias was noted (mean 28.4%SIM CV; mean bias = +105.7 ± STDev = 225.4 cells/mm³). With additional proactive manufacturer support, reliable performance was noted in the subsequent inner-city clinic field study where acceptable precision-to-predicate (11%SIM CV) and less bias of Pima™ to predicate was shown (BA bias ~11 ± STDev = 69 cells/mm³).

Conclusions

Variable precision of Pima™ to predicate CD4 across study sites was attributable to variable capillary sampling. Poor precision was noted in the outlying primary health care clinic where the system is most likely to be used. Stringent attention to capillary blood collection technique is therefore imperative if technologies like Pima™ are used with capillary sampling at the POC. Pima™ CD4 analysis with venous blood was shown to be reproducible, but testing at the point of care exposes operators to biohazard risk related to uncapping vacutainer samples and pipetting of blood, and is best placed in smaller laboratories using established principles of Good Clinical Laboratory Practice. The development of capillary sampling quality control methods that assure reliable CD4 counts at the point of care are awaited.