Clinical performance of an automated reader in interpreting malaria rapid diagnostic tests in Tanzania

Surveillance as a Core Intervention to Strengthen Malaria Control Programs in Moderate to High Transmission Settings

New tools are needed for malaria control, and recent improvements in malaria surveillance have opened the possibility of transforming surveillance into a core intervention. Implementing this strategy can be challenging in moderate to high transmission settings. However, there is a wealth of practical experience among national malaria control programs and partners working to improve and use malaria surveillance data to guide programming. Granular and timely data are critical to understanding geographic heterogeneity, appropriately defining and targeting interventions packages, and enabling timely decision-making at the operational level. Resources to be targeted based on surveillance data include vector control, case management commodities, outbreak responses, quality improvement interventions, and human resources, including community health workers, as they contribute to a more refined granularity of the surveillance system. Effectively transforming malaria surveillance into a core intervention will require strong global and national leadership, empowerment of subnational and local leaders, collaboration among development partners, and global coordination. Ensuring that national health systems include community health work can contribute to a successful transformation. It will require a strong supply chain to ensure that all suspected cases can be diagnosed and data reporting tools including appropriate electronic devices to provide timely data. Regular data quality audits, decentralized implementation, supportive supervision, data-informed decision-making processes, and harnessing technology for data analysis and visualization are needed to improve the capacity for data-driven decision-making at all levels. Finally, resources must be available to respond programmatically to these decisions.

Willingness of Chinese Men Who Have Sex With Men to Use Smartphone-Based Electronic Readers for HIV Self-testing: Web-Based Cross-sectional Study

BACKGROUND

The need for strategies to encourage user-initiated reporting of results after HIV self-testing (HIVST) persists. Smartphone-based electronic readers (SERs) have been shown capable of reading diagnostics results accurately in point-of-care diagnostics and could bridge the current gaps between HIVST and linkage to care.

OBJECTIVE

Our study aimed to assess the willingness of Chinese men who have sex with men (MSM) in the Jiangsu province to use an SER for HIVST through a web-based cross-sectional study.

METHODS

From February to April 2020, we conducted a convenience web-based survey among Chinese MSM by using a pretested structured questionnaire. Survey items were adapted from previous HIVST feasibility studies and modified as required. Prior to answering reader-related questions, participants watched a video showcasing a prototype SER. Statistical analysis included descriptive analysis, chi-squared test, and multivariable logistic regression. P values less than .05 were deemed statistically significant.

RESULTS

Of 692 participants, 369 (53.3%) were aged 26-40 years, 456 (65.9%) had ever self-tested for HIV, and 493 (71.2%) were willing to use an SER for HIVST. Approximately 98% (483/493) of the willing participants, 85.3% (459/538) of ever self-tested and never self-tested, and 40% (46/115) of unwilling participants reported that SERs would increase their HIVST frequency. Engaging in unprotected anal intercourse with regular partners compared to consistently using condoms (adjusted odds ratio [AOR] 3.04, 95% CI 1.19-7.74) increased the odds of willingness to use an SER for HIVST. Participants who had ever considered HIVST at home with a partner right before sex compared to those who had not (AOR 2.99, 95% CI 1.13-7.90) were also more willing to use an SER for HIVST. Playing receptive roles during anal intercourse compared to playing insertive roles (AOR 0.05, 95% CI 0.02-0.14) was associated with decreased odds of being willing to use an SER for HIVST. The majority of the participants (447/608, 73.5%) preferred to purchase readers from local Centers of Disease Control and Prevention offices and 51.2% (311/608) of the participants were willing to pay less than US $4.70 for a reader device.

CONCLUSIONS

The majority of the Chinese MSM, especially those with high sexual risk behaviors, were willing to use an SER for HIVST. Many MSM were also willing to self-test more frequently for HIV with an SER. Further research is needed to ascertain the diagnostic and real-time data-capturing capacity of prototype SERs during HIVST.

A comparative evaluation of mobile medical APPS (MMAS) for reading and interpreting malaria rapid diagnostic tests

BACKGROUND

The World Health Organization recommends confirmatory diagnosis by microscopy or malaria rapid diagnostic test (RDT) in patients with suspected malaria. In recent years, mobile medical applications (MMAs), which can interpret RDT test results have entered the market. To evaluate the performance of commercially available MMAs, an evaluation was conducted by comparing RDT results read by MMAs to RDT results read by the human eye.

METHODS

Five different MMAs were evaluated on six different RDT products using cultured Plasmodium falciparum blood samples at five dilutions ranging from 20 to 1000 parasites (p)/microlitre (µl) and malaria negative blood samples. The RDTs were performed in a controlled, laboratory setting by a trained operator who visually read the RDT results. A second trained operator then used the MMAs to read the RDT results. Sensitivity (Sn) and specificity (Sp) for the RDTs were calculated in a Bayesian framework using mixed models.

RESULTS

The RDT Sn of the P. falciparum (Pf) test line, when read by the trained human eye was significantly higher compared to when read by MMAs (74% vs. average 47%) at samples of 20 p/µl. In higher density samples, the Sn was comparable to the human eye (97%) for three MMAs. The RDT Sn of test lines that detect all Plasmodium species (Pan line), when read by the trained human eye was significantly higher compared to when read by MMAs (79% vs. average 56%) across all densities. The RDT Sp, when read by the human eye or MMAs was 99% for both the Pf and Pan test lines across all densities.

CONCLUSIONS

The study results show that in a laboratory setting, most MMAs produced similar results interpreting the Pf test line of RDTs at parasite densities typically found in patients that experience malaria symptoms (> 100 p/µl) compared to the human eye. At low parasite densities for the Pf line and across all parasite densities for the Pan line, MMAs were less accurate than the human eye. Future efforts should focus on improving the band/line detection at lower band intensities and evaluating additional MMA functionalities like the ability to identify and classify RDT errors or anomalies.

Continuous quality monitoring in the field: an evaluation of the performance of the Fio Deki Reader™ for rapid HIV testing in South Africa

Background

Rapid diagnostic tests (RDTs) are a cornerstone of HIV diagnosis and rely on good quality processing and interpretation, particularly in the era of test and treat. The Deki Reader (Fio Corporation®, Toronto, Ontario, Canada) is a portable device designed specifically for analysing RDTs and was selected for evaluation in South Africa in the context of HIV RDT analysis.

Methods

This study consisted of a laboratory evaluation and two-part field evaluation of the Deki Reader v100, covering two RDT testing algorithms, and an evaluation of the continuous quality monitoring through the Fionet™ web portal. Based on user feedback from the field evaluation, the device underwent hardware and software redesign, and the Deki Reader v200 was evaluated in the laboratory. Ethics approval for this evaluation was obtained from the University of the Witwatersrand Human Research Ethics Committee: M150160.

Results

The intra- and inter-device laboratory precision of the Deki Reader v100 were 98.3 and 99.2% respectively, and 99.3 and 100% for the Deki Reader v200. The laboratory concordances compared to standard-of-care reporting were 99.5 and 98.0% for the two respective models, while sensitivity and specificity were 99.5 and 99.4% for the Deki Reader V100 and 100 and 93.1% for the Deki Reader V200 respectively. Screening and confirmatory concordances in the field were 99.3 and 96.5% under algorithm 1 and 99.7 and 100% under algorithm 2. Sensitivity and specificity for the field evaluation were 99.8 and 97.7%. Overall robustness of the device was acceptable and continuous quality monitoring through Fionet™ was feasible.

Conclusions

The Deki Reader provides an option for improved and reliable quality assessment for rapid diagnosis of HIV using RDTs to enhance the quality of healthcare at the point-of-care. However, the introduction of new RDTs and modification of current algorithms necessitates ongoing and agile RDT reader adjustments, which will require cost modelling to ensure sustainability of devices implemented into national HIV programs.

Connected diagnostics: linking digital rapid diagnostic tests and mobile health wallets to diagnose and treat brucellosis in Samburu, Kenya

BACKGROUND

Despite WHO guidelines for testing all suspected cases of malaria before initiating treatment, presumptive malaria treatment remains common practice among some clinicians and in certain low-resource settings the capacity for microscopic testing is limited. This can lead to misdiagnosis, resulting in increased morbidity due to lack of treatment for undetected conditions, increased healthcare costs, and potential for drug resistance. This is particularly an issue as multiple conditions share the similar etiologies to malaria, including brucellosis, a rare, under-detected zoonosis. Linking rapid diagnostic tests (RDTs) and digital test readers for the detection of febrile illnesses can mitigate this risk and improve case management of febrile illness.

METHODS

This technical advance study examines Connected Diagnostics, an approach that combines the use of point-of-care RDTs for malaria and brucellosis, digitally interpreted by a rapid diagnostic test reader (Deki Reader) and connected to mobile payment mechanisms to facilitate the diagnosis and treatment of febrile illness in nomadic populations in Samburu County, Kenya. Consenting febrile patients were tested with RDTs and patient diagnosis and risk information were uploaded to a cloud database via the Deki Reader. Patients with positive diagnoses were provided digital vouchers for transportation to the clinic and treatment via their health wallet on their mobile phones.

RESULTS

In total, 288 patients were tested during outreach visits, with 9% testing positive for brucellosis and 0.6% testing positive for malaria. All patients, regardless of diagnosis were provided with a mobile health wallet on their cellular phones to facilitate their transport to the clinic, and for patients testing positive for brucellosis or malaria, the wallet funded their treatment. The use of the Deki Reader in addition to quality diagnostics at point of care also facilitated geographic mapping of patient diagnoses in relation to key risk areas for brucellosis transmission.

CONCLUSIONS

This study demonstrates that the Connected Dx approach can be effective even when addressing a remote, nomadic population and a rare disease, indicating that this approach to diagnosing, treatment, and payment for healthcare costs is feasible and can be scaled to address more prevalent diseases and conditions in more populous contexts.

Inorganic Complexes and Metal-Based Nanomaterials for Infectious Disease Diagnostics

Infectious diseases claim millions of lives each year. Robust and accurate diagnostics are essential tools for identifying those who are at risk and in need of treatment in low-resource settings. Inorganic complexes and metal-based nanomaterials continue to drive the development of diagnostic platforms and strategies that enable infectious disease detection in low-resource settings. In this review, we highlight works from the past 20 years in which inorganic chemistry and nanotechnology were implemented in each of the core components that make up a diagnostic test. First, we present how inorganic biomarkers and their properties are leveraged for infectious disease detection. In the following section, we detail metal-based technologies that have been employed for sample preparation and biomarker isolation from sample matrices. We then describe how inorganic- and nanomaterial-based probes have been utilized in point-of-care diagnostics for signal generation. The following section discusses instrumentation for signal readout in resource-limited settings. Next, we highlight the detection of nucleic acids at the point of care as an emerging application of inorganic chemistry. Lastly, we consider the challenges that remain for translation of the aforementioned diagnostic platforms to low-resource settings.

The use of Fionet technology for external quality control of malaria rapid diagnostic tests and monitoring health workers' performance in rural military health facilities in Tanzania

INTRODUCTION

Internal and external quality control (QC) of rapid diagnostic tests (RDTs) is important to increase reliability of RDTs currently used to diagnose malaria. However, cross-checking of used RDTs as part of quality assurance can rarely be done by off-site personnel because there is no guarantee of retaining visible test lines after manufacturers' recommended reading time. Therefore, this study examined the potential of using Fionet™ technology for remote RDT quality monitoring at seven clinics, identifying reasons for making RDT processing and interpretation errors, and taking corrective actions for improvement of diagnosis and consequently improved management of febrile patients.

METHODS

The study was conducted at seven military health facilities in Mainland Tanzania and utilized RDTs capable of detecting Plasmodium falciparum specific Histidine-rich protein 2 (Pf-HRP2) and the genus specific Plasmodium lactate dehydrogenase (pLDH) for other species of plasmodium (P. vivax, P. malariae or P. ovale; pan-pLDH). Patients' data and images of processed RDTs from seven clinics were uploaded on a Fionet web portal and reviewed regularly to monitor preparation procedures and visual interpretation of test results compared to automated analysis using the Deki reader of RDT. Problems detected were rapidly communicated to remote laboratory personnel at the clinic for corrective action and follow-up of patients who were falsely diagnosed as negative and missed treatment. Factors contributing to making errors in visual interpretation of RDT results were analyzed during visits to the health facilities.

RESULTS

A total of 1,367 (1.6%) out of 83,294 RDT test images uploaded to the Fionet portal had discordant test results of which 822 (60.1%) and 545 (39.9%) were falsely reported as negative and positive, respectively. False negative and false positive test results were common for a single test line in 515 (62.7%) and 741 (54.2%) tests, respectively. Out of 1,367 RDT images assessed, 98 (7.2%) had quality problems related to preparation procedures of which 95(96.9%) errors were due to putting too much blood on the sample well or insufficient buffer in the respective wells. The reasons for discrepant results included, false reporting of none existent lines in 526 (38.5%) tests, missing a faint positive line in 493 (36.1%), missing a strong positive line in 248(18.1%) and errors caused by poorly processed RDTs in 96 (7.2%) tests. Among the false negative tests (n = 822), 669 (48.9%) patients were eligible for follow-up and only 339 (48.5%) were reached and 291 (85.8%) received appropriate anti-malaria therapy.

CONCLUSION

Fionet technology enabled remote monitoring of RDT quality issues, identifying reasons contributing to laboratory personnel making errors and provided a rapid method to implement corrective actions at remote sites to improve malaria diagnosis and consequently improved health care management of febrile patients infected with malaria.

Diagnostic tools for tackling febrile illness and enhancing patient management

Most patients with acute infectious diseases develop fever, which is frequently a reason to visit health facilities in resource-limited settings. The symptomatic overlap between febrile diseases impedes their diagnosis on clinical grounds. Therefore, the World Health Organization promotes an integrated management of febrile illness. Along this line, we present an overview of endemic and epidemic etiologies of fever and state-of-the-art diagnostic tools used in the field. It becomes evident that there is an urgent need for the development of novel technologies to fulfill end-users' requirements. This need can be met with point-of-care and near-patient diagnostic platforms, as well as e-Health clinical algorithms, which co-assess test results with key clinical elements and biosensors, assisting clinicians in patient triage and management, thus enhancing disease surveillance and outbreak alerts. This review gives an overview of diagnostic technologies featuring a platform based approach: (i) assay (nucleic acid amplification technologies are examined); (ii) cartridge (microfluidic technologies are presented); (iii) instrument (various detection technologies are discussed); and at the end proposes a way that such technologies can be interfaced with electronic clinical decision-making algorithms towards a broad and complete diagnostic ecosystem.

Field evaluation of a smartphone-based electronic reader of rapid dual HIV and syphilis point-of-care immunoassays

OBJECTIVE

Electronic (E) devices read and quantify lateral flow-based rapid tests, providing a novel approach to assay interpretation. We evaluated the performance of one E-reader for two dual HIV and syphilis immunoassays.

METHODS

We enrolled men who have sex with men and transgender women >18 years of age seeking medical services at an STD clinic in Lima, Peru, between October 2016 and April 2017. Venous blood was tested using two dual HIV and syphilis antibody immunoassays (SD BIOLINE HIV/Syphilis Duo, Republic of Korea, and First Response HIV 1+2/Syphilis Combo, India). Reference testing included a fourth-generation ELISA for HIV antibodies and use of the Treponema pallidum particle agglutination assay for syphilis antibodies. Trained clinic staff visually inspected the immunoassay results, after which the immunoassays were read by the HRDR-200 E-reader (Cellmic, USA), an optomechanical smartphone attachment. We calculated the concordance of the E-reader with visual inspection, as well as the sensitivity of both rapid immunoassays, in detecting HIV and T. pallidum antibodies.

RESULTS

On reference testing of 283 participant specimens, 34% had HIV antibodies and 46% had T. pallidum antibodies. Using First Response, the concordance of the E-reader with visual inspection was 97% (95% CI 94% to 99%) for T . pallidum and 97% (95% CI 95% to 99%) for HIV antibodies. Using SD BIOLINE, the concordance of the E-reader with visual inspection was 97% (95% CI 94% to 99%) for T. pallidum and 99% (95% CI 98% to 99%) for HIV antibodies. For both immunoassays, the sensitivity for HIV antibodies was 98% (95% CI 93% to 100%) and the sensitivity for T. pallidum antibodies was 81% (95% CI 73% to 87%).

CONCLUSIONS

E-reader results correlated well with visual inspection. The sensitivities of both rapid assays were comparable with past reports. Further evaluation of the E-reader is warranted to investigate its utility in data collection, monitoring and documentation of immunoassay results.

Automated Real-Time Collection of Pathogen-Specific Diagnostic Data: Syndromic Infectious Disease Epidemiology

Background

Health care and public health professionals rely on accurate, real-time monitoring of infectious diseases for outbreak preparedness and response. Early detection of outbreaks is improved by systems that are comprehensive and specific with respect to the pathogen but are rapid in reporting the data. It has proven difficult to implement these requirements on a large scale while maintaining patient privacy.

Objective

The aim of this study was to demonstrate the automated export, aggregation, and analysis of infectious disease diagnostic test results from clinical laboratories across the United States in a manner that protects patient confidentiality. We hypothesized that such a system could aid in monitoring the seasonal occurrence of respiratory pathogens and may have advantages with regard to scope and ease of reporting compared with existing surveillance systems.

Methods

We describe a system, BioFire Syndromic Trends, for rapid disease reporting that is syndrome-based but pathogen-specific. Deidentified patient test results from the BioFire FilmArray multiplex molecular diagnostic system are sent directly to a cloud database. Summaries of these data are displayed in near real time on the Syndromic Trends public website. We studied this dataset for the prevalence, seasonality, and coinfections of the 20 respiratory pathogens detected in over 362,000 patient samples acquired as a standard-of-care testing over the last 4 years from 20 clinical laboratories in the United States.

Results

The majority of pathogens show influenza-like seasonality, rhinovirus has fall and spring peaks, and adenovirus and the bacterial pathogens show constant detection over the year. The dataset can also be considered in an ecological framework; the viruses and bacteria detected by this test are parasites of a host (the human patient). Interestingly, the rate of pathogen codetections, on average 7.94% (28,741/362,101), matches predictions based on the relative abundance of organisms present.

Conclusions

Syndromic Trends preserves patient privacy by removing or obfuscating patient identifiers while still collecting much useful information about the bacterial and viral pathogens that they harbor. Test results are uploaded to the database within a few hours of completion compared with delays of up to 10 days for other diagnostic-based reporting systems. This work shows that the barriers to establishing epidemiology systems are no longer scientific and technical but rather administrative, involving questions of patient privacy and data ownership. We have demonstrated here that these barriers can be overcome. This first look at the resulting data stream suggests that Syndromic Trends will be able to provide high-resolution analysis of circulating respiratory pathogens and may aid in the detection of new outbreaks.

The role of the Deki Reader™ in malaria diagnosis, treatment and reporting: findings from an Africare pilot project in Nigeria

BACKGROUND

The Deki Reader is a diagnostic device used with rapid diagnostic tests (RDTs) and linked to an online database for real-time uploads of patient information and results. This is in contrast to visual interpretation of malaria RDTs recorded on the District Health Information System (DHIS). This paper compares records for use of the Deki Reader with DHIS records of visual interpretation of RDTs.

RESULTS

A total of 4063 patient encounters/tests were recorded on the Deki Reader database between June 1st and December 31st, 2016. These tests were for 2629 persons who presented with fever and had RDT done. In comparison, data from DHIS 2.0 for same period recorded 7201 persons presenting with fever. 2421 out of the 2629 persons (92.1%), received RDT using Deki Reader compared to 6535 out of 7201 persons (90.4%) recorded on DHIS (p = 0.04). From DHIS records, malaria positivity rate was 51.6% (3375 out of 6535 persons) compared to Deki Reader records of 23.6% (572 out of 2421 persons). The difference between these two rates was significant (p < 0.001). The odds ratio (95% CI) for the association between use of Deki Reader and having a positive malaria result was 0.29 (0.26-0.32). DHIS showed that 4008 persons received Artemisinin-based combination therapy (ACT) while 3989 persons tested positive with RDT or microscopy, compared to 691 out of 705 persons (98.0%) using Deki Reader. Finally, Deki Reader identified 618 processing and manufacturers errors with an error rate of 15.3%.

CONCLUSION

The Deki Reader is likely a useful tool for malaria diagnosis, treatment, and real-time data management. It potentially improves diagnostic quality, reduces wastage in ACT administration and improves data quality.

Comparison of visual and automated Deki Reader interpretation of malaria rapid diagnostic tests in rural Tanzanian military health facilities

Background

Although microscopy is a standard diagnostic tool for malaria and the gold standard, it is infrequently used because of unavailability of laboratory facilities and the absence of skilled readers in poor resource settings. Malaria rapid diagnostic tests (RDT) are currently used instead of or as an adjunct to microscopy. However, at very low parasitaemia (usually < 100 asexual parasites/µl), the test line on malaria rapid diagnostic tests can be faint and consequently hard to visualize and this may potentially affect the interpretation of the test results. Fio Corporation (Canada), developed an automated RDT reader named Deki Reader™ for automatic analysis and interpretation of rapid diagnostic tests. This study aimed to compare visual assessment and automated Deki Reader evaluations to interpret malaria rapid diagnostic tests against microscopy. Unlike in the previous studies where expert laboratory technicians interpreted the test results visually and operated the device, in this study low cadre health care workers who have not attended any formal professional training in laboratory sciences were employed.

Methods

Finger prick blood from 1293 outpatients with fever was tested for malaria using RDT and Giemsa-stained microscopy for thick and thin blood smears. Blood samples for RDTs were processed according to manufacturers’ instructions automated in the Deki Reader. Results of malaria diagnoses were compared between visual and the automated devise reading of RDT and microscopy.

Results

The sensitivity of malaria rapid diagnostic test results interpreted by the Deki Reader was 94.1% and that of visual interpretation was 93.9%. The specificity of malaria rapid diagnostic test results was 71.8% and that of human interpretation was 72.0%. The positive predictive value of malaria RDT results by the Deki Reader and visual interpretation was 75.8 and 75.4%, respectively, while the negative predictive values were 92.8 and 92.4%, respectively. The accuracy of RDT as interpreted by DR and visually was 82.6 and 82.1%, respectively.

Conclusion

There was no significant difference in performance of RDTs interpreted by either automated DR or visually by unskilled health workers. However, despite the similarities in performance parameters, the device has proven useful because it provides stepwise guidance on processing RDT, data transfer and reporting.

Evaluation of malaria rapid diagnostic test (RDT) use by community health workers: a longitudinal study in western Kenya

Background

Malaria rapid diagnostic tests (RDTs) are a simple, point-of-care technology that can improve the diagnosis and subsequent treatment of malaria. They are an increasingly common diagnostic tool, but concerns remain about their use by community health workers (CHWs). These concerns regard the long-term trends relating to infection prevention measures, the interpretation of test results and adherence to treatment protocols. This study assessed whether CHWs maintained their competency at conducting RDTs over a 12-month timeframe, and if this competency varied with specific CHW characteristics.

Methods

From June to September, 2015, CHWs (n = 271) were trained to conduct RDTs using a 3-day validated curriculum and a baseline assessment was completed. Between June and August, 2016, CHWs (n = 105) were randomly selected and recruited for follow-up assessments using a 20-step checklist that classified steps as relating to safety, accuracy, and treatment; 103 CHWs participated in follow-up assessments. Poisson regressions were used to test for associations between error count data at follow-up and Poisson regression models fit using generalized estimating equations were used to compare data across time-points.

Results

At both baseline and follow-up observations, at least 80% of CHWs correctly completed 17 of the 20 steps. CHWs being 50 years of age or older was associated with increased total errors and safety errors at baseline and follow-up. At follow-up, prior experience conducting RDTs was associated with fewer errors. Performance, as it related to the correct completion of all checklist steps and safety steps, did not decline over the 12 months and performance of accuracy steps improved (mean error ratio: 0.51; 95% CI 0.40–0.63). Visual interpretation of RDT results yielded a CHW sensitivity of 92.0% and a specificity of 97.3% when compared to interpretation by the research team. None of the characteristics investigated was found to be significantly associated with RDT interpretation.

Conclusions

With training, most CHWs performing RDTs maintain diagnostic testing competency over at least 12 months. CHWs generally perform RDTs safely and accurately interpret results. Younger age and prior experiences with RDTs were associated with better testing performance. Future research should investigate the mode by which CHW characteristics impact RDT procedures.

Electronic supplementary material

The online version of this article (10.1186/s12936-018-2358-6) contains supplementary material, which is available to authorized users.

Motivation and satisfaction among community health workers administering rapid diagnostic tests for malaria in Western Kenya

Background

The continued success of community case management (CCM) programs in low-resource settings depends on the ability of these programs to retain the community health workers (CHWs), many of whom are volunteers, and maintain their high-quality performance. This study aims to identify factors related to the motivation and satisfaction of CHWs working in a malaria CCM program in two sub-counties in Western Kenya.

Methods

We interviewed 70 CHWs who were trained to administer malaria rapid diagnostic tests as part of a broader study evaluating a malaria CCM program. We identified factors related to CHWs' motivation and their satisfaction with participation in the program, as well as the feasibility of program scale-up. We used principal components analysis to develop an overall CHW satisfaction score and assessed associations between this score and individual CHW characteristics as well as their experiences in the program.

Results

The majority of CHWs reported that they were motivated to perform their role in this malaria CCM program by a personal desire to help their community (69%). The most common challenge CHWs reported was a lack of community understanding about malaria diagnostic testing and CHWs' role in the program (39%). Most CHWs (89%) reported that their involvement in the diagnostic testing intervention had either a neutral or a net positive effect on their other CHW activities, including improving skills applicable to other tasks. CHWs who said they strongly agreed with the statement that their work with the malaria program was appreciated by the community had a 0.76 standard deviation (SD) increase in their overall satisfaction score (95% confidence interval CI = 0.10-1.24, P = 0.03). Almost all CHWs (99%) strongly agreed that they wanted to continue their role in the malaria program.

Conclusions

Overall, CHWs reported high satisfaction with their role in community-based malaria diagnosis, though they faced challenges primarily related to community understanding and appreciation of the services they provided. CHWs' perceptions that the malaria program generally did not interfere with their other activities is encouraging for the sustainability and scale-up of similar CHW programs.

The impact of digital technologies on point-of-care diagnostics in resource-limited settings

INTRODUCTION

Simple, rapid tests that can be used at the point-of-care (POC) can improve access to diagnostic services and overall patient management in resource-limited settings where laboratory infrastructure is limited. Implementation of POC tests places tremendous strain on already fragile health systems as the demand for training, supply management and quality assurance are amplified. Digital health has a major role to play in ensuring effective delivery and management of POC testing services. Area covered: The ability to digitise laboratory and POC platforms, including lateral flow rapid diagnostic test results, can standardize the interpretation of results and allows data to be linked to proficiency testing to ensure testing quality, reducing interpretation and transcription errors. Remote monitoring of POC instrument functionality and utilization through connectivity, allows programs to optimize instrument placement, algorithm adoption and supply management. Alerts can be built into the system to raise alarm at unusual trends such as outbreaks. Expert commentary: Digital technology has had a powerful impact on POC testing in resource limited settings. Technology, markets, and medical devices have matured to enable connected diagnostics to become a useful tool for epidemiology, patient care and tracking, research, and antimicrobial resistance and outbreak surveillance. However, to unlock this potential, digital tools must first add value at the point of patient care. The global health community need to propose models for protecting intellectual property to foster innovation and for safeguarding data confidentiality.

A mobile health technology platform for quality assurance and quality improvement of malaria diagnosis by community health workers

BACKGROUND

Community health workers (CHWs) play an important role in improving access to services in areas with limited health infrastructure or workforce. Supervision of CHWs by qualified health professionals is the main link between this lay workforce and the formal health system. The quality of services provided by lay health workers is dependent on adequate supportive supervision. It is however one of the weakest links in CHW programs due to logistical and resource constraints, especially in large scale programs. Interventions such as point of care testing using malaria rapid diagnostic tests (RDTs) require real time monitoring to ensure diagnostic accuracy. In this study, we evaluated the utility of a mobile health technology platform to remotely monitor malaria RDT (mRDT) testing by CHWs for quality improvement.

METHODS

As part of a large implementation trial involving mRDT testing by CHWs, we introduced the Fionet system composed of a mobile device (Deki Reader, DR) to assist in processing and automated interpretation of mRDTs, which connects to a cloud-based database which captures reports from the field in real time, displaying results in a custom dashboard of key performance indicators. A random sample of 100 CHWs were trained and provided with the Deki Readers and instructed to use it on 10 successive patients. The CHWs interpretation was compared with the Deki Reader's automatic interpretation, with the errors in processing and interpreting the RDTs recorded. After the CHW entered their interpretation on the DR, the DR provided immediate, automated feedback and interpretation based on its reading of the same cassette. The study team monitored the CHW performance remotely and provided additional support.

RESULTS

A total of 1251 primary and 113 repeat tests were performed by the 97 CHWs who used the DR. 91.6% of the tests had agreement between the DR and the CHWs. There were 61 (4.9%) processing and 52 (4.2%) interpretation errors among the primary tests. There was a tendency towards lower odds of errors with increasing number and frequency of tests, though not statistically significant. Of the 62 tests that were repeated due to errors, 79% achieved concordance between the CHW and the DR. Satisfaction with the use of the DR by the CHWs was high.

CONCLUSIONS

Use of innovative mHealth strategies for monitoring and quality control can ensure quality within a large scale implementation of community level testing by lay health workers.

Evaluation of the Deki Reader™, an automated RDT reader and data management device, in a household survey setting in low malaria endemic southwestern Uganda

Background

Early diagnosis of suspected malaria cases with a rapid diagnostic test (RDT) has been shown to be an effective malaria control tool used in many resource-constrained settings. However, poor quality control and quality assurance hinder the accurate reporting of malaria diagnoses. Recent use of a portable, battery operated RDT reader (Deki Reader™, Fio Corporation) has shown to have high agreement with visual inspection across diverse health centre settings, however evidence of its feasibility and usability during cross sectional surveys are limited. This study aimed to evaluate the performance of the Deki Reader™ in a cross-sectional survey of children from southwestern Uganda.

Methods

A two-stage, stratified cluster sampling survey was conducted between July and October 2014 in three districts of southwestern Uganda, with varying malaria transmission intensities. A total of 566 children aged 6–59 months were included in the analysis. Blood samples were collected and tested for malaria using: the SD Bioline Malaria Ag Pf/Pan RDT and microscopy. Results were compared between visual inspection of the RDT and by the Deki Reader™. Diagnostic performance of both methods were compared to gold-standard microscopy.

Results

The sensitivity and specificity of the Deki Reader™ was 94.1% (95% CI 69.2–99.6%) and 95.6% (95% CI 93.4–97.1%), respectively. The overall percent agreement between the Deki Reader™ and visual RDT inspection was 98.9% (95% CI 93.2–99.8), with kappa statistic of 0.92 (95% CI 0.85–0.98).

Conclusions

The findings from this study suggest that the Deki Reader™ is comparable to visual inspection and performs well in detecting microscopy-positive Plasmodium falciparum cases in a household survey setting. However, the reader’s performance was highly dependent on ensuring adequate battery life and a work environment free of dirt particles.

Use of malaria RDTs in various health contexts across sub-Saharan Africa: a systematic review

BACKGROUND

The World Health Organization recommends parasitological confirmation of malaria prior to treatment. Malaria rapid diagnostic tests (RDTs) represent one diagnostic method that is used in a variety of contexts to overcome limitations of other diagnostic techniques. Malaria RDTs increase the availability and feasibility of accurate diagnosis and may result in improved quality of care. Though RDTs are used in a variety of contexts, no studies have compared how well or effectively RDTs are used across these contexts. This review assesses the diagnostic use of RDTs in four different contexts: health facilities, the community, drug shops and schools.

METHODS

A comprehensive search of the Pubmed database was conducted to evaluate RDT execution, test accuracy, or adherence to test results in sub-Saharan Africa. Original RDT and Plasmodium falciparum focused studies conducted in formal health care facilities, drug shops, schools, or by CHWs between the year 2000 and December 2016 were included. Studies were excluded if they were conducted exclusively in a research laboratory setting, where staff from the study team conducted RDTs, or in settings outside of sub-Saharan Africa.

RESULTS

The literature search identified 757 reports. A total of 52 studies were included in the analysis. Overall, RDTs were performed safely and effectively by community health workers provided they receive proper training. Analogous information was largely absent for formal health care workers. Tests were generally accurate across contexts, except for in drug shops where lower specificities were observed. Adherence to RDT results was higher among drug shop vendors and community health workers, while adherence was more variable among formal health care workers, most notably with negative test results.

CONCLUSIONS

Malaria RDTs are generally used well, though compliance with test results is variable - especially in the formal health care sector. If low adherence rates are extrapolated, thousands of patients may be incorrectly diagnosed and receive inappropriate treatment resulting in a low quality of care and unnecessary drug use. Multidisciplinary research should continue to explore determinants of good RDT use, and seek to better understand how to support and sustain the correct use of this diagnostic tool.

Toward a Framework for Benefit-Risk Assessment in Diagnostic Imaging: Identifying Scenario-specific Criteria

RATIONALE AND OBJECTIVES

Diagnostic imaging has many effects and there is no common definition of value in diagnostic radiology. As benefit-risk trade-offs are rarely made explicit, it is not clear which framework is used in clinical guideline development. We describe initial steps toward the creation of a benefit-risk framework for diagnostic radiology.

MATERIALS AND METHODS

We performed a literature search and an online survey of physicians to identify and collect benefit-risk criteria (BRC) relevant to diagnostic imaging tests. We operationalized a process for selection of BRC with the use of four clinical use case scenarios that vary by diagnostic alternatives and clinical indication. Respondent BRC selections were compared across clinical scenarios and between radiologists and nonradiologists.

RESULTS

Thirty-six BRC were identified and organized into three domains: (1) those that account for differences attributable only to the test or device (n = 17); (2) those that account for clinical management and provider experiences (n = 12); and (3) those that capture patient experience (n = 7). Forty-eight survey participants selected 22 criteria from the initial list in the survey (9-11 per case). Engaging ordering physicians increased the number of criteria selected in each of the four clinical scenarios presented. We developed a process for standardizing selection of BRC in guideline development.

CONCLUSION

These results suggest that a process relying on elements of comparative effectiveness and the use of standardized BRC may ensure consistent examination of differences among alternatives by way of making explicit implicit trade-offs that otherwise enter the decision-making space and detract from consistency and transparency. These findings also highlight the need for multidisciplinary teams that include input from ordering physicians.

[Rapid diagnostic tests for the serodiagnosis of human cystic echinococcosis]

Cystic echinococcosis (CE) is a parasitic zoonosis especially affecting resource-poor populations in livestock raising areas. Imaging, in particular ultrasound (US), is crucial for the diagnosis, staging, and clinical management of abdominal CE in humans. Serology is a valuable complement to imaging, especially when ultrasound features of CE are absent or unclear. In rural endemic areas, where expertise in US is scant, and conventional serology techniques are unavailable due to lack of laboratory equipment, rapid diagnostic tests (RDTs) may be very useful. Several reports have described the performance of commercial and experimental RDTs in the diagnosis of CE, including a recent study by our group that compared the diagnostic performances of three commercial RDTs for the diagnosis of hepatic CE. To put RDTs for CE in context, we reviewed the available literature in English on this topic. Overall, RDTs appear to be useful in resourcepoor settings where they may replace conventional serodiagnostic tests. However, like other serodiagnostic tests, RDTs lack standardization and show unsatisfactory sensitivity and specificity. An important issue that needs to be addressed is that studies on the diagnostic performance of RDTs fail to take into account the variables known to influence results such as anatomical location and cyst stage.

Mobile phone imaging and cloud-based analysis for standardized malaria detection and reporting

Rapid diagnostic tests (RDTs) have been widely deployed in low-resource settings. These tests are typically read by visual inspection, and accurate record keeping and data aggregation remains a substantial challenge. A successful malaria elimination campaign will require new strategies that maximize the sensitivity of RDTs, reduce user error, and integrate results reporting tools. In this report, an unmodified mobile phone was used to photograph RDTs, which were subsequently uploaded into a globally accessible database, REDCap, and then analyzed three ways: with an automated image processing program, visual inspection, and a commercial lateral flow reader. The mobile phone image processing detected 20.6 malaria parasites/microliter of blood, compared to the commercial lateral flow reader which detected 64.4 parasites/microliter. Experienced observers visually identified positive malaria cases at 12.5 parasites/microliter, but encountered reporting errors and false negatives. Visual interpretation by inexperienced users resulted in only an 80.2% true negative rate, with substantial disagreement in the lower parasitemia range. We have demonstrated that combining a globally accessible database, such as REDCap, with mobile phone based imaging of RDTs provides objective, secure, automated, data collection and result reporting. This simple combination of existing technologies would appear to be an attractive tool for malaria elimination campaigns.

Feasibility of an innovative electronic mobile system to assist health workers to collect accurate, complete and timely data in a malaria control programme in a remote setting in Kenya

BACKGROUND

The cornerstone of decision making aimed at improving health services is accurate and timely health information. The Ministry of Public Health and Sanitation in Kenya decided to pilot feasibility of Fionet, an innovation that integrates diagnostics, data capture and cloud services, in its malaria control programme to demonstrate usability and feasibility by primary level workers in a remote setting in Kenya.

METHODS

Eleven sites comprising one sub-district hospital, ten health centres and dispensaries were selected in three districts of Kisumu County to participate. Two health workers per site were selected, trained over a two-day period in the use of the Deki Reader™ to undertake rapid diagnostic testing (RDT) for malaria and data capture of patients' records. Health managers in the three districts were trained in the use of Fionet™ portal (web portal to cloud based information) to access the data uploaded by the Deki Readers. Field Support was provided by the Fio Corporation representative in Kenya.

RESULTS

A total of 5812 malaria RDTs were run and uploaded to the cloud database during this implementation research study. Uploaded data were automatically aggregated into predetermined reports for use by service managers and supervisors. The Deki Reader enhanced the performance of the health workers by not only guiding them through processing of a malaria RDT test, but also by doing the automated analysis of the RDT, capturing the image, determining whether the RDT was processed according to guidelines, and capturing full patient data for each patient encounter. Supervisors were able to perform remote Quality assurance/Quality control (QA/QC) activities almost in real time.

CONCLUSION

Quality, complete and timely data collection by health workers in a remote setting in Kenya is feasible. This paperless innovation brought unprecedented quality control and quality assurance in diagnosis, care and data capture, all in the hands of the health worker at point of care in an integrated way.

Point-of-care diagnostics, a major opportunity for change in traditional diagnostic approaches: potential and limitations

'Point-of-care' (POC) diagnostics are a powerful emerging healthcare approach. They can rapidly provide statistically significant results, are simple to use, do not require specialized equipment and are cost-effective. For these reasons, they have the potential to play a major role in revolutionizing the diagnosis, initiation and monitoring of treatment of major global diseases. This review focuses on antibody-based POC devices that target four major global diseases: cardiovascular diseases, prostate cancer, HIV infection and tuberculosis. The key statistics and pathology of each disease is described in detail, followed by an in-depth discussion on emerging POC devices that target each disease, highlighting their potential and limitations.

Rapid and quantitative detection of zoonotic influenza A virus infection utilizing coumarin-derived dendrimer-based fluorescent immunochromatographic strip test (FICT)

Great efforts have been made to develop robust signal-generating fluorescence materials which will help in improving the rapid diagnostic test (RDT) in terms of sensitivity and quantification. In this study, we developed coumarin-derived dendrimer-based fluorescent immunochromatographic strip test (FICT) assay with enhanced sensitivity as a quantitative diagnostic tool in typical RDT environments. The accuracy of the proposed FICT was compared with that of dot blot immunoassay techniques and conventional RDTs. Through conjugation of coumarin-derived dendrimers with latex beads, fluorescent emission covering broad output spectral ranges was obtained which provided a distinct advantage of easy discrimination of the fluorescent emission of the latex beads with a simple insertion of a long-pass optical filter away from the excitation wavelength. The newly developed FICT assay was able to detect 100 ng/10 μL of influenza A nucleoprotein (NP) antigen within 5 minutes, which corresponded to 2.5-fold higher sensitivity than that of the dot blot immunoassay or conventional RDTs. Moreover, the FICT assay was confirmed to detect at least four avian influenza A subtypes (H5N3, H7N1, H7N7, and H9N2). On applying the FICT to the clinical swab samples infected with respiratory viruses, our FICT assay was confirmed to differentiate influenza H1N1 infection from other respiratory viral diseases. These data demonstrate that the proposed FICT assay is able to detect zoonotic influenza A viruses with a high sensitivity, and it enables the quantitation of the infection intensity by providing the numerical diagnostic values; thus demonstrating enhanced detectability of influenza A viruses.

Simple sample processing enhances malaria rapid diagnostic test performance

Lateral flow immunochromatographic rapid diagnostic tests (RDTs) are the primary form of medical diagnostic used for malaria in underdeveloped nations. Unfortunately, many of these tests do not detect asymptomatic malaria carriers. In order for eradication of the disease to be achieved, this problem must be solved. In this study, we demonstrate enhancement in the performance of six RDT brands when a simple sample-processing step is added to the front of the diagnostic process. Greater than a 4-fold RDT signal enhancement was observed as a result of the sample processing step. This lowered the limit of detection for RDT brands to submicroscopic parasitemias. For the best performing RDTs the limits of detection were found to be as low as 3 parasites per μL. Finally, through individual donor samples, the correlations between donor source, WHO panel detection scores and RDT signal intensities were explored.

Field evaluation of an automated RDT reader and data management device for Plasmodium falciparum/Plasmodium vivax malaria in endemic areas of Colombia

BACKGROUND

Massive implementation of malaria diagnostics in low-resource countries is regarded as a pivotal strategy in control and elimination efforts. Although malaria rapid diagnostic tests (RDTs) are considered a viable alternative, there are still obstacles to the widespread implementation of this strategy, such as reporting constraints and lack of proper quality assurance of RDT-based programmes at point-of-care (POC).

METHODS

A prospective cohort of patients, seeking routine care for febrile episodes at health centres in malaria-endemic areas of Colombia, was used to assess the diagnostic performance of a device based on smartphone technology (Deki ReaderTM, former codename "GenZero"), that assists users at POC to process RDTs. After informed consent, patients were enrolled into the study and blood samples were collected for thick blood smear (TBS) and RDT. The RDT results were interpreted by both visual inspection and Deki Reader device and concordance between visual and device interpretation was measured. Microscopy corrected by real-time polymerase chain reaction (PCR) and microscopy were "gold standard" tests to assess the diagnostic performance.

RESULTS

In total, 1,807 patients were enrolled at seven health centres in malaria-endemic areas of Colombia. Thirty-three Plasmodium falciparum and 100 Plasmodium vivax cases were positive by corrected microscopy. Both sensitivity and specificity were 93.9% (95% CI 69.7-95.2) and 98.7% (95% CI 98.5-99.4) for P. falciparum, and 98.0% (95% CI 90.3-98.9) and 97.9% (95% CI 97.1-98.5) for P. vivax. Percentage concordance between visual and device interpretation of RDT was 98.5% and 99.0% for P. vivax and P. falciparum, respectively.The RDT, when compared to TBS, showed high sensitivity and specificity for P. falciparum in both visual and device interpretation, and good overall diagnostic performance for P. vivax. Comparison between PCR as gold standard and visual and device interpretation showed acceptable overall performance for both species.

CONCLUSIONS

The diagnostic performance of the Deki Reader was comparable to visual interpretation of RDTs (without significant differences) for both malaria species. Providing standardized automated interpretation of RDTs at POC in remote areas, in addition to almost real-time reporting of cases and enabling quality control would greatly benefit large-scale implementation of RDT-based malaria diagnostic programmes.