Accuracy, Ease of Use, Safety, and Acceptability of a 23-μL Conical Cup Blood Transfer Device for Use with Rapid Diagnostic Tests

Operational characteristics of an antibody detecting point of care test for Taenia solium infections in a community and hospital setting

Background

Diagnostic test evaluation includes measures of performance and assessment of operational characteristics. The latter focuses on end-user understanding of instructions to perform the test, ease of use, test turnaround time and ease of result interpretation. This study aimed to assess user comprehension of training for and ease of use of a Taenia solium point of care test (TS POC) evaluated in a community and hospital setting in Zambia and Tanzania, respectively.

Methods

The TS POC is a three-step in-house-produced rapid diagnostic test (RDT) for the simultaneous detection of taeniosis (TST) and cysticercosis (TSCC) antibodies. Data collected by administering questionnaires to 29 end-users and from the main evaluation database was analyzed quantitatively.

Results

End-users (28/29, 97%) perceived that the training they received for performing the test was sufficient. They performed 4080 tests, of which 80 were invalid. The community-based study and TST tests had higher invalid rates. The overall result interpretation was within the acceptable range of RDTs with an overall disagreement between readers of 3.3%. The Kappa coefficient of agreement was 85 and 82% for TSCC and TST, respectively. There was more disagreement among readers in the community-based study.

Conclusion

End-users rated the TS POC kit moderate in terms of ease of use citing long test turnaround time and difficulties in using the blood transfer device. Overall, the operational performance of the TS POC kit and end-users was within the established acceptable performance range.

Supplementary Information

The online version contains supplementary material available at 10.1186/s12879-021-06320-3.

Remote videolink observation of model home sampling and home testing devices to simplify usability studies for point-of-care diagnostics

Both home sample collection and home testing using rapid point-of-care diagnostic devices can offer benefits over attending a clinic/hospital to be tested by a healthcare professional. Usability is critical to ensure that in-home sampling or testing by untrained users does not compromise analytical performance. Usability studies can be laborious and rely on participants attending a research location or a researcher visiting homes; neither has been appropriate during COVID-19 outbreak control restrictions. We therefore developed a remote research usability methodology using videolink observation of home users. This avoids infection risks from home visits and ensures the participant follows the test protocol in their home environment. In this feasibility study, volunteers were provided with models of home blood testing and home blood sampling kits including a model lancet, sampling devices for dried blood spot collection, and model lateral flow device. After refining the study protocol through an initial pilot (n = 7), we compared instructions provided either as written instructions (n = 5), vs addition of video instructions (n = 5), vs written and video instructions plus videolink supervision by the researcher (n = 5). All users were observed via video call to define which test elements could be assessed remotely. All 22 participants in the study accessed the video call and configured their videolink allowing the researcher to clearly observe all testing tasks. The video call allowed the researcher to assess distinct errors during use including quantitative (volume of blood) and qualitative (inaccurate interpretation of results) errors many of which could compromise test accuracy. All participants completed the tasks and returned images of their completed tests (22/22) and most returned completed questionnaires (20/22). We suggest this remote observation via videolink methodology is a simple, rapid and powerful methodology to assess and optimise usability of point-of-care testing methods in the home setting.