Reducing provider workload while preserving patient safety via a two-way texting intervention in Zimbabwe's voluntary medical male circumcision program: study protocol for an un-blinded, prospective, non-inferiority, randomized controlled trial

"Endless opportunities": A qualitative exploration of facilitators and barriers to scale-up of two-way texting follow-up after voluntary medical male circumcision in Zimbabwe

In Zimbabwe, the ZAZIC consortium employs two-way, text-based (2wT) follow-up to strengthen post-operative care for voluntary medical male circumcision (VMMC). 2wT scaled nationally with evidence of client support and strengthened follow-up. However, 2wT uptake among healthcare providers remains suboptimal. Understanding the gap between mobile health (mHealth) potential for innovation expansion and scale-up realization is critical for 2wT and other mHealth innovations. Therefore, we conducted an exploratory qualitative study with the objective of identifying 2wT program strengths, challenges, and suggestions for scale up as part of routine VMMC services. A total of 16 in-depth interviews (IDIs) with diverse 2wT stakeholders were conducted, including nurses, monitoring & evaluation teams, and technology partners-a combination of perspectives that provide new insights. We used both inductive and deductive coding for thematic analysis. Among 2wT drivers of expansion success, interviewees noted: 2wT care benefits for clients; effective hands-on 2wT training; ease of app use for providers; 2wT saved time and money; and 2wT strengthened client/provider interaction. For 2wT scale-up challenges, staff shortages; network infrastructure constraints; client costs; duplication of paper and electronic reporting; and complexity of digital tools integration. To improve 2wT robustness, respondents suggested: more staff training to offset turnover; making 2wT free for clients; using 2wT to replace paper VMMC reporting; integrating with routine VMMC reporting systems; and expanding 2wT to other health areas. High stakeholder participation in app design, implementation strengthening, and evaluation were appreciated. Several 2wT improvements stemmed from this study, including enrollment of multiple people on one number to account for phone sharing; 2wT inclusion of minors ages 15+; clients provided with $1 to offset SMS costs; and reduced SMS messages to clients. Continued 2wT mentoring for staff, harmonization of 2wT with Ministry e-health data systems, and increased awareness of 2wT's client and provider benefits will help ensure successful 2wT scale-up.

Expanding the Evidence on the Safety and Efficiency of 2-Way Text Messaging-Based Telehealth for Voluntary Medical Male Circumcision Follow-up Compared With In-Person Reviews: Randomized Controlled Trial in Rural and Urban South Africa

BACKGROUND

There is a dearth of high-quality evidence from digital health interventions in routine program settings in low- and middle-income countries. We previously conducted a randomized controlled trial (RCT) in Zimbabwe, demonstrating that 2-way texting (2wT) was safe and effective for follow-up after adult voluntary medical male circumcision (VMMC).

OBJECTIVE

To demonstrate the replicability of 2wT, we conducted a larger RCT in both urban and rural VMMC settings in South Africa to determine whether 2wT improves adverse event (AE) ascertainment and, therefore, the quality of follow-up after VMMC while reducing health care workers' workload.

METHODS

A prospective, unblinded, noninferiority RCT was conducted among adult participants who underwent VMMC with cell phones randomized in a 1:1 ratio between 2wT and control (routine care) in North West and Gauteng provinces. The 2wT participants responded to a daily SMS text message with in-person follow-up only if desired or an AE was suspected. The control group was requested to make in-person visits on postoperative days 2 and 7 as per national VMMC guidelines. All participants were asked to return on postoperative day 14 for study-specific review. Safety (cumulative AEs ≤day 14 visit) and workload (number of in-person follow-up visits) were compared. Differences in cumulative AEs were calculated between groups. Noninferiority was prespecified with a margin of -0.25%. The Manning score method was used to calculate 95% CIs.

RESULTS

The study was conducted between June 7, 2021, and February 21, 2022. In total, 1084 men were enrolled (2wT: n=547, 50.5%, control: n=537, 49.5%), with near-equal proportions of rural and urban participants. Cumulative AEs were identified in 2.3% (95% CI 1.3-4.1) of 2wT participants and 1.0% (95% CI 0.4-2.3) of control participants, demonstrating noninferiority (1-sided 95% CI -0.09 to ∞). Among the 2wT participants, 11 AEs (9 moderate and 2 severe) were identified, compared with 5 AEs (all moderate) among the control participants-a nonsignificant difference in AE rates (P=.13). The 2wT participants attended 0.22 visits, and the control participants attended 1.34 visits-a significant reduction in follow-up visit workload (P<.001). The 2wT approach reduced unnecessary postoperative visits by 84.8%. Daily response rates ranged from 86% on day 3 to 74% on day 13. Among the 2wT participants, 94% (514/547) responded to ≥1 daily SMS text messages over 13 days.

CONCLUSIONS

Across rural and urban contexts in South Africa, 2wT was noninferior to routine in-person visits for AE ascertainment, demonstrating 2wT safety. The 2wT approach also significantly reduced the follow-up visit workload, improving efficiency. These results strongly suggest that 2wT provides quality VMMC follow-up and should be adopted at scale. Adaptation of the 2wT telehealth approach to other acute follow-up care contexts could extend these gains beyond VMMC.

TRIAL REGISTRATION

ClinicalTrials.gov NCT04327271; https://www.clinicaltrials.gov/ct2/show/NCT04327271.

Scoping review of health information technology usability methods leveraged in Africa

OBJECTIVE

The aim of this study was to explore the state of health information technology (HIT) usability evaluation in Africa.

MATERIALS AND METHODS

We searched three electronic databases: PubMed, Embase, and Association for Computing Machinery. We categorized the stage of evaluations, the type of interactions assessed, and methods applied using Stead's System Development Life Cycle (SDLC) and Bennett and Shackel's usability models.

RESULTS

Analysis of 73 of 1002 articles that met inclusion criteria reveals that HIT usability evaluations in Africa have increased in recent years and mainly focused on later SDLC stage (stages 4 and 5) evaluations in sub-Saharan Africa. Forty percent of the articles examined system-user-task-environment (type 4) interactions. Most articles used mixed methods to measure usability. Interviews and surveys were often used at each development stage, while other methods, such as quality-adjusted life year analysis, were only found at stage 5. Sixty percent of articles did not include a theoretical model or framework.

DISCUSSION

The use of multistage evaluation and mixed methods approaches to obtain a comprehensive understanding HIT usability is critical to ensure that HIT meets user needs.

CONCLUSIONS

Developing and enhancing usable HIT is critical to promoting equitable health service delivery and high-quality care in Africa. Early-stage evaluations (stages 1 and 2) and interactions (types 0 and 1) should receive special attention to ensure HIT usability prior to implementing HIT in the field.

Two-way text message interventions and healthcare outcomes in Africa: Systematic review of randomized trials with meta-analyses on appointment attendance and medicine adherence

BACKGROUND

The growing access to mobile phones in Africa has led to an increase in mobile health interventions, including an increasing number of two-way text message interventions. However, their effect on healthcare outcomes in an African context is uncertain. This systematic review aims to landscape randomized trials involving two-way text message interventions and estimate their effect on healthcare outcomes.

METHODS

We searched Medline, Embase, Cochrane Central Register of Controlled Trials, The Global Health Library (up to 12 August 2021) and trial registries (up to 24 April 2020). Published and unpublished trials conducted in Africa comparing two-way text message interventions with standard care and/or one-way text message interventions were included. Trials that reported dichotomous effect estimates on healthcare appointment attendance and/or medicine adherence were assessed for risk of bias and included in meta-analyses. Results of other outcomes were reported descriptively.

RESULTS

We included 31 trials (28,563 participants) all set in Sub-Saharan Africa with a wide range of clinical conditions. Overall, ten different trials were included in the primary meta-analyses, and two of these had data on both medicine adherence and appointment attendance. An additional two trials were included in sensitivity analyses. Of the 12 included trials, three were judged as overall low risk of bias and nine as overall high risk of bias trials. Two-way text messages did not improve appointment attendance, RR: 1.03; 95% CI: 0.95-1.12, I2 = 53% (5 trials, 4374 participants) but improved medicine adherence compared to standard care, RR: 1.14, 95% CI: 1.07-1.21, I2 = 8% (6 trials, 2783 participants).

CONCLUSION

Two-way text messages seemingly improve medicine adherence but has an uncertain effect on appointment attendance compared to standard care.

SYSTEMATIC REVIEW REGISTRATION

PROSPERO CRD42020175810.

Cost-effectiveness analysis of two-way texting for post-operative follow-up in Zimbabwe's voluntary medical male circumcision program

Objective

Although adverse events (AEs) following voluntary medical male circumcision (VMMC) are rare, their prompt ascertainment and management is a marker of quality care. The use of two-way text messaging (2wT) for client follow-up after VMMC reduces the need for clinic visits (standard of care (SoC)) without compromising safety. We compared the cost-effectiveness of 2wT to SoC for post-VMMC follow-up in two, high-volume, public VMMC sites in Zimbabwe.

Materials and methods

We developed a decision-analytic (decision tree) model of post-VMMC client follow-up at two high-volume sites. We parameterized the model using data from both a randomized controlled study of 2wT vs. SoC and from the routine VMMC program. The perspective of analysis was the Zimbabwe government (payer). The time horizon covered the time from VMMC to wound healing. Costs included text messaging; both in-person and outreach follow-up; and AE management. Costs were estimated in 2018 U.S. dollars. The outcome of analysis was AE yield relative to the globally accepted safety standard of a 2% AE rate. We estimated the incremental cost per percentage increase in AE ascertainment and the incremental cost per additional AE identified. We conducted univariate and probabilistic sensitivity analyses.

Results

2wT increased the costs due to text messaging by $4.42 but reduced clinic visit costs by $2.92 and outreach costs by $3.61 –a net savings of $2.10. 2wT also increased AE ascertainment by 50% (92% AE yield in 2wT compared to 42% AE yield in SoC). Therefore, 2wT dominated SoC in the incremental analysis: 2wT was less costly and more effective. Results were generally robust to univariate and probabilistic sensitivity analysis.

Conclusions

2wT is cost-effective for post-VMMC follow-up in Zimbabwe. Countries in which VMMC is a high-priority HIV prevention intervention should consider this mHealth intervention to reduce overall cost per VMMC, increasing the likelihood of current and future VMMC program sustainability.

Reducing Provider Workload While Preserving Patient Safety: A Randomized Control Trial Using 2-Way Texting for Postoperative Follow-up in Zimbabwe's Voluntary Medical Male Circumcision Program

Supplemental Digital Content is Available in the Text.

Voluntary medical male circumcisions (MCs) are safe: the majority of men heal without complication. However, guidelines require multiple follow-up visits. In Zimbabwe, where there is high mobile phone ownership, severe health care worker shortages, and rapid MC scale up intersect, we tested a 2-way texting (2wT) intervention to reduce provider workload while safeguarding patient safety.

Usability and acceptability of a two-way texting intervention for post-operative follow-up for voluntary medical male circumcision in Zimbabwe

BACKGROUND

Voluntary medical male circumcision (MC) is safe and effective. Nevertheless, MC programs require multiple post-operative visits. In Zimbabwe, a randomized control trial (RCT) found that post-operative two-way texting (2wT) between clients and MC providers instead of in-person reviews reduced provider workload and safeguarded patient safety. A critical component of the RCT assessed usability and acceptability of 2wT among providers and clients. These findings inform scale-up of the 2wT approach to post-operative follow-up.

METHODS

The RCT assigned 362 adult MC clients with cell phones into 2wT; these men responded to 13 automated daily texts supported by interactive texting or in-person follow-up, when needed. A subset of 100 texting clients filled a self-administered usability survey on day 14. 2wT acceptability was ascertained via 2wT response rates. Among 2wT providers, eight key informant interviews focused on 2wT acceptability and usability. Influences of wage and age on response rates and client-reported potential AEs were explored using linear and logistic regression models, respectively.

RESULTS

Clients felt confident, comfortable, satisfied, and well-supported with 2wT-based follow-up; few noted texting challenges or concerns about healing. Clients felt 2wT saved them time and money. Response rates (92%) suggested 2wT acceptability. Both clients and providers felt 2wT was highly usable. Providers noted 2wT saved them time, empowered clients to engage in their healing, and closed gaps in MC service quality. For scale, providers reinforced good post-operative counseling on AEs and texting instructions. Wage and age did not influence text response rates or potential AE texts.

CONCLUSION

Results strongly suggest that 2wT is highly usable and acceptable for providers and patients. Men with concerns solicited provider guidance and reassurance offered via text. Providers noted that men engaged proactively in their healing. 2wT between providers and patients should be expanded for MC and considered for other short-term care contexts. The trial is registered on ClinicalTrials.gov, trial NCT03119337, and was activated on April 18, 2017. https://clinicaltrials.gov/ct2/show/NCT03119337.