A Call to Digital Health Practitioners: New Guidelines Can Help Improve the Quality of Digital Health Evidence

Expanding the Evidence on the Safety and Efficiency of 2-Way Text Messaging-Based Telehealth for Voluntary Medical Male Circumcision Follow-up Compared With In-Person Reviews: Randomized Controlled Trial in Rural and Urban South Africa

BACKGROUND

There is a dearth of high-quality evidence from digital health interventions in routine program settings in low- and middle-income countries. We previously conducted a randomized controlled trial (RCT) in Zimbabwe, demonstrating that 2-way texting (2wT) was safe and effective for follow-up after adult voluntary medical male circumcision (VMMC).

OBJECTIVE

To demonstrate the replicability of 2wT, we conducted a larger RCT in both urban and rural VMMC settings in South Africa to determine whether 2wT improves adverse event (AE) ascertainment and, therefore, the quality of follow-up after VMMC while reducing health care workers' workload.

METHODS

A prospective, unblinded, noninferiority RCT was conducted among adult participants who underwent VMMC with cell phones randomized in a 1:1 ratio between 2wT and control (routine care) in North West and Gauteng provinces. The 2wT participants responded to a daily SMS text message with in-person follow-up only if desired or an AE was suspected. The control group was requested to make in-person visits on postoperative days 2 and 7 as per national VMMC guidelines. All participants were asked to return on postoperative day 14 for study-specific review. Safety (cumulative AEs ≤day 14 visit) and workload (number of in-person follow-up visits) were compared. Differences in cumulative AEs were calculated between groups. Noninferiority was prespecified with a margin of -0.25%. The Manning score method was used to calculate 95% CIs.

RESULTS

The study was conducted between June 7, 2021, and February 21, 2022. In total, 1084 men were enrolled (2wT: n=547, 50.5%, control: n=537, 49.5%), with near-equal proportions of rural and urban participants. Cumulative AEs were identified in 2.3% (95% CI 1.3-4.1) of 2wT participants and 1.0% (95% CI 0.4-2.3) of control participants, demonstrating noninferiority (1-sided 95% CI -0.09 to ∞). Among the 2wT participants, 11 AEs (9 moderate and 2 severe) were identified, compared with 5 AEs (all moderate) among the control participants-a nonsignificant difference in AE rates (P=.13). The 2wT participants attended 0.22 visits, and the control participants attended 1.34 visits-a significant reduction in follow-up visit workload (P<.001). The 2wT approach reduced unnecessary postoperative visits by 84.8%. Daily response rates ranged from 86% on day 3 to 74% on day 13. Among the 2wT participants, 94% (514/547) responded to ≥1 daily SMS text messages over 13 days.

CONCLUSIONS

Across rural and urban contexts in South Africa, 2wT was noninferior to routine in-person visits for AE ascertainment, demonstrating 2wT safety. The 2wT approach also significantly reduced the follow-up visit workload, improving efficiency. These results strongly suggest that 2wT provides quality VMMC follow-up and should be adopted at scale. Adaptation of the 2wT telehealth approach to other acute follow-up care contexts could extend these gains beyond VMMC.

TRIAL REGISTRATION

ClinicalTrials.gov NCT04327271; https://www.clinicaltrials.gov/ct2/show/NCT04327271.

Factors Affecting the Successful Implementation of a Digital Intervention for Health Financing in a Low-Resource Setting at Scale: Semistructured Interview Study With Health Care Workers and Management Staff

BACKGROUND

Digital interventions for health financing, if implemented at scale, have the potential to improve health system performance by reducing transaction costs and improving data-driven decision-making. However, many interventions never reach sustainability, and evidence on success factors for scale is scarce. The Insurance Management Information System (IMIS) is a digital intervention for health financing, designed to manage an insurance scheme and already implemented on a national scale in Tanzania. A previous study found that the IMIS claim function was poorly adopted by health care workers (HCWs), questioning its potential to enable strategic purchasing and succeed at scale.

OBJECTIVE

This study aimed to understand why the adoption of the IMIS claim function by HCWs remained low in Tanzania and to assess implications for use at scale.

METHODS

We conducted 21 semistructured interviews with HCWs and management staff in 4 districts where IMIS was first implemented. We sampled respondents by using a maximum variation strategy. We used the framework method for data analysis, applying a combination of inductive and deductive coding to organize codes in a socioecological model. Finally, we related emerging themes to a framework for digital health interventions for scale.

RESULTS

Respondents appreciated IMIS's intrinsic software characteristics and technical factors and acknowledged IMIS as a valuable tool to simplify claim management. Human factors, extrinsic ecosystem, and health care ecosystem were considered as barriers to widespread adoption.

CONCLUSIONS

Digital interventions for health financing, such as IMIS, may have the potential for scale if careful consideration is given to the environment in which they are placed. Without a sustainable health financing environment, sufficient infrastructure, and human capacity, they cannot unfold their full potential to improve health financing functions and ultimately contribute to universal health coverage.

[Developing, Evaluating and Implementing Digital Health Interventions Part II - Discussion Paper of the Digital Health Working Group of the German Network for Health Services Research (DNVF)]

The methodological challenges of evaluating digital interventions (DI) for health services research are omnipresent. The Digital Health Working Group of the German Network for Health Services Research (DNVF) presented and discussed these challenges in a two-part discussion paper. The first part addressed challenges in definition, development and evaluation of DI. In this paper, which represents the second part, the definition of outcomes, reporting of results, synthesis of evidence, and implementation are addressed as methodological challenges of DI. Potential solutions are presented and the need to address these challenges in future research are discussed.

Delivering an mHealth Adherence Support Intervention for Patients With HIV: Mixed Methods Process Evaluation of the Philippines Connect for Life Study

Background

The Philippines HIV epidemic is one of the fastest growing epidemics globally, and infections among men who have sex with men are increasing at an alarming rate. Connect for Life Philippines is a mobile health (mHealth) intervention that supports antiretroviral therapy (ART) adherence in this key population through individualized voice calls and SMS text messages.

Objective

The objective of this process evaluation is to assess the intervention reach, dose delivered and received, fidelity, and acceptability and to describe contextual factors affecting the implementation of an mHealth adherence support intervention for patients on ART in a clinic in Metro Manila, Philippines.

Methods

A mixed methods process evaluation approach was used in an observational cohort study. Quantitative data sources for the process evaluation were call and SMS text message logs obtained from the mHealth platform and questionnaires collected at 12-, 24-, and 48-week study visits. Qualitative data were collected from process reports and through a series of focus group discussions conducted with a subset of participants during the intervention development phase, after an initial 8-week pilot phase, and at the end of the study.

Results

The 462 study participants received 31,095 interactive voice calls and 8234 SMS text messages during the study. Owing to technical issues, intervention fidelity was low, with only 22.1% (102/462) of the participants receiving reminders via voice calls and others (360/462, 77.9%) receiving only SMS text messages during the intervention. After 48 weeks in the study, 63.5% (293/462) of the participants reported that they would be quite likely or very likely to recommend the program to a friend, and 53.8% (249/462) of the participants reported that they benefited quite a bit or very much from the intervention. Participants who were on ART for <6 months at the beginning of the study and those who received the daily or weekly pill reminders were more likely to report that they benefited from the intervention (P=.02 and P=.01, respectively).

Conclusions

The Connect for Life intervention had high participant satisfaction and acceptability, especially among those who received high dose of the intervention. However, poor reliability of local telecommunication networks had a large impact on the intervention’s usability, fidelity, and dose received.

Applying Human-Centered Design Principles to Digital Syndromic Surveillance at a Mass Gathering in India: Viewpoint

In the wake of the COVID-19 pandemic, digital health tools have been deployed by governments around the world to advance clinical and population health objectives. Few interventions have been successful or have achieved sustainability or scale. In India, government agencies are proposing sweeping changes to India's digital health architecture. Underpinning these initiatives is the assumption that mobile health solutions will find near universal acceptance and uptake, though the observed reticence of clinicians to use electronic health records suggests otherwise. In this practice article, we describe our experience with implementing a digital surveillance tool at a large mass gathering, attended by nearly 30 million people. Deployed with limited resources and in a dynamic chaotic setting, the adherence to human-centered design principles resulted in near universal adoption and high end-user satisfaction. Through this use case, we share generalizable lessons in the importance of contextual relevance, stakeholder participation, customizability, and rapid iteration, while designing digital health tools for individuals or populations.

Mobile devices and wearable technology for measuring patient outcomes after surgery: a systematic review

Complications following surgery are common and frequently occur the following discharge. Mobile and wearable digital health interventions (DHI) provide an opportunity to monitor and support patients during their postoperative recovery. Lack of high-quality evidence is often cited as a barrier to DHI implementation. This review captures and appraises the current use, evidence base and reporting quality of mobile and wearable DHI following surgery. Keyword searches were performed within Embase, Cochrane Library, Web of Science and WHO Global Index Medicus databases, together with clinical trial registries and Google scholar. Studies involving patients undergoing any surgery requiring skin incision where postoperative outcomes were measured using a DHI following hospital discharge were included, with DHI defined as mobile and wireless technologies for health to improve health system efficiency and health outcomes. Methodological reporting quality was determined using the validated mobile health evidence reporting and assessment (mERA) guidelines. Bias was assessed using the Cochrane Collaboration tool for randomised studies or MINORS depending on study type. Overall, 6969 articles were screened, with 44 articles included. The majority (n = 34) described small prospective study designs, with a high risk of bias demonstrated. Reporting standards were suboptimal across all domains, particularly in relation to data security, prior patient engagement and cost analysis. Despite the potential of DHI to improve postoperative patient care, current progress is severely restricted by limitations in methodological reporting. There is an urgent need to improve reporting for DHI following surgery to identify patient benefit, promote reproducibility and encourage sustainability.

Developing a mHealth Routine Outcome Monitoring and Feedback App ("SMART Track") to Support Self-Management of Addictive Behaviours

Background: Routine outcome monitoring (ROM) has been implemented across a range of addiction treatment services, settings and organisations. Mutual support groups are a notable exception. Innovative solutions are needed. SMART Track is a purpose built smartphone app designed to capture ROM data and provide tailored feedback to adults attending Australian SMART Recovery groups for addictive behaviour(s). Objective: Details regarding the formative stage of app development is essential, but often neglected. Improved consideration of the end-user is vital for curtailing app attrition and enhancing engagement. This paper provides a pragmatic example of how principles embedded in published frameworks can be operationalised to address these priorities during the design and development of the SMART Track app. Methods: Three published frameworks for creating digital health technologies ("Person-Based Approach," "BIT" Model and IDEAS framework) were integrated and applied across two stages of research to inform the development, design and content of SMART Track. These frameworks were chosen to ensure that SMART Track was informed by the needs and preferences of the end-user ("Person-Based"); best practise recommendations for mHealth development ("BIT" Model) and a collaborative, iterative development process between the multi-disciplinary research team, app developers and end-users (IDEAS framework). Results: Stage one of the research process generated in-depth knowledge to inform app development, including a comprehensive set of aims (clinical, research/organisation, and usage); clear articulation of the target behaviour (self-monitoring of recovery related behaviours and experiences); relevant theory (self-determination and social control); appropriate behavioural strategies (e.g., behaviour change taxonomy and process motivators) and key factors that may influence engagement (e.g., transparency, relevance and trust). These findings were synthesised into guiding principles that were applied during stage two in an iterative approach to app design, content and development. Conclusions: This paper contributes new knowledge on important person-centred and theoretical considerations that underpin a novel ROM and feedback app for people with addictive behaviour(s). Although person-centred design and best-practise recommendations were employed, further research is needed to determine whether this leads to improved usage outcomes. Clinical Trial Registration: Pilot Trial: http://anzctr.org.au/Trial/Registration/TrialReview.aspx?id=377336.

An eHealth Framework for Managing Pediatric Growth Disorders and Growth Hormone Therapy

Background

The use of technology to support health and health care has grown rapidly in the last decade across all ages and medical specialties. Newly developed eHealth tools are being implemented in long-term management of growth failure in children, a low prevalence pediatric endocrine disorder.

Objective

Our objective was to create a framework that can guide future implementation and research on the use of eHealth tools to support patients with growth disorders who require growth hormone therapy.

Methods

A total of 12 pediatric endocrinologists with experience in eHealth, from a wide geographical distribution, participated in a series of online discussions. We summarized the discussions of 3 workshops, conducted during 2020, on the use of eHealth in the management of growth disorders, which were structured to provide insights on existing challenges, opportunities, and solutions for the implementation of eHealth tools across the patient journey, from referral to the end of pediatric therapy.

Results

A total of 815 responses were collected from 2 questionnaire-based activities covering referral and diagnosis of growth disorders, and subsequent growth hormone therapy stages of the patient pathway, relating to physicians, nurses, and patients, parents, or caregivers. We mapped the feedback from those discussions into a framework that we developed as a guide to integration of eHealth tools across the patient journey. Responses focused on improved clinical management, such as growth monitoring and automation of referral for early detection of growth disorders, which could trigger rapid evaluation and diagnosis. Patient support included the use of eHealth for enhanced patient and caregiver communication, better access to educational opportunities, and enhanced medical and psychological support during growth hormone therapy management. Given the potential availability of patient data from connected devices, artificial intelligence can be used to predict adherence and personalize patient support. Providing evidence to demonstrate the value and utility of eHealth tools will ensure that these tools are widely accepted, trusted, and used in clinical practice, but implementation issues (eg, adaptation to specific clinical settings) must be addressed.

Conclusions

The use of eHealth in growth hormone therapy has major potential to improve the management of growth disorders along the patient journey. Combining objective clinical information and patient adherence data is vital in supporting decision-making and the development of new eHealth tools. Involvement of clinicians and patients in the process of integrating such technologies into clinical practice is essential for implementation and developing evidence that eHealth tools can provide value across the patient pathway.

Demonstrating the value of digital health: Guidance on contextual evidence gathering for companies in different stages of maturity

Application of value-based healthcare policies affects all actors in social and health care field, including the Digital Health Intervention (DHI) providers aiming to enter the industry or expand their market. Apparent lack of fit between evidence and expectations inhibits the growth of DHI companies. The companies need efficient and credible methods to access and demonstrate the value of their DHIs. Building on the stage-of-maturity logic presented in World Health Organization's (WHO) guide of monitoring and evaluating digital health interventions and Context-Intervention-Mechanism-Outcome (CIMO) logic, we provide a potential approach for DHI companies to assess the evidence needed in their current situation. The proposed approach takes into account the company's future development goals and the business environment, reflecting for every stage of technology maturity according to the WHO guidelines and through the CIMO lens. The focus is on specific intervention and its fit for different organizational and national contexts. The solution guides the research process of the company to understand which evidence-gathering topics should be addressed. This evidence can be beneficial for companies to enter into, occupy, expand or sustain in the domestic or international market.

Determinants of Scale-up From a Small Pilot to a National Electronic Immunization Registry in Vietnam: Qualitative Evaluation

Background

Digital health innovations can improve health system performance, yet previous experience has shown that many innovations do not advance beyond the pilot stage to achieve scale. Vietnam’s National Immunization Information System (NIIS) began as a series of digital health pilots, first initiated in 2010, and was officially launched nationwide in 2017. The NIIS is one of the few examples of an electronic immunization registry (EIR) at national scale in low- and middle-income countries.

Objective

The aim of this study was to understand the determinants of scale-up of the national EIR in Vietnam.

Methods

This qualitative study explored the facilitators and barriers to national scale-up of the EIR in Vietnam. Qualitative data were collected from October to December 2019 through in-depth key informant interviews and desk review. The mHealth Assessment and Planning for Scale (MAPS) Toolkit guided the development of the study design, interview guides, and analytic framework. MAPS defines the key determinants of success, or the “axes of scale,” to be groundwork, partnerships, financial health, technology and architecture, operations, and monitoring and evaluation.

Results

The partnership and operations axes were critical to the successful scale-up of the EIR in Vietnam, while the groundwork and monitoring and the evaluation axes were considered to be strong contributors in the success of all the other axes. The partnership model leveraged complementary strengths of the technical working group partners: the Ministry of Health General Department of Preventive Medicine, the National Expanded Program on Immunization, Viettel (the mobile network operator), and PATH. The operational approach to introducing the NIIS with lean, iterative, and integrated training and supervision was also a key facilitator to successful scale-up. The financial health, technology and architecture, and operations axes were identified as barriers to successful deployment and scale-up. Key barriers to scale-up included insufficient estimates of operational costs, unanticipated volume of data storage and transmission, lack of a national ID to support interoperability, and operational challenges among end users. Overall, the multiple phases of EIR deployment and scale-up from 2010 to 2017 allowed for continuous learning and improvement that strengthened all the axes and contributed to successful scale-up.

Conclusions

The results highlight the importance of the measured, iterative approach that was taken to gradually expand a series of small pilots to nationwide scale. The findings from this study can be used to inform other countries considering, introducing, or in the process of scaling an EIR or other digital health innovations.

Regulatory Sandboxes: A Cure for mHealth Pilotitis?

Mobile health (mHealth) and related digital health interventions in the past decade have not always scaled globally as anticipated earlier despite large investments by governments and philanthropic foundations. The implementation of digital health tools has suffered from 2 limitations: (1) the interventions commonly ignore the “law of amplification” that states that technology is most likely to succeed when it seeks to augment and not alter human behavior; and (2) end-user needs and clinical gaps are often poorly understood while designing solutions, contributing to a substantial decrease in usage, referred to as the “law of attrition” in eHealth. The COVID-19 pandemic has addressed the first of the 2 problems—technology solutions, such as telemedicine, that were struggling to find traction are now closely aligned with health-seeking behavior. The second problem (poorly designed solutions) persists, as demonstrated by a plethora of poorly designed epidemic prediction tools and digital contact-tracing apps, which were deployed at scale, around the world, with little validation. The pandemic has accelerated the Indian state’s desire to build the nation’s digital health ecosystem. We call for the inclusion of regulatory sandboxes, as successfully done in the fintech sector, to provide a real-world testing environment for mHealth solutions before deploying them at scale.

Impact of mobile health and medical applications on clinical practice in gastroenterology

Mobile health apps (MHAs) and medical apps (MAs) are becoming increasingly popular as digital interventions in a wide range of health-related applications in almost all sectors of healthcare. The surge in demand for digital medical solutions has been accelerated by the need for new diagnostic and therapeutic methods in the current coronavirus disease 2019 pandemic. This also applies to clinical practice in gastroenterology, which has, in many respects, undergone a recent digital transformation with numerous consequences that will impact patients and health care professionals in the near future. MHAs and MAs are considered to have great potential, especially for chronic diseases, as they can support the self-management of patients in many ways. Despite the great potential associated with the application of MHAs and MAs in gastroenterology and health care in general, there are numerous challenges to be met in the future, including both the ethical and legal aspects of applying this technology. The aim of this article is to provide an overview of the current status of MHA and MA use in the field of gastroenterology, describe the future perspectives in this field and point out some of the challenges that need to be addressed.

Design Considerations for Implementing eHealth Behavioral Interventions for HIV Prevention in Evolving Sociotechnical Landscapes

PURPOSE OF REVIEW

Despite tremendous potential for public health impact and continued investments in development and evaluation, it is rare for eHealth behavioral interventions to be implemented broadly in practice. Intervention developers may not be planning for implementation when designing technology-enabled interventions, thus creating greater challenges for real-world deployment following a research trial. To facilitate faster translation to practice, we aimed to provide researchers and developers with an implementation-focused approach and set of design considerations as they develop new eHealth programs.

RECENT FINDINGS

Using the Accelerated Creation-to-Sustainment model as a lens, we examined challenges and successes experienced during the development and evaluation of four diverse eHealth HIV prevention programs for young men who have sex with men: Keep It Up!, Harnessing Online Peer Education, Guy2Guy, and HealthMindr. HIV is useful for studying eHealth implementation because of the substantial proliferation of diverse eHealth interventions with strong evidence of reach and efficacy and the responsiveness to rapid and radical disruptions in the field. Rather than locked-down products to be disseminated, eHealth interventions are complex sociotechnical systems that require continual optimization, vigilance to monitor and troubleshoot technological issues, and decision rules to refresh content and functionality while maintaining fidelity to core intervention principles. Platform choice and sociotechnical relationships (among end users, implementers, and the technology) heavily influence implementation needs and challenges. We present a checklist of critical implementation questions to address during intervention development. In the absence of a clear path forward for eHealth implementation, deliberate design of an eHealth intervention's service and technological components in tandem with their implementation plans is critical to mitigating barriers to widespread use. The design considerations presented can be used by developers, evaluators, reviewers, and funders to prioritize the pragmatic scalability of eHealth interventions in research.

Exploring the barriers and facilitators for the use of digital health technologies for the management of COPD: a qualitative study of clinician perceptions

BACKGROUND

Digital health technology (DHT) promises to support patients and healthcare professionals (HCPs) to optimize the management of chronic obstructive pulmonary disease (COPD). However, there is a lack of evidence demonstrating the effectiveness of DHT for the management of COPD. One reason for this is the lack of user-involvement in the development of DHT interventions in COPD meaning their needs and preferences are rarely accounted for in the design phase. Although HCP adoption issues have been identified in relation to DHT, little is known about the challenges perceived by HCPs providing care to COPD patients. Therefore, this study aims to qualitatively explore the barriers and facilitators HCPs perceive for the use of DHT in the management of COPD.

METHODS

Participants (n = 32) were recruited using snowball sampling from two university hospitals and several general practitioner clinics. A semi-structured interview was conducted with each participant. NVivo 12 software was used to complete thematic analysis on the data.

RESULTS

Themes identified include: data quality; evidence-based care; resource constraints; and digital literacy presented as barriers; and facilitators include the following themes: digital health training and education; improving HCP digital literacy; and Personalized prescribing. Patient-centered approaches, such as pulmonary rehabilitation and shared decision-making were suggested as implementation strategies to ease the adoption of digital health for the management of COPD.

CONCLUSION

These findings contribute new insights about the needs and preferences of HCPs working in COPD regarding DHT. The findings can be used to help mitigate user-experience issues by informing the design of person-centered implementation and adoption strategies for future digital health interventions in COPD.

Trends and Visibility of "Digital Health" as a Keyword in Articles by JMIR Publications in the New Millennium: Bibliographic-Bibliometric Analysis

Background

Digital health has become an advancing phenomenon in the health care systems of modern societies. Over the past two decades, various digital health options, technologies, and innovations have been introduced; many of them are still being investigated and evaluated by researchers all around the globe. However, the actual trends and visibility of peer-reviewed publications using “digital health” as a keyword to reflect the topic, published by major relevant journals, still remain to be quantified.

Objective

This study aimed to conduct a bibliographic-bibliometric analysis on articles published in JMIR Publications journals that used “digital health” as a keyword. We evaluated the trends, topics, and citations of these research publications to identify the important share and contribution of JMIR Publications journals in publishing articles on digital health.

Methods

All JMIR Publications journals were searched to find articles in English, published between January 2000 and August 2019, in which the authors focused on, utilized, or discussed digital health in their study and used “digital health” as a keyword. In addition, a bibliographic-bibliometric analysis was conducted using the freely available Profiles Research Networking Software by the Harvard Clinical and Translational Science Center.

Results

Out of 1797 articles having “digital health” as a keyword, published mostly between 2016 and 2019, 277 articles (32.3%) were published by JMIR Publications journals, mainly in the Journal of Medical Internet Research. The most frequently used keyword for the topic was “mHealth.” The average number of times an article had been cited, including self-citations, was above 2.8.

Conclusions

The reflection of “digital health” as a keyword in JMIR Publications journals has increased noticeably over the past few years. To maintain this momentum, more regular bibliographic and bibliometric analyses will be needed. This would encourage authors to consider publishing their articles in relevant, high-visibility journals and help these journals expand their supportive publication policies and become more inclusive of digital health.

The Elusive Path Toward Measuring Health Outcomes: Lessons Learned From a Pseudo-Randomized Controlled Trial of a Large-Scale Mobile Health Initiative

Mobile health (mHealth) offers new opportunities to improve access to health services and health information. It also presents new challenges in evaluating its impact, particularly in linking the use of a technology intervention that aims to improve health behaviors with the health outcomes that are impacted by changed behaviors. The availability of data from a multitude of sources (paper-based and electronic) provides the conditions to facilitate making stronger connections between self-reported data and clinical outcomes. This commentary shares lessons and important considerations based on the experience of applying new research frameworks and incorporating maternal and child health records data into a pseudo-randomized controlled trial to evaluate the impact of mMitra, a stage-based voice messaging program to improve maternal, newborn, and child health outcomes in urban slums in India.

Pregnant Users' Perceptions of the Birth Plan Interface in the "My Prenatal Care" App: Observational Validation Study

BACKGROUND

Birth plans are meant to be a declaration of the expectations and preferences of pregnant woman regarding childbirth. The My Prenatal Care app engages pregnant women in an educational intervention for a healthy pregnancy. We hypothesized that users' positive perception of an in-app birth plan is a relevant step for establishing direct communication between pregnant women and the health care team, based on an online report available on the app.

OBJECTIVE

This study aimed to evaluate pregnant women's perception about the communicability of birth-plan preparation using a mobile app.

METHODS

This was an observational, exploratory, descriptive study. The methodology was user centered, and both qualitative and quantitative approaches were employed. The tools of the communicability evaluation method were applied. Overall, 11 pregnant women evaluated their experience of using a birth-plan prototype interface. The evaluation was performed in a controlled environment, with authorized video recording. There were 8 task-oriented interactions proposed to evaluate interface communicability with users when using the Birth Plan menu. For evaluating perceptions and experiences, a survey with structured and open-ended questions in addition to the free expression of participants was conducted. The primary outcomes assessed were interface communicability and user's perception of the Birth Plan prototype interface in the My Prenatal Care mobile app. Secondarily, we involved users in the prototyping phase of the interface to identify bottlenecks for making improvements in the app.

RESULTS

Regarding users' performance in accomplishing previously prepared tasks, we found that 10 of 11 (91%) women were capable of completing at least 6 of 8 (75%) tasks. A positive relationship was found between the number of communicability problems and the success of completing the tasks. An analysis of the records revealed three communicability breakdowns related to the data entry, save, and scrollbar functions. The participants freely expressed suggestions for improvements such as for the save function and the process of sharing the birth-plan form upon completion.

CONCLUSIONS

Users had a positive perception of the Birth Plan menu of the My Prenatal Care app. This user-centered validation enabled the identification of solutions for problems, resulting in improvements in the app.

Impact of using eHealth tools to extend health services to rural areas of Nigeria: protocol for a mixed-method, non-randomised cluster trial

INTRODUCTION

eHealth solutions that use internet and related technologies to deliver and enhance health services and information are emerging as novel approaches to support healthcare delivery in sub-Saharan Africa. Using digital technology in this way can support cost-effectiveness of care delivery and extend the reach of services to remote locations. Despite the burgeoning literature on eHealth approaches, little is known about the effectiveness of eHealth tools for improving the quality and efficiency of health systems functions or client outcomes in resource-limited countries. eHealth tools including satellite communications are currently being implemented at scale, to extend health services to rural areas of Nigeria, in Ondo and Kano States and the Federal Capital Territory. This paper shares the protocol for a 2-year project ('EXTEND') that aims to evaluate the impact of eHealth tools on health system functions and health outcomes.

METHODOLOGY AND ANALYSIS

This multisite, mixed-method evaluation includes a non-randomised, cluster trial design. The study comprises three phases-baseline, midline and endline evaluations-that involve: (1) process evaluation of video training and digitisation of health data interventions; (2) evaluation of contextual influences on the implementation of interventions; and (3) impact evaluation of results of the project. A convergent mixed-method model will be adopted to allow integration of quantitative and qualitative findings to achieve study objectives. Multiple quantitative and qualitative datasets will be repeatedly analysed and triangulated to facilitate better understanding of impact of eHealth tools on health worker knowledge, quality and efficiency of health systems and client outcomes.

ETHICS AND DISSEMINATION

Ethics approvals were obtained from the University of Leeds and three States' Ministries of Health in Nigeria. All data collected for this study will be anonymised and reports will not contain information that could identify respondents. Study findings will be presented to Ministries of Health at scientific conferences and published in peer-reviewed journals.

TRIAL REGISTRATION NUMBER

ISRCTN32105372; Pre-results.

Establishing Standards to Evaluate the Impact of Integrating Digital Health into Health Systems

The key milestones in the rise of digital health illustrate efforts to bridge gaps in the evidence base, a shifting focus to scale-up and sustainability, growing attention to the precise costing of these strategies, and an emergent implementation science agenda that better characterizes the ecosystem—the social, political, economic, legal, and ethical context that supports digital health implementation—necessary to take digital health approaches to scale.

Caring electronically for young outpatients who have epilepsy

PURPOSE

The purpose of this study was to review electronic tools that might improve the delivery of epilepsy care, reduce medical care costs, and empower families to improve self-management capability.

METHOD

We reviewed the epilepsy-specific literature about self-management, electronic patient-reported or provider-reported outcomes, on-going remote surveillance, and alerting/warning systems.

CONCLUSIONS

The improved care delivery system that we envision includes self-management, electronic patient (or provider)-reported outcomes, on-going remote surveillance, and alerting/warning systems. This system and variants have the potential to reduce seizure burden through improved management, keep children out of the emergency department and hospital, and even reduce the number of outpatient visits.

The Biopsychosocial-Digital Approach to Health and Disease: Call for a Paradigm Expansion

Digital health is an advancing phenomenon in modern health care systems. Currently, numerous stakeholders in various countries are evaluating the potential benefits of digital health solutions at the individual, population, and/or organizational levels. Additionally, driving factors are being created from the customer-side of the health care systems to push health care providers, policymakers, or researchers to embrace digital health solutions. However, health care providers may differ in their approach to adopt these solutions. Health care providers are not assumed to be appropriately trained to address the requirements of integrating digital health solutions into daily everyday practices and procedures. To adapt to the changing demands of health care systems, it is necessary to expand relevant paradigms and to train human resources as required. In this article, a more comprehensive paradigm will be proposed, based on the ‘biopsychosocial model’ of assessing health and disease, originally introduced by George L Engel. The “biopsychosocial model” must be leveraged to include a “digital” component, thus suggesting a ‘biopsychosocial-digital’ approach to health and disease. Modifications to the “biopsychosocial” model and transition to the “biopsychosocial-digital” model are explained. Furthermore, the emerging implications of understanding health and disease are clarified pertaining to their relevance in training human resources for health care provision and research.