Development and Usability of a Smartphone Application for Tracking Antiretroviral Medication Refill Data for Human Immunodeficiency Virus

Scoping review of health information technology usability methods leveraged in Africa

OBJECTIVE

The aim of this study was to explore the state of health information technology (HIT) usability evaluation in Africa.

MATERIALS AND METHODS

We searched three electronic databases: PubMed, Embase, and Association for Computing Machinery. We categorized the stage of evaluations, the type of interactions assessed, and methods applied using Stead's System Development Life Cycle (SDLC) and Bennett and Shackel's usability models.

RESULTS

Analysis of 73 of 1002 articles that met inclusion criteria reveals that HIT usability evaluations in Africa have increased in recent years and mainly focused on later SDLC stage (stages 4 and 5) evaluations in sub-Saharan Africa. Forty percent of the articles examined system-user-task-environment (type 4) interactions. Most articles used mixed methods to measure usability. Interviews and surveys were often used at each development stage, while other methods, such as quality-adjusted life year analysis, were only found at stage 5. Sixty percent of articles did not include a theoretical model or framework.

DISCUSSION

The use of multistage evaluation and mixed methods approaches to obtain a comprehensive understanding HIT usability is critical to ensure that HIT meets user needs.

CONCLUSIONS

Developing and enhancing usable HIT is critical to promoting equitable health service delivery and high-quality care in Africa. Early-stage evaluations (stages 1 and 2) and interactions (types 0 and 1) should receive special attention to ensure HIT usability prior to implementing HIT in the field.

Development of a conceptual framework for linking mHealth applications to eRecord systems in Botswana

BACKGROUND

The proliferation of mHealth solutions and eRecord systems is inevitable in developing countries, and ensuring their bi-directional interoperability is essential. Interoperability has been described as the ability for two or more systems or components to exchange information and use the information that has been exchanged. Given the importance of linking mHealth solutions to eRecord systems in the developing world, a suitable interoperability framework is required to provide an agreed approach to interoperability and specify common elements. Although eHealth interoperability frameworks exist in the literature, none meet all the requirements for linking mHealth solutions to eRecord systems in developing countries. The aim of this paper was to describe the design and development of a conceptual framework for linking mHealth solutions to eRecord systems in Botswana, as an exemplar.

METHODS

An iterative and reflective process was adopted, supported by existing literature and research including consultations with eHealth experts, and guidance from existing frameworks. These collectively identified key elements, concepts, and standards relevant and essential for framework design and development.

RESULTS

The mHealth-eRecord Interoperability Framework (mHeRIF) was developed which highlights the need for: governance and regulation of mHealth and eRecord systems, a national health information exchange, and which interoperability levels to achieve. Each of these are supported by integral themes and concepts. It also addresses the need for regular review, accreditation, and alignment of framework concepts and themes with a National eHealth Strategy Interoperability Development Process. To demonstrate the framework's applicability, a proposed architecture for the Kgonafalo mobile telemedicine programme is presented.

CONCLUSION

Interoperable mHealth solutions and eRecords systems have the potential to strengthen health systems. This paper reports the design and development of an evidence-based mHeRIF to align with, build upon, and expand National eHealth Strategies by guiding the linking of mHealth solutions to eRecord systems in Botswana and other developing countries facing similar circumstances.

The Value of Assessing Self-Reported and Biological Indicators of Outcomes in Evaluating HIV Programs

PURPOSE OF REVIEW

In this manuscript, we present recent findings concerning concordance and discrepancy between biological measures and self-reports of these three outcomes of HIV programs: HIV status, adherence to antiretroviral medications (ARVs) and use of and adherence to pre-exposure prophylaxis medication (PrEP), and condom use/unprotected sex.

RECENT FINDINGS

Recent studies suggest that three successive rapid HIV tests (for those whose first test in positive) might be reasonably inexpensive and valid biological data to collect to combine with self-reports of HIV status, dried blood spots sufficiently affordable to combine with self-reports of adherence to ARVs and use of or adherence to PrEP, and that the discrepancy between self-reports of condom use and biomarkers of unprotected sex may be relatively small in high-income countries. Additional work on assessment of incorrect condom usage and breakage, standardized self-report measures of condom use, and more private data collection methodologies in low-income settings might reduce the recent observed discrepancies even further. Concordance between self-reports of HIV and biomarkers indicating HIV positive status has varied considerably, with much lower rates in low-income countries, where the stigma of HIV is still very high. Recommendation is for combining self-report data with the results of three successive rapid tests for those testing positive. For adherence, again agreement between self-reports and a variety of more objective and/or biological measures is only moderate. Dried blood spots (DBS) may be sufficiently inexpensive in low-resource settings that this may be the best biological method to combine with self-reports. In publications over the last 8 years, the discrepancy between self-reports of condom use and biomarkers for unprotected sex may be even lower than 20% after controlling for other features of the study, particularly in high-income countries. Our results suggest that more careful assessment of incorrect condom use and breakage as reasons other than intentional misreporting should be investigated more carefully and that more private data collection methods such as audio, computer-assisted self-interviewing (ACASI) might be employed more often in low-resource settings to reduce this discrepancy in those settings further. In addition, further analysis of the discrepancy between self-reports of condom use and biomarkers should be conducted of published studies using the correct calculation methods to be more certain of these findings.

Possibilities, Problems, and Perspectives of Data Collection by Mobile Apps in Longitudinal Epidemiological Studies: Scoping Review

Background

The broad availability of smartphones and the number of health apps in app stores have risen in recent years. Health apps have benefits for individuals (eg, the ability to monitor one’s health) as well as for researchers (eg, the ability to collect data in population-based, clinical, and observational studies). Although the number of health apps on the global app market is huge and the associated potential seems to be great, app-based questionnaires for collecting patient-related data have not played an important role in epidemiological studies so far.

Objective

This study aims to provide an overview of studies that have collected patient data using an app-based approach, with a particular focus on longitudinal studies. This literature review describes the current extent to which smartphones have been used for collecting (patient) data for research purposes, and the potential benefits and challenges associated with this approach.

Methods

We conducted a scoping review of studies that used data collection via apps. PubMed was used to identify studies describing the use of smartphone app questionnaires for collecting data over time. Overall, 17 articles were included in the summary.

Results

Based on the results of this scoping review, there are only a few studies that integrate smartphone apps into data-collection approaches. Studies dealing with the collection of health-related data via smartphone apps have mainly been developed with regard to psychosomatic, neurodegenerative, respiratory, and cardiovascular diseases, as well as malign neoplasm. Among the identified studies, the duration of data collection ranged from 4 weeks to 12 months, and the participants’ mean ages ranged from 7 to 69 years. Potential can be seen for real-time information transfer, fast data synchronization (which saves time and increases effectivity), and the possibility of tracking responses longitudinally. Furthermore, smartphone-based data-collection techniques might prevent biases, such as reminder bias or mistakes occurring during manual data transfers. In chronic diseases, real-time communication with physicians and early detection of symptoms enables rapid modifications in disease management.

Conclusions

The results indicate that using mobile technologies can help to overcome challenges linked with data collection in epidemiological research. However, further feasibility studies need to be conducted in the near future to test the applicability and acceptance of these mobile apps for epidemiological research in various subpopulations.

A Review of Usability Evaluation Methods and Their Use for Testing eHealth HIV Interventions

PURPOSE OF REVIEW

To provide a comprehensive review of usability testing of eHealth interventions for HIV.

RECENT FINDINGS

We identified 28 articles that assessed the usability of eHealth interventions for HIV, most of which were published within the past 3 years. The majority of the eHealth interventions for HIV was developed on a mobile platform and focused on HIV prevention as the intended health outcome. Usability evaluation methods included eye-tracking, questionnaires, semi-structured interviews, contextual interviews, think-aloud protocols, cognitive walkthroughs, heuristic evaluations and expert reviews, focus groups, and scenarios. A wide variety of methods is available to evaluate the usability of eHealth interventions. Employing multiple methods may provide a more comprehensive assessment of the usability of eHealth interventions as compared with inclusion of only a single evaluation method.

The need for a telemedicine strategy for Botswana? A scoping review and situational assessment

Background

Health, healthcare, and healthcare system problems within the developing world are well recognised. eHealth, the use of Information and Communications Technologies (ICT) for health, is frequently suggested as one means by which to ameliorate such problems. However, to identify and implement the most appropriate ehealth solutions requires development of a thoughtful and broadly evidence-informed strategy. Most published strategies focus on health informatics solutions, neglecting the potential for other aspects of ehealth (telehealth, telemedicine, elearning, and ecommerce). This study examined the setting in Botswana to determine the need for a telemedicine-specific strategy.

Methods

A situational assessment of ehealth activities in Botswana was performed through a scoping review of the scientific and grey literature using specified search terms to July 2018; an interview with an official from the major mhealth stakeholder; and benchtop review of policies and other relevant Government documents including the country’s current draft eHealth Strategy.

Results

Thirty-nine papers were reviewed. Various ehealth technologies have been applied within Botswana. These include Skype for educational activities, instant messaging (WhatsApp for telepathology; SMS for transmission of laboratory test results, patient appointment reminders, and invoicing and bill payment), and robotics for dermatopathology. In addition health informatics technologies have been used for surveillance, monitoring, and access to information by healthcare workers. The number of distinct health information systems has been reduced from 37 to 12, and 9 discrete EMRs remain active within the public health institutions. Many infrastructural issues were identified. A critical assessment of the current draft ehealth strategy document for Botswana showed limitations. Many telemedicine services have been introduced over the years (addressing cervical cancer screening, teledermatology, teleradiology, oral medicine and eye screening), but only one project was confirmed to be active and being scaled up with the intervention of the Government.

Conclusions

Botswana’s draft ‘ehealth’ strategy will not, in and of itself, nurture innovative growth in the application of telemedicine initiatives, which currently are fragmented and stalled. This lack of focus is preventing telemedicine’s recognised potential from being leveraged. A specific Telemedicine Strategy, aligned with and supportive of the pre-existing ehealth strategy, would provide the necessary focus, stimulus, and guidance.

Development and Usability of a Smartphone Application for Tracking Oncology Patients in Gaborone, Botswana

BACKGROUND

The majority of new cancer cases are expected to be diagnosed in low- and middle-income countries (LMICs) by 2025, and 65% of cancer deaths currently occur in LMICs. Treatment adherence, patient monitoring, and follow-up are essential to cancer care but are often not possible in these settings. Out Patient (OP) Care, a smartphone application (app) developed to fill this gap, texts appointment reminders to patients and electronically stores medical records confidentially.

OBJECTIVES

This study aims to present the development of this app and evaluate its usability and feasibility as defined by provider and patient experiences in the context of a multidisciplinary cancer clinic in Gaborone, Botswana.

METHODS

OP Care was piloted at a multidisciplinary team gynecologic oncology clinic in Gaborone, Botswana. The app was developed through an iterative process with feedback from clinic staff and physicians. The usability was evaluated using a cross-sectional survey. All staff members in the gynecologic oncology clinic, which typically consists of one doctor and four nurses, as well as a portion of the staff in the (Princess Marina Hospital general) oncology ward used the app. All providers using the app were surveyed, along with all patients who attended the gynecologic oncology clinic during the 3-week survey period. Staff demographics, reactions, and opinions on usability, as well as patients' reactions to the appointment reminders were collected. Agreement to the ease-of-usability statements was recorded on a 1 (not at all) to 7 (extremely so) scale. Primary outcomes were the app's usability and the feasibility of text reminders from the patient's perspective.

RESULTS

Nine staff and 15 patients were surveyed. Staff included three doctors and six nurses and encompassed all of the staff in the gynecologic oncology clinic as well as a portion of the general oncology ward. All surveyed staff owned a smartphone and used a computer at home. Most (78%) staff did not feel that OP Care would increase their work burden and were willing to use the app if implemented permanently (median: 6; interquartile range [IQR]: 1). Seventeen out of the nineteen usability questions, such as "I feel comfortable using this system," scored a median of 6, corresponding to "very much so." Patients reported that the reminder text messages were helpful (median: 6; IQR: 1) and preferred the text reminders to be in Setswana (median: 7; IQR: 1).

CONCLUSION

High usability scores indicate that the app can be scaled up to usage in this clinic and others. Although patients appreciate OP Care, the option for call and text reminders in Setswana is indicated.