A usability study of a mobile health application for rural Ghanaian midwives

Acceptability and use of the electronic community health information system and its determinants among health extension workers in Ethiopia: a retrospective cross-sectional observational study

BACKGROUND

The electronic community health information system has been increasingly developed and deployed to quantify and support quality health service delivery by community health workers in Ethiopia. However, the success and failure of the electronic community health information system depend on the acceptability and use by its users. This study assessed the acceptability and use of the electronic community health information system and its determinants among health extension workers in Ethiopia.

METHODS

A retrospective cross-sectional observational study was conducted among 587 randomly selected health extension workers from six regions of Ethiopia. The Revised Technology Acceptance Model was used as a theoretical framework for the study. Descriptive statistics, structural equation modeling, and principal component analysis techniques were used to analyze the data. For all significance tests, multiple comparison adjustments were made using the Bonferroni Correction Method.

RESULTS

There was near universal acceptance of the electronic community health information system, ranging from 94.4 to 97.4% among health extension workers. However, actual use of the system was considerably lower, at 50%. Perceived usefulness of the electronic community health information system had a direct and positive effect on acceptability (β3 = 0.415, p < 0.001). Perceived ease of use had both direct and indirect positive effects on electronic community health information system acceptability (β2 = 0.340, p < 0.001 and β1*β3 = 0.289, p < 0.001, respectively), while acceptability had a direct and positive effect on the use of the electronic community health information system (β3 = 0.297, p < 0.001).

CONCLUSIONS

Despite the very high acceptability of the electronic community health information system among health extension workers, actual use of the system is considerably lower. Hence, an integrated and coordinated approach is required to close the acceptance-use gap.

Usability of a mobile application for the clinical follow-up of patients with chronic obstructive pulmonary disease and home oxygen therapy

BACKGROUND

Technological health tools (e-Health) may potentially facilitate the treatment of patients with chronic diseases through development of self-management and -care skills in patients and caregivers. However, these tools are usually marketed without prior analysis and without providing any context to final users, which frequently results in low adherence to their use.

PURPOSE

To determine the usability of and satisfaction toward a mobile app for the clinical monitoring of patients with chronic obstructive pulmonary disease (COPD) receiving oxygen therapy at home.

METHODS

This was a participative-qualitative study focused on final users-with direct intervention by patients and professionals-consisting of three phases as follows: (i) medium-fidelity mockups design, (ii) development of a usability test for each user profile, and (iii) assessment of the satisfaction level regarding the usability of the mobile app. A sample was established and selected through non-probability convenience sampling and was divided into two groups as follows: healthcare professionals (n = 13) and patients (n = 7). Each participant received a smartphone with mockup designs. The "think-aloud" method was applied in the usability test. Participants were audio recorded and the anonymous transcriptions were analyzed, highlighting fragments about mockups characteristics and the usability test. The difficulty level of the tasks was assessed with a scale from 1 (very easy) to 5 (too difficult), and task non-completion was considered a critical mistake. The satisfaction level related to test usability was assessed with a 4-score Likert scale ranging from 4 (totally agree) to 1 (totally disagree).

RESULTS

Regarding the difficulty level, >60% of professionals described most tasks as "very easy" and 70% of patients as "easy." No participant made critical mistakes and both groups reported a high satisfaction level regarding the usability variables. The patient and professionals group required 18 and 11 min to complete all tasks, respectively.

CONCLUSIONS

Participants described the app as intuitive and easy to use. The usability satisfaction results show a high level of satisfaction for both groups. This positive assessment and performance in user tests showed that the mobile application was able to be apprehended and used by participants in the circumstances of use in the usability tests. Usability evaluation through satisfaction surveys and qualitative data analysis allows for greater insight into the use of mobile applications in healthcare.

Scoping review of health information technology usability methods leveraged in Africa

OBJECTIVE

The aim of this study was to explore the state of health information technology (HIT) usability evaluation in Africa.

MATERIALS AND METHODS

We searched three electronic databases: PubMed, Embase, and Association for Computing Machinery. We categorized the stage of evaluations, the type of interactions assessed, and methods applied using Stead's System Development Life Cycle (SDLC) and Bennett and Shackel's usability models.

RESULTS

Analysis of 73 of 1002 articles that met inclusion criteria reveals that HIT usability evaluations in Africa have increased in recent years and mainly focused on later SDLC stage (stages 4 and 5) evaluations in sub-Saharan Africa. Forty percent of the articles examined system-user-task-environment (type 4) interactions. Most articles used mixed methods to measure usability. Interviews and surveys were often used at each development stage, while other methods, such as quality-adjusted life year analysis, were only found at stage 5. Sixty percent of articles did not include a theoretical model or framework.

DISCUSSION

The use of multistage evaluation and mixed methods approaches to obtain a comprehensive understanding HIT usability is critical to ensure that HIT meets user needs.

CONCLUSIONS

Developing and enhancing usable HIT is critical to promoting equitable health service delivery and high-quality care in Africa. Early-stage evaluations (stages 1 and 2) and interactions (types 0 and 1) should receive special attention to ensure HIT usability prior to implementing HIT in the field.

Healthcare Workers' Perspectives of mHealth Adoption Factors in the Developing World: Scoping Review

BACKGROUND

mHealth applications provide health practitioners with platforms that enable disease management, facilitate drug adherence, facilitate drug adherence, speed up diagnosis, monitor outbreaks, take and transfer medical images, and provide advice. Many developing economies are investing more in mobile telecommunication infrastructure than in road transport and electric power generation. Despite this, mHealth has not seen widespread adoption by healthcare workers in the developing world. This study reports a scoping review of factors that impact the adoption of mHealth by healthcare workers in the developing world, and based on these findings, a framework is developed for enhancing mHealth adoption by healthcare workers in the developing world.

METHODS

A structured literature search was performed using PubMed and Scopus, supplemented by hand searching. The searches were restricted to articles in English during the period January 2009 to December 2019 and relevant to the developing world that addressed: mobile phone use by healthcare workers and identified factors impacting the adoption of mHealth implementations. All authors reviewed selected papers, with final inclusion by consensus. Data abstraction was performed by all authors. The results were used to develop the conceptual framework using inductive iterative content analysis.

RESULTS AND DISCUSSION

Of 919 articles, 181 met the inclusion criteria and, following a review of full papers, 85 reported factors that impact (promote or impede) healthcare worker adoption of mHealth applications. These factors were categorised into 18 themes and, after continued iterative review and discussion were reduced to 7 primary categories (engagement/funding, infrastructure, training/technical support, healthcare workers' mobile-cost/ownership, system utility, motivation/staffing, patients' mobile-cost/ownership), with 17 sub-categories. These were used to design the proposed framework.

CONCLUSIONS

Successful adoption of mHealth by healthcare workers in the developing world will depend on addressing the factors identified in the proposed framework. They must be assessed in each specific setting prior to mHealth implementation. Application of the proposed framework will help shape future policy and practice of mHealth implementation in the developing world and increase adoption by health workers.

A Virtual Assistant in Vaccine Pharmacovigilance: Content and Usability Validation

This article describes the process of developing and validating a virtual assistant to perform vaccine pharmacovigilance. We performed a pilot study with a panel of 22 healthcare professionals who performed content validation of the virtual assistant prototype. Usability was tested with 126 users, using the System Usability Scale. The data analysis was performed by the agreement rate and content validity index, and the κ test was used to verify the agreement between the evaluators. The content domains of the virtual assistant achieved excellent suitability, relevance, and representativeness criteria, all greater than 86%; the content validity index ranged from 0.81 to 0.98, with an average of 0.90 and an interrater reliability index of 1.00. There was excellent interrater agreement (average κ value, 0.76). The total usability score among users was 80.1, ranging from 78.2 in group 1 (users without reactions to vaccines) to 82.1 in group 2 (users with reactions) (P = .002). The virtual assistant for vaccine pharmacovigilance obtained a satisfactory level of content validity and usability, giving greater credibility to the claim that this device provides greater surveillance and safety for patients.

mHealth in sub-Saharan Africa and Europe: A systematic review comparing the use and availability of mHealth approaches in sub-Saharan Africa and Europe

Background

mHealth can help with healthcare service delivery for various health issues, but there's a significant gap in the availability and use of mHealth systems between sub-Saharan Africa and Europe, despite the ongoing digitalization of the global healthcare system.

Objective

This work aims to compare and investigate the use and availability of mHealth systems in sub-Saharan Africa and Europe, and identify gaps in current mHealth development and implementation in both regions.

Methods

The study adhered to the PRISMA 2020 guidelines for article search and selection to ensure an unbiased comparison between sub-Saharan Africa and Europe. Four databases (Scopus, Web of Science, IEEE Xplore, and PubMed) were used, and articles were evaluated based on predetermined criteria. Details on the mHealth system type, goal, patient type, health concern, and development stage were collected and recorded in a Microsoft Excel worksheet.

Results

The search query produced 1020 articles for sub-Saharan Africa and 2477 articles for Europe. After screening for eligibility, 86 articles for sub-Saharan Africa and 297 articles for Europe were included. To minimize bias, two reviewers conducted the article screening and data retrieval. Sub-Saharan Africa used SMS and call-based mHealth methods for consultation and diagnosis, mainly for young patients such as children and mothers, and for issues such as HIV, pregnancy, childbirth, and child care. Europe relied more on apps, sensors, and wearables for monitoring, with the elderly as the most common patient group, and the most common health issues being cardiovascular disease and heart failure.

Conclusion

Wearable technology and external sensors are heavily used in Europe, whereas they are seldom used in sub-Saharan Africa. More efforts should be made to use the mHealth system to improve health outcomes in both regions, incorporating more cutting-edge technologies like wearables internal and external sensors. Undertaking context-based studies, identifying determinants of mHealth systems use, and considering these determinants during mHealth system design could enhance mHealth availability and utilization.

Use of mHealth tools to register birth outcomes in low-income and middle-income countries: a scoping review

OBJECTIVE

Accurate reporting of birth outcomes in low-income and middle-income countries (LMICs) is essential. Mobile health (mHealth) tools have been proposed as a replacement for conventional paper-based registers. mHealth could provide timely data for individual facilities and health departments, as well as capture deliveries outside facilities. This scoping review evaluates which mHealth tools have been reported to birth outcomes in the delivering room in LMICs and documents their reported advantages and drawbacks.

DESIGN

A scoping review following Preferred Reporting Items for Systematic Reviews and Meta-Analyses and Joanna Briggs Institute guidelines for scoping reviews and the mHealth evidence reporting and assessment checklist for evaluating mHealth interventions.

DATA SOURCES

PubMed, CINAHL and Global Health were searched for records until 3 February 2022 with no earliest date limit.

ELIGIBILITY CRITERIA

Studies were included where healthcare workers used mHealth tools in LMICs to record birth outcomes. Exclusion criteria included mHealth not being used at the point of delivery, non-peer reviewed literature and studies not written in English.

DATA EXTRACTION AND SYNTHESIS

Two independent reviewers screened studies and extracted data. Common themes among studies were identified.

RESULTS

640 records were screened, 21 of which met the inclusion criteria, describing 15 different mHealth tools. We identified six themes: (1) digital tools for labour monitoring (8 studies); (2) digital data collection of specific birth outcomes (3 studies); (3) digital technologies used in community settings (6 studies); (4) attitudes of healthcare workers (10 studies); (5) paper versus electronic data collection (3 studies) and (6) infrastructure, interoperability and sustainability (8 studies).

CONCLUSION

Several mHealth technologies are reported to have the capability to record birth outcomes at delivery, but none were identified that were designed solely for that purpose. Use of digital delivery registers appears feasible and acceptable to healthcare workers, but definitive evaluations are lacking. Further assessment of the sustainability of technologies and their ability to integrate with existing health information systems is needed.

Development, usability and quality evaluation of the resilient mobile application for women with breast cancer

Introduction

Mental health problems as a consequence of cancer lower the quality of life of cancer patients. Despite increasing studies of breast cancer-focused mobile health applications (m-Health apps), there is less research on breast cancer patients' quality of life or well-being. The purpose of this study is to develop and evaluate the usability and quality of an educational m-Health app aimed at improving the resilience of breast cancer in women.

Methods

This study was conducted in four phases. It included extracting the requirements of the app through the nominal group technique. Based on these results, an m-Health app was developed and evaluated in terms of usability and quality by two scales, System Usability Scale and Mobile App Rating Scale questionnaires, respectively. Finally, the role of patients' age and educational backgrounds in the use of the app was assessed. The relationship between learnability and usability of the app was measured by the T-Test.

Results

The app was developed with three user interfaces. Its usability developed from the patient's point of view scored a remarkable score of 83.20 with a 95% confidence interval. This value was too indicative of high satisfaction with the usefulness and the possibility of recommending it to other cancer survivors. The results of the quality evaluation from an expert's point of view showed that this app had good functionality. Evaluation of the role of demographic information in the use of the app showed that it can be used for all age groups with different levels of education. The app did not differ significantly between learnability and usability.

Conclusion

The development of m-Health apps, based on usability principles that are suitable for all age groups with different levels of education, is welcomed by cancer patients.

Digital Solutions for Community and Primary Health Workers: Lessons From Implementations in Africa

The agenda for Universal Health Coverage has driven the exploration of various innovative approaches to expanding health services to the general population. As more African countries have adopted digital health tools as part of the strategic approach to expanding health services, there is a need for defining a standard framework for implementation across board. Therefore, there is a need to review and employ an evidence-based approach to inform managing challenges, adopting best approaches, and implement informed recommendations. We reviewed a variety of digital health tools applied to different health conditions in primary care settings and highlighted the challenges faced, approaches that worked and relevant recommendations. These include limited coverage and network connectivity, lack of technological competence, lack of power supply, limited mobile phone usage and application design challenges. Despite these challenges, this review suggests that mHealth solutions could attain effective usage when healthcare workers receive adequate onsite training, deploying applications designed in an intuitive and easy to understand approach in a manner that fits into the users existing workflows, and involvement of the stakeholders at all levels in the design, planning, and implementation stages of the interventions.

Use of technology to prevent, detect, manage and control hypertension in sub-Saharan Africa: a systematic review

OBJECTIVE

To identify and assess the use of technologies, including mobile health technology, internet of things (IoT) devices and artificial intelligence (AI) in hypertension healthcare in sub-Saharan Africa (SSA).

DESIGN

Systematic review.

DATA SOURCES

Medline, Embase, Scopus and Web of Science.

ELIGIBILITY CRITERIA

Studies addressing outcomes related to the use of technologies for hypertension healthcare (all points in the healthcare cascade) in SSA.

METHODS

Databases were searched from inception to 2 August 2021. Screening, data extraction and risk of bias assessment were done in duplicate. Data were extracted on study design, setting, technology(s) employed and outcomes. Blood pressure (BP) reduction due to intervention was extracted from a subset of randomised controlled trials. Methodological quality was assessed using the Mixed Methods Appraisal Tool.

RESULTS

1717 hits were retrieved, 1206 deduplicated studies were screened and 67 full texts were assessed for eligibility. 22 studies were included, all reported on clinical investigations. Two studies were observational, and 20 evaluated technology-based interventions. Outcomes included BP reduction/control, treatment adherence, retention in care, awareness/knowledge of hypertension and completeness of medical records. All studies used mobile technology, three linked with IoT devices. Short Message Service (SMS) was the most popular method of targeting patients (n=6). Moderate BP reduction was achieved in three randomised controlled trials. Patients and healthcare providers reported positive perceptions towards the technologies. No studies using AI were identified.

CONCLUSIONS

There are a range of successful applications of key enabling technologies in SSA, including BP reduction, increased health knowledge and treatment adherence following targeted mobile technology interventions. There is evidence to support use of mobile technology for hypertension management in SSA. However, current application of technologies is highly heterogeneous and key barriers exist, limiting efficacy and uptake in SSA. More research is needed, addressing objective measures such as BP reduction in robust randomised studies.

PROSPERO REGISTRATION NUMBER

CRD42020223043.

Worlds apart: a socio-material exploration of mHealth in rural areas of developing countries

Purpose

The implementation of mobile health (mHealth) in developing countries seems to be stuck in a pattern of successive pilot studies that struggle for mainstream implementation. This study addresses the research question: what existing health-related structures, properties and practices are presented by rural areas of developing countries that might inhibit the implementation of mHealth initiatives?

Design/methodology/approach

This study was conducted using a socio-material approach, based on an exploratory case study in West Africa. Interviews and participant observation were used to gather data. A thematic analysis identified important social and material agencies, practices and imbrications which may limit the effectiveness of mHealth apps in the region.

Findings

Findings show that, while urban healthcare is highly structured, best practice-led, rural healthcare relies on peer-based knowledge sharing, and community support. This has implications for the enacted materiality of mobile technologies. While urban actors see mHealth as a tool for automation and the enforcement of responsible healthcare best practice, rural actors see mHealth as a tool for greater interconnectivity and independent, decentralised care.

Research limitations/implications

This study has two significant limitations. First, the study focussed on a region where technology-enabled guideline-driven treatment is the main mHealth concern. Second, consistent with the exploratory nature of this study, the qualitative methodology and the single-case design, the study makes no claim to statistical generalisability.

Originality/value

To the authors' knowledge, this is the first study to adopt a socio-material view that considers existing structures and practices that may influence the widespread adoption and assimilation of a new mHealth app. This helps identify contextual challenges that are limiting the potential of mHealth to improve outcomes in rural areas of developing countries.

An Intelligent Individualized Cardiovascular App for Risk Elimination (iCARE) for Individuals With Coronary Heart Disease: Development and Usability Testing Analysis

Background

Death and disability from coronary heart disease (CHD) can be largely reduced by improving risk factor management. However, adhering to evidence-based recommendations is challenging and requires interventions at the level of the patient, provider, and health system.

Objective

The aim of this study was to develop an Intelligent Individualized Cardiovascular App for Risk Elimination (iCARE) to facilitate adherence to health behaviors and preventive medications, and to test the usability of iCARE.

Methods

We developed iCARE based on a user-centered design approach, which included 4 phases: (1) function design, (2) iterative design, (3) expert inspections and walkthroughs of the prototypes, and (4) usability testing with end users. The usability testing of iCARE included 2 stages: stage I, which included a task analysis and a usability evaluation (January to March 2019) of the iCARE patient app using the modified Health Information Technology Usability Survey (Health-ITUES); and stage II (June 2020), which used the Health-ITUES among end users who used the app for 6 months. The end users were individuals with a confirmed diagnosis of CHD from 2 university-affiliated hospitals in Beijing, China.

Results

iCARE consists of a patient app, a care provider app, and a cloud platform. It has a set of algorithms that trigger tailored feedback and can send individualized interventions based on data from initial assessment and health monitoring via manual entry or wearable devices. For stage I usability testing, 88 hospitalized patients (72% [63/88] male; mean age 60 [SD 9.9] years) with CHD were included in the study. The mean score of the usability testing was 90.1 (interquartile range 83.3-99.0). Among enrolled participants, 90% (79/88) were satisfied with iCARE; 94% (83/88) and 82% (72/88) reported that iCARE was useful and easy to use, respectively. For stage II usability testing, 61 individuals with CHD (85% [52/61] male; mean age 53 [SD 8.2] years) who were from an intervention arm and used iCARE for at least six months were included. The mean total score on usability testing based on the questionnaire was 89.0 (interquartile distance: 77.0-99.5). Among enrolled participants, 89% (54/61) were satisfied with the use of iCARE, 93% (57/61) perceived it as useful, and 70% (43/61) as easy to use.

Conclusions

This study developed an intelligent, individualized, evidence-based, and theory-driven app (iCARE) to improve patients’ adherence to health behaviors and medication management. iCARE was identified to be highly acceptable, useful, and easy to use among individuals with a diagnosis of CHD.

Trial Registration

Chinese Clinical Trial Registry ChiCTR-INR-16010242; https://tinyurl.com/2p8bkrew

Health workers' perspectives of a mobile health tool to improve diagnosis and management of paediatric acute respiratory illnesses in Uganda: a qualitative study

OBJECTIVES

Mobile health tools have potential to improve the diagnosis and management of acute lower respiratory illnesses (ALRI), a leading cause of paediatric mortality worldwide. The objectives were to evaluate health workers' perceptions of acceptability, usability and feasibility of Acute Lower Respiratory Illness Treatment and Evaluation (ALRITE), a novel mobile health tool to help frontline health workers diagnose, treat and provide education about ALRI in children <5 years.

DESIGN

A qualitative study including semistructured interviews with health facility administrators and focus groups with primary care health workers.

SETTING

Two federally funded Ugandan primary care health facilities, one peri-urban and one rural.

PARTICIPANTS

We enrolled 3 health administrators and 28 health workers (clinical officers and nurses).

INTERVENTION

The ALRITE smartphone application was developed to help frontline health workers adhere to ALRI guidelines and differentiate wheezing illnesses from pneumonia in children under 5 years of age. ALRITE contains a simple decision tree, a partially automated respiratory rate counter, educational videos and an adapted respiratory assessment score to determine bronchodilator responsiveness. We performed a demonstration of ALRITE for participants at the beginning of interviews and focus groups. No participant had used ALRITE prior.

RESULTS

Themes impacting the potential implementation of ALRITE were organised using individual-level, clinic-level and health-system level determinants. Individual-level determinants were acceptability and perceived benefit, usability, provider needs and provider-patient relationship. Clinic-level determinants were limited resources and integration within the health centre. Systems-level determinants included medication shortages and stakeholder engagement.

CONCLUSIONS

Incorporation of these themes will ready ALRITE for field testing. Early engagement of end users provides insights critical to the development of tailored mHealth decision support tools.

Systematic Review and Meta-Analysis of the Diagnostic Accuracy of Mobile-Linked Point-of-Care Diagnostics in Sub-Saharan Africa

Mobile health devices are emerging applications that could help deliver point-of-care (POC) diagnosis, particularly in settings with limited laboratory infrastructure, such as Sub-Saharan Africa (SSA). The advent of Severe acute respiratory syndrome coronavirus 2 has resulted in an increased deployment and use of mHealth-linked POC diagnostics in SSA. We performed a systematic review and meta-analysis to evaluate the accuracy of mobile-linked point-of-care diagnostics in SSA. Our systematic review and meta-analysis were guided by the Preferred Reporting Items requirements for Systematic Reviews and Meta-Analysis. We exhaustively searched PubMed, Science Direct, Google Scholar, MEDLINE, and CINAHL with full text via EBSCOhost databases, from mHealth inception to March 2021. The statistical analyses were conducted using OpenMeta-Analyst software. All 11 included studies were considered for the meta-analysis. The included studies focused on malaria infections, Schistosoma haematobium, Schistosoma mansoni, soil-transmitted helminths, and Trichuris trichiura. The pooled summary of sensitivity and specificity estimates were moderate compared to those of the reference representing the gold standard. The overall pooled estimates of sensitivity, specificity, positive likelihood ratio, negative likelihood ratio, and diagnostic odds ratio of mobile-linked POC diagnostic devices were as follows: 0.499 (95% CI: 0.458–0.541), 0.535 (95% CI: 0.401–0.663), 0.952 (95% CI: 0.60–1.324), 1.381 (95% CI: 0.391–4.879), and 0.944 (95% CI: 0.579–1.538), respectively. Evidence shows that the diagnostic accuracy of mobile-linked POC diagnostics in detecting infections in SSA is presently moderate. Future research is recommended to evaluate mHealth devices’ diagnostic potential using devices with excellent sensitivities and specificities for diagnosing diseases in this setting.

The most used questionnaires for evaluating telemedicine services

Background

Questionnaires are commonly used tools in telemedicine services that can help to evaluate different aspects. Selecting the ideal questionnaire for this purpose may be challenging for researchers. This study aims to review which questionnaires are used to evaluate telemedicine services in the studies, which are most common, and what aspects of telemedicine evaluation do they capture.

Methods

The PubMed database was searched in August 2020 to retrieve articles. Data extracted from the final list of articles included author/year of publication, journal of publication, type of evaluation, and evaluation questionnaire. Data were analyzed using descriptive statistics.

Results

Fifty-three articles were included in this study. The questionnaire was used for evaluating the satisfaction (49%), usability (34%), acceptance (11.5%), and implementation (2%) of telemedicine services. Among telemedicine specific questionnaires, Telehealth Usability Questionnaire (TUQ) (19%), Telemedicine Satisfaction Questionnaire (TSQ) (13%), and Service User Technology Acceptability Questionnaire (SUTAQ) (5.5%), were respectively most frequently used in the collected articles. Other most used questionnaires generally used for evaluating the users’ satisfaction, usability, and acceptance of technology were Client Satisfaction Questionnaire (CSQ) (5.5%), Questionnaire for User Interaction Satisfaction (QUIS) (5.5%), System Usability Scale (SUS) (5.5%), Patient Satisfaction Questionnaire (PSQ) (5.5%), and Technology Acceptance Model (TAM) (3.5%) respectively.

Conclusion

Employing specifically designed questionnaires or designing a new questionnaire with fewer questions and more comprehensiveness in terms of the issues studied provides a better evaluation. Attention to user needs, end-user acceptance, and implementation processes, along with users' satisfaction and usability evaluation, may optimize telemedicine efforts in the future.

Possibilities, Problems, and Perspectives of Data Collection by Mobile Apps in Longitudinal Epidemiological Studies: Scoping Review

Background

The broad availability of smartphones and the number of health apps in app stores have risen in recent years. Health apps have benefits for individuals (eg, the ability to monitor one’s health) as well as for researchers (eg, the ability to collect data in population-based, clinical, and observational studies). Although the number of health apps on the global app market is huge and the associated potential seems to be great, app-based questionnaires for collecting patient-related data have not played an important role in epidemiological studies so far.

Objective

This study aims to provide an overview of studies that have collected patient data using an app-based approach, with a particular focus on longitudinal studies. This literature review describes the current extent to which smartphones have been used for collecting (patient) data for research purposes, and the potential benefits and challenges associated with this approach.

Methods

We conducted a scoping review of studies that used data collection via apps. PubMed was used to identify studies describing the use of smartphone app questionnaires for collecting data over time. Overall, 17 articles were included in the summary.

Results

Based on the results of this scoping review, there are only a few studies that integrate smartphone apps into data-collection approaches. Studies dealing with the collection of health-related data via smartphone apps have mainly been developed with regard to psychosomatic, neurodegenerative, respiratory, and cardiovascular diseases, as well as malign neoplasm. Among the identified studies, the duration of data collection ranged from 4 weeks to 12 months, and the participants’ mean ages ranged from 7 to 69 years. Potential can be seen for real-time information transfer, fast data synchronization (which saves time and increases effectivity), and the possibility of tracking responses longitudinally. Furthermore, smartphone-based data-collection techniques might prevent biases, such as reminder bias or mistakes occurring during manual data transfers. In chronic diseases, real-time communication with physicians and early detection of symptoms enables rapid modifications in disease management.

Conclusions

The results indicate that using mobile technologies can help to overcome challenges linked with data collection in epidemiological research. However, further feasibility studies need to be conducted in the near future to test the applicability and acceptance of these mobile apps for epidemiological research in various subpopulations.

Examination of tools associated with the evaluation of knowledge uptake and utilization: A scoping review

Knowledge transfer and exchange (KTE) has become an integral part of organizational practice. Evaluation of KTE, as well as knowledge products generated through this process, is important for understanding the effectiveness of KTE strategies. This scoping review aimed to identify tools and frameworks used to evaluate knowledge uptake and utilization (KUU). The search strategy included review of PubMed and Scopus databases, hand searching of relevant journals, and citation tracing. Over 6500 abstracts were screened; 292 full-text articles were shortlisted by two reviewers. Seventy-two articles described tools for evaluating KUU. A total of 23 tools could be generally applied to knowledge products/processes used in different sectors; 36 evaluation tools were designed for specific knowledge products (i.e., websites); 9 tools were discipline-specific (i.e., medical field), and four articles described evaluations of knowledge products/processes using alternative methods such as Google Analytics or qualitative methods. The majority of tools (n = 40, 56 %) focused on usability of a knowledge product or process. This scoping review identified various tools being used to assess the effectiveness and impact of KTE processes/products, however, the measures were as varied as the projects, and were often not designed to evaluate KTE in particular.

Usability of a mobile application on diabetic foot self-care

OBJECTIVES

to assess the usability of an app prototype for diabetic foot self-care by an end user.

METHODS

a descriptive study that uses heuristic assessment of a hybrid app usability. Fifteen users of an outpatient diabetes care service in a capital of Northeastern Brazil participated in the study during April 2018. The usability measurement tool called Smartphone Usability questionnaiRE was applied.

RESULTS

the lowest score was 77 and the highest was 112, with an average usability of 96.1 points. Usability was framed in the last two levels, 70 and 8o. Users now strongly agree (level 70) and fully (level 80) with the assessed items, which represents good usability of the apps prototype.

CONCLUSIONS

the final product developed focuses on user needs and requirements, which can ensure usability based on effectiveness, efficiency and satisfaction triad.

Health workers' perceptions and experiences of using mHealth technologies to deliver primary healthcare services: a qualitative evidence synthesis

BACKGROUND

Mobile health (mHealth), refers to healthcare practices supported by mobile devices, such as mobile phones and tablets. Within primary care, health workers often use mobile devices to register clients, track their health, and make decisions about care, as well as to communicate with clients and other health workers. An understanding of how health workers relate to, and experience mHealth, can help in its implementation.

OBJECTIVES

To synthesise qualitative research evidence on health workers' perceptions and experiences of using mHealth technologies to deliver primary healthcare services, and to develop hypotheses about why some technologies are more effective than others.

SEARCH METHODS

We searched MEDLINE, Embase, CINAHL, Science Citation Index and Social Sciences Citation Index in January 2018. We searched Global Health in December 2015. We screened the reference lists of included studies and key references and searched seven sources for grey literature (16 February to 5 March 2018). We re-ran the search strategies in February 2020. We screened these records and any studies that we identified as potentially relevant are awaiting classification.

SELECTION CRITERIA

We included studies that used qualitative data collection and analysis methods. We included studies of mHealth programmes that were part of primary healthcare services. These services could be implemented in public or private primary healthcare facilities, community and workplace, or the homes of clients. We included all categories of health workers, as well as those persons who supported the delivery and management of the mHealth programmes. We excluded participants identified as technical staff who developed and maintained the mHealth technology, without otherwise being involved in the programme delivery. We included studies conducted in any country.

DATA COLLECTION AND ANALYSIS

We assessed abstracts, titles and full-text papers according to the inclusion criteria. We found 53 studies that met the inclusion criteria and sampled 43 of these for our analysis. For the 43 sampled studies, we extracted information, such as country, health worker category, and the mHealth technology. We used a thematic analysis process. We used GRADE-CERQual to assess our confidence in the findings.

MAIN RESULTS

Most of the 43 included sample studies were from low- or middle-income countries. In many of the studies, the mobile devices had decision support software loaded onto them, which showed the steps the health workers had to follow when they provided health care. Other uses included in-person and/or text message communication, and recording clients' health information. Almost half of the studies looked at health workers' use of mobile devices for mother, child, and newborn health. We have moderate or high confidence in the following findings. mHealth changed how health workers worked with each other: health workers appreciated being more connected to colleagues, and thought that this improved co-ordination and quality of care. However, some described problems when senior colleagues did not respond or responded in anger. Some preferred face-to-face connection with colleagues. Some believed that mHealth improved their reporting, while others compared it to "big brother watching". mHealth changed how health workers delivered care: health workers appreciated how mHealth let them take on new tasks, work flexibly, and reach clients in difficult-to-reach areas. They appreciated mHealth when it improved feedback, speed and workflow, but not when it was slow or time consuming. Some health workers found decision support software useful; others thought it threatened their clinical skills. Most health workers saw mHealth as better than paper, but some preferred paper. Some health workers saw mHealth as creating more work. mHealth led to new forms of engagement and relationships with clients and communities: health workers felt that communicating with clients by mobile phone improved care and their relationships with clients, but felt that some clients needed face-to-face contact. Health workers were aware of the importance of protecting confidential client information when using mobile devices. Some health workers did not mind being contacted by clients outside working hours, while others wanted boundaries. Health workers described how some community members trusted health workers that used mHealth while others were sceptical. Health workers pointed to problems when clients needed to own their own phones. Health workers' use and perceptions of mHealth could be influenced by factors tied to costs, the health worker, the technology, the health system and society, poor network access, and poor access to electricity: some health workers did not mind covering extra costs. Others complained that phone credit was not delivered on time. Health workers who were accustomed to using mobile phones were sometimes more positive towards mHealth. Others with less experience, were sometimes embarrassed about making mistakes in front of clients or worried about job security. Health workers wanted training, technical support, user-friendly devices, and systems that were integrated into existing electronic health systems. The main challenges health workers experienced were poor network connections, access to electricity, and the cost of recharging phones. Other problems included damaged phones. Factors outside the health system also influenced how health workers experienced mHealth, including language, gender, and poverty issues. Health workers felt that their commitment to clients helped them cope with these challenges.

AUTHORS' CONCLUSIONS

Our findings propose a nuanced view about mHealth programmes. The complexities of healthcare delivery and human interactions defy simplistic conclusions on how health workers will perceive and experience their use of mHealth. Perceptions reflect the interplay between the technology, contexts, and human attributes. Detailed descriptions of the programme, implementation processes and contexts, alongside effectiveness studies, will help to unravel this interplay to formulate hypotheses regarding the effectiveness of mHealth.

Operability, Acceptability, and Usefulness of a Mobile App to Track Routine Immunization Performance in Rural Pakistan: Interview Study Among Vaccinators and Key Informants

BACKGROUND

There has been a recent spate of mobile health (mHealth) app use for immunizations and other public health concerns in low- and middle-income countries. However, recent evidence has largely focused on app development or before-and-after effects on awareness or service coverage. There is little evidence on the factors that facilitate adoption of mHealth programs, which is critical to effectively embed digital technology into mainstream health systems.

OBJECTIVE

This study aimed to provide the qualitative experiences of frontline health staff and district managers while engaging with real-time digital technology to improve the coverage of routine childhood immunization in an underserved rural district in Pakistan.

METHODS

An Android-based app was iteratively developed and used for a 2-year period in 11 union councils of the Tando Muhammad Khan district, an underserved rural district with poor immunization coverage in Pakistan. We used iterative methods to examine the (1) acceptability and operability of the app, (2) validity of the collected data, and (3) use of the collected data. In addition, we collected the barriers and enablers for uptake of the mHealth app. Each of these topics was further explored related to changes in work as well as the enabling factors for and barriers to app use. In-depth interviews were conducted with the 26 vaccinators posted in the 11 union councils and 7 purposively selected key informants (government district managers) involved with the Expanded Program for Immunization. Findings were triangulated in line with the three broad research areas.

RESULTS

Digital immunization tracking was considered acceptable by vaccinators and district managers. Real-time immunization data were used to monitor vaccination volume, track children with incomplete vaccinations, develop outreach visit plans, correct existing microplans, and disburse a fuel allowance for outreach sessions. The validity of the app data was perceived to be superior to that of data from manual records. Ease of operability, satisfaction with data, personal recognition, links to field support, and a sense of empowerment served as powerful enablers. Taking twice the time to complete both manual and digital entries and outdated phones over time were considered constraints. An unintended knock-on effect was improved coordination and strengthening of Expanded Program for Immunization review platforms across district stakeholders through digitalized data.

CONCLUSIONS

Embedding digital technology into mainstream health systems relies on use by both end users and district stakeholders. Ease of operability, satisfaction with data reliability, personal recognition, links to field support, and empowerment are powerful enablers, whereas improved coordination as a result of easy, transparent data access can be an important by-product of digitalization. Findings are relevant not only for wide-scale implementation of immunization tracking apps in Pakistan but also for informing the use of digital technology for results-based delivery by frontline health workers.

Mobile health app usability and quality rating scales: a systematic review

PURPOSE

To review the rating scales used to evaluate usability and quality of mobile health applications, and to compare their purpose, content, and intended target users (i.e., patients, caregivers, or researchers).

MATERIAL AND METHODS

We conducted a systematic review of the literature in accordance with the PRISMA statement on Medline, CINAHL, PsycINFO, IEEE Explore databases, as well as a review of the grey literature to identify rating scales used to evaluate usability and quality of mobile health applications (m-health apps), between January 1, 2000 and July 31, 2018. Two researchers screened the titles and abstracts of articles that met inclusion criteria, and retrieved usability and quality rating scales from the articles.

RESULTS

We identified 24 usability scales and 25 quality rating scales in 87 peer-reviewed articles. We identified only one quality rating scale designed for non-expert users (i.e., patients or caregivers). None of the studies used a theoretical framework for app evaluation to support the scales. The validity of existing quality rating scales is yet to be investigated.

CONCLUSION

Existing usability and quality rating scales are targeted at professionals, not end users who are patients or caregivers. Rating scales that are usable by all end-users would make mobile health apps accessible and meaningful to consumers.Implications for rehabilitationThe number of mobile health applications on app stores that can be used for rehabilitation is increasing.Most healthcare providers lack the training to identify m-health apps with high quality to be used in rehabilitation.This study has reviewed the current rating scales that can help clinicians and care providers rate the quality of m-health apps and identify the ones that are most appropriate for their practice.

"Assessment of the social influence and facilitating conditions that support nurses' adoption of hospital electronic information management systems (HEIMS) in Ghana using the unified theory of acceptance and use of technology (UTAUT) model"

Background

Hospital electronic information management systems (HEIMS) are widely used in Ghana, and hence its performance must be carefully assessed. Nurses as clinical health personnel are the largest cluster of hospital staff and are the pillar of healthcare delivery. Therefore, they play a crucial role in the adoption and assessment of HEIMSs in Ghana. This report sought to assess the “Social Influence” (SI) and “Facilitating Conditions” (FC) that support Nurses’ Acceptance of HEIMS in Ghana using the “Unified Theory of Acceptance and Use of Technology” (UTAUT) model.

Methods

This study applied a non-experimental survey design. An electronic platform questionnaire on smartphones was used to collect data on 660 nurses. Statistically, AMOS Structural Equation Modelling (SEM) version 22.0 was employed to examine the research model.

Results

“Behavioral Intention” (BI) to HEIMS use was significantly predicted by SI and FC (p < 0.001). Notably, both SI and FC had an influence on nurses’ use behavior (UB) with behavioral intention (BI) as the mediator, which explains a total of 42.1% variance in the intention of nurses to use HEIMS. Likewise, UB of HEIMS was also significantly predicted by SI (R² = 43.2) and BI (R² = 0.39.6) with both constructs explaining a total of 51.7% of the variance in nurses’ acceptance to use HEIMS.

Conclusion

Nurses’ adoption of HEIMS in terms of the UB was influenced by SI and BI, whiles SI and FC had the strongest influence on BI (serving as mediator) of UB to adopt and use HEIMS among the nurses in Ghanaian hospitals.

Mobile phone apps for clinical decision support in pregnancy: a scoping review

Background

The use of digital technology in healthcare has been found to be useful for data collection, provision of health information and communications. Despite increasing use of medical mobile phone applications (apps), by both clinicians and patients, there appears to be a paucity of peer-reviewed publications evaluating their use, particularly in pregnancy. This scoping review explored the use of mobile phone apps for clinical decision support in pregnancy. Specific objectives were to: 1. determine the current landscape of mobile phone app use for clinical decision support in pregnancy; 2. identify perceived benefits and potential hazards of use and 3. identify facilitators and barriers to implementation of these apps into clinical practice.

Methods

Papers eligible for inclusion were primary research or reports on the development and evaluation of apps for use by clinicians for decision support in pregnancy, published in peer-reviewed journals. Research databases included Medline, Embase, PsychoInfo, the Cochrane Database of Systematic Reviews and the online digital health journals JMIR mHealth and uHealth. Charting and thematic analysis was undertaken using NVivo qualitative data management software and the Framework approach.

Results

After screening for eligibility, 13 papers were identified, mainly reporting early stage development of the mobile app, and feasibility or acceptability studies designed to inform further development. Thematic analysis revealed four main themes across the included papers: 1. acceptability and satisfaction; 2. ease of use and portability; 3. multi-functionality and 4. the importance of user involvement in development and evaluation.

Conclusions

This review highlights the benefits of mobile apps for clinical decision support in pregnancy and potential barriers to implementation, but reveals a lack of rigorous reporting of evaluation of their use and data security. This situation may change, however, following the issue of FDA and MHRA guidelines and implementation of UK government and other international strategies. Overall, the findings suggest that ease of use, portability and multi-functionality make mobile apps for clinical decision support in pregnancy useful and acceptable tools for clinicians.

Detection of high-risk pregnancies in low-resource settings: a case study in Guatemala

Background

Maternal and neonatal mortality is still very high at a global level, even though its reduction is a goal established among the Sustainable Development Goals by the United Nations. In order to improve prenatal care to address this challenge, this article proposes a strategy to detect and refer high risk pregnancies in rural setting through a portable ultrasound system combined with blood and urine strip tests.

Methods

The Healthy Pregnancy project was conceived as a single, explanatory and positivist case study, with a sample of ten thousand pregnant women attended by itinerant nurses of the Departments of Alta Verapaz and San Marcos. These nurses were trained and equipped with 31 portable ultrasound, and blood and urine tests to detect common obstetric pathology. Moreover, two obstetricians were responsible for remotely supervising the quality of prenatal care. Target communities were selected by the Health Directorates of the public health system from those that had the highest maternal mortality in previous years.

Results

The project attended to 10,108 women in 2 years and 3 months. 55 twin gestations (0.54%) were diagnosed. Non-cephalic presentation was found in 14.87% of the pregnant women attended from week 32 onwards. 20 patients were referred for non-evolutive gestation. An 11.08% prevalence of anemia was detected. Urine infections were diagnosed in 16.43% of the cases. Proteinuria was detected in 2.6% of patients, but only 17 of them presented high blood pressure and were therefore referred with a suspected pre-eclampsia.

Discussion

The results obtained indicate that an intervention of these characteristics makes it possible to improve the quality of care of rural pregnant women in low and middle-income countries.

Conclusion

The results show that with suitable equipment, training, and supervision, the nursing staff in charge of care in rural areas can identify and refer most of the obstetric risks in time, which may contribute to the reduction of maternal mortality.

Trial registration

This research was not registered because it is a case study in which the assignment of the medical intervention was not at the discretion of the investigators.

Electronic supplementary material

The online version of this article (10.1186/s12978-019-0748-z) contains supplementary material, which is available to authorized users.

Power Gaps Among Stakeholders in Israel's Primary Care and the Role of Primary Care Physicians' Relative Power in Their Intention to Use Video-Consultations with Patients

Introduction: Although some correlates of primary care physicians (PCPs) telemedicine adoption have been studied, little is known about whether the intention to use video-consultations (VCs) relates to how PCPs view their power, relative to other stakeholder groups in primary care. The aim of this study was (1) to describe PCPs', patients', and policy makers' (PMs) views of their power and (2) to explore how PCPs views of power are associated with their intention to use VC. Methods: A convergent parallel mixed-methods design was used. Interviews were conducted with five focus groups that comprised 42 patients; five focus groups with 52 PCPs; and 24 individual interviews with PMs. A total of 508 patients, 311 PCPs, and 141 PMs completed the questionnaire, assessing intention to use VC and stakeholders' relative power. The qualitative data were analyzed using the thematic method; survey data were analyzed using quantitative methods. Results: All stakeholder groups rated PCPs' power as significantly lower, relative to that of patients and managers. PCPs' intention to use telemedicine was found to be significantly related to perceived power gaps between them and patients (r = -0.24, p < 0.001) and between them and managers (r = -0.45, p < 0.001). Themes revealed in the analysis describing how PCPs' low power influences their intention to use VC were as follows: PCPs' low-impact telemedicine-related decisions, increased work overload, "big brother" control, and Health Maintenance Organization demands for telemedicine mandatory usage. Conclusions: To successfully adopt VC, efforts should be made to increase PCPs' relative power, by strengthening their involvement in decision-making procedures and by increasing PCPs' control over their work environment.

Heuristic-based user interface evaluation of the mobile centralized doctor appointment system

Purpose

This study aims to evaluate the interface of the mobile Centralized Doctor Appointment System (CDAS), the largest mobile e-government health application developed in Turkey to allow citizens to make medical appointments at public hospitals.

Design/methodology/approach

A total of 40 information systems engineers took part in the study. The evaluation process was mainly based on Nielsen’s heuristics. The data obtained in the evaluation process were enriched using system usability scale to conduct a more detailed analysis.

Findings

Based on the findings, problems related to the usability of the evaluated mobile health application were identified. The most violated heuristic items were found to be “error prevention” and “user control and freedom”, whereas the least violated heuristic item was “consistency and standards”. The participants generally categorized the usability problems they identified as “minor” or “major” according to their severity.

Originality/value

As a developing country, Turkey has made considerable investment in mobile e-government applications in recent years. It is equally important that mobile e-government services provided by public institutions have features that make these applications effective, efficient and satisfying for citizens. Therefore, the usability of mobile health applications in government services needs to be researched to improve their effectiveness and guide authorities, practitioners and designers.

Integrating mHealth at point of care in low- and middle-income settings: the system perspective

While the field represents a wide spectrum of products and services, many aspects of mHealth have great promise within resource-poor settings: there is an extensive range of cheap, widely available tools which can be used at the point of care delivery. However, there are a number of conditions which need to be met if such solutions are to be adequately integrated into existing health systems; we consider these from regulatory, technological and user perspectives. We explore the need for an appropriate legislative and regulatory framework, to avoid ‘work around’ solutions, which threaten patient confidentiality (such as the extensive use of instant messaging services to deliver sensitive clinical information and seek diagnostic and management advice). In addition, we will look at other confidentiality issues such as the need for applications to remove identifiable information (such as photos) from users’ devices. Integration is dependent upon multiple technological factors, and we illustrate these using examples such as products made available specifically for adoption in low- and middle-income countries. Issues such as usability of the application, signal loss, data volume utilization, need to enter passwords, and the availability of automated or in-app context-relevant clinical advice will be discussed. From a user perspective, there are three groups to consider: experts, front-line clinicians, and patients. Each will accept, to different degrees, the use of technology in care – often with cultural or regional variation – and this is central to integration and uptake. For clinicians, ease of integration into daily work flow is critical, as are familiarity and acceptability of other technology in the workplace. Front-line staff tend to work in areas with more challenges around cell phone signal coverage and data availability than ‘back-end’ experts, and the effect of this is discussed.

Usability Evaluation for the Amulet Wearable Device in Rural Older Adults with Obesity

Mobile health (mHealth) interventions hold the promise of augmenting existing health promotion interventions. Older adults present unique challenges in advancing new models of health promotion using technology including sensory limitations and less experience with mHealth, underscoring the need for specialized usability testing. We use an open-source mHealth device as a case example for its integration in a newly designed health services intervention. We performed a convergent, parallel mixed-methods study including semi-structured interviews, focus groups, and questionnaires, using purposive sampling of 29 older adults, 4 community leaders and 7 clinicians in a rural setting We transcribed the data, developed codes informed by thematic analysis using inductive and deductive methods, and assessed the quantitative data using descriptive statistics. Our results suggest the importance of end-users in user-centered design of mHealth devices and that aesthetics are critically important. The prototype could potentially be feasibly integrated within health behavior interventions. Centralized dashboards were desired by all participants and ecological momentary assessment could be an important part of monitoring. Concerns of mHealth, including the prototype device, include the device's accuracy, its intrusiveness in daily life and privacy. Formative evaluations are critically important prior to deploying large-scale interventions.

Mobile health and the performance of maternal health care workers in low- and middle-income countries: A realist review

Introduction

Maternal health and the performance of health workers is a key concern in low- and middle-income countries. Mobile health technologies are reportedly able to improve workers' performance. However, how this has been achieved for maternal health workers in low-resource settings is not fully substantiated. To address this gap by building theoretical explanations, two questions were posed: How does mobile health influence the performance of maternal health care workers in low- and middle-income countries? What mechanisms and contextual factors are associated with mobile health use for maternal health service delivery in low- and middle-income countries?

Methods

Guided by established guidelines, a realist review was conducted. Five databases were searched for relevant English language articles published between 2009 and 2016. A three-stage framework was developed and populated with explanatory configurations of Intervention-Context-Actors-Mechanism-Outcome. Articles were analyzed retroductively, with identified factors grouped into meaningful clusters.

Results

Of 1254 records identified, 23 articles representing 16 studies were retained. Four main mechanisms were identified: usability and empowerment explaining mobile health adoption, third-party recognition explaining mobile health utilization, and empowerment of health workers explaining improved competence. Evidence was skewed toward the adoption and utilization stage of the framework, with weak explanations for performance outcomes.

Conclusions

Findings suggest that health workers can be empowered to adopt and utilize mobile health in contexts where it is aligned to their needs, workload, training, and skills. In turn, mobile health can empower health workers with skills and confidence when it is perceived as useful and easy to use, in contexts that foster recognition from clients, peers, or supervisors.

Use of an electronic Partograph: feasibility and acceptability study in Zanzibar, Tanzania

BACKGROUND

The ePartogram is a tablet-based application developed to improve care for women in labor by addressing documented challenges in partograph use. The application is designed to provide real-time decision support, improve data entry, and increase access to information for appropriate labor management. This study's primary objective was to evaluate the feasibility and acceptability of ePartogram use in resource-constrained clinical settings.

METHODS

The ePartogram was introduced at three facilities in Zanzibar, Tanzania. Following 3 days of training, skilled birth attendants (SBAs) were observed for 2 weeks using the ePartogram to monitor laboring women. During each observed shift, data collectors used a structured observation form to document SBA comfort, confidence, and ability to use the ePartogram. Results were analyzed by shift. Short interviews, conducted with SBAs (n = 82) after each of their first five ePartogram-monitored labors, detected differences over time. After the observation period, in-depth interviews were conducted (n = 15). A thematic analysis of interview transcripts was completed.

RESULTS

Observations of 23 SBAs using the ePartogram to monitor 103 women over 84 shifts showed that the majority of SBAs (87-91%) completed each of four fundamental ePartogram tasks-registering a client, entering first and subsequent measurements, and navigating between screens-with ease or increasing ease on their first shift; this increased to 100% by the fifth shift. Nearly all SBAs (93%) demonstrated confidence and all SBAs demonstrated comfort in using the ePartogram by the fifth shift. SBAs expressed positive impressions of the ePartogram and found it efficient and easy to use, beginning with first client use. SBAs noted the helpfulness of auditory reminders (indicating that measurements were due) and visual alerts (signaling abnormal measurements). SBAs expressed confidence in their ability to interpret and act on these reminders and alerts.

CONCLUSIONS

It is feasible and acceptable for SBAs to use the ePartogram to support labor management and care. With structured training and support during initial use, SBAs quickly became competent and confident in ePartogram use. Qualitative findings revealed that SBAs felt the ePartogram improved timeliness of care and supported decision-making. These findings point to the ePartogram's potential to improve quality of care in resource-constrained labor and delivery settings.

Mobile health solutions in developing countries: a stakeholder perspective

Infrastructural deficiencies, limited access to medical care, and shortage of health care workers are just a few of the barriers to health care in developing countries. mHealth has the potential to overcome at least some of these challenges. To address this, a stakeholder perspective is adopted and an analysis of existing research is undertaken to look at mHealth delivery in developing countries. This study focuses on four key stakeholder groups i.e., health care workers, patients, system developers, and facilitators. A systematic review identifies 108 peer-reviewed articles, which are analysed to determine the extent these articles investigate the different types of stakeholder interactions, and to identify high-level themes emerging within these interactions. This analysis illustrates two key gaps. First, while interactions involving health care workers and/or patients have received significant attention, little research has looked at the role of patient-to-patient interactions. Second, the interactions between system developers and the other stakeholder groups are strikingly under-represented.

Health Worker mHealth Utilization: A Systematic Review

This systematic review describes mHealth interventions directed at healthcare workers in low-resource settings from the PubMed database from March 2009 to May 2015. Thirty-one articles were selected for final review. Four categories emerged from the reviewed articles: data collection during patient visits, communication between health workers and patients, communication between health workers, and public health surveillance. Most studies used a combination of quantitative and qualitative methods to assess acceptability of use, barriers to use, changes in healthcare delivery, and improved health outcomes. Few papers included theory explicitly to guide development and evaluation of their mHealth programs. Overall, evidence indicated that mobile technology tools, such as smartphones and tablets, substantially benefit healthcare workers, their patients, and healthcare delivery. Limitations to mHealth tools included insufficient program use and sustainability, unreliable Internet and electricity, and security issues. Despite these limitations, this systematic review demonstrates the utility of using mHealth in low-resource settings and the potential for widespread health system improvements using technology.

A Human-Centered Design Methodology to Enhance the Usability, Human Factors, and User Experience of Connected Health Systems: A Three-Phase Methodology

BACKGROUND

Design processes such as human-centered design, which involve the end user throughout the product development and testing process, can be crucial in ensuring that the product meets the needs and capabilities of the user, particularly in terms of safety and user experience. The structured and iterative nature of human-centered design can often present a challenge when design teams are faced with the necessary, rapid, product development life cycles associated with the competitive connected health industry.

OBJECTIVE

We wanted to derive a structured methodology that followed the principles of human-centered design that would allow designers and developers to ensure that the needs of the user are taken into account throughout the design process, while maintaining a rapid pace of development. In this paper, we present the methodology and its rationale before outlining how it was applied to assess and enhance the usability, human factors, and user experience of a connected health system known as the Wireless Insole for Independent and Safe Elderly Living (WIISEL) system, a system designed to continuously assess fall risk by measuring gait and balance parameters associated with fall risk.

METHODS

We derived a three-phase methodology. In Phase 1 we emphasized the construction of a use case document. This document can be used to detail the context of use of the system by utilizing storyboarding, paper prototypes, and mock-ups in conjunction with user interviews to gather insightful user feedback on different proposed concepts. In Phase 2 we emphasized the use of expert usability inspections such as heuristic evaluations and cognitive walkthroughs with small multidisciplinary groups to review the prototypes born out of the Phase 1 feedback. Finally, in Phase 3 we emphasized classical user testing with target end users, using various metrics to measure the user experience and improve the final prototypes.

RESULTS

We report a successful implementation of the methodology for the design and development of a system for detecting and predicting falls in older adults. We describe in detail what testing and evaluation activities we carried out to effectively test the system and overcome usability and human factors problems.

CONCLUSIONS

We feel this methodology can be applied to a wide variety of connected health devices and systems. We consider this a methodology that can be scaled to different-sized projects accordingly.

A mixed methods systematic review of success factors of mhealth and telehealth for maternal health in Sub-Saharan Africa

Access to health care is still limited for many women in sub-Saharan Africa (SSA), while it remains an important determinant of maternal mortality and morbidity. Information and communication technologies (ICTs), such as mhealth and telehealth, can help to facilitate this access by acting on the various obstacles encountered by women, be they socio-cultural, economic, geographical or organizational. However, various factors contribute to the success of mhealth and telehealth implementation and use, and must be considered for these technologies to go beyond the pilot project stage. The objective of this systematic literature review is to synthesize the empirical knowledge on the success factors of the implementation and use of telehealth and mhealth to facilitate access to maternal care in SSA. The methodology used is based on that of the Cochrane Collaboration, including a documentary search using standardized language in six databases, selection of studies corresponding to the inclusion criteria, data extraction, evaluation of study quality, and synthesis of the results. A total of 93 articles were identified, which allowed the inclusion of seven studies, six of which were on mhealth. Based on the framework proposed by Broens et al., we synthesized success factors into five categories: (I) technology, such as technical support to maintain, troubleshoot and train users, good network coverage, existence of a source of energy and user friendliness; (II) user acceptance, which is facilitated by factors such as unrestricted use of the device, perceived usefulness to the worker, adequate literacy, or previous experience of use ; (III) short- and long-term funding; (IV) organizational factors, such as the existence of a well-organized health system and effective coordination of interventions; and (V) political or legislative aspects, in this case strong government support to deploy technology on a large scale. Telehealth and mhealth are promising solutions to reduce maternal morbidity and mortality in SSA, but knowledge on how these interventions can succeed and move to scale is limited. Success factors identified in this review can provide guidance on elements that should be considered in the design and implementation of telehealth and mhealth for maternal health in SSA.

Understanding the perception towards using mHealth applications in practice

The objective of this study was to investigate physicians’ perceptions to use mobile health applications in practice, and to identify influencing factors to use the technology. An mHealth technology acceptance model was proposed (M-TAM), and a cross-sectional survey was implemented using structured questionnaire to collect data. Online tools were used for inviting participants (physicians) and data collection from Turkey. The data was analyzed using Confirmatory Factor Analysis (CFA) and Structural Equation Modeling (SEM). A total of 128 physicians participated in the survey. The model explained the perception of physicians towards mHealth application use by 51% of total variance. The influential factors were identified as Effort Expectancy, Mobile Anxiety, Perceived Service Availability and Technical Training and Support. The study provided a new model to the literature of health information technology. Findings of the research contributed by unveiling latent constructs and their influence on physicians’ perceptions towards a new healthcare technology: mHealth applications.

Who bears the cost of 'informal mhealth'? Health-workers' mobile phone practices and associated political-moral economies of care in Ghana and Malawi

Africa's recent communications 'revolution' has generated optimism that using mobile phones for health (mhealth) can help bridge healthcare gaps, particularly for rural, hard-to-reach populations. However, while scale-up of mhealth pilots remains limited, health-workers across the continent possess mobile phones. This article draws on interviews from Ghana and Malawi to ask whether/how health-workers are using their phones informally and with what consequences. Health-workers were found to use personal mobile phones for a wide range of purposes: obtaining help in emergencies; communicating with patients/colleagues; facilitating community-based care, patient monitoring and medication adherence; obtaining clinical advice/information and managing logistics. However, the costs were being borne by the health-workers themselves, particularly by those at the lower echelons, in rural communities, often on minimal stipends/salaries, who are required to 'care' even at substantial personal cost. Although there is significant potential for 'informal mhealth' to improve (rural) healthcare, there is a risk that the associated moral and political economies of care will reinforce existing socioeconomic and geographic inequalities.

Barriers and facilitators to health information exchange in low- and middle-income country settings: a systematic review

The exchange and use of health information can help healthcare professionals and policymakers make informed decisions on ways of improving patient and population health. Many low- and middle-income countries (LMICs) have however failed to embrace the approaches and technologies to facilitate health information exchange (HIE). We sought to understand the barriers and facilitators to the implementation and adoption of HIE in LMICs. Two reviewers independently searched 11 academic databases for published and on-going qualitative, quantitative and mixed-method studies and searched for unpublished work through the Google search engine. The searches covered the period from January 1990 to July 2014 and were not restricted by language. Eligible studies were independently, critically appraised and then thematically analysed. The searches yielded 5461 citations after de-duplication of results. Of these, 56 articles, three conference abstracts and four technical reports met the inclusion criteria. The lack of importance given to data in decision making, corruption and insecurity, lack of training and poor infrastructure were considered to be major challenges to implementing HIE, but strong leadership and clear policy direction coupled with the financial support to acquire essential technology, improve the communication network, and provide training for staff all helped to promote implementation. The body of work also highlighted how implementers of HIE needed to take into account local needs to ensure that stakeholders saw HIE as relevant and advantageous. HIE interventions implemented through leapfrog technologies such as telehealth/telemedicine and mHealth in Brazil, Kenya, and South Africa, provided successful examples of exchanging health information in LMICs despite limited resources and capability. It is important that implementation of HIE is aligned with national priorities and local needs.

What's Past is Prologue: A Scoping Review of Recent Public Health and Global Health Informatics Literature

OBJECTIVE

To categorize and describe the public health informatics (PHI) and global health informatics (GHI) literature between 2012 and 2014.

METHODS

We conducted a semi-systematic review of articles published between January 2012 and September 2014 where information and communications technologies (ICT) was a primary subject of the study or a main component of the study methodology. Additional inclusion and exclusion criteria were used to filter PHI and GHI articles from the larger biomedical informatics domain. Articles were identified using MEDLINE as well as personal bibliographies from members of the American Medical Informatics Association PHI and GHI working groups.

RESULTS

A total of 85 PHI articles and 282 GHI articles were identified. While systems in PHI continue to support surveillance activities, we identified a shift towards support for prevention, environmental health, and public health care services. Furthermore, articles from the U.S. reveal a shift towards PHI applications at state and local levels. GHI articles focused on telemedicine, mHealth and eHealth applications. The development of adequate infrastructure to support ICT remains a challenge, although we identified a small but growing set of articles that measure the impact of ICT on clinical outcomes.

DISCUSSION

There is evidence of growth with respect to both implementation of information systems within the public health enterprise as well as a widening of scope within each informatics discipline. Yet the articles also illuminate the need for more primary research studies on what works and what does not as both searches yielded small numbers of primary, empirical articles.

CONCLUSION

While the body of knowledge around PHI and GHI continues to mature, additional studies of higher quality are needed to generate the robust evidence base needed to support continued investment in ICT by governmental health agencies.

m-Health adoption by healthcare professionals: a systematic review

OBJECTIVE

The aim of this systematic review was to synthesize current knowledge of the factors influencing healthcare professional adoption of mobile health (m-health) applications.

METHODS

Covering a period from 2000 to 2014, we conducted a systematic literature search on four electronic databases (PubMed, EMBASE, CINAHL, PsychInfo). We also consulted references from included studies. We included studies if they reported the perceptions of healthcare professionals regarding barriers and facilitators to m-health utilization, if they were published in English, Spanish, or French and if they presented an empirical study design (qualitative, quantitative, or mixed methods). Two authors independently assessed study quality and performed content analysis using a validated extraction grid with pre-established categorization of barriers and facilitators.

RESULTS

The search strategy led to a total of 4223 potentially relevant papers, of which 33 met the inclusion criteria. Main perceived adoption factors to m-health at the individual, organizational, and contextual levels were the following: perceived usefulness and ease of use, design and technical concerns, cost, time, privacy and security issues, familiarity with the technology, risk-benefit assessment, and interaction with others (colleagues, patients, and management).

CONCLUSION

This systematic review provides a set of key elements making it possible to understand the challenges and opportunities for m-health utilization by healthcare providers.

Mobile Access to ClinicalConnect: A User Feedback Survey on Usability, Productivity, and Quality

Background

ClinicalConnect, a federated clinical viewer for South West Ontario, Canada, launched a mobile interface in June 2012.

Objective

The aim of the study was to assess usability of the mobile interface and the perceived impact on productivity of health care providers and quality of healthcare delivery.

Methods

A survey was conducted using the System Usability Scale (SUS) and questionnaires designed to measure productivity and quality based on Canada Health Infoway's Benefits Evaluation framework.

Results

The mean SUS score was 67 based on 77 responses. The mean scores for productivity and quality were 3.37 (N=74) and 3.62 (N=71), respectively, on a 5-point Likert scale where 3 was neutral.

Conclusions

Users perceived the mobile interface of ClinicalConnect as useful but were neutral about the ease of use.

Research in nursing informatics 2014

This article reflects the work done in the third year of the Nursing Informatics Year in Review project. This project seeks to search and analyze articles written by nurses as first author on the subject of nursing informatics, published August 2013-August 2014. Each year we also seek recommended articles from our American Medical Informatics Association-Nursing Informatics Work Group (AMIA-NIWG) members that meet the same criteria as the search and most influenced their thinking and scholarship. Twenty-seven articles emerged from the literature review, and our AMIA-NIWG members recommended 32 articles. We analyzed the articles by journal of publication, country of first author, source of funding, research method, research setting, and area of focus. The purpose of this article was to present the results of this project for 2014.

Translating Behavioral Interventions Onto mHealth Platforms: Developing Text Message Interventions for Smoking and Alcohol

The development of mHealth applications is often driven by the investigators and developers with relatively little input from the targeted population. User input is commonly limited to "like/dislike" post- intervention consumer satisfaction ratings or device or application specific user analytics such as usability. However, to produce successful mHealth applications with lasting effects on health behaviors it is crucial to obtain user input from the start of each project and throughout development. The aim of this tutorial is to illustrate how qualitative methods in an iterative process of development have been used in two separate behavior change interventions (targeting smoking and alcohol) delivered through mobile technologies (ie, text messaging). A series of focus groups were conducted to assist in translating a face-to-face smoking cessation intervention onto a text message (short message service, SMS) delivered format. Both focus groups and an advisory panel were used to shape the delivery and content of a text message delivered intervention for alcohol risk reduction. An in vivo method of constructing message content was used to develop text message content that was consistent with the notion of texting as "fingered speech". Formative research conducted with the target population using a participatory framework led to important changes in our approach to intervention structure, content development, and delivery. Using qualitative methods and an iterative approach that blends consumer-driven and investigator-driven aims can produce paradigm-shifting, novel intervention applications that maximize the likelihood of use by the target audience and their potential impact on health behaviors.

Electronic diagnostic algorithms to assist mid-level health care workers in Nepal: a mixed-method exploratory study

INTRODUCTION

The use of mobile health applications for data collection and disease management by rural health care workers in developing countries has been shown to be accepted by patients and health care workers. However, the acceptances of diagnostic decision applications have not been studied. Moreover, verbal acceptance of these tools has not been shown to equate with actual usage by the health care workers when use is not compulsory.

OBJECTIVE

To measure the acceptance, usage and reasons for use or non-use of electronic diagnostic applications by health care workers to aid in clinical diagnosis.

METHODS

Eleven health care workers (HCW) from rural facilities were asked to use the e-algo application on an electronic tablet with patients over the age of five presenting with acute complaints. Use was compulsory for the first 30 working days and after that optional. Patients were asked by questionnaire about their preference and confidence between the traditional approach and that of the e-algo. HCW acceptance was measured by focus group discussions after the compulsory period. The HCW was then told to use the application as they desired. After two months of non-compulsory usage, reasons were explored for use or non-use through a focus group discussion and interviews.

RESULTS

A total of 1410 out-patient encounters occurred in the first phase. Of this, the e-algo was used with 1177 encounters (83%). 496 patients were asked about their preference and confidence in the use of the e-algo. 325 preferred the e-algo over the traditional visit 65.8-25.1%. Patient confidence was higher in the e-algo 72.2-17.4%. In the second phase, three of the nine HCWs did not use the e-algo at all, the remaining six HCWs reported e-algo use dropped to approximately 15% of total OPD visits. E-algos were reported to be used primarily with more complicated or confusing cases. Reasons for non-use was primarily time related.

CONCLUSIONS

We concluded that patients had confidence in and preferred the HCW using the e-algo in their patient care. The HCW users were also positive about the e-algo application, seeing its primary benefit as assisting them in more difficult cases through the use of a differential diagnosis and focused questions. HCWs also reported that the e-algo functioned as a learning tool as well as a diagnostic tool. However, actual usage of the application dropped off significantly when its use was not mandatory. The primary reason was that they did not feel the time required to use the application was warranted in the vast majority of their cases which they perceived as being simple and easily diagnose without the assistance of the application. Unless the HCW perceives the decision-support application to be valid, time-saving and easy to use, they will not use them.

Usability and feasibility of a tablet-based Decision-Support and Integrated Record-keeping (DESIRE) tool in the nurse management of hypertension in rural western Kenya

BACKGROUND

Mobile health (mHealth) applications have recently proliferated, especially in low- and middle-income countries, complementing task-redistribution strategies with clinical decision support. Relatively few studies address usability and feasibility issues that may impact success or failure of implementation, and few have been conducted for non-communicable diseases such as hypertension.

OBJECTIVE

To conduct iterative usability and feasibility testing of a tablet-based Decision Support and Integrated Record-keeping (DESIRE) tool, a technology intended to assist rural clinicians taking care of hypertension patients at the community level in a resource-limited setting in western Kenya.

METHODS

Usability testing consisted of "think aloud" exercises and "mock patient encounters" with five nurses, as well as one focus group discussion. Feasibility testing consisted of semi-structured interviews of five nurses and two members of the implementation team, and one focus group discussion with nurses. Content analysis was performed using both deductive codes and significant inductive codes. Critical incidents were identified and ranked according to severity. A cause-of-error analysis was used to develop corresponding design change suggestions.

RESULTS

Fifty-seven critical incidents were identified in usability testing, 21 of which were unique. The cause-of-error analysis yielded 23 design change suggestions. Feasibility themes included barriers to implementation along both human and technical axes, facilitators to implementation, provider issues, patient issues and feature requests.

CONCLUSIONS

This participatory, iterative human-centered design process revealed previously unaddressed usability and feasibility issues affecting the implementation of the DESIRE tool in western Kenya. In addition to well-known technical issues, we highlight the importance of human factors that can impact implementation of mHealth interventions.