Usability of Commercially Available Mobile Applications for Diverse Patients

User-Centered Design of Learn to Quit, a Smoking Cessation Smartphone App for People With Serious Mental Illness

BACKGROUND

Smoking rates in the United States have been reduced in the past decades to 15% of the general population. However, up to 88% of people with psychiatric symptoms still smoke, leading to high rates of disease and mortality. Therefore, there is a great need to develop smoking cessation interventions that have adequate levels of usability and can reach this population.

OBJECTIVE

The objective of this study was to report the rationale, ideation, design, user research, and final specifications of a novel smoking cessation app for people with serious mental illness (SMI) that will be tested in a feasibility trial.

METHODS

We used a variety of user-centered design methods and materials to develop the tailored smoking cessation app. This included expert panel guidance, a set of design principles and theory-based smoking cessation content, development of personas and paper prototyping, usability testing of the app prototype, establishment of app's core vision and design specification, and collaboration with a software development company.

RESULTS

We developed Learn to Quit, a smoking cessation app designed and tailored to individuals with SMI that incorporates the following: (1) evidence-based smoking cessation content from Acceptance and Commitment Therapy and US Clinical Practice Guidelines for smoking cessation aimed at providing skills for quitting while addressing mental health symptoms, (2) a set of behavioral principles to increase retention and comprehension of smoking cessation content, (3) a gamification component to encourage and sustain app engagement during a 14-day period, (4) an app structure and layout designed to minimize usability errors in people with SMI, and (5) a set of stories and visuals that communicate smoking cessation concepts and skills in simple terms.

CONCLUSIONS

Despite its increasing importance, the design and development of mHealth technology is typically underreported, hampering scientific innovation. This report describes the systematic development of the first smoking cessation app tailored to people with SMI, a population with very high rates of nicotine addiction, and offers new design strategies to engage this population. mHealth developers in smoking cessation and related fields could benefit from a design strategy that capitalizes on the role visual engagement, storytelling, and the systematic application of behavior analytic principles to deliver evidence-based content.

User Experience of an Innovative Mobile Health Program to Assist in Insulin Dose Adjustment: Outcomes of a Proof-Of-Concept Trial

BACKGROUND

Many patients with diabetes require insulin therapy to achieve optimal glycemic control. Initiation and titration of insulin often require an insulin dose adjustment (IDA) program, involving frequent exchange of blood glucose levels (BGLs) and insulin prescription advice between the patient and healthcare team. This process is time consuming with logistical barriers.

OBJECTIVE

To develop an innovative mobile health (m-Health) mobile-based IDA program (mIDA) and evaluate the user adherence and experience through a proof-of-concept trial.

METHODS

In the program, an m-Health system was designed to be integrated within a clinical IDA service, comprising a Bluetooth-enabled glucose meter, smartphone application, and clinician portal. Insulin-requiring patients with type-2 diabetes mellitus and stable BGL were recruited to use the m-Health system to record and exchange BGL entries, insulin dosages, and clinical messages for 2 weeks. The user experience was evaluated by a Likert scale questionnaire.

RESULTS

Nine participants, aged 58 ± 14 years (mean ± SD), completed the trial with average daily records of 3.1 BGL entries and 1.2 insulin dosage entries. The participants recognized the potential value of the clinical messages. They felt confident about managing their diabetes and were positive regarding ease of use and family support of the system, but disagreed that there were no technical issues. Finally, they were satisfied with the program and would continue to use it if possible.

CONCLUSIONS

The m-Health system for IDA showed promising levels of adherence, usability, perception of usefulness, and satisfaction. Further research is required to assess the feasibility and cost-effectiveness of using this system in outpatient settings.

Methods for Evaluating the Content, Usability, and Efficacy of Commercial Mobile Health Apps

Commercial mobile apps for health behavior change are flourishing in the marketplace, but little evidence exists to support their use. This paper summarizes methods for evaluating the content, usability, and efficacy of commercially available health apps. Content analyses can be used to compare app features with clinical guidelines, evidence-based protocols, and behavior change techniques. Usability testing can establish how well an app functions and serves its intended purpose for a target population. Observational studies can explore the association between use and clinical and behavioral outcomes. Finally, efficacy testing can establish whether a commercial app impacts an outcome of interest via a variety of study designs, including randomized trials, multiphase optimization studies, and N-of-1 studies. Evidence in all these forms would increase adoption of commercial apps in clinical practice, inform the development of the next generation of apps, and ultimately increase the impact of commercial apps.

Lack of Adoption of a Mobile App to Support Patient Self-Management of Diabetes and Hypertension in a Federally Qualified Health Center: Interview Analysis of Staff and Patients in a Failed Randomized Trial

Background

Thousands of mobile health (mHealth) apps have been developed to support patients’ management of their health, but the effectiveness of many of the apps remains unclear. While mHealth apps appear to hold promise for improving the self-management of chronic conditions across populations, failure to balance the system demands of the app with the needs, interests, or resources of the end users can undermine consumers’ adoption of these technologies.

Objective

The original aim of this study was to evaluate the effectiveness of a commercial mHealth app in improving clinical outcomes for adult patients in a Federally Qualified Health Center (FQHC) with uncontrolled diabetes and/or hypertension. Patients entered clinical data into the app, which also supported messaging between patients and providers. After a 4-month period of vigorous recruitment, the trial was suspended due to low enrollment and inconsistent use of the app by enrolled patients. The project aim was changed to understanding why the trial was unsuccessful.

Methods

We used the user-task-context (eUTC) usability framework to develop a set of interview questions for patients and staff who were involved in the trial. All interviews were done by phone and lasted 20 to 30 minutes. Interviews were not recorded.

Results

There was a poor fit between the app, end users, and recruitment and treatment approaches in our setting. Usability testing might have revealed this prior to launch but was not an option. There was not sufficient time during routine care for clinical staff to familiarize patients with the app or to check clinical data and messages, which are unreimbursed activities. Some patients did not use the app appropriately. The lack of integration with the electronic health record (EHR) was cited as a problem for both patients and staff who also said the app was just one more thing to attend to.

Conclusions

This brief trial underscores the pitfalls in the utilization of mHealth apps. Effective use of mHealth tools requires a good fit between the app, the users’ electronic health (eHealth) literacy, the treatment approach, staff time, and reimbursement for services. The last 3 are contextual factors of the setting that affected the adoption of the app and context is an important factor in implementation science. We recommend that researchers address contextual factors in the trial and adoption of mHealth technologies.

The efficacy of smartphone-based mental health interventions for depressive symptoms: a meta-analysis of randomized controlled trials

The rapid advances and adoption of smartphone technology presents a novel opportunity for delivering mental health interventions on a population scale. Despite multi-sector investment along with wide-scale advertising and availability to the general population, the evidence supporting the use of smartphone apps in the treatment of depression has not been empirically evaluated. Thus, we conducted the first meta-analysis of smartphone apps for depressive symptoms. An electronic database search in May 2017 identified 18 eligible randomized controlled trials of 22 smartphone apps, with outcome data from 3,414 participants. Depressive symptoms were reduced significantly more from smartphone apps than control conditions (g=0.38, 95% CI: 0.24-0.52, p<0.001), with no evidence of publication bias. Smartphone interventions had a moderate positive effect in comparison to inactive controls (g=0.56, 95% CI: 0.38-0.74), but only a small effect in comparison to active control conditions (g=0.22, 95% CI: 0.10-0.33). Effects from smartphone-only interventions were greater than from interventions which incorporated other human/computerized aspects along the smartphone component, although the difference was not statistically significant. The studies of cognitive training apps had a significantly smaller effect size on depression outcomes (p=0.004) than those of apps focusing on mental health. The use of mood monitoring softwares, or interventions based on cognitive behavioral therapy, or apps incorporating aspects of mindfulness training, did not affect significantly study effect sizes. Overall, these results indicate that smartphone devices are a promising self-management tool for depression. Future research should aim to distil which aspects of these technologies produce beneficial effects, and for which populations.

Views of Patients on Using mHealth to Monitor and Prevent Diabetic Foot Ulcers: Qualitative Study

Background

People with diabetes are at risk for diabetic foot ulcers (DFUs), which can lead to limb loss and a significant decrease in quality of life. Evidence suggests that mHealth can be an effective tool in diabetes self-management. mHealth presents an opportunity for the prevention and monitoring of DFUs. However, there is a paucity of research that explores its effectiveness in the DFU patient population, as well as the views and attitudes of these patients toward technology and mHealth.

Objective

This study aimed to explore the views, attitudes, and experiences of a diabetic patient population with or at risk of DFUs regarding technology, mHealth, and the diabetic foot.

Methods

We used a qualitative research approach using in-depth interviews with 8 patients with DFUs. Questions were structured around experience with technology, current health practices related to diabetic foot care, and thoughts on using an mHealth device that prevents and monitors DFUs. We transcribed and thematically analyzed all interviews.

Results

All patients had positive responses for an mHealth intervention aimed at preventing and monitoring DFUs. We found 4 themes in the data: diversity in use of technology, feet-checking habits, 2-way communication with health care professionals (HCPs), and functionality. There were varying levels of familiarity with and dependence on technology within this patient population. These relationships correlated with distinct generations found in North America, including baby boomers and Generation X. Furthermore, we found that most patients performed daily feet checks to monitor any changes in health. However, some did not perform feet checks prior to the development of a DFU. Patients expressed interest in 2-way communication with HCPs that would allow for easier appointment scheduling, sharing of medical data, decreased number of visits, and use of alerts for when medical attention is required. Patients also identified conditions of functionality for the mHealth intervention. These included consideration of debilitating complications because of diabetes, such as retinopathy and decreased mobility; ease of use of the intervention; and implementation of virtual communities to support continued use of the intervention.

Conclusions

Our patient population expressed an interest in mHealth for preventing and monitoring DFUs, although some participants were not frequent users of technology. mHealth continues to show potential in improving patient outcomes, and this study provides a foundation for designing interventions specific to a DFU population. Further research is needed to confirm these findings.

Patient portals and health apps: Pitfalls, promises, and what one might learn from the other

Widespread use of health information technology (IT) could potentially increase patients' access to their health information and facilitate future goals of advancing patient-centered care. Despite having increased access to their health data, patients do not always understand this information or its implications, and digital health data can be difficult to navigate when displayed in a small-format, complex interface. In this paper, we discuss two forms of patient-facing health IT tools-patient portals and applications (apps)-and highlight how, despite several limitations of each, combining high-yield features of mobile health (mHealth) apps with portals could increase patient engagement and self-management and be more effective than either of them alone. Patient portal adoption is variable, and due to design and interface limitations and health literacy issues, many people find the portal difficult to use. Conversely, apps have experienced rapid adoption and traditionally have more consumer-friendly features with easy log-in access, real-time tracking, and simplified data display. These features make the applications more intuitive and easy-to-use than patient portals. While apps have their own limitations and might serve different purposes, patient portals could adopt some high-yield features and functions of apps that lead to engagement success with patients. We thus suggest that to improve user experience with future portals, developers could look towards mHealth apps in design, function, and user interface. Adding new features to portals may improve their use and empower patients to track their overall health and disease states. Nevertheless, both these health IT tools should be subjected to rigorous evaluation to ensure they meet their potential in improving patient outcomes.

Exploring User Learnability and Learning Performance in an App for Depression: Usability Study

BACKGROUND

Mental health apps tend to be narrow in their functioning, with their focus mostly being on tracking, management, or psychoeducation. It is unclear what capability such apps have to facilitate a change in users, particularly in terms of learning key constructs relating to behavioral interventions. Thought Challenger (CBITs, Chicago) is a skill-building app that engages users in cognitive restructuring, a core component of cognitive therapy (CT) for depression.

OBJECTIVE

The purpose of this study was to evaluate the learnability and learning performance of users following initial use of Thought Challenger.

METHODS

Twenty adults completed in-lab usability testing of Thought Challenger, which comprised two interactions with the app. Learnability was measured via completion times, error rates, and psychologist ratings of user entries in the app; learning performance was measured via a test of CT knowledge and skills. Nonparametric tests were conducted to evaluate the difference between individuals with no or mild depression to those with moderate to severe depression, as well as differences in completion times and pre- and posttests.

RESULTS

Across the two interactions, the majority of completion times were found to be acceptable (5 min or less), with minimal errors (1.2%, 10/840) and successful completion of CT thought records. Furthermore, CT knowledge and skills significantly improved after the initial use of Thought Challenger (P=.009).

CONCLUSIONS

The learning objectives for Thought Challenger during initial uses were successfully met in an evaluation with likely end users. The findings therefore suggest that apps are capable of providing users with opportunities for learning of intervention skills.

Addressing Disparities in Diabetes Management Through Novel Approaches to Encourage Technology Adoption and Use

Type 2 diabetes (T2D) is one of the nation’s leading drivers of disability and health care utilization, with elevated prevalence among individuals with lower education, income, and racial/ethnic minorities. Health information technology (HIT) holds vast potential for helping patients, providers, and payers to address T2D and the skyrocketing rates of chronic illness and associated health care costs. Patient portals to electronic health records (EHRs) serve as a gateway to consumer use of HIT. We found that disparities in portal use portend growing T2D disparities. Little progress has been made in addressing identified barriers to technology adoption, especially among populations with elevated risk of T2D. Patients often lack digital literacy skills and continuous connectivity and fear loss of the relationship with providers. Providers may experience structural disincentives to promoting patient use of HIT and apply hidden biases that inhibit portal use. Health care systems often provide inadequate training to patients and providers in use of HIT, and lack resources devoted to obtaining and optimizing use of data generated by HIT. Lastly, technology-related barriers include inadequate consideration of user perspectives, lack of evidence for patient-focused apps, and lack of features to enable providers and health care systems to readily obtain aggregate data to improve care and facilitate research. After discussing these barriers in detail, we propose possible solutions and areas where further research is needed to ensure that individuals and health care systems obtain the full benefit of the nation’s planned $38 billion HIT investment. A digital inclusion framework sheds new light on barriers posed for patients with social health inequalities. We have determined that partnerships with community organizations focused on digital inclusion could help health systems explore and study new approaches, such as universal screening and referral of patients for digital skills, health literacy, and Internet connectivity.

Usability of a Novel Mobile Health iPad App by Vulnerable Populations

BACKGROUND

Recent advances in mobile technologies have created new opportunities to reach broadly into populations that are vulnerable to health disparities. However, mobile health (mHealth) strategies could paradoxically increase health disparities, if low socioeconomic status individuals lack the technical or literacy skills needed to navigate mHealth programs.

OBJECTIVE

The aim of this study was to determine whether patients from vulnerable populations could successfully navigate and complete an mHealth patient decision aid.

METHODS

We analyzed usability data from a randomized controlled trial of an iPad program designed to promote colorectal cancer (CRC) screening. The trial was conducted in six primary care practices and enrolled 450 patients, aged 50-74 years, who were due for CRC screening. The iPad program included a self-survey and randomly displayed either a screening decision aid or a video about diet and exercise. We measured participant ability to complete the program without assistance and participant-rated program usability.

RESULTS

Two-thirds of the participants (305/450) were members of a vulnerable population (limited health literacy, annual income < US $20,000, or black race). Over 92% (417/450) of the participants rated the program highly on all three usability items (90.8% for vulnerable participants vs 96.6% for nonvulnerable participants, P=.006). Only 6.9% (31/450) of the participants needed some assistance to complete the program. In multivariable logistic regression, being a member of a vulnerable population was not associated with needing assistance. Only older age, less use of text messaging (short message service, SMS), and lack of Internet use predicted needing assistance.

CONCLUSIONS

Individuals who are vulnerable to health disparities can successfully use well-designed mHealth programs. Future research should investigate whether mHealth interventions can reduce health disparities.

Translating self-persuasion into an adolescent HPV vaccine promotion intervention for parents attending safety-net clinics

OBJECTIVE

Self-persuasion is an effective behavior change strategy, but has not been translated for low-income, less educated, uninsured populations attending safety-net clinics or to promote human papillomavirus (HPV) vaccination. We developed a tablet-based application (in English and Spanish) to elicit parental self-persuasion for adolescent HPV vaccination and evaluated its feasibility in a safety-net population.

METHODS

Parents (N=45) of age-eligible adolescents used the self-persuasion application. Then, during cognitive interviews, staff gathered quantitative and qualitative feedback on the self-persuasion tasks including parental decision stage.

RESULTS

The self-persuasion tasks were rated as easy to complete and helpful. We identified six question prompts rated as uniformly helpful, not difficult to answer, and generated non-redundant responses from participants. Among the 33 parents with unvaccinated adolescents, 27 (81.8%) reported deciding to get their adolescent vaccinated after completing the self-persuasion tasks.

CONCLUSIONS

The self-persuasion application was feasible and resulted in a change in parents' decision stage. Future studies can now test the efficacy of the tablet-based application on HPV vaccination.

PRACTICE IMPLICATIONS

The self-persuasion application facilitates verbalization of reasons for HPV vaccination in low literacy, safety-net settings. This self-administered application has the potential to be more easily incorporated into clinical practice than other patient education approaches.

Information and communication technology use by female residents of public housing

BACKGROUND

Evidence suggests that Internet, mobile, or social media based-interventions may promote obesity-lowering behavior change, which has implications for cancer prevention and control interventions. However, the uptake of communication technologies among low socioeconomic status individuals, who need obesity management strategies most, is unclear.

METHODS

Using the baseline data from a cluster-randomized behavioral intervention trial, we examined the cross-sectional associations of frequency of information and communication technologies (ICT) use among female public housing residents, as well as the variation of ICT use across demographic and health-related variables.

RESULTS

ICT use was common among female public housing residents, with mobile use for calls and texts most prevalent (97% and 84%, respectively). Internet, social media, and health information users tended to be younger compared to non-users. Email, Internet, multimodal, and health information users were more likely to be born in the U.S. and be more highly educated than non-users. Social media and health information users were more likely to be Spanish speakers and people of Hispanic ethnicity compared to non-users, although this was not statistically significant. There were few differences according to obesity or physical activity level.

CONCLUSIONS

Our findings of differential socio-demographics between users vs. non-users suggests that future cancer prevention and control interventions among public housing residents should consider selecting ICT that are aligned with the usage patterns of different groups making up the intended audience.