Diagnostic Performance of a Smartphone-Based Photoplethysmographic Application for Atrial Fibrillation Screening in a Primary Care Setting

Background

Diagnosing atrial fibrillation (AF) before ischemic stroke occurs is a priority for stroke prevention in AF. Smartphone camera–based photoplethysmographic (PPG) pulse waveform measurement discriminates between different heart rhythms, but its ability to diagnose AF in real‐world situations has not been adequately investigated. We sought to assess the diagnostic performance of a standalone smartphone PPG application, Cardiio Rhythm, for AF screening in primary care setting.

Methods and Results

Patients with hypertension, with diabetes mellitus, and/or aged ≥65 years were recruited. A single‐lead ECG was recorded by using the AliveCor heart monitor with tracings reviewed subsequently by 2 cardiologists to provide the reference standard. PPG measurements were performed by using the Cardiio Rhythm smartphone application. AF was diagnosed in 28 (2.76%) of 1013 participants. The diagnostic sensitivity of the Cardiio Rhythm for AF detection was 92.9% (95% CI] 77–99%) and was higher than that of the AliveCor automated algorithm (71.4% [95% CI 51–87%]). The specificities of Cardiio Rhythm and the AliveCor automated algorithm were comparable (97.7% [95% CI: 97–99%] versus 99.4% [95% CI 99–100%]). The positive predictive value of the Cardiio Rhythm was lower than that of the AliveCor automated algorithm (53.1% [95% CI 38–67%] versus 76.9% [95% CI 56–91%]); both had a very high negative predictive value (99.8% [95% CI 99–100%] versus 99.2% [95% CI 98–100%]).

Conclusions

The Cardiio Rhythm smartphone PPG application provides an accurate and reliable means to detect AF in patients at risk of developing AF and has the potential to enable population‐based screening for AF.

The Continued Use of Mobile Health Apps: Insights From a Longitudinal Study

BACKGROUND

Mobile health (mHealth) apps that support individuals pursuing health and wellness goals, such as weight management, stress management, smoking cessation, and self-management of chronic conditions have been on the rise. Despite their potential benefits, the use of these tools has been limited, as most users stop using them just after a few times of use. Under this circumstance, achieving the positive outcomes of mHealth apps is less likely.

OBJECTIVE

The objective of this study was to understand continued use of mHealth apps and individuals' decisions related to this behavior.

METHODS

We conducted a qualitative longitudinal study on continued use of mHealth apps. We collected data through 34 pre- and postuse interviews and 193 diaries from 17 participants over two weeks.

RESULTS

We identified 2 dimensions that help explain continued use decisions of users of mHealth apps: users' assessment of mHealth app and its capabilities (user experience) and their persistence at their health goals (intent). We present the key factors that influence users' assessment of an mHealth app (interface design, navigation, notifications, data collection methods and tools, goal management, depth of knowledge, system rules, actionable recommendations, and user system fit) and relate these factors to previous literature on behavior change technology design. Using these 2 dimensions, we developed a framework that illustrated 4 decisions users might make after initial interaction with mHealth apps (to abandon use, limit use, switch app, and continue use). We put forth propositions to be explored in future research on mHealth app use.

CONCLUSIONS

This study provides insight into the factors that shape users' decisions to continue using mHealth apps, as well as other likely decision scenarios after the initial use experience. The findings contribute to extant knowledge of mHealth use and provide important implications for design of mHealth apps to increase long-term engagement of the users.

Mobile App-Based Health Promotion Programs: A Systematic Review of the Literature

This study investigated the features and usefulness of mobile app-based health promotion programs for the general population. A comprehensive bibliographic search of studies on health promotion programs using mobile apps in peer-reviewed journals published in English up to November 2017 was performed using the PubMed, Embase, and CINAHL databases. The inclusion criteria were (1) randomized control trial designs; (2) assessed mobile app-based interventions to promote adult health conditions; 12 studies were ultimately included. The most common topics were diet and physical activity (n = 8) and overall healthy lifestyle improvement (n = 4). The purpose of the apps included providing feedback on one’s health status (n = 9) and monitoring individual health status or behavior change (n = 9). Across all studies, health outcomes were shown to be better for mobile app users compared to non-users. Mobile app-based health interventions may be an effective strategy for improving health promotion behaviors in the general population without diseases. This study suggests that mobile app use is becoming commonplace for a variety of health-promoting behaviors in addition to physical activity and weight control. Future research should address the feasibility and effectiveness of using mobile apps for health promotion in developing countries.

mHealth in the Wild: Using Novel Data to Examine the Reach, Use, and Impact of PTSD Coach

BACKGROUND

A majority of Americans (58%) now use smartphones, making it possible for mobile mental health apps to reach large numbers of those who are living with untreated, or under-treated, mental health symptoms. Although early trials suggest positive effects for mobile health (mHealth) interventions, little is known about the potential public health impact of mobile mental health apps.

OBJECTIVE

The purpose of this study was to characterize reach, use, and impact of "PTSD Coach", a free, broadly disseminated mental health app for managing posttraumatic stress disorder (PTSD) symptoms.

METHODS

Using a mixed-methods approach, aggregate mobile analytics data from 153,834 downloads of PTSD Coach were analyzed in conjunction with 156 user reviews.

RESULTS

Over 60% of users engaged with PTSD Coach on multiple occasions (mean=6.3 sessions). User reviews reflected gratitude for the availability of the app and being able to use the app specifically during moments of need. PTSD Coach users reported relatively high levels of trauma symptoms (mean PTSD Checklist Score=57.2, SD=15.7). For users who chose to use a symptom management tool, distress declined significantly for both first-time users (mean=1.6 points, SD=2.6 on the 10-point distress thermometer) and return-visit users (mean=2.0, SD=2.3). Analysis of app session data identified common points of attrition, with only 80% of first-time users reaching the app's home screen and 37% accessing one of the app's primary content areas.

CONCLUSIONS

These findings suggest that PTSD Coach has achieved substantial and sustained reach in the population, is being used as intended, and has been favorably received. PTSD Coach is a unique platform for the delivery of mobile mental health education and treatment, and continuing evaluation and improvement of the app could further strengthen its public health impact.

Effectiveness of Mobile Health Interventions on Diabetes and Obesity Treatment and Management: Systematic Review of Systematic Reviews

BACKGROUND

Diabetes and obesity have become epidemics and costly chronic diseases. The impact of mobile health (mHealth) interventions on diabetes and obesity management is promising; however, studies showed varied results in the efficacy of mHealth interventions.

OBJECTIVE

This review aimed to evaluate the effectiveness of mHealth interventions for diabetes and obesity treatment and management on the basis of evidence reported in reviews and meta-analyses and to provide recommendations for future interventions and research.

METHODS

We systematically searched the PubMed, IEEE Xplore Digital Library, and Cochrane databases for systematic reviews published between January 1, 2005, and October 1, 2019. We analyzed 17 reviews, which assessed 55,604 original intervention studies, that met the inclusion criteria. Of those, 6 reviews were included in our meta-analysis.

RESULTS

The reviews primarily focused on the use of mobile apps and text messaging and the self-monitoring and management function of mHealth programs in patients with diabetes and obesity. All reviews examined changes in biomarkers, and some reviews assessed treatment adherence (n=7) and health behaviors (n=9). Although the effectiveness of mHealth interventions varied widely by study, all reviews concluded that mHealth was a feasible option and had the potential for improving patient health when compared with standard care, especially for glycemic control (-0.3% to -0.5% greater reduction in hemoglobin A1c) and weight reduction (-1.0 kg to -2.4 kg body weight). Overall, the existing 6 meta-analysis studies showed pooled favorable effects of these mHealth interventions (-0.79, 95% CI -1.17 to -0.42; I2=90.5).

CONCLUSIONS

mHealth interventions are promising, but there is limited evidence about their effectiveness in glycemic control and weight reduction. Future research to develop evidence-based mHealth strategies should use valid measures and rigorous study designs. To enhance the effectiveness of mHealth interventions, future studies are warranted for the optimal formats and the frequency of contacting patients, better tailoring of messages, and enhancing usability, which places a greater emphasis on maintaining effectiveness over time.

Measuring the Quality of Mobile Apps for the Management of Pain: Systematic Search and Evaluation Using the Mobile App Rating Scale

Background

Chronic pain is a major health issue requiring an approach that not only considers medication, but also many other factors included in the biopsychosocial model of pain. New technologies, such as mobile apps, are tools to address these factors, although in many cases they lack proven quality or are not based on scientific evidence, so it is necessary to review and measure their quality.

Objective

The aim is to evaluate and measure the quality of mobile apps for the management of pain using the Mobile App Rating Scale (MARS).

Methods

This study included 18 pain-related mobile apps from the App Store and Play Store. The MARS was administered to measure their quality. We list the scores (of each section and the final score) of every app and we report the mean score (and standard deviation) for an overall vision of the quality of the pain-related apps. We compare the section scores between the groups defined according to the tertiles via analysis of variance (ANOVA) or Kruskal-Wallis test, depending on the normality of the distribution (Shapiro-Wilk test).

Results

The global quality ranged from 1.74 (worst app) to 4.35 (best app). Overall, the 18 apps obtained a mean score of 3.17 (SD 0.75). The best-rated sections were functionality (mean 3.92, SD 0.72), esthetics (mean 3.29, SD 1.05), and engagement (mean 2.87, SD 1.14), whereas the worst rated were app specific (mean 2.48, SD 1.00), information (mean 2.52, SD 0.82), and app subjective quality (mean 2.68, SD 1.22). The main differences between tertiles were found on app subjective quality, engagement, esthetics, and app specific.

Conclusions

Current pain-related apps are of a certain quality mainly regarding their technical aspects, although they fail to offer information and have an impact on the user. Most apps are not based on scientific evidence, have not been rigorously tested, and the confidentiality of the information collected is not guaranteed. Future apps would need to improve these aspects and exploit the capabilities of current devices.

Factors related to sustained use of a free mobile app for dietary self-monitoring with photography and peer feedback: retrospective cohort study

BACKGROUND

Healthy eating interventions that use behavior change techniques such as self-monitoring and feedback have been associated with stronger effects. Mobile apps can make dietary self-monitoring easy with photography and potentially reach huge populations.

OBJECTIVE

The aim of the study was to assess the factors related to sustained use of a free mobile app ("The Eatery") that promotes healthy eating through photographic dietary self-monitoring and peer feedback.

METHODS

A retrospective analysis was conducted on the sample of 189,770 people who had downloaded the app and used it at least once between October 2011 and April 2012. Adherence was defined based on frequency and duration of self-monitoring. People who had taken more than one picture were classified as "Users" and people with one or no pictures as "Dropouts". Users who had taken at least 10 pictures and used the app for at least one week were classified as "Actives", Users with 2-9 pictures as "Semi-actives", and Dropouts with one picture as "Non-actives". The associations between adherence, registration time, dietary preferences, and peer feedback were examined. Changes in healthiness ratings over time were analyzed among Actives.

RESULTS

Overall adherence was low-only 2.58% (4895/189,770) used the app actively. The day of week and time of day the app was initially used was associated with adherence, where 20.28% (5237/25,820) of Users had started using the app during the daytime on weekdays, in comparison to 15.34% (24,718/161,113) of Dropouts. Users with strict diets were more likely to be Active (14.31%, 900/6291) than those who had not defined any diet (3.99%, 742/18,590), said they ate everything (9.47%, 3040/32,090), or reported some other diet (11.85%, 213/1798) (χ(2) 3=826.6, P<.001). The average healthiness rating from peers for the first picture was higher for Active users (0.55) than for Semi-actives (0.52) or Non-actives (0.49) (F2,58167=225.9, P<.001). Actives wrote more often a textual description for the first picture than Semi-actives or Non-actives (χ(2) 2=3515.1, P<.001). Feedback beyond ratings was relatively infrequent: 3.83% (15,247/398,228) of pictures received comments and 15.39% (61,299/398,228) received "likes" from other users. Actives were more likely to have at least one comment or one "like" for their pictures than Semi-actives or Non-actives (χ(2) 2=343.6, P<.001, and χ(2) 2=909.6, P<.001, respectively). Only 9.89% (481/4863) of Active users had a positive trend in their average healthiness ratings.

CONCLUSIONS

Most people who tried out this free mobile app for dietary self-monitoring did not continue using it actively and those who did may already have been healthy eaters. Hence, the societal impact of such apps may remain small if they fail to reach those who would be most in need of dietary changes. Incorporating additional self-regulation techniques such as goal-setting and intention formation into the app could potentially increase user engagement and promote sustained use.

Comparing Self-Monitoring Strategies for Weight Loss in a Smartphone App: Randomized Controlled Trial

BACKGROUND

Self-monitoring of dietary intake is a valuable component of behavioral weight loss treatment; however, it declines quickly, thereby resulting in suboptimal treatment outcomes.

OBJECTIVE

This study aimed to examine a novel behavioral weight loss intervention that aims to attenuate the decline in dietary self-monitoring engagement.

METHODS

GoalTracker was an automated randomized controlled trial. Participants were adults with overweight or obesity (n=105; aged 21-65 years; body mass index, BMI, 25-45 kg/m²) and were randomized to a 12-week stand-alone weight loss intervention using the MyFitnessPal smartphone app for daily self-monitoring of either (1) both weight and diet, with weekly lessons, action plans, and feedback (Simultaneous); (2) weight through week 4, then added diet, with the same behavioral components (Sequential); or (3) only diet (App-Only). All groups received a goal to lose 5% of initial weight by 12 weeks, a tailored calorie goal, and automated in-app reminders. Participants were recruited via online and offline methods. Weight was collected in-person at baseline, 1 month, and 3 months using calibrated scales and via self-report at 6 months. We retrieved objective self-monitoring engagement data from MyFitnessPal using an application programming interface. Engagement was defined as the number of days per week in which tracking occurred, with diet entries counted if ≥800 kcal per day. Other assessment data were collected in-person via online self-report questionnaires.

RESULTS

At baseline, participants (84/100 female) had a mean age (SD) of 42.7 (11.7) years and a BMI of 31.9 (SD 4.5) kg/m². One-third (33/100) were from racial or ethnic minority groups. During the trial, 5 participants became ineligible. Of the remaining 100 participants, 84% (84/100) and 76% (76/100) completed the 1-month and 3-month visits, respectively. In intent-to-treat analyses, there was no difference in weight change at 3 months between the Sequential arm (mean -2.7 kg, 95% CI -3.9 to -1.5) and either the App-Only arm (-2.4 kg, -3.7 to -1.2; P=.78) or the Simultaneous arm (-2.8 kg, -4.0 to -1.5; P=.72). The median number of days of self-monitoring diet per week was 1.9 (interquartile range [IQR] 0.3-5.5) in Sequential (once began), 5.3 (IQR 1.8-6.7) in Simultaneous, and 2.9 (IQR 1.2-5.2) in App-Only. Weight was tracked 4.8 (IQR 1.9-6.3) days per week in Sequential and 5.1 (IQR 1.8-6.3) days per week in Simultaneous. Engagement in neither diet nor weight tracking differed between arms.

CONCLUSIONS

Regardless of the order in which diet is tracked, using tailored goals and a commercial mobile app can produce clinically significant weight loss. Stand-alone digital health treatments may be a viable option for those looking for a lower intensity approach.

TRIAL REGISTRATION

ClinicalTrials.gov NCT03254953; https://clinicaltrials.gov/ct2/show/NCT03254953 (Archived by WebCite at http://www.webcitation.org/72PyQrFjn).

Feasibility of PRIME: A Cognitive Neuroscience-Informed Mobile App Intervention to Enhance Motivated Behavior and Improve Quality of Life in Recent Onset Schizophrenia

Background

Despite improvements in treating psychosis, schizophrenia remains a chronic and debilitating disorder that affects approximately 1% of the US population and costs society more than depression, dementia, and other medical illnesses across most of the lifespan. Improving functioning early in the course of illness could have significant implications for long-term outcome of individuals with schizophrenia. Yet, current gold-standard treatments do not lead to clinically meaningful improvements in outcome, partly due to the inherent challenges of treating a population with significant cognitive and motivational impairments. The rise of technology presents an opportunity to develop novel treatments that may circumvent the motivational and cognitive challenges observed in schizophrenia.

Objective

The purpose of this study was two-fold: (1) to evaluate the feasibility and acceptability of implementing a Personalized Real-Time Intervention for Motivation Enhancement (PRIME), a mobile app intervention designed to target reward-processing impairments, enhance motivation, and thereby improve quality of life in recent onset schizophrenia, and (2) evaluate the empirical benefits of using an iterative, user-centered design (UCD) process.

Methods

We conducted two design workshops with 15 key stakeholders, followed by a series of in-depth interviews in collaboration with IDEO, a design and innovation firm. The UCD approach ultimately resulted in the first iteration of PRIME, which was evaluated by 10 RO participants. Results from the Stage 1 participants were then used to guide the next iteration that is currently being evaluated in an ongoing RCT. Participants in both phases were encouraged to use the app daily with a minimum frequency of 1/week over a 12-week period.

Results

The UCD process resulted in the following feature set: (1) delivery of text message (short message service, SMS)-based motivational coaching from trained therapists, (2) individualized goal setting in prognostically important psychosocial domains, (3) social networking via direct peer-to-peer messaging, and (4) community “moments feed” to capture and reinforce rewarding experiences and goal achievements. Users preferred an experience that highlighted several of the principles of self-determination theory, including the desire for more control of their future (autonomy and competence) and an approach that helps them improve existing relationships (relatedness). IDEO, also recommended an approach that was casual, friendly, and nonstigmatizing, which is in line with the recovery model of psychosis. After 12-weeks of using PRIME, participants used the app, on average, every other day, were actively engaged with its various features each time they logged in and retention and satisfaction was high (20/20, 100% retention, high satisfaction ratings). The iterative design process lead to a 2- to 3-fold increase in engagement from Stage 1 to Stage 2 in almost each aspect of the platform.

Conclusions

These results indicate that the neuroscience-informed mobile app, PRIME, is a feasible and acceptable intervention for young people with schizophrenia.

The German Version of the Mobile App Rating Scale (MARS-G): Development and Validation Study

BACKGROUND

The number of mobile health apps (MHAs), which are developed to promote healthy behaviors, prevent disease onset, manage and cure diseases, or assist with rehabilitation measures, has exploded. App store star ratings and descriptions usually provide insufficient or even false information about app quality, although they are popular among end users. A rigorous systematic approach to establish and evaluate the quality of MHAs is urgently needed. The Mobile App Rating Scale (MARS) is an assessment tool that facilitates the objective and systematic evaluation of the quality of MHAs. However, a German MARS is currently not available.

OBJECTIVE

The aim of this study was to translate and validate a German version of the MARS (MARS-G).

METHODS

The original 19-item MARS was forward and backward translated twice, and the MARS-G was created. App description items were extended, and 104 MHAs were rated twice by eight independent bilingual researchers, using the MARS-G and MARS. The internal consistency, validity, and reliability of both scales were assessed. Mokken scale analysis was used to investigate the scalability of the overall scores.

RESULTS

The retranslated scale showed excellent alignment with the original MARS. Additionally, the properties of the MARS-G were comparable to those of the original MARS. The internal consistency was good for all subscales (ie, omega ranged from 0.72 to 0.91). The correlation coefficients (r) between the dimensions of the MARS-G and MARS ranged from 0.93 to 0.98. The scalability of the MARS (H=0.50) and MARS-G (H=0.48) were good.

CONCLUSIONS

The MARS-G is a reliable and valid tool for experts and stakeholders to assess the quality of health apps in German-speaking populations. The overall score is a reliable quality indicator. However, further studies are needed to assess the factorial structure of the MARS and MARS-G.

Effectiveness of Mobile App-Assisted Self-Care Interventions for Improving Patient Outcomes in Type 2 Diabetes and/or Hypertension: Systematic Review and Meta-Analysis of Randomized Controlled Trials

Background

Mobile app-assisted self-care interventions are emerging promising tools to support self-care of patients with chronic diseases such as type 2 diabetes and hypertension. The effectiveness of such interventions requires further exploration for more supporting evidence.

Objective

A systematic review and meta-analysis of randomized controlled trials (RCTs) were conducted to examine the effectiveness of mobile app-assisted self-care interventions developed for type 2 diabetes and/or hypertension in improving patient outcomes.

Methods

We followed the Cochrane Collaboration guidelines and searched MEDLINE, Cochrane Library, EMBASE, and CINAHL Plus for relevant studies published between January 2007 and January 2019. Primary outcomes included changes in hemoglobin A_1c (HbA_1c) levels, systolic blood pressure (SBP), and diastolic blood pressure (DBP). Changes in other clinical-, behavioral-, knowledge-, and psychosocial-related outcomes were included as secondary outcomes. Primary outcomes and objective secondary outcomes that were reported in at least two trials were meta-analyzed; otherwise, a narrative synthesis was used for data analysis.

Results

A total of 27 trials were identified and analyzed. For primary outcomes, the use of mobile app-assisted self-care interventions was associated with significant reductions in HbA_1c levels (standardized mean difference [SMD] −0.44, 95% CI −0.59 to −0.29; P<.001), SBP (SMD −0.17, 95% CI −0.31 to −0.03, P=.02), and DBP (SMD −0.17, 95% CI −0.30 to −0.03, P=.02). Subgroup analyses for primary outcomes showed that several intervention features were supportive of self-management, including blood glucose, blood pressure, and medication monitoring, communication with health care providers, automated feedback, personalized goal setting, reminders, education materials, and data visualization. In addition, 8 objective secondary outcomes were meta-analyzed, which showed that the interventions had significant lowering effects on fasting blood glucose levels and waist circumference. A total of 42 secondary outcomes were narratively synthesized, and mixed results were found.

Conclusions

Mobile app-assisted self-care interventions can be effective tools for managing blood glucose and blood pressure, likely because their use facilitates remote management of health issues and data, provision of personalized self-care recommendations, patient–care provider communication, and decision making. More studies are required to further determine which combinations of intervention features are most effective in improving the control of the diseases. Moreover, evidence regarding the effects of these interventions on the behavioral, knowledge, and psychosocial outcomes of patients is still scarce, which warrants further examination.

A Mobile App to Stabilize Daily Functional Activity of Breast Cancer Patients in Collaboration With the Physician: A Randomized Controlled Clinical Trial

Background

The well-being of breast cancer patients and reporting of adverse events require close monitoring. Mobile apps allow continuous recording of disease- and medication-related symptoms in patients undergoing chemotherapy.

Objective

The aim of the study was to evaluate the effects of a mobile app on patient-reported daily functional activity in a supervised and unsupervised setting.

Methods

We conducted a randomized controlled study of 139 breast cancer patients undergoing chemotherapy. Patient status was self-measured using Eastern Cooperative Oncology Group scoring and Common Terminology Criteria for Adverse Events. Participants were randomly assigned to a control group, an unsupervised group that used a mobile app to record data, or a supervised group that used the app and reviewed data with a physician. Primary outcome variables were change in daily functional activity and symptoms over three outpatient visits.

Results

Functional activity scores declined in all groups from the first to second visit. However, from the second to third visit, only the supervised group improved, whereas the others continued to decline. Overall, the supervised group showed no significant difference from the first (median 90.85, IQR 30.67) to third visit (median 84.76, IQR 18.29, P=.72). Both app-using groups reported more distinct adverse events in the app than in the questionnaire (supervised: n=1033 vs n=656; unsupervised: n=852 vs n=823), although the unsupervised group reported more symptoms overall (n=4808) in the app than the supervised group (n=4463).

Conclusions

The mobile app was associated with stabilized daily functional activity when used under collaborative review. App-using participants could more frequently report adverse events, and those under supervision made fewer and more precise entries than unsupervised participants. Our findings suggest that patient well-being and awareness of chemotherapy adverse effects can be improved by using a mobile app in collaboration with the treating physician.

ClinicalTrial

ClinicalTrials.gov NCT02004496; https://clinicaltrials.gov/ct2/show/NCT02004496 (Archived by WebCite at http://www.webcitation.org/6k68FZHo2)

Mobile Apps to Support the Self-Management of Hypertension: Systematic Review of Effectiveness, Usability, and User Satisfaction

Background

Hypertension is a chronic disease that is considered to be a public health problem and requires efforts by patients to manage themselves. The global growth in the use of mobile phones and tablets has been accompanied by the increased use of health apps. Many of these apps support the self-management of hypertension and, therefore, they have the potential benefits of lowering blood pressure. Despite this, there is currently a lack of evidence for their effectiveness, usability, and patient satisfaction with their use.

Objective

A systematic review was conducted to assess the effectiveness of apps in lowering blood pressure, as well as their usability and patients’ satisfaction with their use.

Methods

We conducted searches in the following databases: MEDLINE (OVID), EMBASE (OVID), PsycINFO (OVID), CINAHL, the Cochrane Central Register of Controlled Trials (CENTRAL, The Cochrane Library), IEEE Xplore ASSIAN, Google Scholar and the main Arabic databases Al Manhal, AskZad, and Mandumah. We looked for studies that used apps in the self-management of hypertension from 2008-2016. We also checked the reference lists of the review papers and all the primary studies for additional references.

Results

A total of 21 studies with a total of 3112 participants were included in the review. Of the 14 studies that assessed the effectiveness of the apps in lowering blood pressure, 10 (71.4%) studies (6 RCTs and 4 nonrandomized studies) reported that using the apps led to significant decreases in blood pressure and seemed to be effective in the self-management of hypertension. Of these 10, only 2 (20%) RCTs and 3 (30%) nonrandomized studies had a low–moderate risk of bias. The results of this review are inconclusive regarding which combinations of functionalities would be most effective in lowering blood pressure because of variation in the studies’ quality, but the data suggest that apps incorporating more comprehensive functionalities are likely to be more effective. In all the studies that assessed the usability of the apps and users’ acceptance of them, all the apps seemed to be accepted and easy to use.

Conclusions

Most of the studies reported that apps might be effective in lowering blood pressure and are accepted by users. However, these findings should be interpreted with caution, as most of the studies had a high risk of bias. More well-designed, large-scale studies are required to evaluate the real effect of using apps in lowering blood pressure and to identify the most effective functionality combinations for lowering blood pressure.

Testing the Feasibility of Remote Patient Monitoring in Prenatal Care Using a Mobile App and Connected Devices: A Prospective Observational Trial

Background

Excessive weight gain and elevated blood pressure are significant risk factors for adverse pregnancy outcomes such as gestational diabetes, premature birth, and preeclampsia. More effective strategies to facilitate adherence to gestational weight gain goals and monitor blood pressure may have a positive health benefit for pregnant women and their babies. The impact of utilizing a remote patient monitoring system to monitor blood pressure and weight gain as a component of prenatal care has not been previously assessed.

Objective

The objective of this study is to determine the feasibility of monitoring patients remotely in prenatal care using a mobile phone app and connected digital devices.

Methods

In this prospective observational study, 8 women with low risk pregnancy in the first trimester were recruited at an urban academic medical center. Participants received a mobile phone app with a connected digital weight scale and blood pressure cuff for at-home data collection for the duration of pregnancy. At-home data was assessed for abnormal values of blood pressure or weight to generate clinical alerts to the patient and provider. As measures of the feasibility of the system, participants were studied for engagement with the app, accuracy of remote data, efficacy of alert system, and patient satisfaction.

Results

Patient engagement with the mobile app averaged 5.5 times per week over the 6-month study period. Weight data collection and blood pressure data collection averaged 1.5 times and 1.1 times per week, respectively. At-home measurements of weight and blood pressure were highly accurate compared to in-office measurements. Automatic clinical alerts identified two episodes of abnormal weight gain with no false triggers. Patients demonstrated high satisfaction with the system.

Conclusions

In this pilot study, we demonstrated that a system using a mobile phone app coupled to remote monitoring devices is feasible for prenatal care.

Mobile Breast Cancer e-Support Program for Chinese Women With Breast Cancer Undergoing Chemotherapy (Part 2): Multicenter Randomized Controlled Trial

Background

Women undergoing chemotherapy for the treatment of breast cancer have frequently reported unmet supportive care needs. Moreover, easily accessible and innovative support is lacking.

Objective

The purpose of this trial was to determine the effectiveness of an app-based breast cancer e-support program to address women’s self-efficacy (primary outcome), social support, symptom distress, quality of life, anxiety, and depression. Secondary objectives included exploring the association between women’s health outcomes and the breast cancer e-support usage data.

Methods

A multicenter, single-blinded, randomized controlled trial was conducted. A total of 114 women with breast cancer, who were commencing chemotherapy and were able to access internet through a mobile phone, were recruited in the clinics from 2 university-affiliated hospitals in China. Women were randomized either to the intervention group (n=57) receiving breast cancer e-support plus care as usual or the control group (n=57) receiving care as usual alone. The health care team and research assistants collecting data were blinded to the women’s group allocation. Bandura’s self-efficacy theory and the social exchange theory guided the development of the breast cancer e-support program, which has 4 components: (1) a Learning forum, (2) a Discussion forum, (3) an Ask-the-Expert forum, and (4) a Personal Stories forum. Moderated by an experienced health care professional, the breast cancer e-support program supported women for 12 weeks covering 4 cycles of chemotherapy. Health outcomes were self-assessed through paper questionnaires in clinics at baseline before randomization (T0), after 3 (T1), and 6 months (T2) of follow-ups.

Results

Fifty-five participants in the intervention group and 49 in the control group completed the follow-up assessments (response rate: 91.2%). During the 12-week intervention, the log-in frequency ranged from 0 to 774 times (mean 54.7; SD 131.4; median 11; interquartile range, IQR 5-27), and the total usage duration ranged from 0 to 9371 min (mean 1072.3; SD 2359.5; median 100; IQR 27-279). Repeated measures multivariate analysis of covariance (intention-to-treat) found that breast cancer e-support + care as usual participants had significant better health outcomes at 3 months regarding self-efficacy (21.05; 95% CI 1.87-40.22; P=.03; d=0.53), symptom interference (−0.73; 95% CI −1.35 to −.11; P=.02; d=−0.51), and quality of life (6.64; 95% CI 0.77-12.50; P=.03, d=0.46) but not regarding social support, symptom severity, anxiety, and depression compared with care as usual participants. These beneficial effects were not sustained at 6 months. Spearman rank-order correlation showed that the breast cancer e-support usage duration was positively correlated with self-efficacy (r=.290, P=.03), social support (r=.320, P=.02), and quality of life (r=.273, P=.04) at 3 months.

Conclusions

The breast cancer e-support program demonstrated its potential as an effective and easily accessible intervention to promote women’s self-efficacy, symptom interference, and quality of life during chemotherapy.

Trial Registration

Australian New Zealand Clinical Trials Registry (ANZCTR): ACTRN12616000639426; www.ANZCTR.org.au/ACTRN12616000639426.aspx (Archived by Webcite at http://www.webcitation.org/6v1n9hGZq)

Use of Smartphones for Early Detection of Melanoma: Systematic Review

Background

The early diagnosis of melanoma is associated with decreased mortality. The smartphone, with its apps and the possibility of sending photographs to a dermatologist, could improve the early diagnosis of melanoma.

Objective

The aim of our review was to report the evidence on (1) the diagnostic performance of automated smartphone apps and store-and-forward teledermatology via a smartphone in the early detection of melanoma, (2) the impact on the patient’s medical-care course, and (3) the feasibility criteria (focusing on the modalities of picture taking, transfer of data, and time to get a reply).

Methods

We conducted a systematic search of PubMed for the period from January 1, 2007 (launch of the first smartphone) to November 1, 2017.

Results

The results of the 25 studies included 13 concentrated on store-and-forward teledermatology, and 12 analyzed automated smartphone apps. Store-and-forward teledermatology opens several new perspectives, such as it accelerates the care course (less than 10 days vs 80 days), and the related procedures were assessed in primary care populations. However, the concordance between the conclusion of a teledermatologist and the conclusion of a dermatologist who conducts a face-to-face examination depended on the study (the kappa coefficient range was .20 to .84, median κ=.60). The use of a dermoscope may improve the concordance (the kappa coefficient range was .29 to .87, median κ=.74). Regarding automated smartphone apps, the major concerns are the lack of assessment in clinical practice conditions, the lack of assessment in primary care populations, and their low sensitivity, ranging from 7% to 87% (median 69%). In this literature review, up to 20% of the photographs transmitted were of insufficient quality. The modalities of picture taking and encryption of the data were only partially reported.

Conclusions

The use of store-and-forward teledermatology could improve access to a dermatology consultation by optimizing the care course. Our review confirmed the absence of evidence of the safety and efficacy of automated smartphone medical apps. Further research is required to determine quality criteria, as there was major variability among the studies.

Digital health technology and diabetes management

Diabetes care is largely dependent on patient self-management and empowerment, given that patients with diabetes must make numerous daily decisions as to what to eat, when to exercise, and determine their insulin dose and timing if required. In addition, patients and providers are generating vast amounts of data from many sources, including electronic medical records, insulin pumps, sensors, glucometers, and other wearables, as well as evolving genomic, proteomic, metabolomics, and microbiomic data. Multiple digital tools and apps have been developed to assist patients to choose wisely, and to enhance their compliance by using motivational tools and incorporating incentives from social media and gaming techniques. Healthcare teams (HCTs) and health administrators benefit from digital developments that sift through the enormous amounts of patient-generated data. Data are acquired, integrated, analyzed, and presented in a self-explanatory manner, highlighting important trends and items that require attention. The use of decision support systems may propose data-driven actions that, for the most, require final approval by the patient or physician before execution and, once implemented, may improve patient outcomes. The digital diabetes clinic aims to incorporate all digital patient data and provide individually tailored virtual or face-to-face visits to those persons who need them most. Digital diabetes care has demonstrated only modest HbA1c reduction in multiple studies and borderline cost-effectiveness, although patient satisfaction appears to be increased. Better understanding of the barriers to digital diabetes care and identification of unmet needs may yield improved utilization of this evolving technology in a safe, effective, and cost-saving manner.

Mobile Delivery of the Diabetes Prevention Program in People With Prediabetes: Randomized Controlled Trial

BACKGROUND

The Centers for Disease Control and Prevention (CDC) diabetes prevention program (DPP) has formed the foundation for Type 2 Diabetes Mellitus (T2DM) prevention efforts and lifestyle change modifications in multiple care settings. To our knowledge, no randomized controlled trial has verified the efficacy of a fully mobile version of CDC's diabetes prevention program (DPP).

OBJECTIVE

This study aimed to investigate the long-term weight loss and glycemic efficacy of a mobile-delivered DPP compared with a control group receiving usual medical care.

METHODS

Adults with prediabetes (N=202) were recruited from a clinic and randomized to either a mobile-delivered, coach-guided DPP (Noom) or a control group that received regular medical care including a paper-based DPP curriculum and no formal intervention. The intervention group learned how to use the Noom program, how to interact with their coach, and the importance of maintaining motivation. They had access to an interactive coach-to-participant interface and group messaging, daily challenges for behavior change, DPP-based education articles, food logging, and automated feedback. Primary outcomes included changes in weight and hemoglobin A_1c (HbA_1c) levels at 6 and 12 months, respectively. Exploratory secondary outcomes included program engagement as a predictor of changes in weight and HbA_1c levels.

RESULTS

A total of 202 participants were recruited and randomized into the intervention (n=101) or control group (n=99). In the intention-to-treat (ITT) analyses, changes in the participants' weight and BMI were significantly different at 6 months between the intervention and control groups, but there was no difference in HbA_1c levels (mean difference 0.004%, SE 0.05; P=.94). Weight and BMI were lower in the intervention group by -2.64 kg (SE 0.71; P<.001) and -0.99 kg/m2 (SE 0.29; P=.001), respectively. These differences persisted at 12 months. However, in the analyses that did not involve ITT, program completers achieved a significant weight loss of 5.6% (SE 0.81; P<.001) at 6 months, maintaining 4.7% (SE 0.88; P<.001) of their weight loss at 12 months. The control group lost -0.15% at 6 months (SE 0.64; P=.85) and gained 0.33% (SE 0.70; P=.63) at 12 months. Those randomized to the intervention group who did not start the program had no meaningful weight or HbA_1c level change, similar to the control group. At 1 year, the intervention group showed a 0.23% reduction in HbA_1c levels; those who completed the intervention showed a 0.28% reduction. Those assigned to the control group had a 0.16% reduction in HbA_1c levels.

CONCLUSIONS

This novel mobile-delivered DPP achieved significant weight loss reductions for up to 1 year compared with usual care. This type of intervention reduces the risk of overt diabetes without the added barriers of in-person interventions.

TRIAL REGISTRATION

ClinicalTrials.gov NCT03865342; https://clinicaltrials.gov/ct2/show/NCT03865342.

The App Behavior Change Scale: Creation of a Scale to Assess the Potential of Apps to Promote Behavior Change

BACKGROUND

Using mobile phone apps to promote behavior change is becoming increasingly common. However, there is no clear way to rate apps against their behavior change potential.

OBJECTIVE

This study aimed to develop a reliable, theory-based scale that can be used to assess the behavior change potential of smartphone apps.

METHODS

A systematic review of all studies purporting to investigate app's behavior change potential was conducted. All scales and measures from the identified studies were collected to create an item pool. From this item pool, 3 health promotion exerts created the App Behavior Change Scale (ABACUS). To test the scale, 70 physical activity apps were rated to provide information on reliability.

RESULTS

The systematic review returned 593 papers, the abstracts and titles of all were reviewed, with the full text of 77 papers reviewed; 50 papers met the inclusion criteria. From these 50 papers, 1333 questions were identified. Removing duplicates and unnecessary questions left 130 individual questions, which were then refined into the 21-item scale. The ABACUS demonstrates high percentage agreement among reviewers (over 80%), with 3 questions scoring a Krippendorff alpha that would indicate agreement and a further 7 came close with alphas >.5. The scale overall reported high interrater reliability (2-way mixed interclass coefficient=.92, 95% CI 0.81-0.97) and high internal consistency (Cronbach alpha=.93).

CONCLUSIONS

The ABACUS is a reliable tool that can be used to determine the behavior change potential of apps. This instrument fills a gap by allowing the evaluation of a large number of apps to be standardized across a range of health categories.

Using Intensive Longitudinal Data Collected via Mobile Phone to Detect Imminent Lapse in Smokers Undergoing a Scheduled Quit Attempt

Background

Mobile phone‒based real-time ecological momentary assessments (EMAs) have been used to record health risk behaviors, and antecedents to those behaviors, as they occur in near real time.

Objective

The objective of this study was to determine if intensive longitudinal data, collected via mobile phone, could be used to identify imminent risk for smoking lapse among socioeconomically disadvantaged smokers seeking smoking cessation treatment.

Methods

Participants were recruited into a randomized controlled smoking cessation trial at an urban safety-net hospital tobacco cessation clinic. All participants completed in-person EMAs on mobile phones provided by the study. The presence of six commonly cited lapse risk variables (ie, urge to smoke, stress, recent alcohol consumption, interaction with someone smoking, cessation motivation, and cigarette availability) collected during 2152 prompted or self-initiated postcessation EMAs was examined to determine whether the number of lapse risk factors was greater when lapse was imminent (ie, within 4 hours) than when lapse was not imminent. Various strategies were used to weight variables in efforts to improve the predictive utility of the lapse risk estimator.

Results

Participants (N=92) were mostly female (52/92, 57%), minority (65/92, 71%), 51.9 (SD 7.4) years old, and smoked 18.0 (SD 8.5) cigarettes per day. EMA data indicated significantly higher urges (P=.01), stress (P=.002), alcohol consumption (P<.001), interaction with someone smoking (P<.001), and lower cessation motivation (P=.03) within 4 hours of the first lapse compared with EMAs collected when lapse was not imminent. Further, the total number of lapse risk factors present within 4 hours of lapse (mean 2.43, SD 1.37) was significantly higher than the number of lapse risk factors present during periods when lapse was not imminent (mean 1.35, SD 1.04), P<.001. Overall, 62% (32/52) of all participants who lapsed completed at least one EMA wherein they reported ≥3 lapse risk factors within 4 hours of their first lapse. Differentially weighting lapse risk variables resulted in an improved risk estimator (weighted area=0.76 vs unweighted area=0.72, P<.004). Specifically, 80% (42/52) of all participants who lapsed had at least one EMA with a lapse risk score above the cut-off within 4 hours of their first lapse.

Conclusions

Real-time estimation of smoking lapse risk is feasible and may pave the way for development of mobile phone‒based smoking cessation treatments that automatically tailor treatment content in real time based on presence of specific lapse triggers. Interventions that identify risk for lapse and automatically deliver tailored messages or other treatment components in real time could offer effective, low cost, and highly disseminable treatments to individuals who do not have access to other more standard cessation treatments.

Mobile Apps for Blood Pressure Monitoring: Systematic Search in App Stores and Content Analysis

BACKGROUND

Using a mobile app for self-management could make it easier for patients to get insight into their blood pressure patterns. However, little is known about the availability, quality, and features of mobile apps targeting blood pressure.

OBJECTIVE

The goal of the research was to determine the availability, functionality, and quality of mobile apps that could be used for blood pressure monitoring purposes.

METHODS

A systematic app search was performed based on the standards for systematic reviews. We searched the Dutch official app stores for Android and iOS platforms using predefined keywords and included all English and Dutch mobile apps targeting blood pressure. Two independent assessors determined eligibility and quality of the apps using the 5-point Mobile App Rating Scale (MARS). Quality scores of the apps with and without 17 a priori selected characteristics were compared using independent sample t tests.

RESULTS

A total of 184 apps (104 Android, 80 iOS) met the inclusion criteria. The mean overall MARS score was 2.63 (95% CI 2.55-2.71) for Android and 2.64 (95% CI 2.56-2.71) for iOS. The apps Bloeddruk (4.1) and AMICOMED BP (3.6) had the highest quality scores on the Android and iOS platforms, respectively. Of the app characteristics recorded, only pricing, in-app advertisements, and local data storage were not associated with the quality scores. In only 3.8% (7/184) of the apps, involvement of medical experts in its development was mentioned, whereas none of the apps was formally evaluated with results published in a peer-reviewed journal.

CONCLUSIONS

This study provides an overview of the best apps currently available in the app stores and important key features for self-management that can be used by health care providers and patients with hypertension to identify a suitable app targeting blood pressure monitoring. However, the majority of the apps targeting blood pressure monitoring were of poor quality. Therefore, it is important to involve medical experts in the developmental stage of health-related mobile apps to improve the quality of these apps.

Effectiveness of Internet-Based Electronic Technology Interventions on Breastfeeding Outcomes: Systematic Review

BACKGROUND

Supporting women to initiate and continue breastfeeding is a global challenge. A range of breastfeeding interventions employing electronic technologies (e-technologies) are being developed, which offer different delivery modes and features over the internet; however, the impact of internet-based e-technologies on breastfeeding outcomes remains unclear.

OBJECTIVE

This study aimed to identify the characteristics of current internet-based breastfeeding interventions employing e-technologies and investigate the effects of internet-based e-technologies on breastfeeding outcomes.

METHODS

A systematic search was conducted in accordance with the Preferred Reporting Items for Systematic Reviews and Meta-Analyses guidelines in the following databases: Scopus, Web of Science, the Cochrane Database of Systematic Reviews, ScienceDirect, Google Scholar, the Association for Computing Machinery, SpringerLink, and Institute of Electrical and Electronics Engineers Xplore.

RESULTS

This systematic review included 16 studies published between 2007 and 2018, with 4018 women in 8 countries. The characteristics of the interventions were grouped based on (1) mode of delivery (web-based, mobile phone apps, and computer kiosk), (2) purpose of the interventions (education and support), and (3) key strategies (monitoring and breastfeeding tracking, personalization, online discussion forum, web-based consultation, and breastfeeding station locators). Combining educational activities with web-based personalized support through discussion forums appeared to be the most effective way to improve breastfeeding outcomes and long-term exclusive breastfeeding rates. Monitoring and breastfeeding trackers appeared to be the least effective ways.

CONCLUSIONS

This study demonstrated a variety of internet-based e-technologies that professionals can use to promote, educate, and support breastfeeding women. Future internet-based breastfeeding interventions employing e-technologies might consider improving interaction with mothers and personalizing the content of the proposed interventions.

Mobile and Web-Based Apps That Support Self-Management and Transition in Young People With Chronic Illness: Systematic Review

BACKGROUND

More adolescents with chronic physical illness are living into adulthood, and they require the development of proficient self-management skills to maintain optimal physical health as they transition into adult care services. It is often during this vulnerable transition period that deterioration in illness control is seen as a result of inadequate self-management skills and understanding of their chronic illness. Mobile technology has been proposed as an innovative opportunity to assist in improving the management of chronic conditions as young people transition to adult care services. Over the past 5 years, there has been a significant increase in research into the use of health-related apps.

OBJECTIVE

This study aimed to evaluate the utility and effectiveness of mobile and Web-based health apps that support self-management and transition in young people with chronic physical health illnesses.

METHODS

We conducted a comprehensive review of the literature in 5 bibliographic databases, using key search terms, considering only articles published from 2013, as we were extending the data from 2 previous systematic reviews. Abstracts were screened for possible inclusion by 2 reviewers. Data extraction and quality assessment tools were used for the evaluation of included studies.

RESULTS

A total of 1737 records were identified from the combined electronic searches, and 854 records were removed as duplicates. A total of 68 full articles were further assessed for eligibility, and 6 articles met our review criteria: 3 pilot studies, 2 randomized controlled trials, and 1 prospective cohort study. Publication years ranged from 2015 to 2018. The apps reported were targeted at type 1 diabetes mellitus, epilepsy, asthma, beta thalassemia major, and sickle cell disease, with a combined sample size of 336. A total of 4 studies included in this review reported being effective in increasing knowledge of the targeted condition and increasing therapy adherence, including increased medication adherence. A total of 2 manuscripts only mentioned the word transition. Participant's satisfaction was reported for all studies. Heterogeneity of the studies prevented meta-analysis.

CONCLUSIONS

There remain limited data on the effectiveness and use of mobile and Web-based apps, which might facilitate the transition of adolescents with chronic illnesses from pediatric to adult health care services. This systematic review provides an updated overview of available apps for adolescents with chronic illnesses. This systematic review has been unable to provide evidence for effectiveness of this approach, but it does provide insights into future study design, with reference to the development, evaluation, and efficacy of apps tailored for adolescents with chronic illnesses, including the involvement of adolescents in such designs.

TRIAL REGISTRATION

PROSPERO CRD42018104611; https://www.crd.york.ac.uk/prospero/display_record.php?RecordID=104611.

Use of Mobile Phone App Interventions to Promote Weight Loss: Meta-Analysis

Background

Obesity and lack of physical activity are major health risk factors for many life-threatening diseases, such as cardiovascular diseases, type 2 diabetes, and cancer. The use of mobile app interventions to promote weight loss and boost physical activity among children and adults is fascinating owing to the demand for cutting-edge and more efficient interventions. Previously published studies have examined different types of technology-based interventions and their impact on weight loss and increase in physical activity, but evidence regarding the impact of only a mobile phone app on weight loss and increase in physical activity is still lacking.

Objective

The main objective of this study was to assess the efficacy of a mobile phone app intervention for reducing body weight and increasing physical activity among children and adults.

Methods

PubMed, Google Scholar, Scopus, EMBASE, and the Web of Science electronic databases were searched for studies published between January 1, 2000, and April 30, 2019, without language restrictions. Two experts independently screened all the titles and abstracts to find the most appropriate studies. To be included, studies had to be either a randomized controlled trial or a case-control study that assessed a mobile phone app intervention with body weight loss and physical activity outcomes. The Cochrane Collaboration Risk of Bias tool was used to examine the risk of publication bias.

Results

A total of 12 studies involving a mobile phone app intervention were included in this meta-analysis. Compared with the control group, the use of a mobile phone app was associated with significant changes in body weight (−1.07 kg, 95% CI −1.92 to −0.21, P=.01) and body mass index (−0.45 kg/m2, 95% CI −0.78 to −0.12, P=.008). Moreover, a nonsignificant increase in physical activity was observed (0.17, 95% CI −2.21 to 2.55, P=.88).

Conclusions

The findings of this study demonstrate the promising and emerging efficacy of using mobile phone app interventions for weight loss. Future studies are needed to explore the long-term efficacy of mobile app interventions in larger samples.

Translation, Cross-Cultural Adaptation, and Validation of the Malay Version of the System Usability Scale Questionnaire for the Assessment of Mobile Apps

Background

A mobile app is a programmed system designed to be used by a target user on a mobile device. The usability of such a system refers not only to the extent to which product can be used to achieve the task that it was designed for, but also its effectiveness and efficiency, as well as user satisfaction. The System Usability Scale is one of the most commonly used questionnaires used to assess the usability of a system. The original 10-item version of System Usability Scale was developed in English and thus needs to be adapted into local languages to assess the usability of a mobile apps developed in other languages.

Objective

The aim of this study is to translate and validate (with cross-cultural adaptation) the English System Usability Scale questionnaire into Malay, the main language spoken in Malaysia. The development of a translated version will allow the usability of mobile apps to be assessed in Malay.

Methods

Forward and backward translation of the questionnaire was conducted by groups of Malay native speakers who spoke English as their second language. The final version was obtained after reconciliation and cross-cultural adaptation. The content of the Malay System Usability Scale questionnaire for mobile apps was validated by 10 experts in mobile app development. The efficacy of the questionnaire was further probed by testing the face validity on 10 mobile phone users, followed by reliability testing involving 54 mobile phone users.

Results

The content validity index was determined to be 0.91, indicating good relevancy of the 10 items used to assess the usability of a mobile app. Calculation of the face validity index resulted in a value of 0.94, therefore indicating that the questionnaire was easily understood by the users. Reliability testing showed a Cronbach alpha value of .85 (95% CI 0.79-0.91) indicating that the translated System Usability Scale questionnaire is a reliable tool for the assessment of usability of a mobile app.

Conclusions

The Malay System Usability Scale questionnaire is a valid and reliable tool to assess the usability of mobile app in Malaysia.