Measuring Success of Patients' Continuous Use of Mobile Health Services for Self-management of Chronic Conditions: Model Development and Validation

Impact of a Nationwide Medication History Sharing Program on the Care Process and End-User Experience in a Tertiary Teaching Hospital: Cohort Study and Cross-Sectional Study

Background

Timely and comprehensive collection of a patient's medication history in the emergency department (ED) is crucial for optimizing health care delivery. The implementation of a medication history sharing program, titled "Patient's In-home Medications at a Glance," in a tertiary teaching hospital aimed to efficiently collect and display nationwide medication histories for patients' initial hospital visits.

Objective

As an evaluation was necessary to provide a balanced picture of the program, we aimed to evaluate both care process outcomes and humanistic outcomes encompassing end-user experience of physicians and pharmacists.

Methods

We conducted a cohort study and a cross-sectional study to evaluate both outcomes. To evaluate the care process, we measured the time from the first ED assessment to urgent percutaneous coronary intervention (PCI) initiation from electronic health records. To assess end-user experience, we developed a 22-item questionnaire using a 5-point Likert scale, including 5 domains: information quality, system quality, service quality, user satisfaction, and intention to reuse. This questionnaire was validated and distributed to physicians and pharmacists. The Mann-Whiteny U test was used to analyze the PCI initiation time, and structural equation modeling was used to assess factors affecting end-user experience.

Results

The time from the first ED assessment to urgent PCI initiation at the ED was significantly decreased using the patient medication history program (mean rank 42.14 min vs 28.72 min; Mann-Whitney U=346; P=.03). A total of 112 physicians and pharmacists participated in the survey. Among the 5 domains, "intention to reuse" received the highest score (mean 4.77, SD 0.37), followed by "user satisfaction" (mean 4.56, SD 0.49), while "service quality" received the lowest score (mean 3.87, SD 0.79). "User satisfaction" was significantly associated with "information quality" and "intention to reuse."

Conclusions

Timely and complete retrieval using a medication history-sharing program led to an improved care process by expediting critical decision-making in the ED, thereby contributing to value-based health care delivery in a real-world setting. The experiences of end users, including physicians and pharmacists, indicated satisfaction with the program regarding information quality and their intention to reuse.

Mobile Apps for Common Noncommunicable Disease Management: Systematic Search in App Stores and Evaluation Using the Mobile App Rating Scale

Background

The success of mobile apps in improving the lifestyle of patients with noncommunicable diseases through self-management interventions is contingent upon the emerging growth in this field. While users of mobile health (mHealth) apps continue to grow in number, little is known about the quality of available apps that provide self-management for common noncommunicable diseases such as diabetes, hypertension, and obesity.

Objective

We aimed to investigate the availability, characteristics, and quality of mHealth apps for common noncommunicable disease health management that included dietary aspects (based on the developer's description), as well as their features for promoting health outcomes and self-monitoring.

Methods

A systematic search of English-language apps on the Google Play Store (Google LLC) and Apple App Store (Apple Inc) was conducted between August 7, 2022, and September 13, 2022. The search terms used included weight management, obesity, diabetes, hypertension, cardiovascular diseases, stroke, and diet. The selected mHealth apps' titles and content were screened based on the description that was provided. Apps that were not designed with self-management features were excluded. We analyzed the mHealth apps by category and whether they involved health care professionals, were based on scientific testing, and had self-monitoring features. A validated and multidimensional tool, the Mobile App Rating Scale (MARS), was used to evaluate each mHealth app's quality based on a 5-point Likert scale from 1 (inadequate) to 5 (excellent).

Results

Overall, 42 apps were identified. Diabetes-specific mHealth apps accounted for 7% (n=3) of the market, hypertension apps for 12% (n=5), and general noncommunicable disease management apps for 21% (n=9). About 38% (n=16) of the apps were for managing chronic diseases, while 74% (n=31) were for weight management. Self-management features such as weight tracking, BMI calculators, diet tracking, and fluid intake tracking were seen in 86% (n=36) of the apps. Most mHealth apps (n=37, 88%) did not indicate whether there was involvement of health professionals in app development. Additionally, none of the apps reported scientific evidence demonstrating their efficacy in managing health. The overall mean MARS score was 3.2 of 5, with a range of 2.0 to 4.1. Functionality was the best-rated category (mean score 3.9, SD 0.5), followed by aesthetics (mean score 3.2, SD 0.9), information (mean score 3.1, SD 0.7), and engagement (mean score 2.9, SD 0.6).

Conclusions

The quality of mHealth apps for managing chronic diseases was heterogeneous, with roughly half of them falling short of acceptable standards for both quality and content. The majority of apps contained scant information about scientific evidence and the developer's history. To increase user confidence and accomplish desired health outcomes, mHealth apps should be optimized with the help of health care professionals. Future studies on mHealth content analysis should focus on other diseases as well.

Efficacy of an mHealth App to Support Patients' Self-Management of Hypertension: Randomized Controlled Trial

BACKGROUND

Hypertension is a significant global disease burden. Mobile health (mHealth) offers a promising means to provide patients with hypertension with easy access to health care services. Yet, its efficacy needs to be validated, especially in lower-income areas with a high-salt diet.

OBJECTIVE

This study aims to assess the efficacy of an mHealth app-based intervention in supporting patients' self-management of hypertension.

METHODS

A 2-arm randomized controlled trial was conducted among 297 patients with hypertension at the General Hospital of Ningxia Medical University, Ningxia Hui Autonomous Region, China. Participants selected via convenience sampling were randomly allocated into intervention and control groups. Intervention group participants were trained and asked to use an mHealth app named Blood Pressure Assistant for 6 months. They could use the app to record and upload vital signs, access educational materials, and receive self-management reminders and feedback from health care providers based on the analysis of the uploaded data. Control group participants received usual care. Blood pressure (BP) and 2 questionnaire surveys about hypertension knowledge and lifestyle behavior were used to assess all participants at baseline and 6 months. Data analysis was performed with SPSS software using 2-tailed t tests and a chi-square test.

RESULTS

There were no significant differences in baseline characteristics and medication use between the 2 groups (all P>.05). After 6 months, although both groups show a significant pre-post improvement (P<.001 each), the BP control rate (ie, the proportion of patients with a systolic BP of <140 mm Hg and diastolic BP of <90 mm Hg) in the intervention group was better than that in the control group (100/111, 90.1% vs 75/115, 65.2%; P<.001). The mean systolic and diastolic BP were significantly reduced by 25.83 (SD 8.99) and 14.28 (SD 3.74) mm Hg in the intervention group (P<.001) and by 21.83 (SD 6.86) and 8.87 (SD 4.22) mm Hg in the control group (P<.001), respectively. The differences in systolic and diastolic BP between the 2 groups were significant (P<.001 and P=.01, respectively). Hypertension knowledge significantly improved only in the intervention group in both pre-post and intergroup comparisons (both P<.001). However, only intragroup improvement was observed for lifestyle behaviors in the intervention group (P<.001), including medication adherence (P<.001), healthy diet (P=.02), low salt intake (P<.001), and physical exercises (P=.02), and no significant difference was observed in the control group or on intergroup comparisons.

CONCLUSIONS

This research shows that the mHealth app-based intervention has the potential to improve patient health knowledge and support self-management among them toward a healthier lifestyle, including medication adherence, low-salt diets, and physical exercises, thereby achieving optimal BP control. Further research is still needed to verify the specific effects of these interventions.

TRIAL REGISTRATION

Chinese Clinical Trial Registry ChiCTR1900026437; https://www.chictr.org.cn/showproj.html?proj=38801.

Factors affecting the willingness of patients with type 2 diabetes to use digital disease management applications: a cross-sectional study

Background

The global burden of type 2 diabetes has significantly increased, leading to a considerable impact on healthcare systems worldwide. While the advent of mobile healthcare has provided some relief by addressing the shortage of certain medical resources, its adoption among the Chinese population remains relatively low. To extend the benefits of mHealth to a greater number of Chinese diabetic patients, it is essential to investigate the factors that influence their willingness to utilize it and implement targeted interventions based on these influencing factors. The Technology Acceptance Model (TAM) is widely employed to examine users' ultimate usage behaviors, and previous studies have indicated the potential relevance of the Perceived Risk (PR) theory and the eHealth Literacy Theory to users' usage behaviors.

Objective

Our objective was to investigate the determinants that affect the willingness of Chinese patients diagnosed with type 2 diabetes patients to utilize digital disease management applications (DDMAs).

Methods

We conducted a cross-sectional study of patients with type 2 diabetes in three tertiary general hospitals in Chengdu using questionnaires designed by the investigators. Participants were sampled using a convenience sampling method. The questionnaire comprised three sections: socio-demographic profile and medical history; current awareness and willingness to use digital disease management applications; and the current level of e-health literacy. Structural equation modeling was employed to assess the impact of patient awareness of DDMAs and e-health literacy on the willingness to use such DDMAs.

Results

(1) Patients' attitudes toward using DDMAs were significantly influenced by perceived ease of use (β = 0.380, P < 0.001) and perceived usefulness (β = 0.546, P < 0.001); (2) Electronic health literacy exerted a significant impact on patients' perceived usefulness (β = 0.115, P = 0.018) and perceived ease of use (β = 0.659, P < 0.001); (3) Patients' willingness to use was significantly influenced by perceived usefulness (β = 0.137, P < 0.001) and use attitude (β = 0.825, P < 0.001).

Conclusions

The present research findings hold both theoretical and practical significance, and can serve as a guide for healthcare practitioners and researchers to gain a deeper comprehension of the acceptance of digital disease management applications (DDMAs) among type 2 diabetes patients.

A WeChat applet-based national remote emergency system for malignant hyperthermia in China: a usability study

BACKGROUND

Malignant hyperthermia (MH) is a rare anesthetic emergency with a high mortality rate in China. We developed a WeChat applet-based National Remote Emergency System for Malignant Hyperthermia (MH-NRES) to provide a real-time emergency system to help Chinese anesthesiologists deal with MH crises. However, it is imperative that close attention should be paid to the usability of the applet.

PURPOSE

The objectives of this study were to (1) evaluate the usability of the applet-based MH-NRES for anesthesiologists; and (2) to test the validity and reliability of a modified mHealth app usability questionnaire.

METHODS

A modified User Version of the Mobile Application Rating Scale (uMARS) was designed. Together with System Usability Scale (SUS) and Post-Study System Usability Questionnaire (PSSUQ), another two well-validated questionnaires, uMARS were then used to evaluate the usability of MH-NRES. The Cronbach alpha of the total score and the subscales of uMARS was calculated to evaluate the internal consistency. The correlation coefficients among three questionnaires were calculated.

RESULTS

In this study, 118 anesthesiologists provided responses to the questionnaire. The overall mean uMARS score was 4.43 ± 0.61, which ranged from 3 to 5. The mean PSSUQ score were in good to excellent range with mean of 6.02 ± 0.97, which ranged from 3.19 to 7. The overall SUS score was 76.0 ± 17.6, which ranged from 45 to 100. The total uMARS score had excellent internal consistency (Cronbach alpha = 0.984). uMARS and its subscales were strongly correlated with PSSUQ (coefficient 0.758-0.819, P < 0.001) and SUS (coefficient 0.535-0.561, P < 0.001), respectively.

CONCLUSIONS

Data obtained from the usability evaluation questionnaires in this study indicated a high quality of the MH-NRES on the ease of use, satisfaction and perceived usefulness, which suggest this system might be a useful tool for anesthesiologists' education and management of MH crises. Future feedback from high-fidelity simulation and clinical scenarios are need for further usability evaluation of this system.

Continuous usage intention of mobile health services: model construction and validation

BACKGROUND

Mobile health (mHealth) services can not give full play to their value if only it is used in the short term, and their continuous usage can achieve better effects in health management. This study aims to explore the factors that affect continuous usage intentions of mHealth services and their mechanism of action.

METHODS

First, considering the uniqueness of health services and social environmental factors, this study constructed an extended Expectation Confirmation Model of Information System Continuance (ECM-ISC) to investigate factors that may influence the intention of continuous usage of mHealth services based on three dimensions, namely individual characteristics, technology and environment. Second, the survey method was used to validate the research model. The questionnaire items were derived from validated instruments and discussed by experts and data were collected both online and offline. The structural equation model was used for data analysis.

RESULTS

There were 334 avidity questionnaires through cross-sectional data and these participants had used mHealth services ever. The reliability and validity of the test model were good, in which Cronbach's Alpha values of 9 variables exceeded 0.9, composite reliability 0.8, the average variance extracted value 0.5, and the factor loading 0.8. The modified model had a good fitting effect and strong explanatory power. It accounted for 89% of the variance in expectation confirmation, 74% of the variance in perceived usefulness, 92% of the variance in customer satisfaction, and 84% of the variance in continuous usage intention. Compared with the initial model hypotheses, perceived system quality was deleted according to the heterotrait-monotrait ratio, so paths related to it were deleted; perceived usefulness wasn't positively associated with customer satisfaction, and its path was also deleted. Other paths were consistent with the initial hypothesis. The two new added paths were that subjective norm was positively associated with perceived service quality (β = 0.704, P < 0.001), and perceived information quality (β = 0.606, P < 0.001). Electronic health literacy (E-health literacy) was positively associated with perceived usefulness (β = 0.379, P < 0.001), perceived service quality (β = 0.200, P < 0.001), and perceived information quality (β = 0.320, P < 0.001). Continuous usage intention was influenced by perceived usefulness (β = 0.191, P < 0.001), customer satisfaction (β = 0.453, P < 0.001), and subjective norm (β = 0.372, P < 0.001).

CONCLUSIONS

The study constructed a new theoretical model including E-health literacy, subjective norm and technology qualities to clarify continuous usage intention of mHealth services, and empirically validated the model. Attention should be paid to E-health literacy, subjective norm, perceived information quality, and perceived service quality to improve continuous usage intention of users and self-management by mHealth Apps managers and governments. This research provides solid evidence for the validity of the expanded model of ECM-ISC in the mHealth field, which can be a theoretical and practical basis for mHealth operators' product research and development.

A fuzzy-set qualitative comparative analysis exploration of multiple paths to users' continuous use behavior of diabetes self-management apps

BACKGROUND

Despite the obvious potential benefits of diabetes self-management apps, users' continuous use of diabetes self-management apps is still not widespread. Influential factors coexisted in information ecologies are likely to have a synthetic effect on users' continuous use behavior. However, it is less clear how factors in information ecologies combine to influence users' continuous use behavior.

OBJECTIVE

The objectives of this study are to explore combinations of factors (perceived severity, information quality, service quality, system quality, and social influence) in information ecologies that lead to users' continuous use behavior of diabetes self-management apps and which combination is the most important.

METHODS

Purpose sampling was used to recruit diabetes self-management app users from July 1, 2021 to January 31, 2022. Fuzzy-set qualitative comparative analysis (fsQCA) was then employed by conducting necessity and sufficiency analysis.

RESULTS

In total 280 diabetes self-management app users participated. The necessity analysis indicated that no single factor was necessary to cause users' continuous use behavior, and the sufficiency analysis identified five different combinations of factors that lead to users' continuous use behavior. Of these five, the combination of high information quality, high service quality, and high social influence was found to be the most important path.

CONCLUSIONS

Users' continuous use behavior of diabetes self-management apps results from the synergistic effects of factors in information ecologies. The five paths that directly contribute to users' continuous use, as well as the four user types preliminarily identified in this study may provide a reference for healthcare providers and app developers.

Understanding Post-Adoption Behavioral Intentions of Mobile Health Service Users: An Empirical Study during COVID-19

This study aims to understand the post-adoption behaviors of mobile health (m-Health) service users during the COVID-19 pandemic. Drawing on the stimulus-organism-response framework, we examined the effects of user personality traits, doctor characteristics, and perceived risks on user continuance intentions and positive word of mouth (WOM) when using m-Health, as mediated by cognitive and emotional trust. The empirical data were collected via an online survey questionnaire from 621 m-Health service users in China and were verified with partial least squares structural equation modeling. The results showed that personal traits and doctor characteristics were positively associated and the perceived risks were negatively associated with both cognitive and emotional trust. Both cognitive and emotional trust significantly influenced users' post-adoption behavioral intentions in terms of continuance intentions and positive WOM, with different magnitudes. This study provides new insights for the promotion of the sustainable development of m-Health businesses after or during the pandemic.

Counseling for Health: How Psychological Distance Influences Continuance Intention towards Mobile Medical Consultation

As mobile healthcare services entered the public sight with high frequency during the COVID-19 pandemic, patients are increasingly recognizing the effectiveness of mobile medical consultation (MMC). Earlier studies have investigated what influences continuance intention (CI) towards MMC, but few studies have scrutinized it from the perspective of patients' psychological distance. We formulated a framework to examine the psychological factors influencing CI towards MMC by integrating the information systems continuance model and psychological distance theory. The framework was validated using the partial least squares structural equation modeling (PLS-SEM) approach and data from 475 MMC users in China. The empirical results revealed that immediacy, telepresence, intimacy, and substitutability were significant predictors of CI, while satisfaction mediated these pathways. Pandemic-induced anxiety positively moderated the effect of immediacy on satisfaction and the effect of satisfaction on CI. Practical implementations for MMC healthcare practitioners, designers, and marketers are drawn.

Identifying major impact factors affecting the continuance intention of mHealth: a systematic review and multi-subgroup meta-analysis

The mobile health (mHealth) industry is an enormous global market; however, the dropout or continuance of mHealth is a major challenge that is affecting its positive outcomes. To date, the results of studies on the impact factors have been inconsistent. Consequently, research on the pooled effects of impact factors on the continuance intention of mHealth is limited. Therefore, this study aims to systematically analyze quantitative studies on the continuance intention of mHealth and explore the pooled effect of each direct and indirect impact factor. Until October 2021, eight literature databases were searched. Fifty-eight peer-reviewed studies on the impact factors and effects on continuance intention of mHealth were included. Out of the 19 direct impact factors of continuance intention, 15 are significant, with attitude (β = 0.450; 95% CI: 0.135, 0.683), satisfaction (β = 0.406; 95% CI: 0.292, 0.509), health empowerment (β = 0.359; 95% CI: 0.204, 0.497), perceived usefulness (β = 0.343; 95% CI: 0.280, 0.403), and perceived quality of health life (β = 0.315, 95% CI: 0.211, 0.412) having the largest pooled effect coefficients on continuance intention. There is high heterogeneity between the studies; thus, we conducted a subgroup analysis to explore the moderating effect of different characteristics on the impact effects. The geographic region, user type, mHealth type, user age, and publication year significantly moderate influential relationships, such as trust and continuance intention. Thus, mHealth developers should develop personalized continuous use promotion strategies based on user characteristics.

Quality of Mobile Apps for Care Partners of People With Alzheimer Disease and Related Dementias: Mobile App Rating Scale Evaluation

Background

Over 11 million care partners in the United States who provide care to people living with Alzheimer disease and related dementias (ADRD) cite persistent and pervasive unmet needs related to their caregiving role. The proliferation of mobile apps for care partners has the potential to meet care partners’ needs, but the quality of apps is unknown.

Objective

This study aims to evaluate the quality of publicly available apps for care partners of people living with ADRD and identify design features of low- and high-quality apps to guide future research and user-centered app development.

Methods

We searched the US Apple App and Google Play stores with the criteria that included apps needed to be available in the US Google Play or Apple App stores, accessible to users out of the box, and primarily intended for use by an informal (family or friend) care partner of a person living with ADRD. We classified and tabulated app functionalities. The included apps were then evaluated using the Mobile App Rating Scale (MARS) using 23 items across 5 dimensions: engagement, functionality, aesthetics, information, and subjective quality. We computed descriptive statistics for each rating. To identify recommendations for future research and app development, we categorized rater comments on score-driving factors for each MARS rating item and what the app could have done to improve the item score.

Results

We evaluated 17 apps. We found that, on average, apps are of minimally acceptable quality. Functionalities supported by apps included education (12/17, 71%), interactive training (3/17, 18%), documentation (3/17, 18%), tracking symptoms (2/17, 12%), care partner community (3/17, 18%), interaction with clinical experts (1/17, 6%), care coordination (2/17, 12%), and activities for the person living with ADRD (2/17, 12%). Of the 17 apps, 8 (47%) had only 1 feature, 6 (35%) had 2 features, and 3 (18%) had 3 features. The MARS quality mean score across apps was 3.08 (SD 0.83) on the 5-point rating scale (1=inadequate to 5=excellent), with apps scoring highest on average on functionality (mean 3.37, SD 0.99) and aesthetics (mean 3.24, SD 0.92) and lowest on average on information (mean 2.95, SD 0.95) and engagement (mean 2.76, SD 0.89). The MARS subjective quality mean score across apps was 2.26 (SD 1.02).

Conclusions

We identified apps whose mean scores were more than 1 point below minimally acceptable quality, whereas some were more than 1 point above. Many apps had broken features and were rated as below acceptable for engagement and information. Minimally acceptable quality is likely to be insufficient to meet care partner needs. Future research should establish minimum quality standards across dimensions for care partner mobile apps. Design features of high-quality apps identified in this study can provide the foundation for benchmarking these standards.

Effects of Patient-Generated Health Data: Comparison of Two Versions of Long-Term Mobile Personal Health Record Usage Logs

Patient-generated health data (PGHD) can be managed easily by a mobile personal health record (mPHR) and can increase patient engagement. This study investigated the effect of PGHD functions on mPHR usage. We collected usage log data from an mPHR app, My Chart in My Hand (MCMH), for seven years. We analyzed the number of accesses and trends for each menu by age and sex according to the version-up. Generalized estimating equation (GEE) analysis was used to determine the likelihood of continuous app usage according to the menus and version-up. The total number of users of each version were 15,357 and 51,553, respectively. Adult females under 50 years were the most prevalent user group (30.0%). The “My Chart” menu was the most accessed menu, and the total access count increased by ~10 times after the version-up. The “Health Management” menu designed for PGHD showed the largest degree of increase in its likelihood of continuous usage after the version-up (1.245; p < 0.0001) across menus (range: 0.925–1.050). Notably, improvement of PGHD management in adult females over 50 years is needed.

Effectiveness of mobile health-based self-management application for posttransplant cares: A systematic review

BACKGROUND AND AIMS

Patients after transplantation need medical management for the rest of their lives, and self-management seems to lead to greater adherence to medical standards, improve early physical changes, and increase patient empowerment. The main objective of this article is to systematic review of the consideration to mobile health applications (m-Health apps) used in transplantation.

METHODS

A systematic search was conducted MEDLINE (through PubMed), Web of Science, Scopus, and Science Direct from inception to November 2020. The Preferred Reporting Items for Systematic Reviews and Meta-Analysis (PRISMA) statement was used in this study. Comprehensive research was carried out using a combination of keywords and MeSH terms associated with m-Health, empowerment, self-management, and transplantation. Two independent reviewers screened titles and abstracts, assessed full-text articles, and extracted data from articles that met inclusion criteria. Eligible studies were original research articles that included posttransplant care and mobile phone-based applications to support self-management and self-care. Also, thesis, book chapters, letters to editors, short briefs, reports, technical reports, book reviews, systematic reviews, or meta-analysis were excluded.

RESULTS

We divided all the reviewed articles into four categories, self-management (medication adherence, adherence to medical regimen, and remote monitoring), evaluation, interaction, and interface; 37.5% of the studies were focused on lung transplantation. In 56.25% of the studies, medication adherence was considered because one of the main reasons for the rejection and graft loss is stated medication nonadherence. Also, 62.5% of the studies demonstrated that the use of m-health improved medication adherence and self-management in transplantation.

CONCLUSIONS

The use of m-Health apps interventions to self-management after transplantation has shown promising feasibility and acceptability, and there is modest evidence to support the efficacy of these interventions. We found that m-Health solutions can help the patient in self-management in many ways after transplantation.

Effects of Mobile Application Program (App)-Assisted Health Education on Preventive Behaviors and Cancer Literacy among Women with Cervical Intraepithelial Neoplasia

Objective: This study aimed (1) to study the effects of health education on preventive behaviors and cancer literacy among women with cervical intraepithelial neoplasia (CIN); (2) to compare the effects of mobile application program (App)-assisted health education with traditional book-form health education. Participants: A total of 132 women ages 20 to 69 years women. Methods: This prospective longitudinal study enrolled 132 CIN women who were evaluated three times. Propensity score matching was used by controlling subjects’ age strata, body mass index, education level, occupation, and type of surgery. Results: The influences of various educational tools were investigated. Four domains were assessed, including health behavior, attitude towards behavior change, self-efficacy of behavior, and cervical cancer (CCa) literacy. Significant improvements in behavior change and CCa literacy due to a health education program were observed (p ≤ 0.002). The App combined with a traditional booklet had the highest score for behavior change and was significantly greater than the booklet-only learning (p = 0.002). The App-assisted form, either App alone or combined with booklet, had a significantly better impact on health promotion when compared to the booklet alone (p = 0.045 and 0.005, respectively). App-only learning had the highest score of CCa literacy (p = 0.004). Conclusion: Health education interventions can have positive effects in terms of change of behavior and CCa literacy. App-assisted learning could be used as a supportive technology, and App learning alone or combined with a traditional booklet may be an innovative model of clinical health promotion for women with CIN.