Development of an integrated e-health tool for people with, or at high risk of, cardiovascular disease: The Consumer Navigation of Electronic Cardiovascular Tools (CONNECT) web application

Mobile App for Patients With Chronic Obstructive Pulmonary Diseases During Home-Based Exercise Care: Usability Study

BACKGROUND

Digital health tools have demonstrated promise in the treatment and self-management of chronic diseases while also serving as an important means for reducing the workload of health care professionals (HCPs) and enhancing the quality of care. However, these tools often merely undergo large-scale testing or enter the market without undergoing rigorous user experience analysis in the early stages of their development, leading to frequent instances of low use or failure.

OBJECTIVE

This study aims to assess the usability of and satisfaction with a mobile app designed for the clinical monitoring of patients with chronic obstructive pulmonary disease undergoing pulmonary rehabilitation at home.

METHODS

This study used a mixed methods approach involving two key stakeholders-patients with chronic obstructive pulmonary disease and HCPs-across three phases: (1) mobile app mock-up design, (2) usability testing, and (3) satisfaction evaluation. Using convenience sampling, participants were grouped as HCPs (n=12) and patients (n=18). Each received a tablet with mock-ups for usability testing through interviews, with audio recordings transcribed and analyzed anonymously in NVivo12.0, focusing on mock-up features and usability insights. Task difficulty was rated from 1 (very easy) to 5 (very difficult), with noncompletion deemed a critical error. Usability satisfaction was measured on a 5-point Likert scale from 1 (strongly disagree) to 5 (strongly agree).

RESULTS

The research indicated a notable difference in app usability perceptions: 66% (8/12) of HCPs found tasks "very easy," compared to only 22% (4/18) of patients. Despite this, no participant made critical errors or withdrew, and satisfaction was high. HCPs completed tasks in about 20 minutes, while patients took 30. Older adults faced challenges with touch screens and scroll menus, suggesting the need for intuitive design aids like auditory support and visual health progress indicators, such as graphs. HCPs noted potential data delays affecting service, while non-native-speaking caregivers faced interpretation challenges. A secure pairing system for privacy in teleconsultations proved difficult for older users; a simpler icon-based system is recommended. This study highlights the need to consider stakeholder abilities in medical app design to enhance function implementation.

CONCLUSIONS

Most HCPs (11/12, 91%) found the app intuitive, though they recommended adding icons to show patient progress to support clinical decisions. In contrast, 62% (11/18) of patients struggled with tablet navigation, especially with connectivity features. To ensure equitable access, the design should accommodate older users with diverse abilities. Despite challenges, both groups reported high satisfaction, with patients expressing a willingness to learn and recommending the app. These positive usability evaluations suggest that, with design improvements, such apps could see increased use in home-based care.

Development of a Digital Health Intervention for the Secondary Prevention of Cardiovascular Disease (INTERCEPT): Co-Design and Usability Testing Study

BACKGROUND

Secondary prevention is an important strategy to reduce the burden of cardiovascular disease (CVD), a leading cause of death worldwide. Despite the growing evidence for the effectiveness of digital health interventions (DHIs) for the secondary prevention of CVD, the majority are designed with minimal input from target end users, resulting in poor uptake and usage.

OBJECTIVE

This study aimed to optimize the acceptance and effectiveness of a DHI for the secondary prevention of CVD through co-design, integrating end users' perspectives throughout.

METHODS

A theory-driven, person-based approach using co-design was adopted for the development of the DHI, known as INTERCEPT. This involved a 4-phase iterative process using online workshops. In phase 1, a stakeholder team of health care professionals, software developers, and public and patient involvement members was established. Phase 2 involved identification of the guiding principles, content, and design features of the DHI. In phase 3, DHI prototypes were reviewed for clarity of language, ease of navigation, and functionality. To anticipate and interpret DHI usage, phase 4 involved usability testing with participants who had a recent cardiac event (<2 years). To assess the potential impact of usability testing, the System Usability Scale was administered before and after testing. The GUIDED (Guidance for Reporting Intervention Development Studies in Health Research) checklist was used to report the development process.

RESULTS

Five key design principles were identified: simplicity and ease of use, behavioral change through goal setting and self-monitoring, personalization, system credibility, and social support. Usability testing resulted in 64 recommendations for the app, of which 51 were implemented. Improvements in System Usability Scale scores were observed when comparing the results before and after implementing the recommendations (61 vs 83; P=.02).

CONCLUSIONS

Combining behavior change theory with a person-based, co-design approach facilitated the development of a DHI for the secondary prevention of CVD that optimized responsiveness to end users' needs and preferences, thereby potentially improving future engagement.

Development and validation of a mobile application prototype for postoperative cardiac surgery

OBJECTIVES

to develop and validate the content, appearance, and semantics of a prototype application for monitoring patients in the postoperative period of cardiac surgery.

METHODS

this is a technological development study based on Contextualized Instructional Design. The content and appearance evaluation was conducted by a committee of specialists, and semantic validation was carried out by patients from a cardiac surgery outpatient clinic.

RESULTS

the application prototype consisted of 43 screens, validated by 17 health specialists, with content validity ratio and appearance validity index results of 0.86 and 0.99, respectively. For semantic validation, 10 patients participated in data collection, with a total content validity index of 0.978.

CONCLUSIONS

the prototype of the "VivaCor PósOp" application demonstrated evidence of content, appearance, and semantic validity, with the potential to stimulate self-care in patients in the postoperative period of cardiac surgery.

Knowledge mapping of digital medicine in cardiovascular diseases from 2004 to 2022: A bibliometric analysis

Objective

To review studies on digital medicine in cardiovascular diseases (CVD), discuss its development process, knowledge structure and research hotspots, and provide a perspective for researchers in this field.

Methods

The relevant literature in recent 20 years (January 2004 to October 2022) were retrieved from the Web of Science Core Collection (WoSCC). CiteSpace was used to demonstrate our knowledge of keywords, co-references and speculative frontiers. VOSviewer was used to chart the contributions of authors, institutions and countries and incorporates their link strength into the table.

Results

A total of 5265 English articles in set timespan were included. The number of publications increased steadily annually. The United States (US) produced the highest number of publications, followed by England. Most publications were from Harvard Medicine School, followed by Massachusetts General Hospital and Brigham Women's Hospital. The most authoritative academic journal was JMIR mHealth and uHealth. Noseworthy PA may have the highest influence in this intersected field with the highest number of citations and total link strength. The utilization of wearable mobile devices in the context of CVD, encompassing the identification of risk factors, diagnosis and prevention of diseases, as well as early intervention and remote management of diseases, has been widely acknowledged as a knowledge base and an area of current interest. To investigate the impact of various digital medicine interventions on chronic care and assess their clinical effectiveness, examine the potential of machine learning (ML) in delivering clinical care for atrial fibrillation (AF) and identifying early disease risk factors, as well as explore the development of disease prediction models using neural networks (NNs), ML and unsupervised learning in CVD prognosis, may emerge as future trends and areas of focus.

Conclusion

Recently, there has been a significant surge of interest in the investigation of digital medicine in CVD. This initial bibliometric study offers a comprehensive analysis of the research landscape pertaining to digital medicine in CVD, thereby furnishing related scholars with a dependable reference to facilitate further progress in this domain.

Exploring the evolution of eHealth in disease management: A bibliometric analysis from 1999 to 2023

Objective

In the digital age, eHealth is vital in modern healthcare, impacting medical services and public health. Despite its potential in disease management, a comprehensive bibliometric analysis is lacking. This study utilizes bibliometric methods to explore the evolution of eHealth in disease management from 1999 to 2023, aiming to discern the research status and trends.

Methods

A literature search was conducted using the Web of Science Core Collection (WOSCC) database. Publications and journals were quantitatively analyzed using Microsoft Office Excel 2023. Country/institution/author collaborations and keyword co-occurrences were analyzed using VOSviewer. CiteSpace was employed to analyze the citation bursts of reference. A global distribution network of publications was constructed and thematic trends were analyzed using R package "bibliometrix."

Results

The study identified 1763 articles on eHealth in disease management. Since 2011, there has been a notable increase in publications, with the United States (n = 391, 22.08%) and the University of Sydney (n = 60, 3.40%) as leading contributors. High-quality journals primarily publish this research. Globally, 9631 authors contributed, with Chavannes, Niels H being the most prolific (n = 23). Author co-citation analysis indicated Eysenbach, G as the most cited (n = 336). Research currently focuses on developing a comprehensive eHealth framework, optimizing mHealth for chronic diseases, improving eHealth intervention trial reporting, assessing social factors in eHealth literacy, and examining telemedicine's role during the Covid-19 pandemic.

Conclusion

This study offers a comprehensive overview of eHealth research in disease management. eHealth's potential in disease prevention and treatment is significant. To enhance eHealth's impact, international collaboration, technological innovation, tailored intervention trials, addressing the digital divide, and solving legal and ethical issues are crucial. This study will guide future research endeavors, with the goal of enhancing eHealth's benefits and expanding its accessibility to a wider patient base.

Nurses' Roles in mHealth App Development: Scoping Review

BACKGROUND

Although mobile health (mHealth) apps for both health consumers and health care providers are increasingly common, their implementation is frequently unsuccessful when there is a misalignment between the needs of the user and the app's functionality. Nurses are well positioned to help address this challenge. However, nurses' engagement in mHealth app development remains unclear.

OBJECTIVE

This scoping review aims to determine the extent of the evidence of the role of nurses in app development, delineate developmental phases in which nurses are involved, and to characterize the type of mHealth apps nurses are involved in developing.

METHODS

We conducted a scoping review following the 6-stage methodology. We searched 14 databases to identify publications on the role of nurses in mHealth app development and hand searched the reference lists of relevant publications. Two independent researchers performed all screening and data extraction, and a third reviewer resolved any discrepancies. Data were synthesized and grouped by the Software Development Life Cycle phase, and the app functionality was described using the IMS Institute for Healthcare Informatics functionality scoring system.

RESULTS

The screening process resulted in 157 publications being included in our analysis. Nurses were involved in mHealth app development across all stages of the Software Development Life Cycle but most frequently participated in design and prototyping, requirements gathering, and testing. Nurses most often played the role of evaluators, followed by subject matter experts. Nurses infrequently participated in software development or planning, and participation as patient advocates, research experts, or nurse informaticists was rare.

CONCLUSIONS

Although nurses were represented throughout the preimplementation development process, nurses' involvement was concentrated in specific phases and roles.

Tools to guide clinical discussions on physical activity, sedentary behaviour, and/or sleep for health promotion between primary care providers and adults accessing care: a scoping review

BACKGROUND

Health care providers have reported low knowledge, skill, and confidence for discussing movement behaviours (i.e., physical activity, sedentary behaviour, and sleep), which may be improved with the use of tools to guide movement behaviour discussions in their practice. Past reviews have examined the psychometric properties, scoring, and behavioural outcomes of physical activity discussion tools. However, the features, perceptions, and effectiveness of discussion tools for physical activity, sedentary behaviour, and/or sleep have not yet been synthesized. The aim of this review was to report and appraise tools for movement behaviour discussions between health care providers and adults 18 + years in a primary care context within Canada or analogous countries.

METHODS

An integrated knowledge translation approach guided this review, whereby a working group of experts in medicine, knowledge translation, communications, kinesiology, and health promotion was engaged from research question formation to interpretation of findings. Three search approaches were used (i.e., peer-reviewed, grey literature, and forward searches) to identify studies reporting on perceptions and/or effectiveness of tools for physical activity, sedentary behaviour, and/or sleep. The quality of included studies was assessed using the Mixed Methods Appraisal Tool.

RESULTS

In total, 135 studies reporting on 61 tools (i.e., 51 on physical activity, one on sleep, and nine combining two movement behaviours) met inclusion criteria. Included tools served the purposes of assessment (n = 57), counselling (n = 50), prescription (n = 18), and/or referral (n = 12) of one or more movement behaviour. Most tools were used or intended for use by physicians, followed by nurses/nurse practitioners (n = 11), and adults accessing care (n = 10). Most tools were also used or intended to be used with adults without chronic conditions aged 18-64 years (n = 34), followed by adults with chronic conditions (n = 18). The quality of the 116 studies that evaluated tool effectiveness varied.

CONCLUSIONS

Many tools were positively perceived and were deemed effective at enhancing knowledge of, confidence for, ability in, and frequency of movement behaviour discussions. Future tools should guide discussions of all movement behaviours in an integrated manner in line with the 24-Hour Movement Guidelines. Practically, this review offers seven evidence-based recommendations that may guide future tool development and implementation.

Cost analysis of face-to-face visits, virtual visits, and a digital care pathway in the treatment of tonsillitis patients

PURPOSE

The aim of this study was to compare the costs of two different telemedicine-assisted tonsillitis care pathways with traditional face-to-face visits at the Department of Otorhinolaryngology - Head and Neck Surgery (ORL-HNS) at Helsinki University Hospital.

METHODS

We characterized and analyzed the patient flows and their individual episodes of all tonsillitis patients at the Department of ORL-HNS between September 2020 and August 2022. Records were collected by doctors at the clinic. We investigated costs and allocated resources in four categories: invoice from the Department of ORL-HNS to the public payer, expenses to the Department, patient fees, and doctor's resource.

RESULTS

At least a third of the tonsillitis patients were eligible for telemedicine. The digital care pathway was 12.6 % less expensive for the public payer compared to the previous virtual visit model. For the Department, the expense of the digital care pathway was 58.8 % less per patient than the virtual visit model. Patient fees decreased 79.5 %. The digital care pathway reduced the doctor's resource from 30.28 min to 19.78 min, which accounts for a 34.7 % reduction. Patients finished the digital care pathway in a median of 62 min (SD = 60) compared to the 2-4 h which they would spend on an outpatient clinic visit.

CONCLUSION

Our study demonstrates that tonsillitis patients are eligible for preoperative telemedicine. With at least a third of the tonsillitis patients being eligible for telemedicine, major cost savings can be achieved with efficient e-health-assisted solutions.

A Disentangled VAE-BiLSTM Model for Heart Rate Anomaly Detection

Cardiovascular diseases (CVDs) remain a leading cause of death globally. According to the American Heart Association, approximately 19.1 million deaths were attributed to CVDs in 2020, in particular, ischemic heart disease and stroke. Several known risk factors for CVDs include smoking, alcohol consumption, lack of regular physical activity, and diabetes. The last decade has been characterized by widespread diffusion in the use of wristband-style wearable devices which can monitor and collect heart rate data, among other information. Wearable devices allow the analysis and interpretation of physiological and activity data obtained from the wearer and can therefore be used to monitor and prevent potential CVDs. However, these data are often provided in a manner that does not allow the general user to immediately comprehend possible health risks, and often require further analytics to draw meaningful conclusions. In this paper, we propose a disentangled variational autoencoder (β-VAE) with a bidirectional long short-term memory network (BiLSTM) backend to detect in an unsupervised manner anomalies in heart rate data collected during sleep time with a wearable device from eight heterogeneous participants. Testing was performed on the mean heart rate sampled both at 30 s and 1 min intervals. We compared the performance of our model with other well-known anomaly detection algorithms, and we found that our model outperformed them in almost all considered scenarios and for all considered participants. We also suggest that wearable devices may benefit from the integration of anomaly detection algorithms, in an effort to provide users more processed and straightforward information.

Implementation and User Evaluation of an eHealth Technology Platform Supporting Patients With Cardiovascular Disease in Managing Their Health After a Cardiac Event: Mixed Methods Study

BACKGROUND

eHealth technology can help patients with cardiovascular disease adopt and maintain a healthy lifestyle by supporting self-management and offering guidance, coaching, and tailored information. However, to support patients over time, eHealth needs to blend in with their needs, treatment, and daily lives. Just as needs can differ between patients, needs can change within patients over time. To better adapt technology features to patients' needs, it is necessary to account for these changes in needs and contexts of use.

OBJECTIVE

This study aimed to identify and monitor patients' needs for support from a web-based health management platform and how these needs change over time. It aimed to answer the following research questions: "How do novice and more advanced users experience an online health management platform?" "What user expectations support or hinder the adoption of an online health management platform, from a user perspective?" and "How does actual usage relate to user experiences and adoption?"

METHODS

A mixed methods design was adopted. The first method involved 2 rounds of usability testing, followed by interviews, with 10 patients at 0 months (round 1) and 12 patients at 6 months (round 2). In the second method, log data were collected to describe the actual platform use.

RESULTS

After starting cardiac rehabilitation, the platform was used frequently. The patients mentioned that they need to have an incentive, set goals, self-monitor their health data, and feel empowered by the platform. However, soon after the rehabilitation program stopped, use of the platform declined or patients even quit because of the lack of continued tailored or personalized advice. The reward system motivated them to log data, but most participants indicated that being healthy should be the main focus, not receiving gifts. A web-based platform is flexible, accessible, and does not have any obligations; however, it should be implemented as an addition to regular care.

CONCLUSIONS

Although use of the platform declined in the longer term, patients quitting the technology did not directly indicate that the technology was not functioning well or that patients no longer focused on achieving their values. The key to success should not be user adherence to a platform but adherence to healthy lifestyle habits. Therefore, the implementation of eHealth should include the transition to a stage where patients might no longer need support from a technology platform to be independently and sustainably adherent to their healthy lifestyle habits. This emphasizes the importance of conducting multi-iterative evaluations to continuously monitor whether and how patients' needs and contexts of use change over time. Future research should focus on how this transition can be identified and monitored and how these insights can inform the design and implementation of the technology.

Efficacy and pitfalls of digital technologies in healthcare services: A systematic review of two decades

The use of technology in the healthcare sector and its medical practices, from patient record maintenance to diagnostics, has significantly improved the health care emergency management system. At that backdrop, it is crucial to explore the role and challenges of these technologies in the healthcare sector. Therefore, this study provides a systematic review of the literature on technological developments in the healthcare sector and deduces its pros and cons. We curate the published studies from the Web of Science and Scopus databases by using PRISMA 2015 guidelines. After mining the data, we selected only 55 studies for the systematic literature review and bibliometric analysis. The study explores four significant classifications of technological development in healthcare: (a) digital technologies, (b) artificial intelligence, (c) blockchain, and (d) the Internet of Things. The novel contribution of current study indicate that digital technologies have significantly influenced the healthcare services such as the beginning of electronic health record, a new era of digital healthcare, while robotic surgeries and machine learning algorithms may replace practitioners as future technologies. However, a considerable number of studies have criticized these technologies in the health sector based on trust, security, privacy, and accuracy. The study suggests that future studies, on technological development in healthcare services, may take into account these issues for sustainable development of the healthcare sector.

Cardio-metabolic risk modeling and assessment through sensor-based measurements

OBJECTIVE

Cardio-metabolic risk assessment in the general population is of paramount importance to reduce diseases burdened by high morbility and mortality. The present paper defines a strategy for out-of-hospital cardio-metabolic risk assessment, based on data acquired from contact-less sensors.

METHODS

We employ Structural Equation Modeling to identify latent clinical variables of cardio-metabolic risk, related to anthropometric, glycolipidic and vascular function factors. Then, we define a set of sensor-based measurements that correlate with the clinical latent variables.

RESULTS

Our measurements identify subjects with one or more risk factors in a population of 68 healthy volunteers from the EU-funded SEMEOTICONS project with accuracy 82.4%, sensitivity 82.5%, and specificity 82.1%.

CONCLUSIONS

Our preliminary results strengthen the role of self-monitoring systems for cardio-metabolic risk prevention.

A Mobile App for Prevention of Cardiovascular Disease and Type 2 Diabetes Mellitus: Development and Usability Study

BACKGROUND

Cardiovascular disease (CVD) and type 2 diabetes mellitus (T2DM) are posing a huge burden on health care systems worldwide. Mobile apps can deliver behavior change interventions for chronic disease prevention on a large scale, but current evidence for their effectiveness is limited.

OBJECTIVE

This paper reported on the development and user testing of a mobile app that aims at increasing risk awareness and engaging users in behavior change. It would form part of an intervention for primary prevention of CVD and T2DM.

METHODS

The theoretical framework of the app design was based on the Behaviour Change Wheel, combined with the capability, opportunity, and motivation for behavior change system and the behavior change techniques from the Behavior Change Technique Taxonomy (version 1). In addition, evidence from scientific literature has guided the development process. The prototype was tested for user-friendliness via an iterative approach. We conducted semistructured interviews with individuals in the target populations, which included the System Usability Scale. We transcribed and analyzed the interviews using descriptive statistics for the System Usability Scale and thematic analysis to identify app features that improved utility and usability.

RESULTS

The target population was Australians aged ≥45 years. The app included 4 core modules (risk score, goal setting, health measures, and education). In these modules, users learned about their risk for CVD and T2DM; set goals for smoking, alcohol consumption, diet, and physical activity; and tracked them. In total, we included 12 behavior change techniques. We conducted 2 rounds of usability testing, each involving 5 participants. The average age of the participants was 58 (SD 8) years. Totally, 60% (6/10) of the participants owned iPhone Operating System phones, and 40% (4/10) of them owned Android phones. In the first round, we identified a technical issue that prevented 30% (3/10) of the participants from completing the registration process. Among the 70% (7/10) of participants who were able to complete the registration process, 71% (5/7) rated the app above average, based on the System Usability Scale. During the interviews, we identified some issues related to functionality, content, and language and clarity. We used the participants' feedback to improve these aspects.

CONCLUSIONS

We developed the app using behavior change theory and scientific evidence. The user testing allowed us to identify and remove technical errors and integrate additional functions into the app, which the participants had requested. Next, we will evaluate the feasibility of the revised version of the app developed through this design process and usability testing.

Engaging clinicians early during the development of a graphical user display of an intelligent alerting system at the bedside

BACKGROUND

Artificial Intelligence (AI) is increasingly used to support bedside clinical decisions, but information must be presented in usable ways within workflow. Graphical User Interfaces (GUI) are front-facing presentations for communicating AI outputs, but clinicians are not routinely invited to participate in their design, hindering AI solution potential.

PURPOSE

To inform early user-engaged design of a GUI prototype aimed at predicting future Cardiorespiratory Insufficiency (CRI) by exploring clinician methods for identifying at-risk patients, previous experience with implementing new technologies into clinical workflow, and user perspectives on GUI screen changes.

METHODS

We conducted a qualitative focus group study to elicit iterative design feedback from clinical end-users on an early GUI prototype display. Five online focus group sessions were held, each moderated by an expert focus group methodologist. Iterative design changes were made sequentially, and the updated GUI display was presented to the next group of participants.

RESULTS

23 clinicians were recruited (14 nurses, 4 nurse practitioners, 5 physicians; median participant age ∼35 years; 60% female; median clinical experience 8 years). Five themes emerged from thematic content analysis: trend evolution, context (risk evolution relative to vital signs and interventions), evaluation/interpretation/explanation (sub theme: continuity of evaluation), clinician intuition, and clinical operations. Based on these themes, GUI display changes were made. For example, color and scale adjustments, integration of clinical information, and threshold personalization.

CONCLUSIONS

Early user-engaged design was useful in adjusting GUI presentation of AI output. Next steps involve clinical testing and further design modification of the AI output to optimally facilitate clinician surveillance and decisions. Clinicians should be involved early and often in clinical decision support design to optimize efficacy of AI tools.

World Heart Federation Roadmap for Digital Health in Cardiology

More than 500 million people worldwide live with cardiovascular disease (CVD). Health systems today face fundamental challenges in delivering optimal care due to ageing populations, healthcare workforce constraints, financing, availability and affordability of CVD medicine, and service delivery. Digital health technologies can help address these challenges. They may be a tool to reach Sustainable Development Goal 3.4 and reduce premature mortality from non-communicable diseases (NCDs) by a third by 2030. Yet, a range of fundamental barriers prevents implementation and access to such technologies. Health system governance, health provider, patient and technological factors can prevent or distort their implementation. World Heart Federation (WHF) roadmaps aim to identify essential roadblocks on the pathway to effective prevention, detection, and treatment of CVD. Further, they aim to provide actionable solutions and implementation frameworks for local adaptation. This WHF Roadmap for digital health in cardiology identifies barriers to implementing digital health technologies for CVD and provides recommendations for overcoming them.

A Comprehensive Review on Seismocardiogram: Current Advancements on Acquisition, Annotation, and Applications

In recent years, cardiovascular diseases are on the rise, and they entail enormous health burdens on global economies. Cardiac vibrations yield a wide and rich spectrum of essential information regarding the functioning of the heart, and thus it is necessary to take advantage of this data to better monitor cardiac health by way of prevention in early stages. Specifically, seismocardiography (SCG) is a noninvasive technique that can record cardiac vibrations by using new cutting-edge devices as accelerometers. Therefore, providing new and reliable data regarding advancements in the field of SCG, i.e., new devices and tools, is necessary to outperform the current understanding of the State-of-the-Art (SoTA). This paper reviews the SoTA on SCG and concentrates on three critical aspects of the SCG approach, i.e., on the acquisition, annotation, and its current applications. Moreover, this comprehensive overview also presents a detailed summary of recent advancements in SCG, such as the adoption of new techniques based on the artificial intelligence field, e.g., machine learning, deep learning, artificial neural networks, and fuzzy logic. Finally, a discussion on the open issues and future investigations regarding the topic is included.

The Benefits of Telemedicine in Personalized Prevention of Cardiovascular Diseases (CVD): A Systematic Review

INTRODUCTION

Adverse effects on personalized care and outcomes of cardiovascular diseases (CVD) could occur if health systems do not work in an efficient manner. The pandemic caused by COVID-19 has opened new perspectives for the execution and advancement of cardiovascular tests through telemedicine platforms.

OBJECTIVE

This study aimed to analyze the usefulness of telemedical systems for providing personal care in the prevention of CVD.

METHODS

A systematic review analysis was conducted on the literature available from libraries such as PubMed (Medline), Scopus (Embase), and Cumulative Index to Nursing and Allied Health Literature (CINAHL). Data available in the last 10 years (2011-2020) were also examined by PRISMA guidelines. The selected studies were divided into two categories: (1) benefits of telemedicine in CVD prevention, and (2) recent progress in telemedical services for personalized care of CVD.

RESULTS

The literature search produced 587 documents, and 19 articles were considered in this review. Results highlighted that the timely delivery of preventive care for CVD which can be implemented virtually can benefit and modify morbidity and mortality. This could also reduce the pressure on hospitals by decreasing acute CVD occurrence among the general population. The use of these technologies can also help to reduce access to hospitals and other medical devices when not necessary.

CONCLUSIONS

Telemedicine platforms can be used for regular checkups for CVD and contribute to preventing the occurrence of acute events and more in general the progression of CVD.

An Internet-Based Intervention for Cardiovascular Disease Management Integrated With Primary Care Electronic Health Records: Mixed Methods Evaluation of Implementation Fidelity and User Engagement

Background

Growing evidence supports the benefits of eHealth interventions to increase patient engagement and improve outcomes for a range of conditions. However, ineffective program delivery and usage attrition limit exposure to these interventions and may reduce their effectiveness.

Objective

This study aims to evaluate the delivery fidelity of an eHealth intervention, describe use patterns, compare outcomes between low and high users, and identify mediating factors on intervention delivery and receipt.

Methods

This is a mixed methods study of an internet-based intervention being evaluated for effectiveness in a randomized controlled trial (RCT). The intervention comprised medication and cardiovascular disease (CVD) risk data uploaded from the primary care electronic health record (EHR); interactive, personalized CVD risk score estimation; goal setting and self-monitoring; an interactive social forum; and optional receipt of heart health messages. Fidelity was assessed over 12 months. Trial outcomes were compared between low and high users. Data sources included program delivery records, web log data, trial data, and thematic analysis of communication records.

Results

Most participants in the intervention group (451/486, 93%) had an initial training session conducted by telephone (413/447, 92.4% of participants trained), with a mean duration of 44 minutes (range 10-90 minutes). Staff conducted 98.45% (1776/1804) of the expected follow-ups, mostly by telephone or email. Of the 451 participants who commenced log-ins, 46.8% (211) were categorized as low users (defined as at least one log-in in 3 or fewer months of follow-up), 40.4% (182) were categorized as high users (at least one log-in in more than 3 months of follow-up), and 12.8% (58) were nonadopters (no log-ins after their training session). The mean log-in frequency was 3-4 per month in ongoing users. There was no significant difference between the groups in the primary trial outcome of adherence to guideline-recommended medications (P=.44). In unadjusted analyses, high users had significantly greater eHealth literacy scores (P=.003) and were more likely to meet recommended weekly targets for fruit (P=.03) and fish (P=.004) servings; however, the adjusted findings were not significant. Interactive screen use was highest for goal tracking and lowest for the chat forum. Screens with EHR-derived data held only an early interest for most users. Fidelity measures (reach, content, dose delivered, and dose received) were influenced by the facilitation strategies used by staff, invisible qualities of staff-participant communication, and participants’ responsiveness to intervention attributes.

Conclusions

A multifeature internet-based intervention was delivered with high fidelity to the RCT protocol and was regularly used by 40.4% (182/451) of users over 12 months. Higher log-in frequency as an indicator of greater intervention exposure was not associated with statistically significant improvements in eHealth literacy scores, lifestyle changes, or clinical outcomes. Attributes of the intervention and individualized support influenced initial and ongoing use.

Interdisciplinary collaboration between nursing and engineering in health care: A scoping review

BACKGROUND

Due to the rapid advancements in precision medicine and artificial intelligence, interdisciplinary collaborations between nursing and engineering have emerged. Although engineering is vital in solving complex nursing problems and advancing healthcare, the collaboration between the two fields has not been fully elucidated.

OBJECTIVES

To identify the study areas of interdisciplinary collaboration between nursing and engineering in health care, particularly focusing on the role of nurses in the collaboration.

METHODS

In this study, a scoping review using the Preferred Reporting Items for Systematic Reviews and Meta-Analysis Extension for Scoping Reviews was performed. A comprehensive search for published literature was conducted using the PubMed, Cumulative Index to Nursing and Allied Health Literature, Scopus, Embase, Web of Science, ScienceDirect, Institute of Electrical and Electronics Engineers Digital Library, and Association for Computing Machinery Digital Library from inception to November 22, 2020. Data screening and extraction were performed independently by two reviewers. Any discrepancies in results were resolved through discussions or in consultation with a third reviewer. Data were analyzed by descriptive statistics and content analysis. Results were visualized in an interdisciplinary collaboration model.

RESULTS

We identified 6,752 studies through the literature search, and 60 studies met the inclusion criteria. The study areas of interdisciplinary collaboration concentrated on patient safety (n = 18), symptom monitoring and health management (n = 18), information system and nursing human resource management (n = 16), health education (n = 5), and nurse-patient communication (n = 3). The roles of nurses in the interdisciplinary collaboration were divided into four themes: requirement analyst (n = 21), designer (n = 22), tester(n = 37) and evaluator (n = 49). Based on these results, an interdisciplinary collaboration model was constructed.

CONCLUSIONS

Interdisciplinary collaborations between nursing and engineering promote nursing innovation and practice. However, these collaborations are still emerging and in the early stages. In the future, nurses should be more involved in the early stages of solving healthcare problems, particularly in the requirement analysis and designing phases. Furthermore, there is an urgent need to develop interprofessional education, strengthen nursing connections with the healthcare engineering industry, and provide more platforms and resources to bring nursing and engineering disciplines together.

A digital health intervention for cardiovascular disease management in primary care (CONNECT) randomized controlled trial

Digital health applications (apps) have the potential to improve health behaviors and outcomes. We aimed to examine the effectiveness of a consumer web-based app linked to primary care electronic health records (EHRs). CONNECT was a multicenter randomized controlled trial involving patients with or at risk of cardiovascular disease (CVD) recruited from primary care (Clinical Trial registration ACTRN12613000715774). Intervention participants received an interactive app which was pre-populated and refreshed with EHR risk factor data, diagnoses and, medications. Interactive risk calculators, motivational messages and lifestyle goal tracking were also included. Control group received usual health care. Primary outcome was adherence to guideline-recommended medications (≥80% of days covered for blood pressure (BP) and statin medications). Secondary outcomes included attainment of risk factor targets and eHealth literacy. In total, 934 patients were recruited; mean age 67.6 (±8.1) years. At 12 months, the proportion with >80% days covered with recommended medicines was low overall and there was no difference between the groups (32.8% vs. 29.9%; relative risk [RR] 1.07 [95% CI, 0.88-1.20] p = 0.49). There was borderline improvement in the proportion meeting BP and LDL targets in intervention vs. control (17.1% vs. 12.1% RR 1.40 [95% CI, 0.97-2.03] p = 0.07). The intervention was associated with increased attainment of physical activity targets (87.0% intervention vs. 79.7% control, p = 0.02) and e-health literacy scores (72.6% intervention vs. 64.0% control, p = 0.02). In conclusion, a consumer app integrated with primary health care EHRs was not effective in increasing medication adherence. Borderline improvements in risk factors and modest behavior changes were observed.

A realist evaluation approach to explaining the role of context in the impact of a complex eHealth intervention for improving prevention of cardiovascular disease

Background

Reduction of cardiovascular disease (CVD) is a worldwide health priority and innovative uses of technology-based interventions may assist patients with improving prevention behaviours. Targeting these interventions to recipients most likely to benefit requires understanding how contexts of use influence responsiveness to the intervention, and how this interaction favours or discourages health behaviour. Using a realist evaluation approach, the aim of this study was to examine the contextual factors influencing behaviour change within a multi-feature eHealth intervention with personalised data integration from the primary care electronic health record (EHR).

Methods

Realist evaluation of qualitative data from the Consumer Navigation of Electronic Cardiovascular Tools (CONNECT) randomised trial (N = 934). Thirty-six participants from the intervention group (N = 486) who had completed 12 months of study follow-up were interviewed. Coding of transcripts was structured around configurations of contexts, mechanisms, and outcomes of intervention use. Contextual narratives were derived from thematic analysis of the interviews.

Results

Mechanisms favouring positive health behaviour occurred when participants responded to four interactive features of the intervention. Facilitating mechanisms included greater cognitive engagement whereby participants perceived value and benefit, and felt motivated, confident and incentivised. Participants moved from being unconcerned (or unaware) to more task-oriented engagement with personal CVD risk profile and prevention. Increased personalisation occurred when modifiable CVD risk factors became relatable to lifestyle behaviour; and experiences of feeling greater agency/self-efficacy emerged. Use and non-use of the intervention were influenced by four overarching narratives within the individual’s micro-level and meso-level environments: illness experiences; receptiveness to risk and prevention information; history of the doctor-patient relationship; and relationship with technology.

Conclusions

Intervention-context interactions are central to understanding how change mechanisms activate within complex interventions to exert their impact on recipients. Intervention use and non-use were context-dependent, underscoring the need for further research to target eHealth innovations to those most likely to benefit.

Using User-Feedback to Develop a Website: MyT1DHope, for Parents of Children with T1D

Effectively caring for a child with type-1 diabetes (T1D) can be extremely demanding and stressful for the entire family. The difficulties of caring for a child with T1D impact the psychological and physical well-being of the parents. Interventions aimed at reducing stress and increasing coping may improve parental outcomes. This project sought to develop a resource to be used as a preliminary intervention step for these parents. This research was conducted in two parts. Part 1 includes three stages of formative evaluation, including a focus group, interviews, and a survey with parents to examine the current landscape of diabetes websites as a resource. Using data from Part 1, Part 2 of the study included the identification of a theory to guide the design of a website, the development of the website, and an 8-week pilot study of the website with parents with a child with T1D. Significant improvements were found in diabetes knowledge and caregivers' satisfaction of life. No changes were found in social support, self-efficacy, or quality of life. Overall, the data show that the parents were generally satisfied with the website. Through this work, researchers were able to develop a deeper understanding of the needs of parents caring for a child with T1D to develop the initial component of a larger intervention.

Evaluation of mHealth Applications Related to Cardiovascular Diseases: a Systematic Review

Introduction:

Currently, with the widespread penetration of mobile devices with Internet access, including smartphones, they can allow specific and/or complementary activities in the health field as well as in other commercial sectors.

Aim:

This systematic review examined the impact of mHealth-based for cardiovascular research. The specific aims of the systematic review are to (1) classification of the studies according to the type of research (scientific articles and master’s and doctoral theses) and (2) relationship of studies with topics associated with cardiovascular diseases.

Results:

This review corresponds to information in scientific journals of high impact. This review intends to respond to the following question: How these research works have evaluated the performance of health mobile applications, with a special interest in cardiac issues? This review of these searches corresponds to an analysis by 14 categories, being these: 1) Scientific paper; 2) Doctoral Thesis; 3) Master thesis; 4) Telemedicine; 5) m-sssshealth, e-health; 6) cardiovascular, coronary diseases, heart failures, cardiopulmonary, cardiac rehabilitation; 7) rural health; 8) prevention and control, protection; 9) wearables; 10) mobile, web applications, app, smartphone, software, platform; 11) mhealth education, training, promotion, formative process; 12) self-management; 13) Multiple Vital Sign Monitoring, medical device, heart rate measurement, health care information systems; 14) health regulatory. It provides evidence of how some apps have been evaluated, and in some cases, the effectiveness of the estimated accuracy is not in line with the real situation.

Conclusion:

The analysis of these studies allows us to locate the sources of the development of mobile health projects. It also guides us to discover some needs that require new technology implementations.

Patient-Centered Methods for Designing and Developing Health Information Communication Technologies: A Systematic Review

Background: Chronic disease management and maintaining healthy behaviors to prevent disease are important lifelong considerations. Adherence to prescribed management and behaviors often falls short of physician recommendations, which can result in negative health outcomes. Information communication technologies (ICTs) offer an approach to combat this issue. However, uptake and sustainability of ICTs have mixed results. One reason could be that technologies are often created without an understanding of the complexities of patient needs. Therefore, the intent of this study is to explore the current landscape of patient-centered design and development of health ICTs through a systematic review. Materials and Methods: Systematic literature searches were conducted in the databases EBSCO, PubMed, and Web of Science between October 2016 and February 2017. Each paper was critically evaluated for each data extraction classification, and was categorized based on the chronic disease or health focus, method of patient-centered design, resulting themes, and use of theory. Results: The study search resulted in 3,748 articles total. After duplicates and articles not meeting criteria were removed, 57 articles were selected for assessment. Four main themes emerged: participant experience, technological requirements, behavioral and knowledge components, and social components. Conclusions: Adhering to chronic disease management and healthy behaviors are both crucial to attain positive health outcomes. ICTs can play an interesting role in aiding disease management and healthy behavior promotion, but involving end-users and applying a theoretical foundation in the design and development of these technologies should be considered.

Community-Based Chronic Disease Prevention and Management for Aboriginal People in New South Wales, Australia: Mixed Methods Evaluation of the 1 Deadly Step Program

BACKGROUND

Chronic diseases account for over 70% of health gaps between Aboriginal people and the rest of the Australian population. The 1 Deadly Step program involves community-based events that use a sporting platform and cultural ambassadors to improve chronic disease prevention and management in New South Wales (NSW).

OBJECTIVE

This study aimed to evaluate the feasibility and acceptability of a community-based chronic disease screening program for Aboriginal people.

METHODS

In 2015, the program was enhanced to include an iPad app for screening assessments, a results portal for nominated care providers, and a reporting portal for program administrators and implemented in 9 NSW community events. A mixed methods evaluation comprising survey data, analytics obtained from iPad and Web portal usage, and key informant interviews was conducted.

RESULTS

Overall, 1046 people were screened between April 2015 and April 2016 (mean age 40.3 years, 640 (61.19%) female, 957 (91.49%) Aboriginal or Torres Strait Islander). High chronic disease rates were observed (231 [22.08%] participants at high cardiovascular disease (CVD) risk, 173 [16.54%] with diabetes, and 181 [17.30%] with albuminuria). A minority at high risk of CVD (99/231 [42.9%]) and with diabetes (73/173 [42.2%]) were meeting guideline-recommended management goals. Overall, 297 participants completed surveys (response rate 37.4%) with 85.1% reporting satisfaction with event organization and information gained and 6.1% experiencing problems with certain screening activities. Furthermore, 21 interviews were conducted. A strong local working group and processes that harnessed community social networks were key to implementation success. Although software enhancements facilitated screening and data management, some technical difficulties (eg, time delays in processing blood test results) impeded smooth processing of information. Only 51.43% of participants had a medical review recorded postevent with wide intersite variability (10.5%-85.6%). Factors associated with successful follow-up included clinic managers with overall program responsibility and availability of medical staff for immediate discussion of results on event day. The program was considered highly resource intensive to implement and support from a central coordinating body and integration with existing operational processes was essential.

CONCLUSIONS

1 Deadly Step offers an effective and acceptable strategy to engage Aboriginal communities in chronic disease screening. High rates of risk factors and management gaps were encountered, including people with no previous knowledge of these issues. Strategies to improve linkage to primary care could enhance the program's impact on reducing chronic disease burden.

Persuasive design features within a consumer-focused eHealth intervention integrated with the electronic health record: A mixed methods study of effectiveness and acceptability

INTRODUCTION

eHealth strategies targeting health-related behaviour often incorporate persuasive software design. To further engage patients with their overall health management, consumer-facing web portals may be integrated with data from one or more care providers. This study aimed to explore effectiveness for healthier behaviour of persuasive design characteristics within a web application integrated with the primary health care electronic record; also patient and general practitioner (GP) preferences for future integrated records.

METHODS

Mixed methods study within the Consumer Navigation of Electronic Cardiovascular Tools randomised controlled trial. Participants were patients with moderate-high risk of cardiovascular disease, and their GPs. Survey and web analytic data were analysed with descriptive statistics. Interview and focus group transcripts were recorded, transcribed, coded and analysed for themes.

RESULTS

Surveys (n = 397) received from patients indicated improved medication adherence (31.8%); improved mental health and well-being (40%); higher physical activity (47%); and healthier eating (61%). Users of the interactive features reported benefiting from personalised cardiovascular disease risk score (73%); goal tracking (69%); risk factor self-monitoring (52%) and receipt of motivational health tips (54%). Focus group and interview participants (n = 55) described customisations that would increase portal appeal and relevance, including more provider interaction. Of the GP survey respondents (n = 38), 74% reported increased patient attendance and engagement with their care. For future integrated portals, 94% of GPs were in favour and key themes among interviewees (n = 17) related to design optimisation, impact on workflow and data security.

CONCLUSION

Intervention features reflecting the persuasive design categories of Primary Task support, Dialogue support and System Credibility support facilitated healthier lifestyle behaviour. Patients valued customisable functions and greater patient-provider interactivity. GPs identified system challenges but saw advantages for patients and the health care relationship. Future studies could further elucidate the persuasive design principles that are at play and which may promote adoption of EHR-integrated consumer portals.

A User-Centered design and usability testing of a web-based medication reconciliation application integrated in an eHealth network

BACKGROUND

Medication discrepancies, which are a threat to patient safety, can be reduced by medication reconciliation (MedRec). MedRec is a complex process that can be supported by the use of information technology and patient engagement. Therefore, the SEAMPAT project aims to develop a MedRec IT platform based on two applications. The application for the professionals is called: the "MedRec app".

OBJECTIVE

In the present study, we aimed to describe the development and usability testing of the MedRec app, reporting results of a three iterations user-centered usability evaluation.

METHODS

We used a three phase iterative user-centered study spread over 16 months. At each phase, the usability evaluation included several methods (observations, questionnaires, and follow-up discussions with participants) to collect quantitative and qualitative data in order to improve the current prototype and evolve to the next prototype.

RESULTS

In total, 48 healthcare professionals (25 general practitioners and 23 hospital clinicians) participated to the MedRec app evaluation. There were 14, 32 and 5 participants for phases 1, 2 and 3 respectively. At each phase, many design modifications were done to strengthen usability. Concerning usability, participants considered the prototypes as an acceptable interface with a median System Usability Score of 73 at phase 2 and 75 at phase 3. Participants emphasized the need for improvements concerning workflow integration, usefulness and interoperability.

CONCLUSION

The MedRec app was perceived as being useful, usable and satisfying. However, further improvements are required in several usability aspects. Our study demonstrates the importance of conducting usability assessments before investing time and resources in a large study evaluating the effect of an eMedRec approach on clinical outcomes. Our findings may also increase the chances of acceptability and sustained use over time by clinicians.

Smart health and innovation: facilitating health-related behaviour change

Non-communicable diseases (NCD) are the leading cause of death globally. Smart health technology and innovation is a potential strategy for increasing reach and for facilitating health behaviour change. Despite rapid growth in the availability and affordability of technology there remains a paucity of published and robust research in the area as it relates to health. The objective of the present paper is to review and provide a snapshot of a variety of contemporary examples of smart health strategies with a focus on evidence and research as it relates to prevention with a CVD management lens. In the present analysis, five examples will be discussed and they include a physician-directed strategy, consumer directed strategies, a public health approach and a screening strategy that utilises external hardware that connects to a smartphone. In conclusion, NCD have common risk factors and all have an association with nutrition and health. Smart health and innovation is evolving rapidly and may help with diagnosis, treatment and management. While on-going research, development and knowledge is needed, the growth of technology development and utilisation offers opportunities to reach more people and achieve better health outcomes at local, national and international levels.

The Digital Heart Manual: A pilot study of an innovative cardiac rehabilitation programme developed for and with users

OBJECTIVE

Patients are seeking greater choice and flexibility in how they engage with self-management programmes. While digital innovations offer opportunities to deliver supportive interventions to patients undergoing cardiac rehabilitation little is known about how accessible, useful and acceptable they are for this group. This project developed a digital version of a leading evidenced cardiac rehabilitation programme, the Heart Manual (HM). The prototype was developed and evaluated iteratively in collaboration with end users.

METHODS

Using a mixed methods design 28 participants provided feedback using semi-structured questionnaires and telephone interviews.

RESULTS

Rich data revealed the perceived user-friendliness of the HM digital format and its effectiveness at communicating the programme's key messages. It flagged areas requiring development, such as more flexible and intuitive navigation pathways. These suggestions informed the refinement of the resource.

CONCLUSION

This evaluation offers support for the new Digital Heart Manual and confirms the value of employing a user-centred approach when developing and improving online interventions. The system is now in use and recommendations from the evaluation are being translated into quality improvements.

PRACTICE IMPLICATIONS

The Digital Heart Manual is user friendly and accessible to patients and health professionals, regardless of age, presenting a suitable alternative to the paper version.

Implementation of a consumer-focused eHealth intervention for people with moderate-to-high cardiovascular disease risk: protocol for a mixed-methods process evaluation

INTRODUCTION

Technology-mediated strategies have potential to engage patients in modifying unhealthy behaviour and improving medication adherence to reduce morbidity and mortality from cardiovascular disease (CVD). Furthermore, electronic tools offer a medium by which consumers can more actively navigate personal healthcare information. Understanding how, why and among whom such strategies have an effect can help determine the requirements for implementing them at a scale. This paper aims to detail a process evaluation that will (1) assess implementation fidelity of a multicomponent eHealth intervention; (2) determine its effective features; (3) explore contextual factors influencing and maintaining user engagement; and (4) describe barriers, facilitators, preferences and acceptability of such interventions.

METHODS AND ANALYSIS

Mixed-methods sequential design to derive, examine, triangulate and report data from multiple sources. Quantitative data from 3 sources will help to inform both sampling and content framework for the qualitative data collection: (1) surveys of patients and general practitioners (GPs); (2) software analytics; (3) programme delivery records. Qualitative data from interviews with patients and GPs, focus groups with patients and field notes taken by intervention delivery staff will be thematically analysed. Concurrent interview data collection and analysis will enable a thematic framework to evolve inductively and inform theory building, consistent with a realistic evaluation perspective. Eligible patients are those at moderate-to-high CVD risk who were randomised to the intervention arm of a randomised controlled trial of an eHealth intervention and are contactable at completion of the follow-up period; eligible GPs are the primary healthcare providers of these patients.

ETHICS AND DISSEMINATION

Ethics approval has been received from the University of Sydney Human Research Ethics Committee and the Aboriginal Health and Medical Research Council (AH&MRC) of New South Wales. Results will be disseminated via scientific forums including peer-reviewed publications and national and international conferences.

TRIAL REGISTRATION NUMBER

ANZCTR 12613000715774.

Examining the use of process evaluations of randomised controlled trials of complex interventions addressing chronic disease in primary health care-a systematic review protocol

BACKGROUND

Randomised controlled trials (RCTs) of complex interventions in primary health care (PHC) are needed to provide evidence-based programmes to achieve the Declaration of Alma Ata goal of making PHC equitable, accessible and universal and to effectively address the rising burden from chronic disease. Process evaluations of these RCTs can provide insight into the causal mechanisms of complex interventions, the contextual factors, and inform as to whether an intervention is ineffective due to implementation failure or failure of the intervention itself. To build on this emerging body of work, we aim to consolidate the methodology and methods from process evaluations of complex interventions in PHC and their findings of facilitators and barriers to intervention implementation in this important area of health service delivery.

METHODS

Systematic review of process evaluations of randomised controlled trials of complex interventions which address prevalent major chronic diseases in PHC settings. Published process evaluations of RCTs will be identified through database and clinical trial registry searches and contact with authors. Data from each study will be extracted by two reviewers using standardised forms. Data extracted include descriptive items about (1) the RCT, (2) about the process evaluations (such as methods, theories, risk of bias, analysis of process and outcome data, strengths and limitations) and (3) any stated barriers and facilitators to conducting complex interventions. A narrative synthesis of the findings will be presented.

DISCUSSION

Process evaluation findings are valuable in determining whether a complex intervention should be scaled up or modified for other contexts. Publishing this protocol serves to encourage transparency in the reporting of our synthesis of current literature on how process evaluations have been conducted thus far and a deeper understanding of potential challenges and solutions to aid in the implementation of effective interventions in PHC beyond the research setting.

SYSTEMATIC REVIEW REGISTRATION

PROSPERO CRD42016035572.