Implementation of a consumer-focused eHealth intervention for people with moderate-to-high cardiovascular disease risk: protocol for a mixed-methods process evaluation

Understanding Whether and How a Digital Health Intervention Improves Transition Care for Emerging Adults Living With Type 1 Diabetes: Protocol for a Mixed Methods Realist Evaluation

BACKGROUND

Emerging adults living with type 1 diabetes (T1D) face a series of challenges with self-management and decreased health system engagement, leading to an increased risk of acute complications and hospital admissions. Effective and scalable strategies are needed to support this population to transfer seamlessly from pediatric to adult care with sufficient self-management capability. While digital health interventions for T1D self-management are a promising strategy, it remains unclear which elements work, how, and for which groups of individuals.

OBJECTIVE

This study aims to evaluate the design and implementation of a multicomponent SMS text message-based digital health intervention to support emerging adults living with T1D in real-world settings. The objectives are to identify the intervention components and associated mechanisms that support user engagement and T1D health care transition experiences and determine the individual characteristics that influence the implementation process.

METHODS

We used a realist evaluation embedded alongside a randomized controlled trial, which uses a sequential mixed methods design to analyze data from multiple sources, including intervention usage data, patient-reported outcomes, and realist interviews. In step 1, we conducted a document analysis to develop a program theory that outlines the hypothesized relationships among "individual-level contextual factors, intervention components and features, mechanisms, and outcomes," with special attention paid to user engagement. Among them, intervention components and features depict 10 core characteristics such as transition support information, problem-solving information, and real-time interactivity. The proximal outcomes of interest include user engagement, self-efficacy, and negative emotions, whereas the distal outcomes of interest include transition readiness, self-blood glucose monitoring behaviors, and blood glucose. In step 2, we plan to conduct semistructured realist interviews with the randomized controlled trial's intervention-arm participants to test the hypothesized "context-intervention-mechanism-outcome" configurations. In step 3, we plan to triangulate all sources of data using a coincidence analysis to identify the necessary combinations of factors that determine whether and how the desired outcomes are achieved and use these insights to consolidate the program theory.

RESULTS

For step 1 analysis, we have developed the initial program theory and the corresponding data collection plan. For step 2 analysis, participant enrollment for the randomized controlled trial started in January 2023. Participant enrollment for this realist evaluation was anticipated to start in July 2023 and continue until we reached thematic saturation or achieved informational power.

CONCLUSIONS

Beyond contributing to knowledge on the multiple pathways that lead to successful engagement with a digital health intervention as well as target outcomes in T1D care transitions, embedding the realist evaluation alongside the trial may inform real-time intervention refinement to improve user engagement and transition experiences. The knowledge gained from this study may inform the design, implementation, and evaluation of future digital health interventions that aim to improve transition experiences.

INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID)

PRR1-10.2196/46115.

Evaluation of the "Shifting Weight using Intermittent Fasting in night-shift workers" weight loss interventions: a mixed-methods protocol

Introduction

Shift workers are at a greater risk for obesity-related conditions. The impacts of working at night presents a challenge for designing effective dietary weight-loss interventions for this population group. The Shifting Weight using Intermittent Fasting in night-shift workers (SWIFt) study is a world-first, randomized controlled trial that compares three weight-loss interventions. While the trial will evaluate the effectiveness of weight-loss outcomes, this mixed-methods evaluation aims to explore for who weight-loss outcomes are achieved and what factors (intervention features, individual, social, organisational and wider environmental) contribute to this.

Methods

A convergent, mixed-methods evaluation design was chosen where quantitative and qualitative data collection occurs concurrently, analyzed separately, and converged in a final synthesis. Quantitative measures include participant engagement assessed via: dietary consult attendance, fulfillment of dietary goals, dietary energy intake, adherence to self-monitoring, and rates for participant drop-out; analyzed for frequency and proportions. Regression models will determine associations between engagement measures, participant characteristics (sex, age, ethnicity, occupation, shift type, night-shifts per week, years in night shift), intervention group, and weight change. Qualitative measures include semi-structured interviews with participants at baseline, 24-weeks, and 18-months, and fortnightly audio-diaries during the 24-week intervention. Interviews/diaries will be transcribed verbatim and analyzed using five-step thematic framework analysis in NVivo. Results from the quantitative and qualitative data will be integrated via table and narrative form to interrogate the validity of conclusions.

Discussion

The SWIFt study is a world-first trial that compares the effectiveness of three weight-loss interventions for night shift workers. This mixed-methods evaluation aims to further explore the effectiveness of the interventions. The evaluation will determine for who the SWIFt interventions work best for, what intervention features are important, and what external factors need to be addressed to strengthen an approach. The findings will be useful for tailoring future scalability of dietary weight-loss interventions for night-shift workers.Clinical trial registration: This evaluation is based on the SWIFt trial registered with the Australian New Zealand Clinical Trials Registry [ACTRN 12619001035112].

Sustainability of the Effects and Impacts of Using Digital Technology to Extend Maternal Health Services to Rural and Hard-to-Reach Populations: Experience From Southwest Nigeria

Background

Nigeria has one of the worst health and development profiles globally. A weak health system, poor infrastructure, and varied socio-cultural factors are cited as inhibitors to optimal health system performance and improved maternal and child health status. eHealth has become a major solution to closing these gaps in health care delivery in low- and middle-income countries (LMICs). This research reports the use of satellite communication (SatCom) technology and the existing 3G mobile network for providing video training (VTR) for health workers and improving the digitization of healthcare data.

Objective

To evaluate whether the expected project outcomes that were achieved at the end-line evaluation of 2019 were sustained 12 months after the project ended.

Methods

From March 2017 to March 2019, digital innovations including VTR and data digitization interventions were delivered in 62 healthcare facilities in Ondo State, southwest Nigeria, most of which lacked access to a 3G mobile network. Data collection for the evaluation combined documents' review with quantitative data extracted from health facility registers, and 24 of the most significant change stories to assess the longevity of the outcomes and impacts of digital innovation in the four domains of healthcare: use of eHealth technology for data management, utilization of health facilities by patients, the standard of care, and staff attitude. Stories of the most significant changes were audio-recorded, transcribed for analysis, and categorized by the above domains to identify the most significant changes 12 months after the project closedown.

Results

Findings showed that four project outcomes which were achieved at end-line evaluation were sustained 12 months after project closedown namely: staff motivation and satisfaction; increased staff confidence to perform healthcare roles; improved standard of healthcare delivery; and increased adoption of eHealth innovations beyond the health sector. Conversely, an outcome that was reversed following the discontinuation of SatCom from health facilities is the availability of accurate and reliable data for decision-making.

Conclusion

Digital technology can have lasting impacts on health workers, patients, and the health system, through improving data management for decision-making, the standard of maternity service delivery, boosting attendance at health facilities, and utilization of services. Locally driven investment is essential for ensuring the long-term survival of eHealth projects to achieve sustainable development goals (SDGs) in LMICs.

An Internet-Based Intervention for Cardiovascular Disease Management Integrated With Primary Care Electronic Health Records: Mixed Methods Evaluation of Implementation Fidelity and User Engagement

Background

Growing evidence supports the benefits of eHealth interventions to increase patient engagement and improve outcomes for a range of conditions. However, ineffective program delivery and usage attrition limit exposure to these interventions and may reduce their effectiveness.

Objective

This study aims to evaluate the delivery fidelity of an eHealth intervention, describe use patterns, compare outcomes between low and high users, and identify mediating factors on intervention delivery and receipt.

Methods

This is a mixed methods study of an internet-based intervention being evaluated for effectiveness in a randomized controlled trial (RCT). The intervention comprised medication and cardiovascular disease (CVD) risk data uploaded from the primary care electronic health record (EHR); interactive, personalized CVD risk score estimation; goal setting and self-monitoring; an interactive social forum; and optional receipt of heart health messages. Fidelity was assessed over 12 months. Trial outcomes were compared between low and high users. Data sources included program delivery records, web log data, trial data, and thematic analysis of communication records.

Results

Most participants in the intervention group (451/486, 93%) had an initial training session conducted by telephone (413/447, 92.4% of participants trained), with a mean duration of 44 minutes (range 10-90 minutes). Staff conducted 98.45% (1776/1804) of the expected follow-ups, mostly by telephone or email. Of the 451 participants who commenced log-ins, 46.8% (211) were categorized as low users (defined as at least one log-in in 3 or fewer months of follow-up), 40.4% (182) were categorized as high users (at least one log-in in more than 3 months of follow-up), and 12.8% (58) were nonadopters (no log-ins after their training session). The mean log-in frequency was 3-4 per month in ongoing users. There was no significant difference between the groups in the primary trial outcome of adherence to guideline-recommended medications (P=.44). In unadjusted analyses, high users had significantly greater eHealth literacy scores (P=.003) and were more likely to meet recommended weekly targets for fruit (P=.03) and fish (P=.004) servings; however, the adjusted findings were not significant. Interactive screen use was highest for goal tracking and lowest for the chat forum. Screens with EHR-derived data held only an early interest for most users. Fidelity measures (reach, content, dose delivered, and dose received) were influenced by the facilitation strategies used by staff, invisible qualities of staff-participant communication, and participants’ responsiveness to intervention attributes.

Conclusions

A multifeature internet-based intervention was delivered with high fidelity to the RCT protocol and was regularly used by 40.4% (182/451) of users over 12 months. Higher log-in frequency as an indicator of greater intervention exposure was not associated with statistically significant improvements in eHealth literacy scores, lifestyle changes, or clinical outcomes. Attributes of the intervention and individualized support influenced initial and ongoing use.

Electronic Health Interventions in the Case of Multiple Sclerosis: From Theory to Practice

(1) Background: eHealth interventions play a growing role in shaping the future healthcare system. The integration of eHealth interventions can enhance the efficiency and quality of patient management and optimize the course of treatment for chronically ill patients. In this integrative review, we discuss different types of interventions, standards and advantages of quality eHealth approaches especially for people with multiple sclerosis (pwMS). (2) Methods: The electronic databases PubMed, Cochrane and Web of Science were searched to identify potential articles for eHealth interventions in pwMS; based on 62 articles, we consider different ways of implementing health information technology with various designs. (3) Results: There already exist some eHealth interventions for single users with a single-use case, interventions with a social setting, as well as eHealth interventions that integrate various single and social interventions and even those that may be used additionally for complex use cases. A key determinant of consumer acceptance is a high-quality user-centric design for healthcare practitioners and pwMS. In pwMS, the different neurological disabilities should be considered, and particular attention must be paid to the course of the treatment and the safety processes of each treatment option. (4) Conclusion: Depending on the field of application and the respective users, interventions are designed for single, social, integrated or complex use. In order to be accepted by their target group, interventions must be beneficial and easy to use.

EatSmart, a Web-Based and Mobile Healthy Eating Intervention for Disadvantaged People With Type 2 Diabetes: Protocol for a Pilot Mixed Methods Intervention Study

Background

People of low socioeconomic position (SEP) are disproportionately affected by type 2 diabetes (T2D), partly due to unhealthy eating patterns that contribute to inadequate disease self-management and prognosis. Digital technologies have the potential to provide a suitable medium to facilitate diabetes education, support self-management, and address some of the barriers to healthy eating, such as lack of nutritional knowledge or shopping or cooking skills, in this target group.

Objective

This study aims to test the feasibility, appeal, and potential effectiveness of EatSmart, a 12-week, evidence-based, theoretically grounded, fully automated web-based and mobile-delivered healthy eating behavior change program to help disadvantaged people living with T2D to eat healthily on a budget and improve diabetes self-management.

Methods

EatSmart is a mixed methods (quantitative and qualitative) pre-post design pilot study. Sixty socioeconomically disadvantaged people with T2D aged 18 to 75 years will be recruited. Participants will complete self-reported baseline assessments of their basic demographic and clinical data, dietary intake, dietary self-efficacy, and barriers to healthy eating. They will be provided with login access to the EatSmart web program, which includes six progressive skill-based modules covering healthy eating planning; smart food budgeting and shopping; time-saving meal strategies, healthy cooking methods, modifying recipes; and a final reinforcement and summary module. Over the 3-month intervention, participants will also receive 3 text messages weekly, encouraging them to review goals, continue to engage with different components of the EatSmart web program, and eat healthily. Participants will undertake follow-up assessments directly following the intervention 3 months post baseline and again after a 6-month postintervention follow-up period (9 months post baseline). Feasibility will be evaluated using the number of participants recruited and retained and objective indicators of engagement with the website. Program appeal and potential effects on primary and secondary outcomes will be assessed via the same surveys used at baseline, with additional questions asking about experience with and perceptions of the program. In-depth qualitative interviews will also be conducted 6 months post intervention to provide deeper insight into experiences with EatSmart and a more comprehensive description of the program’s appeal.

Results

The EatSmart website has been developed, and all participants have viewed the modules as of May 2020. Results are expected to be submitted for publication in December 2020.

Conclusions

This study will provide data to address the currently limited evidence regarding whether disadvantaged populations with T2D may benefit from digitally delivered behavior change programs that facilitate eating healthily on a budget.

Trial Registration

Australian New Zealand Clinical Trials Registry, ACTRN12619001111167; https://anzctr.org.au/Trial/Registration/TrialReview.aspx?ACTRN=12619001111167

International Registered Report Identifier (IRRID)

DERR1-10.2196/19488

A realist evaluation approach to explaining the role of context in the impact of a complex eHealth intervention for improving prevention of cardiovascular disease

Background

Reduction of cardiovascular disease (CVD) is a worldwide health priority and innovative uses of technology-based interventions may assist patients with improving prevention behaviours. Targeting these interventions to recipients most likely to benefit requires understanding how contexts of use influence responsiveness to the intervention, and how this interaction favours or discourages health behaviour. Using a realist evaluation approach, the aim of this study was to examine the contextual factors influencing behaviour change within a multi-feature eHealth intervention with personalised data integration from the primary care electronic health record (EHR).

Methods

Realist evaluation of qualitative data from the Consumer Navigation of Electronic Cardiovascular Tools (CONNECT) randomised trial (N = 934). Thirty-six participants from the intervention group (N = 486) who had completed 12 months of study follow-up were interviewed. Coding of transcripts was structured around configurations of contexts, mechanisms, and outcomes of intervention use. Contextual narratives were derived from thematic analysis of the interviews.

Results

Mechanisms favouring positive health behaviour occurred when participants responded to four interactive features of the intervention. Facilitating mechanisms included greater cognitive engagement whereby participants perceived value and benefit, and felt motivated, confident and incentivised. Participants moved from being unconcerned (or unaware) to more task-oriented engagement with personal CVD risk profile and prevention. Increased personalisation occurred when modifiable CVD risk factors became relatable to lifestyle behaviour; and experiences of feeling greater agency/self-efficacy emerged. Use and non-use of the intervention were influenced by four overarching narratives within the individual’s micro-level and meso-level environments: illness experiences; receptiveness to risk and prevention information; history of the doctor-patient relationship; and relationship with technology.

Conclusions

Intervention-context interactions are central to understanding how change mechanisms activate within complex interventions to exert their impact on recipients. Intervention use and non-use were context-dependent, underscoring the need for further research to target eHealth innovations to those most likely to benefit.

Investigating the Use of Mobile Health Interventions in Vulnerable Populations for Cardiovascular Disease Management: Scoping Review

Background

Cardiovascular disease (CVD) has grown to become one of the leading causes of mortality worldwide. The advancements of CVD-related treatments have led to a decline in CVD prevalence among individuals in high-income countries (HICs). However, these improvements do not reflect the state of individuals in low- and middle-income countries (LMICs) and vulnerable subgroup populations in HICs, such as the Indigenous. To help minimize the health disparities in these populations, technology-based interventions have been offered as a potential solution, but there is concern regarding if they will be effective, or even needed, as these tools have been designed for use in HICs.

Objective

The objective of this study was to explore how mobile health (mHealth) interventions currently assist individuals in Indigenous communities and LMICs with CVD management.

Methods

A scoping review guided by the methods outlined by Arksey and O’Malley was conducted. A comprehensive search was completed by 2 reviewers in 5 electronic databases using keywords related to mobile health, cardiovascular disease, self-care, Indigenous communities, and LMICs. Studies were screened over 2 rounds and critically reviewed using a descriptive-analytical narrative method. Descriptive data were categorized into thematic groups reflecting the major findings related to the study objective.

Results

We identified a total of 11 original articles and 11 review papers that met the criteria for this scoping review. The majority of the studies included a telemonitoring- and text messaging (short message service, SMS)–related feature associated with the intervention. The use of SMS was the most common approach to effectively promote disease management among individuals in both LMICs and Indigenous communities. However, customizing for cultural considerations within the design of the intervention was highlighted as a pivotal component to encourage CVD management. Specifically, individuals emphasized that the inclusion of collaborative partnerships with community members would strengthen the effectiveness of the intervention by ensuring it was designed with the appropriate context.

Conclusions

Technology-based interventions used within Indigenous communities and LMICs have shown their potential to assist individuals with managing their condition. Although the literature available regarding this topic is limited, this review outlines key components to promote the effective use of these tools in the context of these vulnerable populations.

Persuasive design features within a consumer-focused eHealth intervention integrated with the electronic health record: A mixed methods study of effectiveness and acceptability

INTRODUCTION

eHealth strategies targeting health-related behaviour often incorporate persuasive software design. To further engage patients with their overall health management, consumer-facing web portals may be integrated with data from one or more care providers. This study aimed to explore effectiveness for healthier behaviour of persuasive design characteristics within a web application integrated with the primary health care electronic record; also patient and general practitioner (GP) preferences for future integrated records.

METHODS

Mixed methods study within the Consumer Navigation of Electronic Cardiovascular Tools randomised controlled trial. Participants were patients with moderate-high risk of cardiovascular disease, and their GPs. Survey and web analytic data were analysed with descriptive statistics. Interview and focus group transcripts were recorded, transcribed, coded and analysed for themes.

RESULTS

Surveys (n = 397) received from patients indicated improved medication adherence (31.8%); improved mental health and well-being (40%); higher physical activity (47%); and healthier eating (61%). Users of the interactive features reported benefiting from personalised cardiovascular disease risk score (73%); goal tracking (69%); risk factor self-monitoring (52%) and receipt of motivational health tips (54%). Focus group and interview participants (n = 55) described customisations that would increase portal appeal and relevance, including more provider interaction. Of the GP survey respondents (n = 38), 74% reported increased patient attendance and engagement with their care. For future integrated portals, 94% of GPs were in favour and key themes among interviewees (n = 17) related to design optimisation, impact on workflow and data security.

CONCLUSION

Intervention features reflecting the persuasive design categories of Primary Task support, Dialogue support and System Credibility support facilitated healthier lifestyle behaviour. Patients valued customisable functions and greater patient-provider interactivity. GPs identified system challenges but saw advantages for patients and the health care relationship. Future studies could further elucidate the persuasive design principles that are at play and which may promote adoption of EHR-integrated consumer portals.

A process and mechanism of action evaluation of the effect of early and intensive nutrition care, delivered via telephone or mobile application, on quality of life in people with upper gastrointestinal cancer: a study protocol

Background

Cancers of the upper gastrointestinal tract commonly result in malnutrition, which increases morbidity and mortality. Current nutrition best practice lacks a mechanism to provide early and intensive nutrition support to these patients. A 3-arm parallel randomised controlled trial is testing the provision of a tailored, nutritional counselling intervention delivered using a synchronous, telephone-based approach or an asynchronous, mobile application-based approach to address this problem. This protocol outlines the design and methods that will be used to undertake an evaluation of the implementation process, which is imperative for successful replication and dissemination.

Methods

A concurrent triangulation mixed methods comparative analysis will be undertaken. The nutrition intervention will be provided using best practice behaviour change techniques and communicated either via telephone or via mHealth. The implementation outcomes that will be measured are: fidelity to the nutrition intervention protocol and to the delivery approach; engagement; acceptability and contextual factors. Qualitative data from recorded telephone consultations and written messages will be analysed through a coding matrix against the behaviour change techniques outlined in the standard operating procedure, and also thematically to determine barriers and enablers. Negative binomial regression will be used to test for predictive relationships between intervention components with health-related quality of life and nutrition outcomes. Post-intervention interviews with participants and health professionals will be thematically analysed to determine the acceptability of delivery approaches. NVivo 11 Pro software will be used to code for thematic analysis. STATA version 15 will be used to perform quantitative analysis.

Discussion

The findings of this process evaluation will provide evidence of the core active ingredients that enable the implementation of best practice nutrition intervention for people with upper gastrointestinal cancer. Elucidation of the causal pathways of successful implementation and the important relationship to contextual delivery are anticipated. With this information, a strategy for sustained implementation across broader settings will be developed which impact the quality of life and nutritional status of individuals with upper gastrointestinal cancer.

Trial registration

27th January 2017 Australian and New Zealand Clinical Trial Registry (ACTRN12617000152325).

Process evaluation of a primary healthcare validation study of a culturally adapted depression screening tool for use by Aboriginal and Torres Strait Islander people: study protocol

INTRODUCTION

Process evaluations are conducted alongside research projects to identify the context, impact and consequences of research, determine whether it was conducted per protocol and to understand how, why and for whom an intervention is effective. We present a process evaluation protocol for the Getting it Right research project, which aims to determine validity of a culturally adapted depression screening tool for use by Aboriginal and Torres Strait Islander people. In this process evaluation, we aim to: (1) explore the context, impact and consequences of conducting Getting It Right, (2) explore primary healthcare staff and community representatives' experiences with the research project, (3) determine if it was conducted per protocol and (4) explore experiences with the depression screening tool, including perceptions about how it could be implemented into practice (if found to be valid). We also describe the partnerships established to conduct this process evaluation and how the national Values and Ethics: Guidelines for Ethical Conduct in Aboriginal and Torres Strait Islander Health Research is met.

METHODS AND ANALYSIS

Realist and grounded theory approaches are used. Qualitative data include semistructured interviews with primary healthcare staff and community representatives involved with Getting it Right. Iterative data collection and analysis will inform a coding framework. Interviews will continue until saturation of themes is reached, or all participants are considered. Data will be triangulated against administrative data and patient feedback. An Aboriginal and Torres Strait Islander Advisory Group guides this research. Researchers will be blinded from validation data outcomes for as long as is feasible.

ETHICS AND DISSEMINATION

The University of Sydney Human Research Ethics Committee, Aboriginal Health and Medical Research Council of New South Wales and six state ethics committees have approved this research. Findings will be submitted to academic journals and presented at conferences.

TRIAL REGISTRATION NUMBER

ACTRN12614000705684.