Attending to design when developing complex health interventions: A qualitative interview study with intervention developers and associated stakeholders

Scope, Characteristics, Behavior Change Techniques, and Quality of Conversational Agents for Mental Health and Well-Being: Systematic Assessment of Apps

BACKGROUND

Mental disorders cause substantial health-related burden worldwide. Mobile health interventions are increasingly being used to promote mental health and well-being, as they could improve access to treatment and reduce associated costs. Behavior change is an important feature of interventions aimed at improving mental health and well-being. There is a need to discern the active components that can promote behavior change in such interventions and ultimately improve users' mental health.

OBJECTIVE

This study systematically identified mental health conversational agents (CAs) currently available in app stores and assessed the behavior change techniques (BCTs) used. We further described their main features, technical aspects, and quality in terms of engagement, functionality, esthetics, and information using the Mobile Application Rating Scale.

METHODS

The search, selection, and assessment of apps were adapted from a systematic review methodology and included a search, 2 rounds of selection, and an evaluation following predefined criteria. We conducted a systematic app search of Apple's App Store and Google Play using 42matters. Apps with CAs in English that uploaded or updated from January 2020 and provided interventions aimed at improving mental health and well-being and the assessment or management of mental disorders were tested by at least 2 reviewers. The BCT taxonomy v1, a comprehensive list of 93 BCTs, was used to identify the specific behavior change components in CAs.

RESULTS

We found 18 app-based mental health CAs. Most CAs had <1000 user ratings on both app stores (12/18, 67%) and targeted several conditions such as stress, anxiety, and depression (13/18, 72%). All CAs addressed >1 mental disorder. Most CAs (14/18, 78%) used cognitive behavioral therapy (CBT). Half (9/18, 50%) of the CAs identified were rule based (ie, only offered predetermined answers) and the other half (9/18, 50%) were artificial intelligence enhanced (ie, included open-ended questions). CAs used 48 different BCTs and included on average 15 (SD 8.77; range 4-30) BCTs. The most common BCTs were 3.3 "Social support (emotional)," 4.1 "Instructions for how to perform a behavior," 11.2 "Reduce negative emotions," and 6.1 "Demonstration of the behavior." One-third (5/14, 36%) of the CAs claiming to be CBT based did not include core CBT concepts.

CONCLUSIONS

Mental health CAs mostly targeted various mental health issues such as stress, anxiety, and depression, reflecting a broad intervention focus. The most common BCTs identified serve to promote the self-management of mental disorders with few therapeutic elements. CA developers should consider the quality of information, user confidentiality, access, and emergency management when designing mental health CAs. Future research should assess the role of artificial intelligence in promoting behavior change within CAs and determine the choice of BCTs in evidence-based psychotherapies to enable systematic, consistent, and transparent development and evaluation of effective digital mental health interventions.

Acceptability and applicability of an intervention programme with substance addicts

The complexity of the problems related to the harmful use of substances requires regular questioning of practices. This article aims to explore the acceptability and applicability of an intervention programme for patients with problematic substance use. Qualitative study. Data collection, through a focus group with 6 nurses and 6 semi-structured interviews with patients under treatment. We have used lexicographic textual analysis. From the focus group, 151 text segments were analysed, retaining 85.8% of the total for the creation of five classes. An analysis of similarity led to the formation of two central nuclei, represented by the words "Nursing" and "Intervention". From interviews, 252 text segments were analysed, retaining 71.83% for the creation of 5 classes. An analysis of similarity led to the formation of three central nuclei, represented by the words "want", "programme" and "see". Nurses recognise the need for a more structured and flexible approach focused on people's needs. Users also affirm the need for flexible interventions, without a pre-established time frame, that promote labour integration, therapeutic support for abstinence and management of comorbidities.

Designing financial incentives for health behaviour change: a mixed-methods case study of weight loss in men with obesity

Aim

Designing financial incentives for health behaviour change requires choices across several domains, including value (the size of the incentive), frequency of incentives, and direction (gain or loss). However, the rationale underlying complex incentive design is infrequently reported. Transparent reporting is important if we want to understand and improve the incentive development process. This paper describes a mixed methods approach for designing financial incentives for health behaviour change which involves stakeholders throughout the design process.

Subject and methods

The mixed methods approach focuses on incentives for weight loss for men with obesity living in areas with high levels of disadvantage. The approach involves: (a) using an existing framework to identify all domains of a financial incentive scheme for which choices need to be made, deciding what criteria are relevant (such as effectiveness, acceptability and uptake) and making choices on each domain on the basis of the criteria; (b) conducting a survey of target population preferences to inform choices for domains and to design the incentive scheme; and (c) making final decisions at a stakeholder consensus workshop.

Results

The approach was implemented and an incentive scheme for weight loss for men living with obesity was developed. Qualitative interview data from men receiving the incentives in a feasibility trial endorses our approach.

Conclusion

This paper demonstrates that a mixed methods approach with stakeholder involvement can be used to design financial incentives for health behaviour change such as weight loss.

Trial registration number

NCT03040518. Date: 2 February 2017.

Conceptual tensions and practical trade-offs in tailoring implementation interventions

Tailored interventions have been shown to be effective and tailoring is a popular process with intuitive appeal for researchers and practitioners. However, the concept and process are ill-defined in implementation science. Descriptions of how tailoring has been applied in practice are often absent or insufficient in detail. This lack of transparency makes it difficult to synthesize and replicate efforts. It also hides the trade-offs for researchers and practitioners that are inherent in the process. In this article we juxtapose the growing prominence of tailoring with four key questions surrounding the process. Specifically, we ask: (1) what constitutes tailoring and when does it begin and end?; (2) how is it expected to work?; (3) who and what does the tailoring process involve?; and (4) how should tailoring be evaluated? We discuss these questions as a call to action for better reporting and further research to bring clarity, consistency, and coherence to tailoring, a key process in implementation science.

Exploring the perspectives of people with stroke, caregivers and healthcare professionals on the design and delivery of a mHealth adaptive physical activity intervention: a qualitative study protocol

Background: Despite recent advances in acute stroke intervention, secondary prevention strategies are lacking. Physical activity (PA) is the second-largest predictor of stroke and a cornerstone of secondary prevention therapies. Interventions to promote PA post-stroke include components aimed at reducing sedentary behaviour and increasing participation in lifestyle PA and structured exercise. Despite guidelines to adapt PA to individuals’ needs, there is no evidence on the empirical development of adaptive PA interventions post-stroke. This study will explore patient, caregiver and multidisciplinary healthcare professional perspectives on the design and delivery of adaptive, personalised PA interventions, delivered using a smartphone application, following mild-to-moderate stroke. Findings will directly inform the protocol of an experimental trial, using a novel adaptive trial design.   Methods: A descriptive qualitative study will be undertaken to inform the design, delivery and subsequent acceptability of a smartphone application to reduce sedentary behaviour and promote PA post-stroke. Data will be collected via one-to-one interviews and focus groups and analysed according to a six-step thematic analysis. Findings will be reported in accordance with the consolidated criteria for reporting qualitative research (COREQ) checklist. One-to-one interviews and focus group interviews will be conducted with three stakeholder groups: 1) People post-stroke, who are independently mobile, without communication and cognitive deficits, living in the community, and without other diagnosed neurological conditions. 2) Caregivers (formal and informal) involved in post-stroke care.  3) Healthcare professionals who are members of multidisciplinary stroke teams. Ethics and dissemination: Ethical approval has been granted by the Faculty of Education and Health Sciences Research Ethics Committee at the University of Limerick [Ref: 2019_10_03_ EHS]. Findings will be shared locally with all stakeholder groups, submitted for publication, and will inform the protocol and conduct for a novel and flexible experimental trial, examining the effectiveness of an adaptive PA intervention post-stroke.

A collaborative approach to develop an intervention to strengthen health visitors' role in prevention of excess weight gain in children

BACKGROUND

The high prevalence of childhood obesity is a concern for public health policy and practitioners, leading to a focus on early prevention. UK health visitors (HVs) are well-positioned to prevent excessive weight gain trends in pre-school children but experience barriers to implementing guideline recommended practices. This research engaged with HVs to design an intervention to strengthen their role in prevention of early childhood obesity.

METHODS

We describe the processes we used to develop a behaviour change intervention and measures to test its feasibility. We conducted a systematic review to identify factors associated with implementation of practices recommended for prevention of early childhood obesity. We carried out interactive workshops with HVs who deliver health visiting services in County Durham, England. Workshop format was informed by the behaviour change wheel framework for developing theory-based interventions and incorporated systematic review evidence. As intended recipients of the intervention, HVs provided their views of what is important and acceptable in the local context. The findings of the workshops were combined in an iterative process to inform the four steps of the Implementation Intervention development framework that was adapted as a practical guide for the development process.

RESULTS

Theoretical analysis of the workshop findings revealed HVs' capabilities, opportunities and motivations related to prevention of excess weight in 0-2 year olds. Intervention strategies deemed most likely to support implementation (enablement, education, training, modelling, persuasion) were combined to design an interactive training intervention. Measures to test acceptability, feasibility, and fidelity of delivery of the proposed intervention were identified.

CONCLUSIONS

An interactive training intervention has been designed, informed by theory, evidence, and expert knowledge of HVs, in an area of health promotion that is currently evolving. This research addresses an important evidence-practice gap in prevention of childhood obesity. The use of a systematic approach to the development process, identification of intervention contents and their hypothesised mechanisms of action provides an opportunity for this research to contribute to the body of literature on designing of implementation interventions using a collaborative approach. Future research should be directed to evaluate the acceptability and feasibility of the intervention.

Promoting Health Behavior Change in the Preconception Period: Combined Approach to Intervention Planning

Background

Half of women begin pregnancy above the healthy weight range, increasing the risk of complications and adversely affecting the lifelong health of their babies. Maternal obesity remains the strongest risk factor for offspring obesity across childhood, adolescence, and adulthood. Previous research suggests that women should be encouraged to be within a healthy weight range before conception to improve health outcomes.

Objective

We outlined the intervention planning and design process to develop an evidence-informed eHealth intervention to promote weight management. The intervention, based on psychological theories and behavior change techniques, has been developed for women affected by overweight or obesity who intend to become pregnant. The Begin Better web application is part of an integrated program being evaluated in a clinical trial to assess if weight management before pregnancy can influence clinical outcomes for mothers and babies.

Methods

Our intervention development process was guided by intervention mapping and person-based methods. This study documents steps 2 to 4 of a 6-step iterative intervention mapping approach informed by the Information-Motivation-Behavioral Skills model and the findings of a previous interview study. We defined behavior change objectives for each of the Information-Motivation-Behavioral Skills behavioral determinants as well as theory-based behavior change techniques and practical strategies. We also used persuasive system design principles to assist in translating these strategies into a digital environment.

Results

The resultant intervention comprises nutritional and physical activity content along with psychological strategies, which are notably absent from mainstream weight management programs. Strategies to increase motivation, garner social support, and promote self-care are integral to maintaining engagement with the intervention, which aims to improve lifestyle behaviors and enhance well-being. Important elements include tracking mechanisms for percentage progress toward goals to enable feedback on behaviors and outcomes; in-application messages of praise on entry of goals or habits; and strategies to prompt habit formation and action planning via small, easily achievable steps toward positive change.

Conclusions

Design decisions and processes for idea generation about intervention content, format, and delivery are often not reported. In this study, we respond to this gap in the literature and outline a process that is potentially transferable to the development of other interventions.

Human-Centered Design for Public Health Innovation: Codesigning a Multicomponent Intervention to Support Youth Across the HIV Care Continuum in Mozambique

Adolescents and young people represent a growing proportion of people living with HIV (AYAHIV), and there is an urgent need to design, implement, and test interventions that retain AYAHIV in care. Using a human-centered design (HCD) approach, we codesigned CombinADO, an intervention to promote HIV viral suppression and improve antiretroviral therapy (ART) adherence and retention in care among AYAHIV in Nampula, Mozambique. The HCD process involves formative design research with AYAHIV, health care providers, parents/caretakers, and experts in adolescent HIV; synthesis of findings to generate action-oriented insights; ideation and prototyping of intervention components; and a pilot study to assess feasibility, acceptability, and uptake of intervention components.CombinADO promotes ART adherence and retention in care by fostering peer connectedness and belonging, providing accessible medical knowledge, demystifying and destigmatizing HIV, and cultivating a sense of hope among AYAHIV. Successful prototypes included a media campaign to reduce HIV stigma and increase medical literacy; a toolkit to help providers communicate and address the unique needs of AYAHIV clients; peer-support groups to improve medical literacy, empower youth, and provide positive role models for people living with HIV; support groups for parents/caregivers; and discreet pill containers to promote adherence outside the home. In the next phase, the effectiveness of CombinaADO on retention in care, ART adherence, and viral suppression will be evaluated using a cluster-randomized control trial.We demonstrate the utility of using HCD to cocreate a multicomponent intervention to retain AYAHIV in care. We also discuss how the HCD methodology enriches participatory methods and community engagement. This is then illustrated by the youth-driven intervention development of CombinADO by fostering youth empowerment, addressing power imbalances between youth and adult stakeholders, and ensuring that language and content remain adolescent friendly.

Co-production practice and future research priorities in United Kingdom-funded applied health research: a scoping review

BACKGROUND

Interest in and use of co-production in healthcare services and research is growing. Previous reviews have summarized co-production approaches in use, collated outcomes and effects of co-production, and focused on replicability and reporting, but none have critically reflected on how co-production in applied health research might be evolving and the implications of this for future research. We conducted this scoping review to systematically map recent literature on co-production in applied health research in the United Kingdom to inform co-production practice and guide future methodological research.

METHODS

This scoping review was performed using established methods. We created an evidence map to show the extent and nature of the literature on co-production and applied health research, based on which we described the characteristics of the articles and scope of the literature and summarized conceptualizations of co-production and how it was implemented. We extracted implications for co-production practice or future research and conducted a content analysis of this information to identify lessons for the practice of co-production and themes for future methodological research.

RESULTS

Nineteen articles reporting co-produced complex interventions and 64 reporting co-production in applied health research met the inclusion criteria. Lessons for the practice of co-production and requirements for co-production to become more embedded in organizational structures included (1) the capacity to implement co-produced interventions, (2) the skill set needed for co-production, (3) multiple levels of engagement and negotiation, and (4) funding and institutional arrangements for meaningful co-production. Themes for future research on co-production included (1) who to involve in co-production and how, (2) evaluating outcomes of co-production, (3) the language and practice of co-production, (4) documenting costs and challenges, and (5) vital components or best practice for co-production.

CONCLUSION

Researchers are operationalizing co-production in various ways, often without the necessary financial and organizational support required and the right conditions for success. We argue for accepting the diversity in approaches to co-production, call on researchers to be clearer in their reporting of these approaches, and make suggestions for what researchers should record. To support co-production of research, changes to entrenched academic and scientific practices are needed. Protocol registration details: The protocol for the scoping review was registered with protocols.io on 19 October 2021: https://dx.doi.org/10.17504/protocols.io.by7epzje .

The use of cognitive task analysis in clinical and health services research — a systematic review

Background

At times, clinical case complexity and different types of uncertainty present challenges to less experienced clinicians or the naive application of clinical guidelines where this may not be appropriate. Cognitive task analysis (CTA) methods are used to elicit, document and transfer tacit knowledge about how experts make decisions.

Methods

We conducted a methodological review to describe the use of CTA methods in understanding expert clinical decision-making. We searched MEDLINE, EMBASE and PsycINFO from inception to 2019 for primary research studies which described the use of CTA methods to understand how qualified clinicians made clinical decisions in real-world clinical settings.

Results

We included 81 articles (80 unique studies) from 13 countries, published from 1993 to 2019, most commonly from surgical and critical care settings. The most common aims were to understand expert decision-making in particular clinical scenarios, using expert decision-making in the development of training programmes, understanding whether decision support tools were warranted and understanding procedural variability and error identification or reduction. Critical decision method (CDM) and CTA interviews were most frequently used, with hierarchical task analysis, task knowledge structures, think-aloud protocols and other methods less commonly used. Studies used interviews, observation, think-aloud exercises, surveys, focus groups and a range of more CTA-specific methodologies such as the systematic human error reduction and prediction approach. Researchers used CTA methods to investigate routine/typical (n = 64), challenging (n = 13) or more uncommon, rare events and anomalies (n = 3).

Conclusions

In conclusion, the elicitation of expert tacit knowledge using CTA has seen increasing use in clinical specialties working under challenging time pressures, complexity and uncertainty. CTA methods have great potential in the development, refinement, modification or adaptation of complex interventions, clinical protocols and practice guidelines.

Registration

PROSPERO ID CRD42019128418.

Supplementary Information

The online version contains supplementary material available at 10.1186/s40814-022-01002-6.

Development of a web-based discharge education intervention to improve the postdischarge recovery of general surgical patients

BACKGROUND

Postoperative complications contribute to unplanned hospital readmissions, reoperations, and increased mortality for surgical patients. Discharge education for general surgical patients is often inadequate, and challenged by organizational, clinician and patient factors.

PURPOSE

This research describes the development of the web-based discharge education intervention to improve patients' knowledge, skills, and confidence in self-managing their recovery after general surgery.

METHODS

The intervention was informed by the UK Medical Research Council guidance for developing and evaluating complex interventions and Knowledge-to-Action framework, consisting of four iterative stages. Stakeholder engagement was undertaken throughout the development process and a logic model was utilized to map the working mechanism of the intervention. The concept of patient activation and Knowles adult learning theory underpinned the development process.

RESULTS

The literature review and stakeholders' engagement in qualitative interviews and a series of meetings resulted in a web-based discharge education program with three different components: (1) post general surgery warning signs; (2) post general surgery everyday care instructions; and (3) animation video on wound potential wound complications.

CONCLUSION

The web-based discharge education was developed according to the needs and preferences of healthcare providers and general surgical patients. Despite the rigorous and systematic approach used to develop the intervention, its effectiveness requires testing.

CLINICAL RELEVANCE

This comprehensive iterative approach serves as a guide for others planning web-based interventions designed for surgical patients and the research approach used may inform those developing web-based interventions for other patient groups.

Addressing complex pharmacy consultations: methods used to develop a person-centred intervention to highlight alcohol within pharmacist reviews of medications

Background

Alcohol is challenging to discuss, and patients may be reluctant to disclose drinking partly because of concern about being judged. This report presents an overview of the development of a medications review intervention co-produced with the pharmacy profession and with patients, which breaks new ground by seeking to give appropriate attention to alcohol within these consultations.

Methods

This intervention was developed in a series of stages and refined through conceptual discussion, literature review, observational and interview studies, and consultations with advisory groups. In this study we reflect on this process, paying particular attention to the methods used, where lessons may inform innovations in other complex clinical consultations.

Results

Early work with patients and pharmacists infused the entire process with a heightened sense of the complexity of consultations in everyday practice, prompting careful deliberation on the implications for intervention development. This required the research team to be highly responsive to both co-production inputs and data gathered in formally conducted studies, and to be committed to working through the implications for intervention design. The intervention thus evolved significantly over time, with the greatest transformations resulting from patient and pharmacist co-design workshops in the second stage of the process, where pharmacists elaborated on the nature of the need for training in particular. The original research plans provided a helpful structure, and unanticipated issues for investigation emerged throughout the process. This underscored the need to engage dynamically with changing contexts and contents and to avoid rigid adherence to any early prescribed plan.

Conclusions

Alcohol interventions are complex and require careful developmental research. This can be a messy enterprise, which can nonetheless shed new insights into the challenges involved in optimising interventions, and how to meet them, if embraced with an attitude of openness to learning. We found that exposing our own research plans to scrutiny resulted in changes to the intervention design that gained the confidence of different stakeholders. Our understanding of the methods used, and their consequences, may be bounded by the person-centred nature of this particular intervention.

Improving uptake of Fracture Prevention drug treatments: a protocol for Development of a consultation intervention (iFraP-D)

INTRODUCTION

Prevention of fragility fractures, a source of significant economic and personal burden, is hindered by poor uptake of fracture prevention medicines. Enhancing communication of scientific evidence and elicitation of patient medication-related beliefs has the potential to increase patient commitment to treatment. The Improving uptake of Fracture Prevention drug treatments (iFraP) programme aims to develop and evaluate a theoretically informed, complex intervention consisting of a computerised web-based decision support tool, training package and information resources, to facilitate informed decision-making about fracture prevention treatment, with a long-term aim of improving informed treatment adherence. This protocol focuses on the iFraP Development (iFraP-D) work.

METHODS AND ANALYSIS

The approach to iFraP-D is informed by the Medical Research Council complex intervention development and evaluation framework and the three-step implementation of change model. The context for the study is UK fracture liaison services (FLS), which enact secondary fracture prevention. An evidence synthesis of clinical guidelines and Delphi exercise will be conducted to identify content for the intervention. Focus groups with patients, FLS clinicians and general practitioners and a usual care survey will facilitate understanding of current practice, and investigate barriers and facilitators to change. Design of the iFraP intervention will be informed by decision aid development standards and theories of implementation, behaviour change, acceptability and medicines adherence. The principles of co-design will underpin all elements of the study through a dedicated iFraP community of practice including key stakeholders and patient advisory groups. In-practice testing of the prototype intervention will inform revisions ready for further testing in a subsequent pilot and feasibility randomised trial.

ETHICS AND DISSEMINATION

Ethical approval was obtained from North West-Greater Manchester West Research Ethics Committee (19/NW/0559). Dissemination and knowledge mobilisation will be facilitated through national bodies and networks, publications and presentations.

TRIAL REGISTRATION NUMBER

researchregistry5041.

Facilitators and barriers to healthy eating in a worksite cafeteria: a qualitative study

BACKGROUND

Worksite-based nutrition interventions can serve as access points to facilitate healthy eating and translate existing knowledge of cardiometabolic disease prevention. We explored perceptions, facilitators, and barriers for healthy eating in a cafeteria at a large worksite in Mexico City.

METHODS

We conducted an exploratory qualitative study in a large department store in Mexico City with ~ 1500 employees. We conducted eight focus group discussions (FGD) with 63 employees stratified by job category (sales, maintenance, shipping, restaurant, cafeteria, administrative staff, and sales managers). Employees were invited to participate in the FGD if they were at the store at the day and time of the FGD for their job type. FGDs were audio-recorded, transcribed verbatim and analyzed using the thematic method. This process involved the researches´ familiarizing themselves with the data, generating initial codes, searching for themes, reviewing the themes, defining and naming themes, and then interpreting the data.

RESULTS

Employees defined healthy eating as eating foods that are fresh, diverse, and prepared hygienically. The most commonly reported facilitators of healthy eating at the worksite were availability of affordable healthy food options and employees' high health awareness. Major barriers to healthy eating included unavailability of healthy foods, unpleasant taste of food, and preference for fatty foods and meat. For lower-wage workers, affordability was a major concern. Other barriers included lack of time to eat work and long working hours.

CONCLUSION

A broad range of factors affect healthy eating at the cafeteria, some related to nutrition and some related to the employees type of job. Availability of healthy, hygienic, and tasty food at an affordable price could lead to healthier food choices in the worksite cafeteria. These strategies, along with work schedules that allow sufficient time for healthy eating, may help improve dietary behaviors and health of employees.

Development of a complex intervention to improve mobility and participation of older people with vertigo, dizziness and balance disorders in primary care: a mixed methods study

BACKGROUND

Vertigo, dizziness and balance disorders (VDB) are common in older people and cause restrictions in mobility and social participation. Due to a multifactorial aetiology, health care is often overutilised, but many patients are also treated insufficiently in primary care. The purpose of this study was to develop a care pathway as a complex intervention to improve mobility and participation in older people with VDB in primary care.

METHODS

The development process followed the UK Medical Research Council guidance using a mixed-methods design with individual and group interviews carried out with patients, physical therapists (PTs), general practitioners (GPs), nurses working in community care and a multi-professional expert panel to create a first draft of a care pathway (CPW) and implementation strategy using the Consolidated Framework of Implementation Research and the Expert recommendations for Implementing Change. Subsequently, small expert group modelling of specific components of the CPW was carried out, with GPs, medical specialists and PTs. The Behaviour Change Wheel was applied to design the intervention´s approach to behaviour change. To derive theoretical assumptions, we adopted Kellogg´s Logic Model to consolidate the hypothesized chain of causes leading to patient-relevant outcomes.

RESULTS

Individual interviews with patients showed that VDB symptoms need to be taken more seriously by GPs. Patients demanded age-specific treatment offers, group sessions or a continuous mentoring by a PT. GPs required a specific guideline for diagnostics and treatment options including psychosocial interventions. Specific assignment to and a standardized approach during physical therapy were desired by PTs. Nurses favoured a multi-professional documentation system. The structured three-day expert workshop resulted in a first draft of CPW and potential implementation strategies. Subsequent modelling resulted in a CPW with components and appropriate training materials for involved health professionals. A specific implementation strategy is now available.

CONCLUSION

A mixed-methods design was suggested to be a suitable approach to develop a complex intervention and its implementation strategy. We will subsequently test the intervention for its acceptability and feasibility in a feasibility study accompanied by a comprehensive process evaluation to inform a subsequent effectiveness trial.

TRIAL REGISTRATION

The research project is registered in "Projektdatenbank Versorgungsforschung Deutschland" (Project-ID: VfD_MobilE-PHY_17_003910; date of registration: 30.11.2017).

Intervention development of a brief messaging intervention for a randomised controlled trial to improve diabetes treatment adherence in sub-Saharan Africa

Background

Brief messaging interventions, including Short Message Service (SMS) text-messages, delivered via mobile device platforms, show promise to support and improve treatment adherence. To understand how these interventions work, and to facilitate transparency, we need clear descriptions of the intervention development process.

Method

We describe and reflect on the process of designing and pretesting an evidence- and theory-informed brief messaging intervention, to improve diabetes treatment adherence in sub-Saharan Africa. We followed the stepwise approach recommended by the Medical Research Council, United Kingdom (MRC UK) Framework for Development and Evaluation of Complex Health Interventions and guidance for mobile health intervention development.

Results

We used a four-phase, iterative approach that first generated primary and secondary evidence on the lived experience of diabetes, diabetes treatment services and mobile-phone use. Second, we designed a type 2 diabetes-specific, brief text-message library, building on our previous hypertension text-message library, as well as drawing on the primary and secondary data from phase one, and on expert opinion. We then mapped the brief text-messages onto behaviour change (COM-B) theoretical constructs. Third, we refined and finalised the newly developed brief text-message library through stakeholder consultation and translated it into three local languages. Finally, we piloted the intervention by pre-testing the automated delivery of the brief text-messages in the trial sites in Malawi and South Africa. The final SMS text Adherence suppoRt for people with type 2 diabetes (StAR2D) intervention was tested in a randomised controlled trial in Malawi and South Africa (trial registration: ISRCTN70768808).

Conclusion

The complexity of public health interventions requires that we give more attention to intervention development work. Our documentation and reflection on the StAR2D intervention development process promotes transparency, replicability, assessment of intervention quality, and comparison with other studies.

Supplementary Information

The online version contains supplementary material available at 10.1186/s12889-020-10089-6.

Evaluating co-created patient-facing materials to increase understanding of genetic test results

Patients often have difficulty understanding genetic test reports. Technical language and jargon can impede comprehension and limit patients using results to act on findings. One potential way to improve patient understanding of genetic test reports is to provide patient-facing materials. This study aimed to examine understandability and actionability of co-created patient-facing materials for genetic test results in a research context. We combined interprofessional perspectives and patient engagement to co-create patient-facing materials for patients undergoing research genetic testing for congenital hypogonadotropic hypogonadism (Kallmann syndrome). The iterative development process was guided by principles of health literacy and human-centered design (i.e., design thinking). Readability was assessed using eight validated algorithms. Patients and parents evaluated materials using a web-based survey. The gold standard Patient Education Materials Assessment Tool for print materials (PEMAT-P) was employed to measure understandability (content, style, use of numbers, organization, design, use of visual aids) and actionability. PEMAT-P scores >80% were considered high quality. Results were analyzed descriptively and correlations performed to identify relationships between education/health literacy and PEMAT-P ratings. A consensus score of eight algorithms indicated the materials were an 8^th -9th grade reading level. Our findings are consistent with the U.S. Department of Health and Human Services 'average difficulty' classification (i.e., 7th-9th grade). In total, 61 patients/parents evaluated the materials. 'Visual Aids' received the lowest mean PEMAT-P rating (89%). All other parameters scored 90%-97%. PEMAT-P scores did not differ according to educational attainment (less than college vs. college or more, p = 0.28). Participants with adequate health literacy were more likely to approve of the 'organization' of information (p < 0.05). Respondents with low health literacy had more favorable views of 'visual aids' (p < 0.01). Involving patients in a co-creation process can produce high-quality patient-facing materials that are easier to understand.

Development of an intervention to facilitate implementation and uptake of diabetic retinopathy screening

BACKGROUND

'Implementation interventions' refer to methods used to enhance the adoption and implementation of clinical interventions such as diabetic retinopathy screening (DRS). DRS is effective, yet uptake is often suboptimal. Despite most routine management taking place in primary care and the central role of health care professionals (HCP) in referring to DRS, few interventions have been developed for primary care. We aimed to develop a multifaceted intervention targeting both professionals and patients to improve DRS uptake as an example of a systematic development process combining theory, stakeholder involvement, and evidence.

METHODS

First, we identified target behaviours through an audit in primary care of screening attendance. Second, we interviewed patients (n = 47) and HCP (n = 30), to identify determinants of uptake using the Theoretical Domains Framework, mapping these to behaviour change techniques (BCTs) to develop intervention content. Thirdly, we conducted semi-structured consensus groups with stakeholders, specifically users of the intervention, i.e. patients (n = 15) and HCPs (n = 16), regarding the feasibility, acceptability, and local relevance of selected BCTs and potential delivery modes. We consulted representatives from the national DRS programme to check intervention 'fit' with existing processes. We applied the APEASE criteria (affordability, practicability, effectiveness, acceptability, side effects, and equity) to select the final intervention components, drawing on findings from the previous steps, and a rapid evidence review of operationalised BCT effectiveness.

RESULTS

We identified potentially modifiable target behaviours at the patient (consent, attendance) and professional (registration) level. Patient barriers to consent/attendance included confusion between screening and routine eye checks, and fear of a negative result. Enablers included a recommendation from friends/family or professionals and recognising screening importance. Professional barriers to registration included the time to register patients and a lack of readily available information on uptake in their local area/practice. Most operationalised BCTs were acceptable to patients and HCPs while the response to feasibility varied. After considering APEASE, the core intervention, incorporating a range of BCTs, involved audit/feedback, electronic prompts targeting professionals, HCP-endorsed reminders (face-to-face, by phone and letter), and an information leaflet for patients.

CONCLUSIONS

Using the example of an intervention to improve DRS uptake, this study illustrates an approach to integrate theory with user involvement. This process highlighted tensions between theory-informed and stakeholder suggestions, and the need to apply the Theoretical Domains Framework (TDF)/BCT structure flexibly. The final intervention draws on the trusted professional-patient relationship, leveraging existing services to enhance implementation of the DRS programme. Intervention feasibility in primary care will be evaluated in a randomised cluster pilot trial.

Guidance for reporting intervention development studies in health research (GUIDED): an evidence-based consensus study

OBJECTIVE

To improve the quality and consistency of intervention development reporting in health research.

DESIGN

This was a consensus exercise consisting of two simultaneous and identical three-round e-Delphi studies (one with experts in intervention development and one with wider stakeholders including funders, journal editors and public involvement members), followed by a consensus workshop. Delphi items were systematically derived from two preceding systematic reviews and a qualitative interview study.

PARTICIPANTS

Intervention developers (n=26) and wider stakeholders (n=18) from the UK, North America and Europe participated in separate e-Delphi studies. Intervention developers (n=13) and wider stakeholders (n=13) participated in a 1-day consensus workshop.

RESULTS

e-Delphi participants achieved consensus on 15 reporting items. Following feedback from the consensus meeting, the final inclusion and wording of 14 items with description and explanations for each item were agreed. Items focus on context, purpose, target population, approaches, evidence, theory, guiding principles, stakeholder contribution, changes in content or format during the development process, required changes for subgroups, continuing uncertainties, and open access publication. They form the GUIDED (GUIDance for the rEporting of intervention Development) checklist, which contains a description and explanation of each item, alongside examples of good reporting.

CONCLUSIONS

Consensus-based reporting guidance for intervention development in health research is now available for publishers and researchers to use. GUIDED has the potential to lead to greater transparency, and enhance quality and improve learning about intervention development research and practice.