User-Centered Design for Psychosocial Intervention Development and Implementation

Effectiveness of an online text-based stress management program for employees who work in micro- and small-sized enterprises: A randomized controlled trial

Background

Internet psychoeducational interventions improve employees' mental health. However, implementing them for employees in micro- and small-sized enterprises (MSEs) is challenging.

Objectives

This randomized controlled trial examined the effectiveness of a fully automated text-based stress management program, "WellBe-LINE," in improving mental health and job-related outcomes for employees in workplaces with fewer than 50 employees.

Methods

The program was developed based on stakeholder interviews and surveys of 1000 employees at MSEs. Adult full-time employees at an enterprise with fewer than 50 employees were recruited from registered members of a web survey company in Japan. Participants were randomly allocated to the intervention or control group (1:1). Participants in the intervention group were invited to register for the program using the LINE app. Psychological distress measured by Kessler 6 (K6) was a primary outcome, with self-administrated questionnaires at baseline, 2-month (post), and 6-month follow-ups. A mixed model for repeated measures conditional growth model analysis was conducted using a group ∗ time interaction as an intervention effect. Implementation outcomes were measured through implementation outcome scales for digital mental health (iOSDMH).

Results

1021 employees were included in this study. No significant effects were shown in any outcome. The reported implementation outcomes were positively evaluated, with 80 % acceptability, 86 % appropriateness, and feasibility (ease of understanding the contents [88 %], frequency [86 %], and length of content [86 %]).

Conclusions

A simple text-message program for employees at MESs was acceptable, appropriate, and feasible; however, it did not result in improved mental health or job-related outcomes.

Trial registration

UMIN clinical trial registration: UMIN000050624 (registration date: March 18, 2023).

Improving usual care outcomes in major depression in youth by targeting memory specificity: A randomized controlled trial of adjunct computerized memory specificity training (c-MeST)

OBJECTIVE

Extending on previous findings that computerized Memory Specificity Training (c-MeST) improves memory specificity and depressive symptoms in Major Depressive Disorder (MDD) in adults, this study aimed to assess the effects of c-MeST in youth with MDD on memory specificity and depression in addition to other treatment.

METHODS

Participants aged 15-25 (N = 359, 76 % female; M age = 19.2, SD = 3.1), receiving predominantly psychological therapy or counseling (85 %) and/or antidepressants (52 %) were randomized to usual care and c-MeST or usual care. Cognitive and clinical outcomes were assessed at baseline and at one, three, and six-month follow-ups.

RESULTS

The usual care and c-MeST group reported higher memory specificity at one-month (d = 0.42, p = .022), but not at three or six months (d's < 0.15, p's > 0.05). The rate of MDE was numerically lower in the c-MeST group at each follow-up time-point, but group was not a statistically significant predictor at one month (64 % usual care and c-MeST vs. 68 % usual care, OR = 0.81, p = .606), three months (67 % usual care and c-MeST vs. 72 % usual care, OR = 0.64, p = .327) or six months (55 % usual care and c-MeST vs. 68 % usual care, OR = 0.56, p = .266). The usual care and c-MeST group did report lower depressive symptoms at one month (d = 0.42, p = .023) and six-months (d = 0.84, p = .001), but not three-months (d = 0.13, p > .05).

CONCLUSIONS

c-MeST may reduce symptoms in youth with MDD when provided alongside other treatments. However, there are significant limitations to this inference, including high attrition in the study and a need for more data on the acceptability of the intervention.

An evaluation of intervention appropriateness from the perspective of parents: A peer-mediated, play-based intervention for children with ADHD

INTRODUCTION

A peer-mediated, play-based intervention has been developed to address social participation challenges experienced by children with ADHD. To facilitate implementation into clinical practice, interventions should be evaluated for appropriateness to the end-user, as well as effectiveness. Previous research demonstrated the approach is effective for improving children's social play skills. This study aimed to evaluate the appropriateness of the intervention for children with ADHD and their families.

METHODS

Parents of children with ADHD who participated in the play-based intervention were interviewed 1 month after completion. Parents were asked about their perspective of parent and children's experiences of the intervention, the perceived benefits for children and parents, the logistics of participating, and recommended adaptations to the intervention. Interviews were analysed thematically, and themes were mapped to the elements of the adopted definition of appropriateness to understand whether parents supported the appropriateness of the intervention for their families.

CONSUMER AND COMMUNITY INVOLVEMENT

Consumers were not directly involved in the decisions made about this study.

FINDINGS

One core theme, 'collaborative efforts', emerged from the data. Major themes comprising the core theme were 'on the same page', 'therapeutic relationship', and 'getting the job done'. Three sub-themes of 'engagement and motivation', 'the effort was worth it for the reward', and 'Rome wasn't built in a day' were nested within the major themes.

CONCLUSION

Parents largely supported the appropriateness of the intervention, indicating it addressed an important goal for their child, participation was a positive experience, and they perceived the intervention to be beneficial. Future adaptions of the intervention are needed to increase its ecological validity and to generalise the strategies to other social environments and playmates, such as peers at school.

PLAIN LANGUAGE SUMMARY

This study looked at an intervention that uses play with peers to help children with ADHD develop their play skills. The researchers wanted to know if parents thought the intervention was a good fit for their families and if it helped their children. Parents gave an interview a month after the intervention ended. They were asked about their thoughts on the intervention, how it helped their children and themselves, how easy it was to take part, and what changes could be made to make the intervention better. After analysing parents' answers, the researchers found parents mostly agreed that the intervention was a good fit. They said it helped their children to play with their peers, and they had a good time doing it. Parents thought the intervention was helpful, they liked that it was a joint effort between them and the occupational therapist, and they felt it was worth the effort. However, they also suggested some changes. They wanted the intervention to fit into other real-life social situations, such as school, so their children could use the skills they learned in other places. Overall, parents thought the intervention was helpful and suitable for their children and themselves, but some changes might make it more helpful.

Applying a User-Centered Design Framework to Develop a Remote Research Assessment Protocol for a Randomized Clinical Trial for Toddlers with Early Autism Characteristics

COVID-19 required many research teams to shift from in-person to remote assessments, which posed both procedural and theoretical challenges. While research has explored the utility of remote assessments for autism diagnosis from the perspective of families and clinicians, less is known about their application in clinical trials. This paper describes the development of a remote research assessment protocol for a randomized clinical trial focusing on the implementation of reciprocal imitation teaching (RIT) with toddlers in Part C early intervention. This project spans two phases. For Phase 1, our team developed and documented a series of steps utilizing user-centered design (UCD) strategies (e.g., recruiting potential users, creating a prototype, engaging in iterative development) for the purpose of redesigning an assessment protocol for a remote environment. For Phase 2, we examined preliminary outcomes of the redesign process. Primary end users (assessors) rated post-redesign usability and acceptability, while acceptability was examined using attrition data from secondary end users (family participants). Preliminary fidelity of implementation was also examined. The iterative redesign process allowed the research team to refine aspects of the assessment that ultimately led to promising preliminary ratings of usability, acceptability, and feasibility, as well as high fidelity. Preliminary data suggest that the redesigned assessment appears to be an acceptable, feasible, and usable tool for autism clinical trial research and that assessors can use it with fidelity. Further research is needed to examine the reliability and validity of the assessment, as well as implementation characteristics on a larger scale.

Web-Based Tool Designed to Encourage Supplemental Nutrition Assistance Program Use in Urban College Students: Usability Testing Study

BACKGROUND

Food insecurity continues to be a risk for college students in the United States. It is associated with numerous problems, such as chronic health conditions, increased stress and anxiety, and a lower grade point average. After COVID-19, the Supplemental Nutrition Assistance Program (SNAP) benefits were extended to college-aged students; however, there were some barriers to participation, which persisted such as lack of perceived food insecurity risk, lack of knowledge regarding the SNAP application process, the complexity of determining eligibility, and stigma associated with needing social assistance. A technology-enhanced tool was developed to address these barriers to SNAP enrollment and encourage at-risk college students to apply for SNAP.

OBJECTIVE

The purpose of this study was to test the usability and acceptability of a web-based SNAP screening tool designed for college-aged students.

METHODS

College students aged 18-25 years were recruited to participate in 2 rounds of usability testing during fall 2022. Participants tested the prototype of a web-based SNAP screener tool using a standardized think-aloud method. The usability and acceptability of the tool were assessed using a semistructured interview and a 10-item validated System Usability Scale questionnaire. Audio recordings and field notes were systematically reviewed by extracting and sorting feedback as positive or negative comments. System Usability Scale questionnaire data were analyzed using the Wilcoxon signed rank test and sign test.

RESULTS

A total of 12 students (mean age 21.8, SD 2.8 years; n=6, 50% undergraduate; n=11, 92% female; n=7, 58% Hispanic or Black or African American; n=9, 78% low or very low food security) participated in both rounds of user testing. Round 1 testing highlighted overall positive experiences with the tool, with most participants (10/12) stating that the website fulfills its primary objective as a support tool to encourage college students to apply for SNAP. However, issues related to user interface design, navigation, and wording of some questions in the screening tool were noted. Key changes after round 1 reflected these concerns, including improved design of response buttons and tool logo and improved clarity of screening questions. The overall system usability showed slight, but not statistically significant, improvement between round 1 and round 2 (91.25 vs 92.50; P=.10, respectively).

CONCLUSIONS

Overall usability findings suggest that this web-based tool was highly usable and acceptable to urban college students and could be an effective and appealing approach as a support tool to introduce college students to the SNAP application process. The findings from this study will inform further development of the tool, which could eventually be disseminated publicly among various college campuses.

A theoretical explanation for how a nutrition counseling and medically tailored meal delivery program benefitted participants living with lung cancer

PURPOSE

The purpose of this study was to assess participants' perceptions and experiences while participating in a Food is Medicine medically tailored meal plus intensive nutrition counseling intervention to create a theoretical explanation about how the intervention worked.

METHODS

This interpretive qualitative study included the use of semi-structured interviews with active participants in a randomized controlled trial aimed at understanding how a medically tailored meal plus nutrition counseling intervention worked for vulnerable individuals with lung cancer treated at four cancer centers across the USA. During the 8-month long study, participants in the intervention arm were asked to be interviewed, which were recorded, transcribed verbatim, and analyzed using conventional content analysis with principles of grounded theory.

RESULTS

Twenty individuals participated. Data analysis resulted in a theoretical explanation of the intervention's mechanism of action. The explanatory process includes three linked and propositional categories leading to patient resilience: engaging in treatment, adjusting to diagnosis, and active coping. The medically tailored meals plus nutrition counseling engaged participants throughout treatment, which helped participants adjust to their diagnosis, leading to active coping through intentional self-care, behavior change, and improved quality of life.

CONCLUSIONS

These findings provide evidence that a Food is Medicine intervention may buffer some of the adversity related to the diagnosis of lung cancer and create a pathway for participants to experience post-traumatic growth, develop resilience, and change behaviors to actively cope with lung cancer. Medically tailored meals plus intensive nutrition counseling informed by motivational interviewing supported individuals' adjustment to their diagnosis and resulted in perceived positive behavior change.

"A problem shared is a problem solved:" integrating human-centered design and implementation science to optimize lay counselor supervision in Western Kenya

Implementation science and human-centered design (HCD) offer useful frameworks and methods for considering and designing for individuals' needs and preferences when implementing new interventions or technologies in global health. When used in tandem, the two approaches may blend creative and partnered research methods with a focus on the factors necessary to design, implement, and sustain interventions. However, research is needed that describes the process of blending these two approaches and explores the experiences of community partners. This study builds from a stepped-wedge cluster-randomized trial in Western Kenya, wherein teachers and community health volunteers have been trained to provide trauma-focused cognitive behavioral therapy (TF-CBT). Mobile phones emerged as a tool to supervise lay counselors from afar; however, their use was characterized by unique challenges. Informed by human-centered design and implementation science, we first engaged lay counselors (n = 24) and supervisors (n = 3) in individual semi-structured interviews then hosted an in-person participatory workshop to "co-design" solutions to optimize the use of mobile phone supervision. Lay counselors participated in focus group discussions regarding their experiences in the workshop. Focus group transcripts were analyzed using thematic analysis. We describe our approach as well as focus group discussion results. Counselors felt the workshop was a valuable experience to learn new strategies from their colleagues, and they enjoyed the "collaborative spirit" that emerged as they worked together. Counselors felt that varying small and large group discussions fostered participation by creating opportunities for more people to engage and share their thoughts. Counselors suggested the approach be improved by providing more tangible materials (e.g., hand-outs) and more closely following a schedule of activities. It is important to also center stakeholders' experiences as partners in the research process. Though counselors largely expressed positive sentiments, they also shared valuable suggestions for how to improve participatory research practices in the future.

Early development of local data dashboards to depict the substance use care cascade for youth involved in the legal system: qualitative findings from end users

INTRODUCTION

Rates of substance use are high among youth involved in the legal system (YILS); however, YILS are less likely to initiate and complete substance use treatment compared to their non legally-involved peers. There are multiple steps involved in connecting youth to needed services, from screening and referral within the juvenile legal system to treatment initiation and completion within the behavioral health system. Understanding potential gaps in the care continuum requires data and decision-making from these two systems. The current study reports on the development of data dashboards that integrate these systems' data to help guide decisions to improve substance use screening and treatment for YILS, focusing on end-user feedback regarding dashboard utility.

METHODS

Three focus groups were conducted with n = 21 end-users from juvenile legal systems and community mental health centers in front-line positions and in decision-making roles across 8 counties to gather feedback on an early version of the data dashboards; dashboards were then modified based on feedback.

RESULTS

Qualitative analysis revealed topics related to (1) important aesthetic features of the dashboard, (2) user features such as filtering options and benchmarking to compare local data with other counties, and (3) the centrality of consistent terminology for data dashboard elements. Results also revealed the use of dashboards to facilitate collaboration between legal and behavioral health systems.

CONCLUSIONS

Feedback from end-users highlight important design elements and dashboard utility as well as the challenges of working with cross-system and cross-jurisdiction data.

User-Centered Framework for Implementation of Technology (UFIT): Development of an Integrated Framework for Designing Clinical Decision Support Tools Packaged With Tailored Implementation Strategies

BACKGROUND

Electronic health record-based clinical decision support (CDS) tools can facilitate the adoption of evidence into practice. Yet, the impact of CDS beyond single-site implementation is often limited by dissemination and implementation barriers related to site- and user-specific variation in workflows and behaviors. The translation of evidence-based CDS from initial development to implementation in heterogeneous environments requires a framework that assures careful balancing of fidelity to core functional elements with adaptations to ensure compatibility with new contexts.

OBJECTIVE

This study aims to develop and apply a framework to guide tailoring and implementing CDS across diverse clinical settings.

METHODS

In preparation for a multisite trial implementing CDS for pediatric overweight or obesity in primary care, we developed the User-Centered Framework for Implementation of Technology (UFIT), a framework that integrates principles from user-centered design (UCD), human factors/ergonomics theories, and implementation science to guide both CDS adaptation and tailoring of related implementation strategies. Our transdisciplinary study team conducted semistructured interviews with pediatric primary care clinicians and a diverse group of stakeholders from 3 health systems in the northeastern, midwestern, and southeastern United States to inform and apply the framework for our formative evaluation.

RESULTS

We conducted 41 qualitative interviews with primary care clinicians (n=21) and other stakeholders (n=20). Our workflow analysis found 3 primary ways in which clinicians interact with the electronic health record during primary care well-child visits identifying opportunities for decision support. Additionally, we identified differences in practice patterns across contexts necessitating a multiprong design approach to support a variety of workflows, user needs, preferences, and implementation strategies.

CONCLUSIONS

UFIT integrates theories and guidance from UCD, human factors/ergonomics, and implementation science to promote fit with local contexts for optimal outcomes. The components of UFIT were used to guide the development of Improving Pediatric Obesity Practice Using Prompts, an integrated package comprising CDS for obesity or overweight treatment with tailored implementation strategies.

TRIAL REGISTRATION

ClinicalTrials.gov NCT05627011; https://clinicaltrials.gov/study/NCT05627011.

A Digital Behavioral Activation Intervention (JuNEX) for Pregnant Women With Subclinical Depression Symptoms: Explorative Co-Design Study

BACKGROUND

Digital interventions are gaining increasing interest due to their structured nature, ready availability, and self-administered capabilities. Perinatal women have expressed a desire for such interventions. In this regard, behavioral activation interventions may be particularly suitable for digital administration.

OBJECTIVE

This study aims to exploratorily investigate and compare the feasibility of the internet-based self-help guided versus unguided version of the Brief Behavioral Activation Treatment for Depression-Revised, an empirically supported in-person behavioral activation protocol, targeting pregnant women with subclinical depression symptoms. A user-centered design is used, whereby data are collected with the intent of evaluating how to adjust the intervention in line with pregnant women's needs. Usability and user engagement were evaluated.

METHODS

A total of 11 Italian pregnant women with subclinical depressive symptoms based on the Patient Health Questionnaire-9 (scoring<15) participated in this study; of them, 6 (55%) women were randomly assigned to the guided group (age: mean 32.17, SD 4.36 years) and 5 (45%) to the unguided group (age: mean 31, SD 4.95 years). The Moodle platform was used to deliver the interventions in an e-learning format. It consisted of 6 core modules and 3 optional modules; the latter aimed at revising the content of the former. In the guided group, each woman had weekly chats with their assigned human guide to support them in the homework revisions. The intervention content included text, pictures, and videos. Semistructured interviews were conducted, and descriptive statistics were analyzed.

RESULTS

Collectively, the data suggest that the guided intervention was better accepted than the unguided one. However, the high rates of dropout (at T6: guided group: 3/6, 50%; unguided: 4/5, 80%) suggest that a digital replica of Behavioral Activation Treatment for Depression-Revised may not be feasible in an e-learning format. The reduced usability of the platform used was reported, and homework was perceived as too time-consuming and effort-intensive. Moreover, the 6 core modules were deemed sufficient for the intervention's goals, suggesting that the 3 optional modules could be eliminated. Nevertheless, participants from both groups expressed satisfaction with the content and found it relevant to their pregnancy experiences.

CONCLUSIONS

Overall, the findings have emphasized both the intervention's merits and shortcomings. Results highlight the unsuitability of replicating an in-person protocol digitally as well as of the use of nonprofessional tools for the implementation of self-help interventions, ultimately making the intervention not feasible. Pregnant women have nonetheless expressed a desire to receive psychological support and commented on the possibilities of digital psychosocial supports, particularly those that are app-based. The information collected and the issues identified here are important to guide the development and co-design of a more refined platform for the intervention deployment and to tailor the intervention's content to pregnant women's needs.

Leveraging systems science and design thinking to advance implementation science: moving toward a solution-oriented paradigm

Many public health challenges are characterized by complexity that reflects the dynamic systems in which they occur. Such systems involve multiple interdependent factors, actors, and sectors that influence health, and are a primary driver of challenges of insufficient implementation, sustainment, and scale of evidence-based public health interventions. Implementation science frameworks have been developed to help embed evidence-based interventions in diverse settings and identify key factors that facilitate or hinder implementation. These frameworks are largely static in that they do not explain the nature and dynamics of interrelationships among the identified determinants, nor how those determinants might change over time. Furthermore, most implementation science frameworks are top-down, deterministic, and linear, leaving critical gaps in understanding of both how to intervene on determinants of successful implementation and how to scale evidence-based solutions. Design thinking and systems science offer methods for transforming this problem-oriented paradigm into one that is solution-oriented. This article describes these two approaches and how they can be integrated into implementation science strategies to promote implementation, sustainment, and scaling of public health innovation, ultimately resulting in transformative systems changes that improve population health.

Study protocol for a randomized controlled trial of supportive parents - coping kids (SPARCK)-a transdiagnostic and personalized parent training intervention to prevent childhood mental health problems

BACKGROUND

To meet the scientific and political call for effective prevention of child and youth mental health problems and associated long-term consequences, we have co-created, tested, and optimized a transdiagnostic preventive parent-training intervention, Supportive parents - coping kids (SPARCK), together with and for the municipal preventive frontline services. The target group of SPARCK is parents of children between 4 and 12 years who display symptoms of anxiety, depression, and/or behavioral problems, that is, indicated prevention. The intervention consists of components from various empirically supported interventions representing different theorical models on parent-child interactions and child behavior and psychopathology (i.e., behavioral management interventions, attachment theory, emotion socialization theory, cognitive-behavioral therapy, and family accommodation intervention). The content and target strategies of SPARCK are tailored to the needs of the families and children, and the manual suggests how the target strategies may be personalized and combined throughout the maximum 12 sessions of the intervention. The aim of this project is to investigate the effectiveness of SPARCK on child symptoms, parenting practices, and parent and child stress hormone levels, in addition to later use of specialized services compared with usual care (UC; eg. active comparison group).

METHODS

We describe a randomized controlled effectiveness trial in the frontline services of child welfare, health, school health and school psychological counselling services in 24 Norwegian municipalities. It is a two-armed parallel group randomized controlled effectiveness and superiority trial with 252 families randomly allocated to SPARCK or UC. Assessment of key variables will be conducted at pre-, post-, and six-month follow-up.

DISCUSSION

The current study will contribute with knowledge on potential effects of a preventive transdiagnostic parent-training intervention when compared with UC. Our primary objective is to innovate frontline services with a usable, flexible, and effective intervention for prevention of childhood mental health problems to promote equity in access to care for families and children across a heterogeneous service landscape characterized by variations in available resources, personnel, and end user symptomatology.

TRIAL REGISTRATION

ClinicalTrials.gov ID: NTCT05800522.

HCI Contributions in Mental Health: A Modular Framework to Guide Psychosocial Intervention Design

Many people prefer psychosocial interventions for mental health care or other concerns, but these interventions are often complex and unavailable in settings where people seek care. Intervention designers use technology to improve user experience or reach of interventions, and HCI researchers have made many contributions toward this goal. Both HCI and mental health researchers must navigate tensions between innovating on and adhering to the theories of change that guide intervention design. In this paper, we propose a framework that describes design briefs and evaluation approaches for HCI contributions at the scopes of capabilities, components, intervention systems, and intervention implementations. We show how theories of change (from mental health) can be translated into design briefs (in HCI), and that these translations can bridge and coordinate efforts across fields. It is our hope that this framework can support researchers in motivating, planning, conducting, and communicating work that advances psychosocial intervention design.

Effects of three prophylactic interventions on French middle-schoolers' mental health: protocol for a randomized controlled trial

Adolescence is a strategic developmental stage in terms of preventing later difficulties and ensuring good mental health. Prophylactic interventions, which are conducted before the onset, prolongation, or worsening of difficulties, and aim to prevent or reduce symptoms or to promote wellbeing, therefore appear particularly appropriate for adolescents. However, existing prophylactic interventions conducted with adolescents have several weaknesses, including sparse theoretical frameworks, ambivalent evidence of their efficacy, and implementation and dissemination difficulties. In addition, no data are currently available on the effectiveness of such interventions in France. To fill this gap, a four-arm randomized controlled trial will be performed to assess the effectiveness of three prophylactic interventions targeting reactive, proactive and interpersonal adaptation in fourth-grade middle-school students, together with participants' experience and perception of the interventions. Based on existing knowledge about adolescents, their learning mechanisms, and field constraints, these three interventions have been designed to promote their learning and receptiveness to interventions. Compared with baseline (i.e., before the intervention), we expect to observe a significant decrease in the level of distress (anxiety and depressive symptoms, functional impairment, and psychosocial difficulties) and a significant increase in the level of wellbeing after the intervention, across the three intervention groups, but not in the control group. In addition, we expect to observe post-intervention improvements in the processes targeted by the reactive adaptation intervention (operationalized as coping strategy use and flexibility), those targeted by the proactive adaptation intervention (operationalized as the tendency to engage in committed actions and general self-efficacy), and those targeted by the interpersonal adaptation intervention (operationalized as assertiveness in interactions), but only in the corresponding groups, with no change in any of these processes in the control group. The results of this research will not only enrich our knowledge of the processes involved in adolescents' distress and wellbeing, but also provide clues as to the best targets for intervention. Moreover, the material for these interventions will be freely available in French on request to the corresponding author, providing access to innovative and fully assessed interventions aimed at promoting adolescents' mental health in France.This clinical trial is currently being registered under no. 2023-A01973-42 on https://ansm.sante.fr/ . This is the first version of the protocol.

The development and evaluation of a virtual, asynchronous, trauma-focused treatment program for adult survivors of childhood interpersonal trauma

BACKGROUND

The long-term mental and physical health implications of childhood interpersonal trauma on adult survivors is immense, however, there is a lack of available trauma-focused treatment services that are widely accessible. This study, utilizing a user-centered design process, sought feedback on the initial design and development of a novel, self-paced psychoeducation and skills-based treatment intervention for this population.

AIMS

To explore the views and perspectives of adult survivors of childhood interpersonal trauma on the first two modules of an asynchronous trauma-focused treatment program.

METHODS

Fourteen participants from our outpatient hospital service who completed the modules consented to provide feedback on their user experience. A thematic analysis of the three focus groups was conducted.

RESULTS

Four major themes emerged from the focus groups: (1) technology utilization, (2) module content, (3) asynchronous delivery, and (4) opportunity for interactivity. Participants noted the convenience of the platform and the use of multimedia content to increase engagement and did not find the modules to be emotionally overwhelming.

CONCLUSIONS

Our research findings suggest that an asynchronous virtual intervention for childhood interpersonal trauma survivors may be a safe and acceptable way to provide a stabilization-focused intervention on a wider scale.

Measuring digital intervention user experience with a novel ecological momentary assessment (EMA) method, CORTO

Digital interventions often suffer from low usage, which may reflect insufficient attention to user experience. Moreover, the existing evaluation methods have limited applicability in the remote study of user experience of complex interventions that have expansive content and that are used over an extensive period of time. To alleviate these challenges, we describe here a novel qualitative Ecological Momentary Assessment (EMA) method: the CORTO method (Contextual, One-item, Repeated, Timely, Open-ended). We used it to gather digital intervention user experience data from Finnish adults (n = 184) who lived with interview-confirmed major depressive disorder (MDD) and took part in a randomized controlled trial (RCT) that studied the efficacy of a novel 12-week game-based digital intervention for depression. A second dataset on user experience was gathered with retrospective interviews (n = 22). We inductively coded the CORTO method and retrospective interview data, which led to four user experience categories: (1) contextual use, (2) interaction-elicited emotional experience, (3) usability, and (4) technical issues. Then, we used the created user experience categories and Template Analysis to analyze both datasets together, and reported the results qualitatively. Finally, we compared the two datasets with each other. We found that the data generated with the CORTO method offered more insights into usability and technical categories than the interview data that particularly illustrated the contextual use. The emotional valence of the interview data was more positive compared with the CORTO data. Both the CORTO and interview data detected 55 % of the micro-level categories; 20 % of micro-level categories were only detected by the CORTO data and 25 % only by the interview data. We found that the during-intervention user experience measurement with the CORTO method can provide intervention-specific insights, and thereby further the iterative user-centered intervention development. Overall, these findings highlight the impact of evaluation methods on the categories and qualities of insights acquired in intervention research.

Identifying and developing strategies for implementation of a guided internet- and mobile-based infant sleep intervention in well-baby and community mental health clinics using group concept mapping

BACKGROUND

This study aimed to identify strategies for the implementation of a guided internet- and mobile-based intervention (IMI) for infant sleep problems ("Sleep Well, Little Sweetheart") in well-baby and community mental health clinics.

STUDY DESIGN

We used group concept mapping, a two-phased mixed methods approach, conducted as a two-day workshop in each clinic. We recruited 20 participants from four clinics and collected sorting and rating data for implementation strategies based on the Expert Recommendations for Implementing Change taxonomy and brainstorming sessions. Data were analyzed using descriptive statistics, multidimensional scaling, and hierarchical cluster analysis to create cluster maps, laddergrams, and Go-Zone graphs. Participants were presented with the results and discussed and interpreted the findings at each of the clinics in spring 2022.

RESULTS

Participants identified 10 clusters of strategies, of which Training, Embedding and Coherence, User Involvement and Participation, and Clinician Support and Implementation Counseling were rated as most important and feasible. Economy and Funding and Interactive and Interdisciplinary Collaboration were rated significantly lower on importance and feasibility compared to many of the clusters (all ps < 0.05). There was a correlation between the importance and feasibility ratings (r =.62, p =.004).

CONCLUSIONS

The use of group concept mapping made it possible to efficiently examine well-baby and community clinics' perspectives on complex issues, and to acquire specific knowledge to allow for the planning and prioritization of strategies for implementation. These results suggest areas of priority for the implementation of IMIs related to infant sleep problems.

TRIAL REGISTRATION

The study was pre-registered at Open Science Framework ( www.osf.io/emct8 ).

Health literacy needs and preferences for a technology-based intervention to improve college students' sexual and reproductive health

Objective: To explore health literacy needs and preferences for a technology-based intervention (app) to improve sexual and reproductive health (SRH) among college students. Participants: In Spring 2019, in-depth interviews were conducted with 20 participants (10 male, 10 female) from a large, public university. Methods: Interview guide was developed based on Integrated Model of Health Literacy domains and Diffusion of Innovation constructs. Data were analyzed in MaxQDA using applied thematic analysis. Results: Dominant themes included accessing health information and services, evaluating options to make decisions, intervention utility and characteristics, and the emergent theme of credibility. Specific topics included accessing STI testing, contraceptive decision making, information on human papillomavirus (HPV) and the HPV vaccine, patient-provider communication, app design and function elements, and modifying the app to meet the SRH needs of diverse college students. Conclusions: Findings identified areas where an app could address college students' SRH literacy, ultimately improving SRH outcomes among this population.

Formative Evaluation of a Comprehensive Self-Management Intervention for Irritable Bowel Syndrome, Comorbid Anxiety, and Depression: Mixed Methods Study

BACKGROUND

Irritable bowel syndrome (IBS) is a disorder of the gut-brain interaction that is associated with abdominal pain, altered bowel patterns, and reduced quality of life. Up to 50% of patients with IBS also report anxiety or depressive symptoms. Although effective self-management interventions exist for individuals with IBS, few have been effectively implemented, and most do not consider the unique needs of patients with comorbid IBS and anxiety or depression.

OBJECTIVE

This study aimed to determine the anticipated acceptability, appropriateness, feasibility, and usability of a comprehensive self-management intervention using an implementation science and human-centered design approach among individuals with comorbid IBS and anxiety or depression and health care providers.

METHODS

A convergent mixed methods design was used to elicit feedback on the comprehensive self-management intervention outline and content to identify refinement needs before testing. Patients with IBS and moderate to severe anxiety or depression and health care providers were purposefully sampled from primary care and gastroenterology settings. Participants completed semistructured interviews and surveys on anticipated acceptability, appropriateness, feasibility, and usability.

RESULTS

Patient participants (n=12) were on average 36.8 (SD 12.2) years of age, and 42% (5/12) were currently receiving psychological therapy. Health care providers (n=14) were from primary care (n=7) and gastroenterology (n=7) settings. The mean usability scores (out of 100) were 52.5 (SD 14.5) for patients and 45.6 (SD 11.6) for providers. For patients and providers, qualitative data expanded the quantitative findings for acceptability and appropriateness. Acceptability findings were the comprehensive nature of the intervention and discussion of the gut-brain interaction. For appropriateness, participants reported that the intervention provided structure, accountability, and support. Feasibility was confirmed for patients, but there was a divergence of findings between quantitative and qualitative measures for providers. Patients focused on intervention feasibility, while providers focused on implementation feasibility in the clinic. Identified usability issues to address before implementation included the intervention delivery format, length, and lack of integration into health care settings that, if not addressed, may limit the reach of the intervention.

CONCLUSIONS

Patients and health care providers found the intervention acceptable and appropriate. Several feasibility and usability issues were identified, including intervention delivery methods, length of intervention, and the best methods to implement in the clinic setting. The next steps are to refine the intervention to address the identified issues and test in a pilot study whether addressing usability issues leads to the anticipated improvements in implementation and uptake.

Practitioner Adherence and Competence in MEYA, a Free Online Self-Instruction Program in Modular Psychotherapy and Counseling for Children's Autism-Related Clinical Needs

The quality of care in public schools and other community settings for school-aged youths on the autism spectrum is variable and often not evidence-based. Training practitioners in these settings to deliver evidence-based practices (EBPs) may improve the quality of care. We developed a free internet-based training and clinical guidance system synthesizing multiple EBPs for youth on the autism spectrum addressing a range of mental health needs and autism-related behaviors, entitled Modular EBPs for Youth on the Autism Spectrum (MEYA; meya.ucla.edu). A multiple baseline study was conducted with seven practitioners recruited from mental health practice settings across the United States who were providing services to children on the autism spectrum (aged 6 to 17 years). Practitioners were randomly assigned to undergo baseline conditions of 2 to 8 weeks. Once online training in MEYA commenced, practitioners engaged in algorithm-guided self-instruction in EBPs for autism. Participants video-recorded sessions. Independent coders used the MEYA Fidelity Scale (MEYA-FS) to rate adherence and competence in EBPs for autism. Practitioners also completed measures pertaining to implementation outcomes and parents rated youth outcomes on personalized target behaviors. Five of seven practitioners increased their adherence to MEYA practices (i.e., MEYA-FS scores) following MEYA training. Findings for competence were similar, though somewhat less robust. Practitioners generally viewed MEYA as feasible, understandable, and acceptable. Most youth outcomes improved during MEYA. A randomized, controlled trial of MEYA would be helpful in characterizing its effectiveness for supporting practitioner EBP implementation and youth outcomes in school and community service settings.

Cultural adaptation, content, and protocol of a feasibility study of school-based "Let's learn about emotions" intervention for Finnish primary school children

Introduction

Emotional awareness and emotion regulation are crucial for cognitive and socio-emotional development in children. School-based interventions on socio-emotional skills have the potential to prevent these problems and promote well-being of children. The Japanese school-based program, Universal Unified Prevention Program for Diverse Disorders (Up2-D2), has shown preventive effects on mental health of children in Japan. The aims of this protocol paper are to describe the unique process of adapting the Up2-D2 from Eastern to Western context, and to present a feasibility study of the intervention, conducted in Finland.

Methods

The cultural adaptation process started with the linguistic translation of materials, followed by the modification of language to fit the Finnish context. While the Japanese ideology was saved, some content was adapted to fit Finnish school children. Further modifications were made based on feedback from pupils and teachers. The Finnish version of the program was named "Let's learn about emotions" and consisted of 12 sessions and targeted 8- to 12-year-old pupils. A teacher education plan was established to assist Finnish teachers with the intervention, including a workshop, teachers' manual, brief introductory videos, and online support sessions. A feasibility study involving 512 4th graders in the City of Hyvinkää, South of Finland, was conducted. It assessed emotional and behavioral problems, classroom climate, bullying, loneliness, perception of school environment, knowledge of emotional awareness, and program acceptability.

Discussion

The originality of this study underlies in the East-West adaptation of a cognitive behavioral therapy-based program. If promising feasibility findings are replicated in Finland, it could pave the way for further research on implementing such programs in diverse contexts and cultures, promoting coping skills, awareness, social skills and early prevention of child mental health problems.

Ethics

The ethical board of the University of Turku gave ethics approval for this research. The educational board of the City of Hyvinkää accepted this study.

A Pilot Randomized Controlled Trial of Intervention for Social Work Clients with Children Facing Complex Financial Problems in Finland (FinSoc): A Study Protocol

PURPOSE

Social work clients often face complex financial problems. We have developed a financial social work intervention, FinSoc, to increase financial literacy and economic self-efficacy and reduce financial anxiety among parents with financial problems in Finland. The aim of this pilot randomized controlled trial is to explore the feasibility, acceptability, and preliminary effectiveness of the intervention. This paper, a study protocol, describes the design and implementation of the trial. Study protocols are articles detailing a priori the research plan, rationale, proposed methods and plans for how a clinical trial will be conducted.

METHOD

This study is a pilot randomized controlled trial with a mixed methods approach applying both quantitative measures and qualitative interviews. Participating social work clients with children are randomly assigned to either the treatment or the waiting list control group at a ratio of 1:1. The treatment group receives the intervention and the control group receives services as usual. The quantitative data from social work clients are collected at three measurement points. Qualitative interviews are conducted post-intervention with both clients receiving, and professionals implementing the intervention. The feasibility is assessed through recruitment and retention rates and the interviews with social work professionals providing the intervention. Acceptability is assessed through feedback from participants on satisfaction with the intervention and usefulness of the specific intervention components. Potential effectiveness is measured by financial literacy, economic self-efficacy and financial anxiety.

DISCUSSION

The intervention is hypothesized to increase financial literacy and economic self-efficacy and reduce financial anxiety among social work clients with children. The results of this pilot study will increase the evidence base of financial social work and offer new insights for developing interventions for clients experiencing financial difficulties.

Adolescent perspectives on peripartum mental health prevention and promotion from Kenya: Findings from a design thinking approach

In Kenya, approximately one in five girls aged 15-19 years old are pregnant or already a mother. Adolescent girls and young women experience significant mental health vulnerabilities during the pregnancy and postpartum periods, leading to poor antenatal and postnatal care attendance and inferior infant and maternal health outcomes. Pregnant adolescents often experience stigma and disenfranchisement due to their pregnancy status and at the same time lack access to mental health support within health settings, schools, religious institutions, and communities. This paper presents the results of qualitative interviews embedded within the human-centered design (HCD) process used to adapt the Helping Adolescents Thrive (HAT) program for Kenyan peripartum adolescents including young fathers. This qualitative study used two phases. First, a HAT advisory group participated in a series of four workshops to help identify and articulate mental health promotion needs and deepened the team's understanding of youth-centered thinking. Second, qualitative interviews were conducted with 39 pregnant and parenting adolescents to understand their perspectives on mental health prevention and promotion. Pregnant and parenting adolescents articulated different needs including poor support, stigma, and psychological disturbances. Parenting adolescents reported disturbed relationships, managing motherhood, poor health, and social empowerment. Participants highlighted sources of stress including economic challenges, fear of delivery, strained relationships, rejection, and stigma. Participants described psychological disturbances such as feeling stressed, worthless, withdrawn, and suicidal. Coping mechanisms reported by participants included engaging in domestic activities, hobbies, and social networking. Peers, family and spirituality were identified as important sources of support, as well as school integration, livelihoods, support groups and mentorships. Findings from this study can be used to strengthen and adapt HAT program, policy and practice for mental health prevention and promotion for pregnant and parenting adolescents.

A call for early, effective, and scalable parent education programs for high-conflict separated/divorcing parents: A synthesized perspective from prevention science and family law

Conflict between parents is stressful and disruptive to children living in the midst of parental separation or divorce. Although some level of post-separation/divorce conflict is understandable in an emotionally-charged separation/divorce, it undermines the extent to which parents protect their children from short- and long-term problems. In this article, we weave together a synthesized perspective informed by our respective training and experience in prevention science and family law on the role of parent education programs for high-conflict separating/divorcing parents. To do so, we first describe the research on the effects of high interparental conflict on children's outcomes and then discuss current approaches and challenges to reducing these negative effects by offering parent education programs for high-conflict separating/divorcing parents. Then, we propose and describe a new model for early, effective, and scalable parent education programs with the ultimate goal of protecting children after separation/divorce.

Developing an educational resource for gynecological cancer survivors and their caregivers: A methods and experience paper

Building upon the need for greater education, identified by gynecological cancer survivors and their caregivers, the objective of this paper is to describe our patient-clinician-researcher partnership to develop an evidence- and experiential-based educational resource. We engaged in five phases using multiple research methods: 1) assembling the essential expertise, 2) reviewing the literature, 3) drafting the resource, 4) testing the resource, and 5) disseminating the resource. Our diverse partnership provided expertise toward multiple research methods that produced results useful for each successive phase. This combination - a diverse partnership and multiple research methods - resulted in a useful resource to fulfill a gap identified by knowledge users. The combined features described in our paper fill a procedural gap for clinicians and researchers intending to develop educational resources that are empirically and experientially founded.

Élaboration d’une ressource d’information à l’intention des survivantes d’un cancer gynécologique et de leurs proches aidants : exposé sur le vécu et les méthodes

Le présent article fait ressortir la nécessité de mieux informer les survivantes de cancer gynécologique (CG) et leurs proches aidants. Il vise à décrire le partenariat établi entre les patientes, les cliniciens et les chercheurs pour concevoir une ressource d’information fondée sur l’expérience et les données probantes. L’élaboration de cette ressource d’information a fait appel à plusieurs méthodes de recherche. Elle s’est déroulée en cinq étapes : 1) réunion de l’expertise nécessaire; 2) revue de la littérature; 3) ébauche de la ressource; 4) mise à l’essai; 5) diffusion de la ressource. La diversité des partenaires apportait l’expertise nécessaire à l’utilisation de multiples méthodes de recherche ayant produit des résultats utiles à chaque étape. Grâce à cette combinaison (partenariat diversifié et multiples méthodes de recherche), on a élaboré une ressource utile pour répondre à un manque observé par les utilisateurs des connaissances. La combinaison des caractéristiques décrites dans le présent article vient combler une lacune dans la procédure utilisée par les cliniciens et les chercheurs désireux d’élaborer des ressources d’information fondées à la fois sur l’expérience et la pratique.

Process and Implementation Elements of Measurement Feedback Systems: A Systematic Review

Measurement feedback systems (MFS) can help guide treatment and improve clinical outcomes. Studies of MFS are heterogeneous both in execution and results, and the effects of MFS seem restricted by limited attention to process and implementation elements and by limited adoption by health professionals. The current systematic review mapped the use of process and implementation elements in MFS studies. An overview of therapists' use of and attitudes toward MFS is provided. Three-level meta-analyses were used to test theoretically informed process and implementation elements as moderators of the effects of MFS. Hypotheses and general propositions from Clinical Performance Feedback Intervention Theory (CP-FIT) were used to organize the elements of the studies and were used as moderator variables. Previous studies on MFS interventions have had a limited focus on implementation efforts and process elements that may increase the effects of MFS and their use among therapists. Efforts have sparsely been made to reduce barriers to MFS use, and several studies have reported limited engagement with MFS among therapists. Therapists' attitudes toward MFS, feedback, or standardized measures were heterogeneously reported, making data synthesis challenging. Identified process and implementation elements were not significantly associated with effect sizes in the studies and the results did not support the propositions of CP-FIT. The lack of statistically significant associations may be due to limited reporting of details about process and implementation aspects. More research designed to test hypotheses regarding process and implementation elements is needed to improve the use and effects of MFS. Future studies should aspire to report findings in a manner that allows for an understanding of the implementation process and therapists' adoption of these systems.

Acceptability and use of an online health priorities self-identification tool for older adults: A qualitative investigation

Objective

To examine the use of a web-based, self-directed health priorities identification tool for older adults with multiple chronic conditions (MCCs).

Methods

We recruited a gender- and racially-diverse, highly educated sample of older adults with MCCs to engage with our My Health Priorities tool, then complete a semi-structured interview. Thematic analysis was used to examine interview transcripts.

Results

Twenty-one participants shared perspectives on the acceptability and use of the tool. Three themes (with eleven subthemes) were generated to describe: website user experience feedback, the content of the health priorities identification process, and the tool's capacity to empower communication and decision making.

Conclusion

Participants found this tool acceptable and easy to use, describing a variety of benefits of the priorities self-identification process and offered suggestions for refinement and broader implementation. Older adults with limited internet navigation abilities or misconceptions about the self-directed process may benefit from clinicians clarifying the purpose of the process or initiating priorities-aligned discussions.

Innovation

This novel tool can help older adults with MCCs define what matters most for their health and healthcare, informing a variety of health decisions. This tool may enable and motivate patients to lead health priorities decision-making discussions with clinicians and care partners.

Codesign of remote data collection for chronic management of pediatric home mechanical ventilation

INTRODUCTION

Outpatient monitoring of children using invasive home mechanical ventilation (IHMV) is recommended, but access to care can be difficult. This study tested if remote (home-based) data collection was feasible and acceptable in chronic IHMV management.

METHODS

A codesign study was conducted with an IHMV program, home nurses, and English- and Spanish-speaking parent-guardians of children using IHMV (0-17 years; n = 19). After prototyping, parents used a remote patient monitoring (RPM) bundle to collect patient heart rate, respiratory rate (RR), oxygen saturation, end-tidal carbon dioxide (EtCO2 ), and ventilator pressure/volume over 8 weeks. User feedback was analyzed using qualitative methods and the System Usability Scale (SUS). Expected marginal mean differences within patient measures when awake, asleep, or after a break were calculated using mixed effects models.

RESULTS

Patients were a median 2.9 years old and 11 (58%) took breaks off the ventilator. RPM data were entered on a mean of 83.7% (SD ± 29.1%) weeks. SUS scores were 84.8 (SD ± 10.5) for nurses and 91.8 (SD ± 10.1) for parents. Over 90% of parents agreed/strongly agreed that RPM data collection was feasible and relevant to their child's care. Within-patient comparisons revealed that EtCO2 (break-vs-asleep 2.55 mmHg, d = 0.79 [0.42-1.15], p < .001; awake-vs-break 1.48, d = -0.49 [0.13-0.84], p = .02) and RR (break-vs-asleep 16.14, d = 2.12 [1.71-2.53], p < .001; awake-vs-break 3.44, d = 0.45 [0.10-0.04], p = .03) were significantly higher during ventilator breaks.

CONCLUSIONS

RPM data collection in children with IHMV was feasible, acceptable, and captured clinically meaningful vital sign changes during ventilator breaks, supporting the clinical utility of RPM in IHMV management.

Improving the Usability of Written Exposure Therapy for Therapists in the Department of Veterans Affairs Telemental Health: Formative Study Using Qualitative and User-Centered Design Methods

BACKGROUND

User modifications are common in evidence-based psychosocial interventions (EBPIs) for mental health disorders. Often, EBPIs fit poorly into clinical workflows, require extensive resources, or pose considerable burden to patients and therapists. Implementation science is increasingly researching ways to improve the usability of EBPIs before implementation. A user-centered design can be used to support implementation methods to prioritize user needs and solutions to improve EBPI usability.

OBJECTIVE

Trauma-focused EBPIs are a first-line treatment for patients with posttraumatic stress disorder (PTSD) in the Department of Veterans Affairs. Written exposure therapy (WET) is a brief, trauma-focused EBPI wherein patients handwrite about trauma associated with their PTSD. Initially developed for in-person delivery, WET is increasingly being delivered remotely, and outcomes appear to be equivalent to in-person delivery. However, there are logistical issues in delivering WET via video. In this evaluation, we explored usability issues related to WET telehealth delivery via videoconferencing software and designed a solution for therapist-facing challenges to systematize WET telehealth delivery.

METHODS

The Discover, Design and Build, and Test framework guided this formative evaluation and served to inform a larger Virtual Care Quality Enhancement Research Initiative. We used qualitative descriptive methods in the Discover phase to understand the experiences and needs of 2 groups of users providing care within the Department of Veterans Affairs: in-person therapists delivering WET via video because of the COVID-19 pandemic and telehealth therapists who regularly deliver PTSD therapies. We then used user-centered design methods in the Design and Build phase to brainstorm, develop, and iteratively refine potential workflows to address identified usability issues. All procedures were conducted remotely.

RESULTS

In the Discover phase, both groups had challenges delivering WET and other PTSD therapies via telehealth because of technology issues with videoconferencing software, environmental distractions, and workflow disruptions. Narrative transfer (ie, patients sending handwritten trauma accounts to therapists) was the first target for design solution development as it was deemed most critical to WET delivery. In the Design and Build phase, we identified design constraints and brainstormed solution ideas. This led to the development of 3 solution workflows that were presented to a subgroup of therapist users through cognitive walkthroughs. Meetings with this subgroup allowed workflow refinement to improve narrative transfers. Finally, to facilitate using these workflows, we developed PDF manuals that are being refined in subsequent phases of the implementation project (not mentioned in this paper).

CONCLUSIONS

The Discover, Design and Build, and Test framework can be a useful tool for understanding user needs in complex EBPI interventions and designing solutions to user-identified usability issues. Building on this work, an iterative evaluation of the 3 solution workflows and accompanying manuals with therapists and patients is underway as part of a nationwide WET implementation in telehealth settings.

A Video Game Intervention to Prevent Opioid Misuse Among Older Adolescents: Development and Preimplementation Study

BACKGROUND

Opioid misuse and mental disorders are highly comorbid conditions. The ongoing substance misuse and mental health crises among adolescents in the United States underscores the importance of widely scalable substance misuse preventive interventions that also address mental health risks. Serious video games offer an engaging, widely scalable method for delivering and implementing preventive interventions. However, there are no video game interventions that focus on preventing opioid misuse among older adolescents, and there are limited existing video game interventions that address mental health.

OBJECTIVE

This study aims to develop and conduct a formative evaluation of a video game intervention to prevent opioid misuse and promote mental health among adolescents aged 16-19 years (PlaySmart). We conducted formative work in preparation for a subsequent randomized controlled trial.

METHODS

We conducted development and formative evaluation of PlaySmart in 3 phases (development, playtesting, and preimplementation) through individual interviews and focus groups with multiple stakeholders (adolescents: n=103; school-based health care providers: n=51; and addiction treatment providers: n=6). PlaySmart content development was informed by the health belief model, the theory of planned behavior, and social cognitive theory. User-centered design principles informed the approach to development and play testing. The Exploration, Preparation, Implementation, and Sustainability framework informed preimplementation activities. Thematic analysis was used to identify themes from interviews and focus groups that informed PlaySmart game content and approaches to future implementation of PlaySmart.

RESULTS

We developed a novel video game PlaySmart for older adolescents that addresses the risk and protective factors for opioid misuse and mental health. Nine themes emerged from the focus groups that provided information regarding game content. Playtesting revealed areas of the game that required improvement, which were modified for the final game. Preimplementation focus groups identified potential barriers and facilitators for implementing PlaySmart in school settings.

CONCLUSIONS

PlaySmart offers a promising digital intervention to address the current opioid and mental health crises among adolescents in a scalable manner.

Pilot Trial of Online Measurement Training and Feedback in Family Therapy for Adolescent Behavior Problems

OBJECTIVE

Pragmatic procedures for sustaining high-fidelity delivery of evidence-based interventions are needed to support implementation in usual care. This study tested an online therapist training system, featuring observational coder training and self-report fidelity feedback, to promote self-report acumen and routine use of family therapy (FT) techniques for adolescent behavior problems.

METHOD

Therapists (N = 84) from nine substance use and mental health treatment sites reported on 185 adolescent clients. Therapists submitted baseline data on FT technique use with clients, completed a workshop introducing the 32-week training system, and were randomly assigned by site to Core Training versus Core Training + Consultation. Core Training included a therapist coder training course (didactic instruction and mock session coding exercises in 13 FT techniques) and fidelity feedback procedures depicting therapist-report data on FT use. Consultation convened therapists and supervisors for one-hour monthly sessions with an external FT expert. During the 32 weeks of training, therapists submitted self-report data on FT use along with companion session audiotapes subsequently coded by observational raters.

RESULTS

Therapist self-report reliability and accuracy both increased substantially during training. Observers reported no increase over time in FT use; therapists self-reported a decrease in FT use, likely an artifact of their improved self-report accuracy. Consultation did not enhance therapist self-report acumen or increase FT use.

CONCLUSIONS

Online training methods that improve therapist-report reliability and accuracy for FT use may confer important advantages for treatment planning and fidelity monitoring. More intensive and/or different training interventions appear needed to increase routine FT delivery.

Enhancing Mental Health and Medication Adherence Among Men Who Have Sex With Men Recently Diagnosed With HIV With a Dialectical Behavior Therapy-Informed Intervention Incorporating mHealth, Online Skills Training, and Phone Coaching: Development Study Using Human-Centered Design Approach

BACKGROUND

Mental health problems are common among men who have sex with men (MSM) living with HIV and may negatively affect medication adherence. Psychosocial interventions designed to address these urgent needs are scarce in China. Incorporating behavioral health theories into intervention development strengthens the effectiveness of these interventions. The absence of a robust theoretical basis for interventions may also present challenges to identify active intervention ingredients.

OBJECTIVE

This study aims to systematically describe the development of a mobile health-based intervention for MSM recently diagnosed with HIV in China, including the theoretical basis for the content and the considerations for its technological delivery.

METHODS

We used intervention mapping (IM) to guide overall intervention development, a behavioral intervention technology model for technological delivery design, and a human-centered design and cultural adaptation model for intervention tailoring throughout all steps of IM.

RESULTS

The dialectical behavior therapy (DBT)-informed intervention, Turning to Sunshine, comprised 3 components: app-based individual skills learning, group-based skills training, and on-demand phone coaching. The theoretical basis for the intervention content is based on the DBT model of emotions, which fits our conceptualization of the intervention user's mental health needs. The intervention aims to help MSM recently diagnosed with HIV (1) survive moments of high emotional intensity and strong action urges, (2) change emotional expression to regulate emotions, and (3) reduce emotional vulnerability, as well as (4) augment community resources for mental health services. Technological delivery considerations included rationale of the medium, complexity, and esthetics of information delivery; data logs; data visualization; notifications; and passive data collection.

CONCLUSIONS

This study laid out the steps for the development of a DBT-informed mobile health intervention that integrated app-based individual learning, group-based skills training, and phone coaching. This intervention, Turning to Sunshine, aims to improve mental health outcomes for MSM newly diagnosed with HIV in China. The IM framework informed by human-centered design principles and cultural adaptation considerations offered a systematic approach to develop the current intervention and tailor it to the target intervention users. The behavioral intervention technology model facilitated the translation of behavioral intervention strategies into technological delivery components. The systematic development and reporting of the current intervention can serve as a guide for similar intervention studies. The content of the current intervention could be adapted for a broader population with similar emotional struggles to improve their mental health outcomes.

Oral health during pregnancy: an analysis of interprofessional guideline awareness and practice behaviors among prenatal and oral health providers

BACKGROUND

Poor oral health during pregnancy has significant implications across the life course, including increased risk for adverse pregnancy, birth outcomes, and the development of early childhood caries. In efforts to improve perinatal oral health in the United States, a set of national interprofessional guidelines were developed that include recommended practice behaviors for both oral health providers and prenatal providers. The purpose of this study was to examine guideline awareness, familiarity, beliefs, and practice behaviors among both provider types.

METHODS

Prenatal providers and oral health providers in Florida were recruited via random and convenience sampling to complete an online survey guided by the Consolidated Framework for Implementation Research (CFIR) and the Cabana Framework. The present analysis focused on the Individuals Involved domain (CFIR), awareness and familiarity with the guidelines (Cabana Framework), confidence, and practice behaviors as recommended by prenatal oral health guidelines (assess, advise, refer, share/coordinate). Data were analyzed using chi-square tests, independent samples t-tests, Pearson correlation coefficients, and one-way analysis of variance (ANOVA) and analyses were conducted in SPSS.

RESULTS

Prenatal and oral health providers did not differ significantly in their awareness of the guidelines, but awareness was significantly associated with three of the four practice behaviors for prenatal providers. Familiarity with the guidelines was significantly higher among oral health providers and was associated with all four practice behaviors for both provider types. Five out of ten oral health belief items were significantly associated with practicing the guidelines among prenatal providers, but only two among oral health providers. Confidence in performing the practice behaviors was significantly associated with guideline implementation among both groups. Years in practice was significantly associated with performing practice behaviors for prenatal providers, but not for oral health providers.

CONCLUSIONS

Our findings highlight the importance of professional organizations and the role of clinical guidelines on practice behaviors. Although provider education is a key implementation strategy, organizational and policy-level system changes could also be critical in supporting practice behaviors.

Online sleep diaries: considerations for system development and recommendations for data management

STUDY OBJECTIVES

To present development considerations for online sleep diary systems that result in robust, interpretable, and reliable data; furthermore, to describe data management procedures to address common data entry errors that occur despite those considerations.

METHODS

The online sleep diary capture component of the Sleep Healthy Using the Internet (SHUTi) intervention has been designed to promote data integrity. Features include diary entry restrictions to limit retrospective bias, reminder prompts and data visualizations to support user engagement, and data validation checks to reduce data entry errors. Despite these features, data entry errors still occur. Data management procedures relying largely on programming syntax to minimize researcher effort and maximize reliability and replicability. Presumed data entry errors are identified where users are believed to have incorrectly selected a date or AM versus PM on the 12-hour clock. Following these corrections, diaries are identified that have unresolvable errors, like negative total sleep time.

RESULTS

Using the example of one of our fully-powered, U.S. national SHUTi randomized controlled trials, we demonstrate the application of these procedures: of 45,598 total submitted diaries, 487 diaries (0.01%) required modification due to date and/or AM/PM errors and 27 diaries (<0.001%) were eliminated due to unresolvable errors.

CONCLUSION

To secure the most complete and valid data from online sleep diary systems, it is critical to consider the design of the data collection system and to develop replicable processes to manage data.

CLINICAL TRIAL REGISTRATION

Sleep Healthy Using The Internet for Older Adult Sufferers of Insomnia and Sleeplessness (SHUTiOASIS); https://clinicaltrials.gov/ct2/show/NCT03213132; ClinicalTrials.gov ID: NCT03213132.

Cultural Adaptation and Implementation of Cognitive-Behavioral Psychosocial Interventions for Anxiety and Depression in Japanese Youth

The present article reviews the current status of cognitive-behavioral therapy (CBT) interventions for anxiety and depression in Japanese youth. First, a literature review of youth CBT programs for anxiety and depression is provided. Through this process, we identify which program/protocol has been most researched within Japan. Second, through a systematic interview to the authors, the development process of four predominant programs is outlined. The programs included were a family CBT program for anxiety disorders (the Japanese Anxiety Children/Adolescents Cognitive Behavior Therapy program), two school-based prevention programs for anxiety and depression (Journey of the Brave and Phoenix Time), and a transdiagnostic protocol for anxiety and depression (Unified Protocol for Transdiagnostic Treatment of Emotional Disorders in Children and the Unified Protocol for Transdiagnostic Treatment of Emotional Disorders in Adolescents). Third, cultural adaptation and modification of the programs are discussed from the scope of user-centered design principles as described by Lyon and Koerner (Sci Pract 23:180-200, 2016). As a result, changes in program content and material, as represented by the use of culture-friendly program names, acronyms, illustrations, and characters were endorsed in all of the programs. Structured but flexible session formats helped increase learnability and efficiency while keeping the cognitive load of providers and consumers low. A careful selection of providers, as well as quality training and consultation are important factors to maximize competency and ensure appropriate implementation. Application of existing time frames and staff who work in each setting were effective ways to increase scalability. Overall, it was shown that many of the modifications adopted overlap among successful programs; these represent the most basic and essential requirements for a program to be applicable to a wide range of contexts. Implications and further directions are explored.

Systematic development of a set of implementation strategies for transitional care innovations in long-term care

BACKGROUND

Numerous transitional care innovations (TCIs) are being developed and implemented to optimize care continuity for older persons when transferring between multiple care settings, help meet their care needs, and ultimately improve their quality of life. Although the implementation of TCIs is influenced by contextual factors, the use of effective implementation strategies is largely lacking. Thus, to improve the implementation of TCIs targeting older persons receiving long-term care services, we systematically developed a set of viable strategies selected to address the influencing factors.

METHODS

As part of the TRANS-SENIOR research network, a stepwise approach following Implementation Mapping (steps 1 to 3) was applied to select implementation strategies. Building on the findings of previous studies, existing TCIs and factors influencing their implementation were identified. A combination of four taxonomies and overviews of change methods as well as relevant evidence on their effectiveness were used to select the implementation strategies targeting each of the relevant factors. Subsequently, individual consultations with scientific experts were performed for further validation of the process of mapping strategies to implementation factors and for capturing alternative ideas on relevant implementation strategies.

RESULTS

Twenty TCIs were identified and 12 influencing factors (mapped to the Consolidated Framework for Implementation Research) were designated as priority factors to be addressed with implementation strategies. A total of 40 strategies were selected. The majority of these target factors at the organizational level, e.g., by using structural redesign, public commitment, changing staffing models, conducting local consensus discussions, and organizational diagnosis and feedback. Strategies at the level of individuals included active learning, belief selection, and guided practice. Each strategy was operationalized into practical applications.

CONCLUSIONS

This project developed a set of theory and evidence-based implementation strategies to address the influencing factors, along further tailoring for each context, and enhance the implementation of TCIs in daily practice settings. Such work is critical to advance the use of implementation science methods to implement innovations in long-term care successfully.

Preferences of University Students for a Psychological Intervention Designed to Improve Sleep: Focus Group Study

BACKGROUND

Many university students have difficulties with sleep; therefore, effective psychological treatments are needed. Most research on psychological treatments to improve sleep has been conducted with middle-aged and older adults, which means it is unclear whether existing psychological treatments are helpful for young adult university students.

OBJECTIVE

This study aimed to discover university student preferences for a psychological intervention to improve sleep quality.

METHODS

Focus groups were conducted over 3 stages to examine students' views regarding content, format, and session duration for a psychological intervention to improve sleep. A thematic analysis was conducted to analyze participant responses.

RESULTS

In total, 30 participants attended small focus group discussions. Three key themes were identified: (1) program development, (2) help-seeking, and (3) student sleep characteristics. Program development subthemes were program format, program content, and engagement facilitators. Help-seeking subthemes were when to seek help, where to access help, stigma, and barriers. Student sleep characteristics subthemes were factors disturbing sleep and consequences of poor sleep.

CONCLUSIONS

Students emphasized the need for a sleep intervention with an in-person and social component, individualized content, and ways to monitor their progress. Participants did not think there was a stigma associated with seeking help for sleep problems. Students identified the lack of routine in their lifestyle, academic workload, and the pressure of multiple demands as key contributors to sleep difficulties.

Advance Care Planning Website for People With Dementia and Their Family Caregivers: Protocol for a Development and Usability Study

BACKGROUND

Web-based tools for people with dementia and their family caregivers have considerably increased over the years and offer promising solutions to several unmet needs such as supporting self-care in daily life, facilitating treatment delivery, or ensuring their ability to communicate. The use of web-based tools in the field of advance care planning (ACP) for people with dementia and their family caregivers has yet to be explored and requires careful consideration, given the sensitive topic and the specific needs of people with dementia and their families.

OBJECTIVE

This paper reports the protocol for a study aiming to develop and simultaneously test the usability of an ACP website designed for, and with, people with dementia and their families.

METHODS

The development of the website is based on a process map for the development of web-based decision support interventions and on the Medical Research Council framework for complex intervention development and evaluation. Additionally, we apply a user-centered approach in combination with patient and public involvement (PPI) throughout the development process. We describe our iterative development approach to the website. Participants and a PPI group give feedback on 4 prototypes of the ACP website. For each iteration, we aim to include 12 participants (3 people with dementia, 3 family caregivers, and 3 dyads) in usability testing. In the first 3 iterations, usability testing includes (1) a think-aloud exercise, (2) researcher observations, and (3) the System Usability Scale questionnaire. The last iteration of usability testing is composed of a semistructured interview assessing the layout, content, face validity, and readability of the website. Qualitative data from the think-aloud exercises and interviews are analyzed using thematic analysis. Mean scores are calculated for the System Usability Scale questionnaire.

RESULTS

This study received approval from the Ethical Review Board of Brussels University Hospital of the Vrije Universiteit Brussel. Recruitment began in October 2021. The target date for paper submission of the results of the development and usability testing will be in 2023.

CONCLUSIONS

The methods in this protocol describe a feasible and inclusive approach to the development of an ACP website together with people with dementia, their family caregivers, and other stakeholders. We provide a clear overview of how to combine PPI input and user-centered development methods, leading to a transparent and reliable development process. This protocol might stimulate the active participation of people with dementia, their caregivers, and regional stakeholders in future studies on web-based technologies. The results of this study will be used to refine the design and create a relevant and user-friendly ACP website that is ready to be tested in a larger evaluation study.

INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID)

DERR1-10.2196/46935.

Core Elements of Family Therapy for Adolescent Behavioral Health Problems: Validity Generalization in Community Settings

OBJECTIVE

The core elements of family therapy for adolescent mental health and substance use problems, originally distilled from high-fidelity sessions conducted by expert clinicians, were tested for validity generalization when delivered by community therapists in routine settings.

METHOD

The study sampled recorded sessions from 161 cases participating in one of three treatment pools: implementation trial of Functional Family Therapy (98 sessions/50 cases/22 therapists), adaptation trial of Multisystemic Therapy (115 sessions/59 cases/2 therapists), and naturalistic trial of non-manualized family therapy in usual care (107 sessions/52 cases/21 therapists). Adolescents were identified as 60% male and 40% female with an average age of 15.4 years; 49% were Latinx, 27% White Non-Latinx, 15% African American, 3% another race/ethnicity, 6% race/ethnicity unknown. Session recordings (n = 320) were randomly selected for each case and coded for 21 discrete family therapy techniques. Archived data of one-year clinical outcomes were gathered.

RESULTS

Confirmatory factor analyses replicated the factor structure from the original distillation study, retaining all four clinically coherent treatment modules comprised of all 21 techniques: Interactional Change (ICC = .77, Cronbach's α = .81); Relational Reframe (ICC = .75, α = .81); Adolescent Engagement (ICC = .72, α = .78); Relational Emphasis (ICC = .76, α = .80). Exploratory analyses found that greater use of core techniques predicted symptom improvements in one treatment pool.

CONCLUSIONS

Core techniques of family therapy distilled from manualized treatments for adolescent behavioral health problems showed strong evidence of validity generalization, and initial evidence of links to client outcomes, in community settings.

Development and evaluation of a COVID tracking system to support provision of social service in Wyandotte County, Kansas

Background

In addition to the state-mandated case investigation and contact tracing, the Unified Government Public Health Department of Wyandotte County, Kansas implemented social support services for COVID-19 cases and contacts; however, did not have the systems in place to document the provision of these services. Our team worked with the health department to develop and implement the COVID Tracking System (CTS), an eHealth system that linked multiple involved teams. Here, we describe the development and evaluation of the CTS. The objective of this manuscript is to describe and evaluate the development and implementation process of the Covid Tracking System.

Methods

Drawing from concepts of user-centered design, we took a 4-phase approach to development: understanding context, specifying needs, designing solutions, and evaluating. A mixed-methods evaluation of the development and implementation process using RE-AIM was conducted. Quantitative CTS data captured between February 1, 2021, and September 30, 2021 were exported. Descriptive statistics were calculated for categorical variables and means (SD, range) or median (IQR) for continuous variables. Qualitative discussions with key users supplemented the quantitative data.

Results

There were 1,152 cases entered into the CTS, of whom 307 (26.6%) requested a letter be sent to their workplace to excuse them during their quarantine period, 817 (70.9%) requested and had food and cleaning supplies delivered, 21 (1.8%) requested guidance on applying for federal assistance, and 496 (43.1%) requested to be contacted by a community health worker. While a few technical glitches slowed down early implementation, these were quickly resolved and key users felt that the CTS streamlined client referral and simplified their workflow, allowing them to spend more time on patient care and follow up, rather than documentation. After study implementation ended, the Unified Government Public Health Department of Wyandotte County continued using the CTS for client tracing and follow up.

Discussion

This project provides a roadmap of how user centered design can be applied to the development and evaluation of eHealth software to support program intervention implementation, even in situations where urgent action is needed.

Developing Implementation Strategies to Support the Uptake of a Risk Tool to Aid Physicians in the Clinical Management of Patients With Syncope: Systematic Theoretical and User-Centered Design Approach

BACKGROUND

The Canadian Syncope Risk Score (CSRS) was developed to improve syncope management in emergency department settings. Evidence-based tools often fail to have the intended impact because of suboptimal uptake or poor implementation.

OBJECTIVE

In this paper, we aimed to describe the process of developing evidence-based implementation strategies to support the deployment and use of the CSRS in real-world emergency department settings to improve syncope management among physicians.

METHODS

We followed a systematic approach for intervention development, including identifying who needs to do what differently, identifying the barriers and enablers to be addressed, and identifying the intervention components and modes of delivery to overcome the identified barriers. We used the Behaviour Change Wheel to guide the selection of implementation strategies. We engaged CSRS end users (ie, emergency medicine physicians) in a user-centered design approach to generate and refine strategies. This was achieved over a series of 3 qualitative user-centered design workshops lasting 90 minutes each with 3 groups of emergency medicine physicians.

RESULTS

A total of 14 physicians participated in the workshops. The themes were organized according to the following intervention development steps: theme 1-identifying and refining barriers and theme 2-identifying the intervention components and modes of delivery. Theme 2 was subdivided into two subthemes: (1) generating high-level strategies and developing strategies prototypes and (2) refining and testing strategies. The main strategies identified to overcome barriers included education in the format of meetings, videos, journal clubs, and posters (to address uncertainty around when and how to apply the CSRS); the development of a web-based calculator and integration into the electronic medical record (to address uncertainty in how to apply the CSRS); a local champion (to address the lack of team buy-in); and the dissemination of evidence summaries and feedback through email communications (to address a lack of evidence about impact).

CONCLUSIONS

The ability of the CSRS to effectively improve patient safety and syncope management relies on broad buy-in and uptake across physicians. To ensure that the CSRS is well positioned for impact, a comprehensive suite of strategies was identified to address known barriers.

Increasing Participation in a TelePrEP Program for Sexual and Gender Minority Adolescents and Young Adults in Louisiana: Protocol for an SMS Text Messaging-Based Chatbot

BACKGROUND

Sexual and gender minority (SGM) adolescents and young adults (AYAs) are at increased risk of HIV infection, particularly in the Southern United States. Despite the availability of effective biomedical prevention strategies, such as pre-exposure prophylaxis (PrEP), access and uptake remain low among SGM AYAs. In response, the Louisiana Department of Health initiated the LA TelePrEP Program, which leverages the power of telemedicine to connect Louisiana residents to PrEP. A virtual TelePrEP Navigator guides users through the enrollment process, answers questions, schedules appointments, and facilitates lab testing and medication delivery. To increase the participation of SGM AYAs in the program, the TelePrEP program partnered with researchers to develop a chatbot that would facilitate access to the program and support navigator functions. Chatbots are capable of carrying out many functions that reduce employee workload, and despite their successful use in health care and public health, they are relatively new to HIV prevention.

OBJECTIVE

In this paper, we describe the iterative and community-engaged process that we used to develop an SMS text messaging-based chatbot tailored to SGM AYAs that would support navigator functions and disseminate PrEP-related information.

METHODS

Our process was comprised of 2 phases: conceptualization and development. In the conceptualization phase, aspects of navigator responsibilities, program logistics, and user interactions to prioritize in chatbot programming (eg, scheduling appointments and answering questions) were identified. We also selected a commercially available chatbot platform that could execute these functions and could be programmed with minimal coding experience. In the development phase, we engaged Department of Health staff and SGM AYAs within our professional and personal networks. Five different rounds of testing were conducted with various groups to evaluate each iteration of the chatbot. After each iteration of the testing process, the research team met to discuss feedback, guide the programmer on incorporating modifications, and re-evaluate the chatbot's functionality.

RESULTS

Through our highly collaborative and community-engaged process, a rule-based chatbot with artificial intelligence components was successfully created. We gained important knowledge that could advance future chatbot development efforts for HIV prevention. Key to the PrEPBot's success was resolving issues that hampered the user experience, like asking unnecessary questions, responding too quickly, and misunderstanding user input.

CONCLUSIONS

HIV prevention researchers can feasibly and efficiently program a rule-based chatbot with the assistance of commercially available tools. Our iterative process of engaging researchers, program personnel, and different subgroups of SGM AYAs to obtain input was key to successful chatbot development. If the results of this pilot trial show that the chatbot is feasible and acceptable to SGM AYAs, future HIV researchers and practitioners could consider incorporating chatbots as part of their programs.

INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID)

PRR1-10.2196/42983.

Predictive Modeling to Identify Children With Complex Health Needs At Risk for Hospitalization

BACKGROUND

Identifying children at high risk with complex health needs (CCHN) who have intersecting medical and social needs is challenging. This study's objectives were to (1) develop and evaluate an electronic health record (EHR)-based clinical predictive model ("model") for identifying high-risk CCHN and (2) compare the model's performance as a clinical decision support (CDS) to other CDS tools available for identifying high-risk CCHN.

METHODS

This retrospective cohort study included children aged 0 to 20 years with established care within a single health system. The model development/validation cohort included 33 months (January 1, 2016-September 30, 2018) and the testing cohort included 18 months (October 1, 2018-March 31, 2020) of EHR data. Machine learning methods generated a model that predicted probability (0%-100%) for hospitalization within 6 months. Model performance measures included sensitivity, positive predictive value, area under receiver-operator curve, and area under precision-recall curve. Three CDS rules for identifying high-risk CCHN were compared: (1) hospitalization probability ≥10% (model-predicted); (2) complex chronic disease classification (using Pediatric Medical Complexity Algorithm [PMCA]); and (3) previous high hospital utilization.

RESULTS

Model development and testing cohorts included 116 799 and 27 087 patients, respectively. The model demonstrated area under receiver-operator curve = 0.79 and area under precision-recall curve = 0.13. PMCA had the highest sensitivity (52.4%) and classified the most children as high risk (17.3%). Positive predictive value of the model-based CDS rule (19%) was higher than CDS based on the PMCA (1.9%) and previous hospital utilization (15%).

CONCLUSIONS

A novel EHR-based predictive model was developed and validated as a population-level CDS tool for identifying CCHN at high risk for future hospitalization.

Development of an Online Training Platform and Implementation Strategy for School-Based Mental Health Professionals in Rural Elementary Schools: A Mixed-Methods Study

Children in rural settings are less likely to receive mental health services than their urban and suburban counterparts and even less likely to receive evidence-based care. Rural schools could address the need for mental health interventions by using evidence-based practices within a tiered system of supports such as positive behavioral interventions and supports. However, very few school professionals, with or without mental health training, have received training on evidence-based practices. Rural schools need implementation strategies focused on training to prepare school personnel for the implementation of interventions with fidelity. Little is known about training strategies that are feasible and appropriate for the rural school context. User-centered design is an appropriate framework for the development of training strategies for professionals in rural schools because of its participatory approach and the development of products that fit the context where they are going to be used. The purpose of the study was to develop and assess components of an online training platform and implementation strategy based on the user-centered design. Quantitative and qualitative data from 25 participants from an equal number of schools in rural areas of Pennsylvania were used in the study. A mixed-methods design utilizing complementary descriptive statistics and theme analyses indicated that the training platform and implementation strategy were perceived as highly acceptable, appropriate, feasible and usable by school professionals. The resulting training platform and implementation strategy will fill a void in the training literature in rural schools.

Understanding Lay Counselor Perspectives on Mobile Phone Supervision in Kenya: Qualitative Study

BACKGROUND

Task shifting is an effective model for increasing access to mental health treatment via lay counselors with less specialized training that deliver care under supervision. Mobile phones may present a low-technology opportunity to replace or decrease reliance on in-person supervision in task shifting, but important technical and contextual limitations must be examined and considered.

OBJECTIVE

Guided by human-centered design methods, we aimed to understand how mobile phones are currently used when supervising lay counselors, determine the acceptability and feasibility of mobile phone supervision, and generate solutions to improve mobile phone supervision.

METHODS

Participants were recruited from a large hybrid effectiveness implementation study in western Kenya wherein teachers and community health volunteers were trained to provide trauma-focused cognitive behavioral therapy. Lay counselors (n=24) and supervisors (n=3) participated in semistructured interviews in the language of the participants' choosing (ie, English or Kiswahili). Lay counselor participants were stratified by supervisor-rated frequency of mobile phone use such that interviews included high-frequency, average-frequency, and low-frequency phone users in equal parts. Supervisors rated lay counselors on frequency of phone contact (ie, calls and SMS text messages) relative to their peers. The interviews were transcribed, translated when needed, and analyzed using thematic analysis.

RESULTS

Participants described a range of mobile phone uses, including providing clinical updates, scheduling and coordinating supervision and clinical groups, and supporting research procedures. Participants liked how mobile phones decreased burden, facilitated access to clinical and personal support, and enabled greater independence of lay counselors. Participants disliked how mobile phones limited information transmission and relationship building between supervisors and lay counselors. Mobile phone supervision was facilitated by access to working smartphones, ease and convenience of mobile phone supervision, mobile phone literacy, and positive supervisor-counselor relationships. Limited resources, technical difficulties, communication challenges, and limitations on which activities can be effectively performed via mobile phone were barriers to mobile phone supervision. Lay counselors and supervisors generated 27 distinct solutions to increase the acceptability and feasibility of mobile phone supervision. Strategies ranged in terms of the resources required and included providing phones and airtime to support supervision, identifying quiet and private places to hold mobile phone supervision, and delineating processes for requesting in-person support.

CONCLUSIONS

Lay counselors and supervisors use mobile phones in a variety of ways; however, there are distinct challenges to their use that must be addressed to optimize acceptability, feasibility, and usability. Researchers should consider limitations to implementing digital health tools and design solutions alongside end users to optimize the use of these tools.

INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID)

RR2-10.1186/s43058-020-00102-9.

Getting to implementation: Adaptation of an implementation playbook

Introduction

Implementation strategies supporting the translation of evidence into practice need to be tailored and adapted for maximum effectiveness, yet the field of adapting implementation strategies remains nascent. We aimed to adapt "Getting To Outcomes"® (GTO), a 10-step implementation playbook designed to help community-based organizations plan and evaluate behavioral health programs, into "Getting To Implementation" (GTI) to support the selection, tailoring, and use of implementation strategies in health care settings.

Methods

Our embedded evaluation team partnered with operations, external facilitators, and site implementers to employ participatory methods to co-design and adapt GTO for Veterans Health Administration (VA) outpatient cirrhosis care improvement. The Framework for Reporting Adaptations and Modifications to Evidenced-based Implementation Strategies (FRAME-IS) guided documentation and analysis of changes made pre- and post-implementation of GTI at 12 VA medical centers. Data from multiple sources (interviews, observation, content analysis, and fidelity tracking) were triangulated and analyzed using rapid techniques over a 3-year period.

Results

Adaptations during pre-implementation were planned, proactive, and focused on context and content to improve acceptability, appropriateness, and feasibility of the GTI playbook. Modifications during and after implementation were unplanned and reactive, concentrating on adoption, fidelity, and sustainability. All changes were collaboratively developed, fidelity consistent at the level of the facilitator and/or implementer.

Conclusion

GTO was initially adapted to GTI to support health care teams' selection and use of implementation strategies for improving guideline-concordant medical care. GTI required ongoing modification, particularly in steps regarding team building, context assessment, strategy selection, and sustainability due to difficulties with step clarity and progression. This work also highlights the challenges in pragmatic approaches to collecting and synthesizing implementation, fidelity, and adaptation data.

Trial registration

This study was registered on ClinicalTrials.gov (Identifier: NCT04178096).