The implementation of a team training intervention for school mental health: Lessons learned

Participation in Multidisciplinary Teams Among Healthcare Professionals: A Discrete Choice Experiment in Tertiary Public Hospitals in China

Purpose

Healthcare professionals' participation is crucial for the efficient implementation of multidisciplinary team (MDT) collaboration models. We identified the key factors influencing healthcare professionals' preference to participate in MDTs in tertiary hospitals.

Methods

To clarify the attributes and levels of the discrete choice experiment (DCE), we conducted a targeted literature review and conducted in-depth interviews with MDT service providers. Following this, a DCE was designed to evaluate healthcare professionals' preferences for MDT participation, and the influence of factors such as salary subsidies, leadership attention, patient participation, quality assessment, working intensity, and case complexity. A conditional logit model estimated the utility of each attribute. Willingness-to-pay estimates were derived by taking the negative ratio of the coefficients of non-economic and economic attributes. A series of policy simulation analyses were conducted.

Results

Two hundred healthcare professionals completed the questionnaire, with 180 valid responses used for analysis. All attributes were statistically significant. Leadership attention and working intensity were the primary factors influencing staff willingness to participate in MDTs, followed by quality assessment and salary subsidies. Significant preference differences were observed between respondents; compared with mid-level staff, senior-level healthcare professionals believed patient engagement would be more helpful in boosting participation. The policy simulation showed that changing leadership attention from "neglect" to "emphasis" would increase the probability of staff choosing to participate in MDTs from 24.4% to 66.98%.

Conclusion

Leadership attention was the primary concern for healthcare professionals in MDTs. To effectively motivate staff participation in MDTs, policymakers should adopt a holistic approach that considers work motivation and individual backgrounds, including competitive salary packages and a positive work environment. They should concurrently introduce MDT case complexity measurement tools to optimize resource allocation. Addressing staff members' unique needs and career aspirations by creating targeted training programs, pathways for advancement, and personalized career development plans are also crucial.

Partnering with Schools to Adapt a Team Science Intervention: Processes and Challenges

Public schools are a major provider of mental health services for children in the US. Mental and behavioral health services range from universal programming to individualized clinical supports to address student needs. These services in schools are delivered by various professionals including non-teaching and teaching school personnel, school-employed clinicians, and/or contracted community mental health partners. Provision of mental health services requires complex coordination of providers across disciplines, although few professionals have training in multidisciplinary collaboration strategies. Attention to team processes, such as delineating team members' roles, improving communication, and identifying collaboration strategies, may impact the effectiveness of evidence-based mental health service provision in real world settings. One intervention, Team Strategies and Tools to Enhance Performance and Patient Safety (TeamSTEPPS), has been used in healthcare with positive outcomes and has been adapted to educational settings. The current paper describes the community-partnered subsequent adaptation of TeamSTEPPS for schools. Needs assessment interviews identified challenges, successes, and goals for student mental health. Overarching themes extracted from interviews include limited resources at multiple levels (e.g., financial support, time, and personnel), communication challenges, and poor role clarity. A community advisory board provided guidance during the adaptation and implementation planning process. Adaptations to the intervention included tailoring the intervention to the school context and the development of flexible training plans. In addition, individualized implementation plans were developed with each school partner to mitigate foreseeable barriers to rolling-out TeamSTEPPS. Our team is currently piloting the adapted TeamSTEPPS intervention and implementation strategies in partnership with three school districts.

Supplementary Information

The online version contains supplementary material available at 10.1007/s12310-024-09665-7.

Generating Actionable Evidence for School-Based Mental Health Service Delivery: Public-Academic Partnership Based Evaluations

Public-academic partnership-based program evaluations can generate actionable evidence for policymaking, program design and implementation in improving school-based mental health service delivery. The University of Pennsylvania Center for Mental Health and public behavioral health care agencies in Philadelphia in the United States have evaluated Philadelphia's school mental health programs reimbursable through Medicaid billing since 2008. The variety of evaluations include (1) examining acute mental health service use of children receiving school-based mental health care and Medicaid expenditure, (2) examining children's externalizing and internalizing behaviors to measure school mental health providers' performance, and (3) examining effects of different types of school mental health programs on children's behavioral health functioning, school outcomes, and other out-of-school service use. This paper reports key findings of these evaluations, discusses how programs have been refined based on evaluation results, and shares lessons learned for successful public-academic partnership-based evaluations to promote use of actionable evidence.

Improving teamwork in multidisciplinary cross-sector teams: Adaption and pilot testing of a team training for Child Advocacy Center teams

Background

Effective teamwork is critical to the mission of Child Advocacy Center (CAC) multidisciplinary teams. Team interventions designed to fit the unique cross-organizational context of CAC teams may improve teamwork in CACs.

Methods

A collaborative, community-engaged approach was used to adapt TeamSTEPPS, an evidence-based team training for healthcare, for CAC multidisciplinary teams. The adapted training was piloted with one team and evaluated using mixed methods. Team members completed pre-training (n = 26) and follow-up surveys (n = 22) and participated in qualitative interviews (n = 9).

Results

The adaptation process resulted in the creation of TeamTRACS (Team Training in Roles, Awareness, Communication, and Support). Participants rated TeamTRACS as highly acceptable, appropriate, feasible, relevant, and useful for CAC teams. They identified positive and negative aspects of the training, ideas for improvement, and future uses for TeamTRACS.

Conclusions

TeamTRACS is a feasible approach to team training in CACs, and team members find the content and skills relevant and useful. Additional research is needed to test the effectiveness of TeamTRACS and identify appropriate implementation strategies to support its use.

Therapist and supervisor perspectives about two train-the-trainer implementation strategies in schools: A qualitative study

Background

Train-the-trainer (TT) implementation strategies (in which designated clinicians are trained to then train others in an intervention) are promising approaches to support mental health clinician use of evidence-based interventions in school contexts. However, there is little evidence to date examining clinicians' perceptions of the acceptability and feasibility of TT strategies, or comparing clinicians' perceptions of different types of TT strategies.

Methods

The current study was conducted as part of a larger hybrid effectiveness-implementation trial, in which school-based therapists and supervisors received one of two different types of implementation support to implement cognitive behavioral therapy (CBT) groups for anxiety: TT (i.e., initial training for therapists and supervisors) or enhanced TT (TT+; i.e., initial training for therapists and supervisors, and ongoing external consultation for supervisors). We used applied thematic analysis to compare qualitative interview transcripts from 28 therapist interviews and 33 supervisor interviews from therapists and supervisors who received TT or TT+ support and report themes that were similar and different across the two groups.

Results

Most themes were similar across the TT and TT+ conditions: therapists and supervisors in both conditions perceived the group anxiety intervention as acceptable and viewed supervision as acceptable, helpful, and feasible. Therapists and supervisors in both conditions had mixed impressions of the contextual appropriateness of the group anxiety intervention, and some reported logistical challenges with weekly supervision. Some unique themes were identified among the TT+ condition, including supervisors experiencing professional growth, and therapists and supervisors perceiving supervision as critically important and enjoyable.

Conclusions

These results suggest that TT implementation support, using a model in which an internal supervisor receives initial training and then provides ongoing supervision, is acceptable and feasible to support a group CBT intervention in schools. The results also highlight additional benefits that therapists and supervisors perceived when supervisors received ongoing consultation.

Clinical Trial Registration Information

The clinical trial from which these data were derived was registered at ClinicalTrials.gov (https://clinicaltrials.gov/) prior to the time of first patient enrollment. The registration number is: NCT02651402.

Can relational coordination theory be used to understand and improve interprofessional care coordination in schools? A pilot study

Attending to the health needs of students with chronic conditions requires a fluid exchange of information and coordination between parents, educators, administrators, and school healthcare professionals. Previous research often omits school nurses in this exchange, although their role is key to successful outcomes. Relational Coordination (RC) theory posits that cohesive relationships help support communication, enabling stakeholders to coordinate their work. This article preliminarily explores whether RC domains might be relevant in school health settings, utilizing existing qualitative data. Responses from focus group sessions were analyzed using a deductive and inductive analytic approach. Data were coded using the 7 RC domains as a priori codes. Frequent, timely, and accurate communication emerged as major themes in the communication domain. Shared knowledge was a major theme within the relationship domain. Problem-solving communication, shared goals, and mutual respect were minor themes. The results suggest that improving interprofessional collaboration (IPC) and health outcomes in children with chronic conditions using RC theory-informed interventions will be important to deepen the understanding of how these different domains interact and influence student health outcomes.

Team Strategies and Tools to Enhance Performance and Patient Safety (TeamSTEPPS) to Improve Collaboration in School Mental Health: Protocol for a Mixed Methods Hybrid Effectiveness-Implementation Study

BACKGROUND

Public schools in the United States are the main providers of mental health services to children but are often ill equipped to provide quality mental health care, especially in low-income urban communities. Schools often rely on partnerships with community organizations to provide mental health services to students. However, collaboration and communication challenges often hinder implementation of evidence-based mental health strategies. Interventions informed by team science, such as Team Strategies and Tools to Enhance Performance and Patient Safety (TeamSTEPPS), have the potential to improve treatment implementation and collaboration within schools.

OBJECTIVE

The objective of this study is to improve communication and collaboration strategies among mental health and school staff by adapting an evidence-based team science intervention for school settings. We present a protocol for a hybrid effectiveness-implementation study to adapt TeamSTEPPS using stakeholder feedback, develop a tailored implementation plan, and pilot the adapted content in eight schools.

METHODS

Study participants will be recruited from public and charter schools and agencies overseeing school mental health services in the local metro area. We will characterize current services by conducting a needs assessment including stakeholder interviews, observations, and review of administrative data. Thereafter, we will establish an advisory board to understand challenges and develop possible solutions to guide additional TeamSTEPPS adaptations along with a complementary implementation plan. In aim 3, we will implement the adapted TeamSTEPPS plus tailored implementation strategies in eight schools using a pre-post design. The primary outcome measures include the feasibility and acceptability of the adapted TeamSTEPPS. In addition, self-report measures of interprofessional collaboration and teamwork will be collected from 80 participating mental health and school personnel. School observations will be conducted prior to and at three time points following the intervention along with stakeholder interviews. The analysis plan includes qualitative, quantitative, and mixed methods analysis of feasibility and acceptability, school observations, stakeholder interviews, and administrative data of behavioral health and school outcomes for students receiving mental health services.

RESULTS

Recruitment for the study has begun. Goals for aim 1 are expected to be completed in Spring 2021.

CONCLUSIONS

This study utilizes team science to improve interprofessional collaboration among school and mental health staff and contributes broadly to the team science literature by developing and specifying implementation strategies to promote sustainability. Results from this study will provide knowledge about whether interventions to improve school culture and climate can ready both mental health and school systems for implementation of evidence-based mental health practices.

TRIAL REGISTRATION

ClinicalTrials.gov NCT04440228; https://clinicaltrials.gov/ct2/show/NCT04440228.

INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID)

DERR1-10.2196/26567.

Psychometric properties of the Chinese version of the TeamSTEPPS teamwork perceptions questionnaire to measure teamwork perceptions of Chinese residents: a cross-sectional study

OBJECTIVES

The purpose of this research was to evaluate the psychometric properties of the TeamSTEPPS Teamwork Perception Questionnaire (T-TPQ) among the Chinese residents.

DESIGN

Cross-sectional study.

SETTING

A clinical hospital of the China Medical University in Liaoning Province, China.

PARTICIPANTS

A total of 664 residents were enrolled in this research. The valid response rate was 83.0% (664 of 800 residents).

MAIN OUTCOME MEASURES

Internal consistency and test-retest reliability were used to assess the reliability of the questionnaire. The construct validity of the Chinese T-TPQ was evaluated by confirmatory factor analysis. Furthermore, the concurrent, convergent and discriminant validity were analysed.

RESULTS

Cronbach's α coefficient of the T-TPQ in Chinese language was 0.923. Except for the communication dimension (0.649), the Cronbach's α coefficient of all dimensions were satisfactory. The T-TPQ and its five dimensions reported a good test-retest reliability (0.740-0.881, p<0.01). Moreover, the results of the confirmatory factor analysis demonstrated that the construct validity of the Chinese T-TPQ was satisfactory. All dimensions significantly correlated with the Hospital Survey on Patient Safety Culture (HSOPSC) teamwork within units dimension and the Safety Attitudes Questionnaire (SAQ) teamwork climate dimension (p<0.01), and the questionnaire showed satisfactory convergent and discriminant validity.

CONCLUSIONS

The T-TPQ in Chinese language demonstrated good psychometric characteristics and was a reliable and valid questionnaire to measure the Chinese health professionals' perception of teamwork. Thus, the Chinese version of the T-TPQ could be applied in teamwork training programmes and medical education research.

Partnering with School Providers to Co-Design Mental Health Interventions: An Open Trial of Act & Adapt in Urban Public Middle Schools

Schools are well positioned to provide access to youth mental health services, but implementing effective programs that promote emotional and behavioral functioning in school settings is complicated by the poor fit of interventions developed in research settings to complex school contexts. The current study formed a research-practice partnership with two urban public schools and mental health providers employed by those schools (N = 6, 100% female, 50% Black/African American, 50% White/Caucasian) in the adaptation of a depression prevention intervention, Act & Adapt. The intervention was modified by decreasing meeting time and streamlining session content, increasing flexibility, making intervention materials more similar to academic curriculum, and increasing the focus on managing disruptive behavior within group sessions. In an open trial, 6^th grade students (N = 22; 59% boys, 31% Hispanic, 22% Black/African American, 4% Asian, 30% White/Caucasian) at both schools who were identified as clinically "at risk" reported improvements from baseline to post-intervention and at one-year follow-up on measures of emotional and behavioral difficulties and coping strategies, with parallel results by caregiver report. The providers reported satisfaction with the intervention, and qualitative analyses of provider focus groups suggested both barriers and facilitators to research-practice collaborations to implement mental health interventions in schools.

Implementation of KEIGAAF in Primary Schools: A Mutual Adaptation Physical Activity and Nutrition Intervention

School health promotion is advocated. Implementation studies on school health promotion are less often conducted as effectiveness studies and are mainly conducted conventionally by assessing fidelity of "one size fits all" interventions. However, interventions that allow for local adaptation are more appropriate and require a different evaluation approach. We evaluated a mutual adaptation physical activity and nutrition intervention implemented in eight primary schools located in low socioeconomic neighborhoods in the Netherlands, namely the KEIGAAF intervention. A qualitative, multiple-case study design was used to evaluate implementation and contextual factors affecting implementation. We used several qualitative data collection tools and applied inductive content analysis for coding the transcribed data. Codes were linked to the domains of the Consolidated Framework for Implementation Research. NVivo was used to support data analysis. The implementation process varied greatly across schools. This was due to the high level of bottom-up design of the intervention and differing contextual factors influencing implementation, such as differing starting situations. The mutual adaptation between top-down and bottom-up influences was a key element of the intervention. Feedback loops and the health promotion advisors played a crucial role by navigating between top-down and bottom-up. Implementing a mutual adaptation intervention is time-consuming but feasible.

Adapting TeamSTEPPS for school mental health teams: a pilot study

BACKGROUND

School mental health care often is provided by teams contracted from community mental health agencies. The team members that provide this care, however, do not typically receive training in how to work effectively in a team-based context. Team Strategies and Tools to Enhance Performance and Patient Safety (TeamSTEPPS) provides a promising, evidence-based strategy for improving communication and climate in school-based teams.

METHODS

In collaboration with stakeholders, we adapted and piloted TeamSTEPPS for use with school mental health teams. Teams in six schools were randomized to receive the adapted TeamSTEPPS approach or usual supports. The main outcomes of interest were feasibility and acceptability of the adapted TeamSTEPPS strategy.

RESULTS

Results indicated that team member burnout was significantly higher at follow-up than pretreatment for both control and intervention teams. TeamSTEPPS was feasible and acceptable to implement, and leadership emerged as an important facilitator. Barriers to implementation success included staff turnover, lack of resources, and challenges in the school mental health team relationship. Additional supports to implement TeamSTEPPS were suggested, including ongoing consultation and booster training to address high staff turnover.

CONCLUSIONS

Results suggest that TeamSTEPPS is promising for school mental health teams but additional modifications are likely needed.