Quality improvement, implementation, and dissemination strategies to improve mental health care for children and adolescents: a systematic review

Characteristics of quality improvement interventions to improve physical healthcare in mental health settings: a scoping review protocol

INTRODUCTION

Mental health concerns globally impact millions of people, resulting in significant financial impact and adverse health outcomes. People living with mental health concerns are at higher risk of developing physical health issues, which can lead to a shortened life expectancy. Barriers to physical healthcare, such as limited service capacity, low help seeking and stigma, contribute to health disadvantage. Quality improvement (QI) interventions can address these challenges by addressing staff-level and service-level factors to improve the focus on physical healthcare in mental health settings. The aim of this scoping review is to describe studies of QI interventions to improve physical healthcare in mental health settings.

METHODS AND ANALYSIS

The proposed scoping review will be conducted in accordance with guidance for scoping reviews from the Joanna Briggs Institute Manual and in line with the Preferred Reporting Items for Systematic Reviews and Meta-Analyses extension for Scoping Reviews. A systematic review search for peer-reviewed and published articles will be conducted across eight databases: PubMed, MEDLINE (Ovid), Web of Science, CINAHL (EBSCOhost), ProQuest Central, PsycINFO (Ovid), Scopus and Embase (Elsevier). Two independent reviewers will screen the titles, abstracts and full text using Covidence. Any disagreement will be resolved through discussion or with a third reviewer. Data collection will be facilitated using Microsoft Excel. The details of included studies will be extracted by two authors independently.

ETHICS AND DISSEMINATION

No ethical approval is required for the scoping review. The results of this review will be presented at conferences and published in a peer-reviewed scientific journal. This review will also inform the development of a QI strategy to influence mental health staff practices in the provision of physical healthcare in Australian mental health settings.

Key actors in behavioral health services availability and accessibility research: a scoping review bibliometric analysis

This bibliometric review aims to identify key actors in the behavioral health services availability/accessibility literature. Coalescing information about these actors could support subsequent research efforts to improve the availability and accessibility of behavioral health services. The authors used a scoping review method and a bibliometric approach. The articles came from Medline, Embase, Web of Science, CINAHL, and PsycINFO. Articles were included if they assessed behavioral health service availability or accessibility quantitatively and were written in English. The final sample included 265 articles. Bibliometric data were extracted, coded, and verified. The authors analyzed the data using univariate and social network analyses. Publishing in this area has become more consistent and has grown since 2002. Psychiatric Services and Graduate Theses were the most frequently used publication venues. The National Institute on Drug Abuse, National Institute of Mental Health, and the Veterans Administration funded the most research. The most frequently used keyword was "health services accessibility." The findings suggest that this literature is growing. There are a few clusters of researchers in this area. Government organizations primarily fund this research. The paper and supplementary materials list the top researchers, publication venues, funding sources, and key terms to promote further behavioral health availability/accessibility research.

Developing a Sustainable Quality Improvement Program in an Academic Center: The Experience of an Adolescent Unit

Introduction

Successful quality improvement (QI) efforts use a comprehensive, institutional QI framework and professional development, but literature describing implementing QI frameworks in Adolescent Medicine practices is sparse. We aimed to implement and increase the number of formally structured QI projects (primary aim) and the number of projects achieving a centerline (CL) shift (secondary aim) in our hospital's Adolescent Medicine Clinic.

Methods

We used formal QI methodology to improve health outcomes by increasing the number of faculty with formalized QI education, creating interdisciplinary QI teams, and improving staff motivation. QI education was mandatory for Adolescent Medicine fellows and pediatric residents and encouraged for faculty and staff. The Divisional QI leadership team attended monthly meetings to review key driver diagrams, run and control charts, and receive intervention updates. All providers and staff received monthly updates, and the Hospital Quality and Safety Committee received biannual updates. We used run charts to share progress with primary and secondary aims.

Results

Since Q3 2014, the Adolescent Medicine team consistently achieved the primary aim of having 5 active projects in process, with 9 projects from Q1 2018-Q4 2020. For the secondary aim, a target of 50% of active QI projects attaining a sustained centerline shift was achieved in Q2 2018 and maintained in 16 of 20 quarters since.

Conclusions

Clinicians can use QI methodology to improve health outcomes while facilitating professional development. For this initiative to succeed, institutional leadership must provide an infrastructure prioritizing meaningful QI involvement.

Testing the incremental effectiveness of pay-for-performance to improve implementation of a motivational interviewing brief intervention for substance use disorders in HIV settings: Results of a cluster-randomized type 3 hybrid trial

Background

Substance use disorders (SUDs) have a serious adverse impact on people living with HIV. Previously, using a 39-site dual-randomized type 2 hybrid trial design, findings from the Substance Abuse Treatment to HIV Care Project supported the Implementation and Sustainment Facilitation (ISF) strategy to improve implementation and effectiveness of a motivational interviewing brief intervention (MIBI) for SUD within HIV service settings across the United States (US). Building on this trial, this cluster-randomized type 3 hybrid trial aimed to test the incremental effectiveness of a pay-for-performance (P4P), a form of the "alter incentive/allowance structures" strategy.

Methods

Twenty-six HIV service organizations, their staff participants (N=87), and their client participants (N=341) were cluster-randomized to one of two implementation conditions. The control condition included staff-focused training, feedback, and consultation (TFC) and team-focused implementation and sustainment (ISF). The experimental condition included TFC+ISF as well as P4P (TFC+ISF+P4P). P4P used financial incentives to reward MIBI implementation (US$10 per MIBI delivered) and MIBI implementation at or above a pre-defined level of quality (US$10 per demonstration). In addition to these outcomes, past 4-week changes/reductions in client participant's days of primary substance use and anxiety symptoms were examined.

Results

The addition of P4P had a large and significant effect on the number of MIBIs implemented (d=1.30, p<.05) and reduction in anxiety (d=-1.54), but there was no impact on days of substance use. P4P had large effects on MIBI quality (d=1.24) and MIBI implementation effectiveness (d=1.28), but these were not significant (p<.10).

Conclusions

P4P is a form of the "alter incentive/allowance structures" strategy Its function is to reward the implementation of a clinical innovation. Rewarding implementation is consistent with the theory of implementation effectiveness, which suggests implementation climate (i.e., the extent to which implementation is expected, supported, and rewarded) is a key antecedent of implementation effectiveness (i.e., the consistency and quality of implementation). We found that P4P had a significant, positive impact on MIBI implementation in HIV service settings, but client-level outcomes were mixed. Future research should examine the cost-effectiveness of this strategy, as well as to examine the effectiveness of P4P to improve the implementation of other evidence-based innovations.

Trial registration

ClinicalTrials.gov: NCT04687917. Registered 12/18/2020.

Identifying Methods to Select and Tailor Implementation Strategies to Context-Specific Determinants in Child Mental Health Settings: A Scoping Review

This scoping review describes the state of the literature regarding Implementation Strategy Mapping Methods (ISMMs) within the context of child mental health practice delivery. Goals included (a) identify and describe ISMMs addressing determinants of implementing mental health evidence-based interventions (MH-EBIs) for children and (b) describe the scope of the literature (e.g., outcomes, remaining gaps) related to identified ISMMs. Following PRISMA-ScR guidelines, 197 articles were identified. After removing 54 duplicates, 152 titles and abstracts were screened, yielding 36 articles that were screened during the full-text review. The final sample included four studies and two protocol papers (n = 6). A data charting codebook was developed a priori to capture relevant information (e.g., outcomes) and content analysis was utilized to synthesize findings. Six ISMMs were identified: innovation tournament, concept mapping, modified conjoint analysis, COAST-IS, focus group, and intervention mapping. ISMMs were successful in leading to the identification and selection of implementation strategies at participating organizations, and all ISMMs included stakeholders throughout these processes. Findings revealed the novelty of this research area and highlighted numerous areas for future investigation. Implications related to implementation, service, and client outcomes are discussed, including the possible impact of utilizing ISMMs to increase access to MH-EBIs for children receiving services in community settings. Overall, these findings contribute to our understanding of one of the five priority areas within implementation strategy research-enhancing methods used to design and tailor implementation strategies-by providing an overview of methods that may be utilized to facilitate MH-EBI implementation in child mental health care settings. Trial Registration: Not applicable.

Supplementary Information

The online version contains supplementary material available at 10.1007/s43477-023-00086-3.

Required sample size to detect mediation in 3-level implementation studies

Background

Statistical tests of mediation are important for advancing implementation science; however, little research has examined the sample sizes needed to detect mediation in 3-level designs (e.g., organization, provider, patient) that are common in implementation research. Using a generalizable Monte Carlo simulation method, this paper examines the sample sizes required to detect mediation in 3-level designs under a range of conditions plausible for implementation studies.

Method

Statistical power was estimated for 17,496 3-level mediation designs in which the independent variable (X) resided at the highest cluster level (e.g., organization), the mediator (M) resided at the intermediate nested level (e.g., provider), and the outcome (Y) resided at the lowest nested level (e.g., patient). Designs varied by sample size per level, intraclass correlation coefficients of M and Y, effect sizes of the two paths constituting the indirect (mediation) effect (i.e., X→M and M→Y), and size of the direct effect. Power estimates were generated for all designs using two statistical models—conventional linear multilevel modeling of manifest variables (MVM) and multilevel structural equation modeling (MSEM)—for both 1- and 2-sided hypothesis tests.

Results

For 2-sided tests, statistical power to detect mediation was sufficient (≥0.8) in only 463 designs (2.6%) estimated using MVM and 228 designs (1.3%) estimated using MSEM; the minimum number of highest-level units needed to achieve adequate power was 40; the minimum total sample size was 900 observations. For 1-sided tests, 808 designs (4.6%) estimated using MVM and 369 designs (2.1%) estimated using MSEM had adequate power; the minimum number of highest-level units was 20; the minimum total sample was 600. At least one large effect size for either the X→M or M→Y path was necessary to achieve adequate power across all conditions.

Conclusions

While our analysis has important limitations, results suggest many of the 3-level mediation designs that can realistically be conducted in implementation research lack statistical power to detect mediation of highest-level independent variables unless effect sizes are large and 40 or more highest-level units are enrolled. We suggest strategies to increase statistical power for multilevel mediation designs and innovations to improve the feasibility of mediation tests in implementation research.

Supplementary Information

The online version contains supplementary material available at 10.1186/s13012-022-01235-2.

Implementation strategies for knowledge products in primary healthcare: a systematic review of systematic reviews (Preprint)

Background

The underuse or overuse of knowledge products leads to waste in health care, and primary care is no exception.

Objective

This study aimed to characterize which knowledge products are frequently implemented, the implementation strategies used in primary care, and the implementation outcomes that are measured.

Methods

We performed a systematic review (SR) of SRs using the Cochrane systematic approach to include eligible SRs. The inclusion criteria were any primary care contexts, health care professionals and patients, any Effective Practice and Organization of Care implementation strategies of specified knowledge products, any comparators, and any implementation outcomes based on the Proctor framework. We searched the MEDLINE, EMBASE, CINAHL, Ovid PsycINFO, Web of Science, and Cochrane Library databases from their inception to October 2019 without any restrictions. We searched the references of the included SRs. Pairs of reviewers independently performed selection, data extraction, and methodological quality assessment by using A Measurement Tool to Assess Systematic Reviews 2. Data extraction was informed by the Effective Practice and Organization of Care taxonomy for implementation strategies and the Proctor framework for implementation outcomes. We performed a descriptive analysis and summarized the results by using a narrative synthesis.

Results

Of the 11,101 records identified, 81 (0.73%) SRs were included. Of these 81, a total of 47 (58%) SRs involved health care professionals alone. Moreover, 15 SRs had a high or moderate methodological quality. Most of them addressed 1 type of knowledge product (56/81, 69%), common clinical practice guidelines (26/56, 46%) or management, and behavioral or pharmacological health interventions (24/56, 43%). Mixed strategies were used for implementation (67/81, 83%), predominantly education-based (meetings in 60/81, 74%; materials distribution in 59/81, 73%; and academic detailing in 45/81, 56%), reminder (53/81, 36%), and audit and feedback (40/81, 49%) strategies. Education meetings (P=.13) and academic detailing (P=.11) seemed to be used more when the population was composed of health care professionals alone. Improvements in the adoption of knowledge products were the most commonly measured outcome (72/81, 89%). The evidence level was reported in 12% (10/81) of SRs on 62 outcomes (including 48 improvements in adoption), of which 16 (26%) outcomes were of moderate or high level.

Conclusions

Clinical practice guidelines and management and behavioral or pharmacological health interventions are the most commonly implemented knowledge products and are implemented through the mixed use of educational, reminder, and audit and feedback strategies. There is a need for a strong methodology for the SR of randomized controlled trials to explore their effectiveness and the entire cascade of implementation outcomes.

Bridging the Silos: A Comparative Analysis of Implementation Science and Improvement Science

Background

Implementation science and improvement science have similar goals of improving health care services for better patient and population outcomes, yet historically there has been limited exchange between the two fields. Implementation science was born out of the recognition that research findings and effective practices should be more systematically disseminated and applied in various settings to achieve improved health and welfare of populations. Improvement science has grown out of the wider quality improvement movement, but a fundamental difference between quality improvement and improvement science is that the former generates knowledge for local improvement, whereas the latter is aimed at producing generalizable scientific knowledge.

Objectives

The first objective of this paper is to characterise and contrast implementation science and improvement science. The second objective, building on the first, is to highlight aspects of improvement science that potentially could inform implementation science and vice versa.

Methods

We used a critical literature review approach. Search methods included systematic literature searches in PubMed, CINAHL, and PsycINFO until October 2021; reviewing references in identified articles and books; and the authors' own cross-disciplinary knowledge of key literature.

Findings

The comparative analysis of the fields of implementation science and improvement science centred on six categories: (1) influences; (2) ontology, epistemology and methodology; (3) identified problem; (4) potential solutions; (5) analytical tools; and (6) knowledge production and use. The two fields have different origins and draw mostly on different sources of knowledge, but they have a shared goal of using scientific methods to understand and explain how health care services can be improved for their users. Both describe problems in terms of a gap or chasm between current and optimal care delivery and consider similar strategies to address the problems. Both apply a range of analytical tools to analyse problems and facilitate appropriate solutions.

Conclusions

Implementation science and improvement science have similar endpoints but different starting points and academic perspectives. To bridge the silos between the fields, increased collaboration between implementation and improvement scholars will help to clarify the differences and connections between the science and practice of improvement, to expand scientific application of quality improvement tools, to further address contextual influences on implementation and improvement efforts, and to share and use theory to support strategy development, delivery and evaluation.

Public mental health: required actions to address implementation failure in the context of COVID-19

Mental disorders account for at least 18% of global disease burden, and the associated annual global costs are projected to be US$6 trillion by 2030. Evidence-based, cost-effective public mental health (PMH) interventions exist to prevent mental disorders from arising, prevent associated impacts of mental disorders (including through treatment), and promote mental wellbeing and resilience. However, only a small proportion of people with mental disorders receive minimally adequate treatment. Compared with treatment, there is even less coverage of interventions to prevent the associated impacts of mental disorders, prevent mental disorders from arising, or promote mental wellbeing and resilience. This implementation failure breaches the right to health, has increased during the COVID-19 pandemic, and results in preventable suffering, broad impacts, and associated economic costs. In this Health Policy paper, we outline specific actions to improve the coverage of PMH interventions, including PMH needs assessments, collaborative advocacy and leadership, PMH practice to inform policy and implementation, training and improvement of population literacy, settings-based and integrated approaches, use of digital technology, maximising existing resources, focus on high-return interventions, human rights approaches, legislation, and implementation research. Increased interest in PMH in populations and governments since the onset of the COVID-19 pandemic supports these actions. Improved implementation of PMH interventions can result in broad health, social, and economic impacts, even in the short-term, which support the achievement of a range of policy objectives, sustainable economic development, and recovery.

Expect the Unexpected: A Qualitative Study of the Ripple Effects of Children's Mental Health Services Implementation Efforts

Background

Strategies to implement evidence-based interventions (EBIs) in children's mental health services have complex direct and indirect causal impacts on multiple outcomes. Ripple effects are outcomes caused by EBI implementation efforts that are unplanned, unanticipated, and/or more salient to stakeholders other than researchers and implementers. The purpose of the current paper is to provide a compilation of possible ripple effects associated with EBI implementation strategies in children's mental health services, to be used for implementation planning, research, and quality improvement.

Methods

Participants were identified via expert nomination and snowball sampling. Online surveys were completed by 81 participants, each representing one of five roles: providers of mental health services to children or youth, researchers, policy makers, caregivers, and youth. A partially directed conventional content analysis with consensus decision making was used to code ripple effects.

Results

Four hundred and four unique responses were coded into 66 ripple effects and 14 categories. Categories include general knowledge, skills, attitudes, and confidence about using EBIs; general job-related ripple effects; EBI treatment adherence, fidelity, and alignment; gaming the system; equity and stigma; shifting roles, role clarity, and task shifting; economic costs and benefits; EBI treatment availability, access, participation, attendance, barriers, and facilitators; clinical process and treatment quality; client engagement, therapeutic alliance, and client satisfaction; clinical organization structure, relationships in the organization, process, and functioning; youth client and caregiver outcomes; and use of EBI strategies and insights in one's own life.

Conclusions

This research advances the field by providing children's mental health implementers, researchers, funders, policy makers, and consumers with a menu of potential ripple effects. It can be a practical tool to ensure compliance with guidance from Quality Improvement/Quality Assurance, Complexity Science, and Diffusion of Innovation Theory. Future phases will match potential ripple effects with salient children's mental health implementation strategies for each participant role.

CLUSTER searching approach to inform evidence syntheses: A methodological review

BACKGROUND

The CLUSTER model of searching was proposed as a systematic method of searching for studies for reviews of complex interventions.

AIM

The method has not been evaluated before. This methodological review identified and evaluated a sample of evidence syntheses that have used CLUSTER.

METHODS

A forward citation search on the seed CLUSTER publication was conducted on Web of Science Core Collection using six journal citation indexes and Google Scholar in December 2020. Reviews which used the CLUSTER method were eligible for inclusion. A narrative synthesis was used to describe the types of evidence syntheses that used CLUSTER searching, the extent to which the CLUSTER approach has been operationalised within evidence syntheses and whether the value, benefits and limitations of CLUSTER were assessed by the reviewers.

FINDINGS

A total of 16 reviews were identified and eligible for synthesis. Six different review types that used CLUSTER were identified with realist reviews being the most prominent. The evaluation of complex interventions was the most common review topic area. The use of CLUSTER varied among reviews with the retrieval of sibling studies being the most common reason. 'Citations' and 'Lead authors' were the most followed elements of CLUSTER.

CONCLUSIONS

Evidence suggests that CLUSTER has been adopted for use in reviews of complex interventions. Its usage varied among the included reviews. It is imperative that future reviewers diligently report the elements and steps of CLUSTER that were utilised in order to provide a reproducible and transparent search strategy that can be reported with similar transparency to bibliographic database searches.

A Multidimensional Examination of the Measurement of Treatment Engagement: Implications for Children's Mental Health Services and Research

Objective: The gap between rates of children's mental health problems and their participation in services highlights the need to address concerns related to engagement in mental health services more effectively. To identify, understand, and resolve engagement concerns appropriately requires effective measurement. In this study, we employed a multidimensional conceptual framework of engagement to examine the measurement of engagement in intervention studies focused on improving children's and/or families' engagement in services.Method: We coded 52 randomized controlled trials (RCTs) of interventions designed to enhance treatment engagement published between 1974 and 2019 to examine what engagement constructs have been measured, how these constructs have been measured, who has provided information about engagement, and when and why engagement measures have been administered.Results: Attendance was measured in 94.2% of studies, and 59.6% of studies measured only attendance. Furthermore, most studies (61.5%) measured only one engagement dimension. One hundred twelve unique indicators of treatment engagement were used (61.6% measuring attendance). Infrequent measurement of youth (19.2% of studies) or caregiver (26.9%) perspectives was apparent. About half (54.7%) of measures were completed on one occasion, with 53.7% of measures completed after treatment was concluded.Conclusions: Results highlight how the field's measurement of engagement has focused narrowly on attendance and on interventions that improve attendance. We consider promising new directions for capturing the multidimensional, dynamic, and subjective aspects of engagement, and for leveraging measurement in research and practice settings to feasibly and effectively identify, monitor, and address engagement challenges.

Challenges in Investigating the Effective Components of Feedback from Routine Outcome Monitoring (ROM) in Youth Mental Health Care

BackGround

Studies on feedback in youth mental health care are scarce and implementation of feedback into clinical practice is problematic.

Objective

To investigate potentially effective components of feedback from Routine Outcome Monitoring (ROM) in youth mental health care in the Netherlands through a three-arm, parallel-group, randomized controlled trial in which a literature-based, multi-faceted implementation strategy was used.

Method

Participants were randomly allocated to three conditions (basic feedback about symptoms and quality of life; basic feedback supplemented with clinical support tools; discussion of the feedback of the second condition with a colleague while following a standardized format for case consultation) using a block randomization procedure, stratified by location and participants’ age. The youth sample consisted of 225 participants (mean age = 15.08 years; 61.8% female) and the parent sample of 234 mothers and 54 fathers (mean age of children = 12.50 years; 47.2% female). Primary outcome was symptom severity. Secondary outcomes were quality of life and end-of-treatment variables. Additionally, we evaluated whether being Not On Track (NOT) moderated the association between condition and changes in symptom severity.

Results

No significant differences between conditions and no moderating effect of being NOT were found. This outcome can probably be attributed to limited power and implementation difficulties, such as infrequent ROM, unknown levels of viewing and sharing of feedback, and clinicians’ poor adherence to feedback conditions.

Conclusions

The study contributes to our limited knowledge about feedback from ROM and underscores the complexity of research on and implementation of ROM within youth mental health care.

Trial registration Dutch Trial Register NTR4234 .

Taking Youth Suicide Prevention to the Schools: Pilot Evaluation of School-Based Clinician Outcomes and Perspectives of a Multi-Modal Program Including Post-Training Online Consultations for Management of Ongoing Suicide Risk

School-based youth-specific suicide prevention and early intervention initiatives are presently underdeveloped. The current study conducted a pilot evaluation of a multi-modal suicide prevention training program for school-based social workers, ‘Management of Youth Suicidality Training for Schools’ (MYSTS). The program comprised a two-day workshop and six fortnightly post-workshop webinar online consultations. Participants were 36 social workers (years’ experience M = 11.23, SD = 8.29) employed by the Department of Education in Tasmania, Australia. Outcomes were self-rated confidence, competence, and knowledge of self-harm in young people, and attitudes toward suicide prevention and suicide-related behaviors. Exploratory quantitative results indicated significant improvements with large effect sizes for participants’ self-reported competence (d = 1.33), and confidence (d = 1.29) to identify and respond therapeutically to youth suicidality following the workshop. Confidence remained significantly higher than baseline following the online consultations (d = 0.90). Qualitative analysis of online supervision consultations indicated key themes of accessibility, communication and information sharing, and clinical management. Participants endorsed the MYSTS package as well-presented, with relevant topics, and effective learning activities. This study highlights the need for continued supervisory or implementation support to practitioners following suicide prevention training initiatives and suggests web-based teleconference technology as a feasible strategy for this. Further evaluation of the MYSTS package, including a suitable comparison or control condition, is indicated.

Characterizing psychiatric symptoms and neurocognitive functioning among substance-naïve early adolescents: Associations with sleep problems

AIM

Evidence consistently links psychiatric symptoms, reduced neurocognitive functioning (NCF) and sleep problems to the initiation of a wide range of risk behaviours. Less is known, however, about the associations between sleep problems with psychiatric symptoms and NCF among early adolescents yet to engage in substance use.

METHODS

The present study examined baseline data from an ongoing prospective study of 529 youth aged 10-12 years who completed a battery of instruments measuring symptom counts for four psychiatric disorders, performance on six tests of NCF and five types of sleep behaviour on week days. We used latent class analysis to classify the 473 substance-naïve youth into subtypes characterized by probabilistic patterns of psychiatric symptoms and poorer NCF.

RESULTS

Four subtypes emerged: normative (24% of the sample); nonspecific mental health symptoms (27%); lower neurocognitive function (24%) and comorbid psychiatric symptoms and lower neurocognitive function (25%). In a multivariable latent regression model, three or more sleep arousals per night, sleep phase of two or more hours and sleep latency of 20 minutes or more were significantly associated with the two classes having higher symptom counts. Lack of family support was significantly associated with the two classes having lower neurocognitive function and comorbid psychiatric symptoms.

CONCLUSIONS

The youth subtypes in this study provide an important baseline characterization to subsequently understand how these neuropsychiatric relationships may change when substance use and other risk behaviours develop during adolescence. Implications for preventing and treating sleep problems associated with psychiatric comorbidity and neurocognitive dysfunctions are discussed.

Implementation of family psychosocial risk assessment in pediatric cancer with the Psychosocial Assessment Tool (PAT): study protocol for a cluster-randomized comparative effectiveness trial

Background

Childhood cancer affects and is affected by multiple levels of the social ecology, including social and relational determinants of health (e.g., economic stability, housing, childcare, healthcare access, child and family problems). The 2015 Standards of Psychosocial Care in Pediatric Cancer outline optimal psychosocial care sensitive to these ecological factors, starting with assessment of psychosocial healthcare needs to promote medical and psychosocial outcomes across all children with cancer. To address the first standard of family psychosocial assessment, the Psychosocial Assessment Tool (PAT) is a validated screener ready for broad implementation.

Method

The PAT will be implemented across a national sample of 18 pediatric cancer programs ranging in size (annual new patients) in a mixed methods, comparative effectiveness study, guided by the Interactive Systems Framework for Dissemination and Implementation, comparing two implementation strategies. It is hypothesized that implementation will be more successful at the patient/family, provider, and institutional level when training (strategy I) is combined with implementation expanded resources (strategy II). There are three aims: (1) Refine the two implementation strategies using semi-structured qualitative interviews with 19 stakeholders including parent advocates, providers, pediatric oncology organization representatives, healthcare industry leaders; (2) Compare the two theoretically based and empirically informed strategies to implement the PAT in English and Spanish using a cluster-randomized controlled trial across 18 sites. Stratified by size, sites will be randomized to cohort (3) and strategy (2). Outcomes include adoption and penetration of screening (patient/family), staff job satisfaction/burnout (provider), and cost-effective use of resources consistent with family risk (institution); (3) Based on the results of the trial and feedback from the first and second aim, we will develop and disseminate a web-based PAT Implementation Toolkit.

Discussion

Use of the PAT across children’s cancer programs nationally can achieve the assessment standard and inform equitable delivery of psychosocial care matched to family need for all patients.

Trial Registration

ClinicalTrials.gov, NCT04446728, registered 23 June 2020

Towards Integrated Youth Care: A Systematic Review of Facilitators and Barriers for Professionals

To overcome fragmentation in support for children and their families with multiple and enduring problems across life domains, professionals increasingly try to organize integrated care. However, it is unclear what facilitators and barriers professionals experience when providing this integrated care. Our systematic review, including 55 studies from a broad variety of settings in Youth Care, showed that integrated care on a professional level is a multi-component entity consisting of several facilitators and barriers. Findings were clustered in seven general themes: ‘Child’s environment’, ‘Preconditions’, ‘Care process’, ‘Expertise’, ‘Interprofessional collaboration’, ‘Information exchange’, and ‘Professional identity’. The identified facilitators and barriers were generally consistent across studies, indicating broad applicability across settings and professional disciplines. This review clearly shows that when Youth Care professionals address a broad spectrum of problems, a variety of facilitators and barriers should be considered.

Registration PROSPERO, registration number CRD42018084527.

Partnering with patients in quality improvement: towards renewed practices for healthcare organization managers?

BACKGROUND

Around the world, many healthcare organizations engage patients as a quality improvement strategy. In Canada, the University of Montreal has developed a model which consists in partnering with patient advisors, providers, and managers in quality improvement. This model was introduced through its Partners in Care Programs tested with several quality improvement teams in Quebec, Canada. Partnering with patients in quality improvement brings about new challenges for healthcare managers. This model is recent, and little is known about how managers contribute to implementing and sustaining it using key practices.

METHODS

In-depth multi-level case studies were conducted within two healthcare organizations which have implemented a Partners in Care Program in quality improvement. The longitudinal design of this research enabled us to monitor the implementation of patient partnership initiatives from 2015 to 2017. In total, 38 interviews were carried out with managers at different levels (top-level, mid-level, and front-line) involved in the implementation of Partners in Care Programs. Additionally, seven focus groups were conducted with patients and providers.

RESULTS

Our findings show that managers are engaged in four main types of practices: 1-designing the patient partnership approach so that it makes sense to the entire organization; 2-structuring patient partnership to support its deployment and sustainability; 3-managing patient advisor integration in quality improvement to avoid tokenistic involvement; 4-evaluating patient advisor integration to support continuous improvement. Designing and structuring patient partnership are based on typical management practices used to implement change initiatives in healthcare organizations, whereas managing and evaluating patient advisor integration require new daily practices from managers. Our results reveal that managers at all levels, from top to front-line, are concerned with the implementation of patient partnership in quality improvement.

CONCLUSION

This research adds empirical support to the evidence regarding daily managerial practices used for implementing patient partnership initiatives in quality improvement and contributes to guiding healthcare organizations and managers when integrating such approaches.

Development of Quality Management Capacity in Child-Serving Nonprofit Agencies

Quality or performance management capabilities allow agencies to identify effective practices in routine care, implement new practices, and learn to adapt practices as contexts change. Within child-serving human service systems there is not a dominant model of quality management capabilities and how they are deployed. Quality management capabilities and their development were explored at nine different child serving agencies. Agency respondents described four emergent core quality management capabilities: generating shared goals, managing information, routinizing problem-solving, and propagating a culture of quality. None of the nine agencies we studied excelled at all four. Each capability is described and implications for research, policy and practice are discussed.

Waiting times for diagnosis of attention-deficit hyperactivity disorder in children and adolescents referred to Italian ADHD centers must be reduced

BACKGROUND

To investigate timely access to and the time needed to complete the diagnostic path of children and adolescents with suspected attention deficit hyperactivity disorder (ADHD) in the 18 Italian Lombardy Region ADHD reference centers.

METHODS

Data of children and adolescents enrolled in the Regional ADHD disease-oriented Registry for suspected ADHD who requested their first visit in 2013-2017 were analyzed.

RESULTS

The sample comprised 2262 children and adolescents aged 5-17 years who accessed the ADHD centers for diagnostic classification and management. The median waiting time was of 177 days (range 66-375) from the request for the initial appointment to the completion of the diagnostic path, with a three - fold difference between centers. In addition to the center, the strongest significant predictors of long waiting times were age comorbidities, the severity of the disorder, and having already completed some diagnostic procedures provided by the common standard path.

CONCLUSIONS

To guarantee an equal standard of care in ADHD centers for all children and adolescents there is a pressing need to reduce the times to complete the diagnostic path. It is the task of both policymakers and each center to optimize the quality of the service and of the care delivered.

Publication Bias Among Conference Abstracts Reporting on Pediatric Quality Improvement Projects

This study evaluated progress to publication of pediatric quality improvement (QI) projects initially presented as national conference abstracts, according to project findings and other characteristics. QI abstracts were identified among presentations at the 2010-2015 American Academy of Pediatrics National Conference & Exhibition, and publications were tracked through June 2018. Positive findings (improvement on at least 1 quantitative project outcome), interventions, and analyses were correlated with journal publication. Of 142 abstracts, 128 (90%) reported positive findings. Forty-nine positive abstracts and 3 abstracts reporting negative results resulted in publication (38% vs 21%, respectively; P = .256). Median time to publication was 1.2 years for projects with positive findings, compared to >3 years for abstracts with negative findings ( P = .029). Ninety percent of abstracts reported positive findings, and these abstracts progressed to publication more quickly. Overcoming publication bias for pediatric QI projects may enhance selection of promising interventions as new projects are designed.

Measuring overuse of continuous pulse oximetry in bronchiolitis and developing strategies for large-scale deimplementation: study protocol for a feasibility trial

Background

Deimplementation, the systematic elimination of low-value practices, has emerged as an important focus within implementation science. Bronchiolitis is the leading cause of infant hospitalization. Among stable inpatients with bronchiolitis who do not require supplemental oxygen, continuous pulse oximetry monitoring is recognized as an overused, low-value practice in pediatric hospital medicine. There is strong scientific evidence and practice guideline support for limiting pulse oximetry monitoring of stable children with bronchiolitis who do not require supplemental oxygen, yet the practice remains common. This study aims to (1) characterize the extent of this overuse in hospitals located in the USA and Canada, (2) identify barriers and facilitators of successful deimplementation of continuous pulse oximetry monitoring in bronchiolitis, and (3) develop consensus strategies for large-scale deimplementation. In addition to identifying feasible strategies for deimplementation, this study will test the feasibility of data collection approaches to be employed in a large-scale deimplementation trial.

Methods

This multicenter study will be performed in approximately 38 hospitals in the Pediatric Research in Inpatient Settings Network. In Aim 1, we will determine the rate of overuse within each hospital by performing repeated cross-sectional observational sampling of continuous pulse oximetry monitoring of stable bronchiolitis patients age 8 weeks through 23 months who do not require supplemental oxygen. In Aim 2, we will use the Consolidated Framework for Implementation Research (CFIR) as a framework for semi-structured interviews with key stakeholders (physician, nurse, respiratory therapist, administrator, and parent) at the highest- and lowest-overuse hospitals to understand barriers and facilitators of continuous pulse oximetry monitoring deimplementation. In Aim 3, we will use a theory-based causal model to match the identified barriers and facilitators to potential strategies for deimplementation. Candidate strategies will be discussed with a panel of stakeholders from hospitals with high rates of overuse to assess feasibility and acceptability. A questionnaire ranking strategies based on feasibility, acceptability, and impact will be administered to a broader group of stakeholders to arrive at consensus about promising strategies for large-scale deimplementation to be tested in a subsequent trial.

Discussion

Effective strategies for deimplementing continuous pulse oximetry monitoring of stable patients with bronchiolitis have not been well characterized. The findings of this study will provide further understanding of factors that facilitate deimplementation in pediatric hospital settings and provide pilot and feasibility data to inform a trial of large-scale deimplementation of this overused practice.

Trial registration

Not applicable. This study does not meet the World Health Organization definition of a clinical trial.

Electronic supplementary material

The online version of this article (10.1186/s40814-019-0453-2) contains supplementary material, which is available to authorized users.

Integrated Pediatric Health Care in Pennsylvania: A Survey of Primary Care and Behavioral Health Providers

This study reports on a statewide survey of medical and behavioral health professionals to advance the knowledge base on the benefits and obstacles to delivering integrated pediatric health care. Surveys distributed in 3 statewide provider networks were completed by 110 behavioral health specialists (BHSs) and 111 primary care physicians (PCPs). Survey content documented their perceptions about key services, benefits, barriers, and needed opportunities related to integrated care. Factor analyses identified 8 factors, and other items were examined individually. We compared responses by specialty group (BHS vs PCP) and integrated care experience (no vs yes). The findings revealed differences across domains by specialty subgroup. In several cases, BHS (vs PCP) respondents, especially those with integrated care experience, reported lower benefits, higher barriers, and fewer resource requests. The implications of these results for enhancing care integration development, delivery, training, and research are discussed along with the study's limitations and empirical literature.

Who Wants Feedback? Effects of Transformational Leadership and Leader-Member Exchange on Mental Health Practitioners' Attitudes Toward Feedback

OBJECTIVE

The purpose of this study was to identify the mechanisms through which different aspects of leadership affect mental health practitioners' attitudes toward supervisory feedback.

METHODS

Data were collected from 363 practitioners nested in 68 treatment teams in public-sector mental health organizations. A multilevel path analysis was conducted to examine the associations of transformational leadership (supervisor's ability to inspire others to follow a course of action) and leader-member exchange (quality of the supervisor-practitioner relationship) with practitioner attitudes toward feedback.

RESULTS

Transformational leadership and leader-member exchange were directly and positively associated with practitioners' attitudes toward feedback. Transformational leadership was also indirectly associated with practitioners' attitudes toward feedback through the quality of supervisor-practitioner relationships.

CONCLUSIONS

Study results contribute to the growing body of evidence suggesting that leaders play a key role in shaping mental health service delivery. Both leadership behavior and high-quality supervisor-practitioner relationships are important in supporting practitioners in delivering evidence-based mental health care. Policymakers, administrators, and researchers should consider an integrative approach when developing leadership training interventions.

Screening for Depression in Pediatric Primary Care

PURPOSE OF REVIEW

To review the clinical practice guideline landscape for depression screening in pediatric primary care and to identify current gaps in knowledge.

RECENT FINDINGS

Various organizations have recommendations that support screening for depression in pediatric primary care, although some differ based on the age of the child. To date, guidelines have been made based on indirect evidence of efficacy. For example, indirect evidence shows that several screening tools exist for use in primary care, and various primary care-administered or referred treatments for childhood depression have some evidence of efficacy (particularly among adolescents). In addition to determining the applicability of this evidence to younger children, more research is needed on the direct net benefits of screening and to identify factors that facilitate its effective implementation. Indirect evidence supports the benefits of screening for depression in pediatric primary care; most organizations that publish screening guidelines recommend its use.

Pay-for-performance as a cost-effective implementation strategy: results from a cluster randomized trial

BACKGROUND

Pay-for-performance (P4P) has been recommended as a promising strategy to improve implementation of high-quality care. This study examined the incremental cost-effectiveness of a P4P strategy found to be highly effective in improving the implementation and effectiveness of the Adolescent Community Reinforcement Approach (A-CRA), an evidence-based treatment (EBT) for adolescent substance use disorders (SUDs).

METHODS

Building on a $30 million national initiative to implement A-CRA in SUD treatment settings, urn randomization was used to assign 29 organizations and their 105 therapists and 1173 patients to one of two conditions (implementation-as-usual (IAU) control condition or IAU+P4P experimental condition). It was not possible to blind organizations, therapists, or all research staff to condition assignment. All treatment organizations and their therapists received a multifaceted implementation strategy. In addition to those IAU strategies, therapists in the IAU+P4P condition received US $50 for each month that they demonstrated competence in treatment delivery (A-CRA competence) and US $200 for each patient who received a specified number of treatment procedures and sessions found to be associated with significantly improved patient outcomes (target A-CRA). Incremental cost-effectiveness ratios (ICERs), which represent the difference between the two conditions in average cost per treatment organization divided by the corresponding average difference in effectiveness per organization, and quality-adjusted life years (QALYs) were the primary outcomes.

RESULTS

At trial completion, 15 organizations were randomized to the IAU condition and 14 organizations were randomized to the IAU+P4P condition. Data from all 29 organizations were analyzed. Cluster-level analyses suggested the P4P strategy led to significantly higher average total costs compared to the IAU control condition, yet this average increase of 5% resulted in a 116% increase in the average number of months therapists demonstrated competence in treatment delivery (ICER = $333), a 325% increase in the average number of patients who received the targeted dosage of treatment (ICER = $453), and a 325% increase in the number of days of abstinence per patient in treatment (ICER = $8.134). Further supporting P4P as a cost-effective implementation strategy, the cost per QALY was only $8681 (95% confidence interval $1191-$16,171).

CONCLUSION

This study provides experimental evidence supporting P4P as a cost-effective implementation strategy.

TRIAL REGISTRATION

NCT01016704 .

Influencing quality of outpatient SUD care: Implementation of alerts and incentives in Washington State

Financial incentives for quality improvement and feedback on specific clients are two approaches to improving the quality of treatment for individuals with substance use disorders. We examined the impacts of these interventions in Washington State by randomizing outpatient substance use treatment agencies into intervention and control groups. From October 2013 through December 2015, agencies could earn financial incentives for meeting performance goals incorporating both achievement relative to a benchmark and improvement from agencies' own baselines. Weekly feedback was e-mailed to agencies in the alert or alert plus incentives arms. Difference-in difference regressions controlling for client and agency characteristics showed that none of the interventions significantly affected client engagement after outpatient admissions, overall or for sub-groups based on race/ethnicity, age, rural residence, or agency baseline performance. Treatment agencies offered insights related to several themes: delivery system context (e.g., agency time and resources needed during transition to a managed behavioral healthcare system), implementation (e.g., data lag), agency issues (e.g., staff turnover), and client factors (e.g., motivation). Interventions took place during a time of Medicaid expansion and planning for statewide integration of mental health and substance use disorder treatment into a managed care model, which may have resulted in agencies not responding to the interventions. Moreover, incentives and alerts at the agency-level may not be effective when factors are at play beyond the agency's control.