Psychometric assessment of the Primary Care Behavioral Health Provider Adherence Questionnaire (PPAQ)

Primary Care Behavioral Health in Sweden - a protocol of a cluster randomized trial evaluating outcomes related to implementation, organization, and patients (KAIROS)

BACKGROUND

Providing comprehensive and continuous care for patients whose conditions have mental or behavioral components is a central challenge in primary care and an important part of improving universal health coverage. There is a great need for high and routine availability of psychological interventions, but traditional methods for delivering psychotherapy often result in low reach and long wait times. Primary Care Behavioral Health (PCBH) is a method for organizing primary care in which behavioral health staff provide brief, flexible interventions to a large part of the population in active collaboration with other providers. While PCBH holds promise in addressing important challenges, it has not yet been thoroughly evaluated.

METHODS

This cluster randomized trial will assess 17 primary care centers (PCCs) that are starting a PCBH implementation process. The PCCs will be divided into two groups, with one starting immediate implementation and the other acting as a control, implementing six months later. The purpose of the study is to strengthen the evidence base for PCBH regarding implementation-, organization-, and patient-level outcomes, taking into consideration that there is a partially dependent relationship between the three levels. Patient outcomes (such as increased daily functioning and reduction of symptoms) may be dependent on organizational changes (such as availability of treatment, waiting times and interprofessional teamwork), which in turn requires change in implementation outcomes (most notably, model fidelity). In addition to the main analysis, five secondary analyses will compare groups based on different combinations of randomization and time periods, specifically before and after each center achieves sufficient PCBH fidelity.

DISCUSSION

A randomized comparison of PCBH and traditional primary care has, to our knowledge, not been made before. While the naturalistic setting and the intricacies of implementation pose certain challenges, we have designed this study in an effort to evaluate the causal effects of PCBH despite these complex aspects. The results of this project will be helpful in guiding decisions on how to organize the delivery of behavioral interventions and psychological treatment within the context of primary care in Sweden and elsewhere.

TRIAL REGISTRATION

ClinicalTrials.gov: NCT05335382. Retrospectively registered on March 13th, 2022.

An intervention pilot to facilitate harm reduction service decentralization in Vietnam

INTRODUCTION

Harm reduction services, including methadone maintenance therapy (MMT), have been decentralized to Vietnam's community health care settings. This study aims to pilot test an intervention to facilitate decentralized harm reduction service delivery in Vietnam.

METHODS

The research team conducted an intervention pilot between August 2020 and May 2021 with six community MMT distribution sites in Thai Nguyen Province of Vietnam. We recruited five commune health workers (CHW) from each center (N = 30). In-person intervention training included content to correct misconceptions about harm reduction and reduce stigmatizing attitudes toward patients who use drugs and teach CHWs to self-examine and improve their service provision process. The study team developed a web-based platform to streamline CHW's patient monitoring and referral efforts. The team assessed intervention outcomes at baseline, 3-, and 6-months. CHWs in the intervention group provided acceptability ratings and feedback on the intervention at 6-months.

RESULTS

CHWs in both intervention and control groups had similar background characteristics and outcome measures at baseline. CHWs in the intervention group, compared to those in the control group, showed a significantly higher level of improvement in adherence to service delivery protocol at 3-months. CHW in the intervention group had a significantly lower level of management-related stress compared to the control group at 6-months, although the intervention effect measured by the difference in change from baseline was not statistically significant. CHWs who participated in the final focus group reported high acceptability of the intervention.

CONCLUSION

This intervention pilot demonstrated acceptability and promising outcomes on community-based harm reduction service delivery. Similar intervention strategies can be applied to enhance the decentralization of other chronic disease treatment services.

The graying of integrated health: the specialized role of psychology in geriatric primary care

OBJECTIVES

Integrating behavioral health services into primary care is an important global initiative to improve access to mental health services. Within the Veterans Health Administration (VHA), Geriatric Patient Aligned Care Teams (GeriPACTs) are one model of integrated care for frail older adults to serve older Veterans with geriatric syndromes and increased probability of cognitive impairment. Understanding of the role of psychology in GeriPACT is limited. This study examines this role, describes the practice of these psychologists, and evaluates the integration of psychology into geriatric primary care.

METHODS

A mixed-methods design was used. Recruitment occurred through two VHA listservs for GeriPACT and Primary Care Mental Health Integration (PC-MHI) psychologists. Surveys examined referral processes, service access, clinical services provision, and use of psychotherapy modalities. Twenty psychologists participated. Structured follow-up interviews were conducted with five participants.

RESULTS

A large minority of psychologists did not have FTE allotted for GeriPACT work they provided (40%). Sixty percent were assigned to one GeriPACT team. Twenty percent served four to seven GeriPACT teams. Eighty percent provided same-day services. Cognitive assessment was provided weekly by over sixty percent of providers who had FTE allotment to this role. Qualitative data provided a rich description of psychologists' perceptions of their role, team functioning, referral processes, visit structure, and other factors.

CONCLUSION

Findings are discussed in the context of the World Health Organization's guidelines for integrating mental health into primary care. Data suggest a need for an integrated model that adapts to the special needs of older adults in primary care.

The Development and Validation of the Memory Support Treatment Provider Checklist

Patient memory for the contents of treatment is staggeringly poor, and poor memory for treatment is associated with worse treatment outcome. Accordingly, the Memory Support Intervention was developed to improve patient memory for treatment as an adjunct to treatment as usual. As plans to disseminate the Memory Support Intervention are developed, it is important to have efficient, accurate methods of measuring fidelity to the intervention. However, the existing method of assessing fidelity to the Memory Support Intervention, the Memory Support Rating Scale (MSRS), is burdensome and requires trained independent-raters to spend multiple hours reviewing session recordings, which is not feasible in many routine mental health care settings. Hence, a provider-rated measure of fidelity to the MSI has been developed. The goal of this study is to examine the reliability and validity of scores on this measure-the Memory Support Treatment Provider Checklist. A sample of Memory Support Treatment Provider Checklists (N = 319) were completed by providers (N = 8) treating adults with depression (N = 84). Three metrics of the Memory Support Treatment Provider Checklist were evaluated: (a) the internal consistency and structural validity using confirmatory factor analysis based on prior research on the MSRS and the Memory Support Intervention, (b) construct validity, and (c) predictive validity. Results indicate that the Memory Support Treatment Provider Checklist yields reliable and valid scores of fidelity to the Memory Support Intervention. Overall, this checklist offers a viable, brief method of evaluating fidelity to the Memory Support Intervention.

The Validation of a Provider-Reported Fidelity Measure for the Transdiagnostic Sleep and Circadian Intervention in a Community Mental Health Setting

Monitoring treatment fidelity is essential to check if patients receive adequate doses of treatment and to enhance our theoretical understanding of how psychosocial treatments work. Developing valid and efficient measures to assess fidelity is a priority for dissemination and implementation efforts. The present study reports on the psychometric properties of the Provider-Rated TranS-C Checklist-a provider-reported fidelity measure for the Transdiagnostic Sleep and Circadian Intervention (TranS-C). Adults with severe mental illness (SMI; N = 101) seeking treatment in a community mental health setting received eight sessions of TranS-C. Therapists completed the Provider-Rated TranS-C Checklist at the end of each treatment session (N = 808) to indicate which modules they delivered during that session. To assess convergent validity, independent raters scored modules delivered from audio recordings of a subset of sessions (n = 257) for the modules delivered using the Independent-Rater TranS-C Checklist. Using exploratory factor analysis, a unidimensional scale composed of TranS-C's modules was identified. Provider-Rated TranS-C Checklist scores were positively associated with the Independent-Rater TranS-C Checklist scores demonstrating convergent validity. Results indicate that the Provider-Rated TranS-C Checklist yields reliable and valid scores of providers' delivery of TranS-C.

Validation of an Expanded Measure of Integrated Care Provider Fidelity: PPAQ-2

This study aimed to validate the factor structure of the expanded Primary Care Behavioral Health Provider Adherence Questionnaire (PPAQ-2), which is designed to assess provider fidelity to both the Primary Care Behavioral Health (PCBH) and collaborative care management (CCM) models of integrated primary care. Two-hundred fifty-three integrated care providers completed self-reports of professional background, perceptions of clinic integration and related practice barriers, and the PPAQ-2. Confirmatory factor analyses were conducted to assess the theorized factor structure and criterion validity was assessed through correlational analysis. Factor analyses demonstrated adequate fit with the data and acceptable to excellent composite reliabilities across five PCBH domains and five CCM domains. Validity was demonstrated by correlations between adherence scores and measures of clinic integration and barriers to fidelity. The PPAQ-2 is a psychometrically sound measure that can be used in future integrated care dismantling studies to identify provider behaviors that best predict patient outcomes.

The Primary Care Behavioral Health (PCBH) Model: An Overview and Operational Definition

The Primary Care Behavioral Health (PCBH) model is a prominent approach to the integration of behavioral health services into primary care settings. Implementation of the PCBH model has grown over the past two decades, yet research and training efforts have been slowed by inconsistent terminology and lack of a concise, operationalized definition of the model and its key components. This article provides the first concise operationalized definition of the PCBH model, developed from examination of multiple published resources and consultation with nationally recognized PCBH model experts. The definition frames the model as a team-based approach to managing biopsychosocial issues that present in primary care, with the over-arching goal of improving primary care in general. The article provides a description of the key components and strategies used in the model, the rationale for those strategies, a brief comparison of this model to other integration approaches, a focused summary of PCBH model outcomes, and an overview of common challenges to implementing the model.

Training the Doctors: A Scoping Review of Interprofessional Education in Primary Care Behavioral Health (PCBH)

Primary care behavioral health (PCBH) is a model of integrated healthcare service delivery that has been well established in the field of psychology and continues to grow. PCBH has been associated with positive patient satisfaction and health outcomes, reduced healthcare expenditures, and improved population health. However, much of the education and training on PCBH has focused on developing behavioral health providers to practice in this medical setting. Less attention has been paid to physician team members to support and practice within an integrated environment. This is problematic as underdeveloped physician team members may contribute to low utilization and attrition of behavioral health consultants. A scoping review was conducted to examine the training of physicians in this domain since 2006. Twenty-one studies were identified, predominantly in Family Medicine training programs. Although PCBH training was generally well received, more program evaluation, formalized curriculum, and faculty development are needed to establish best practices.

Service providers' adherence to methadone maintenance treatment protocol in China

BACKGROUND

Methadone maintenance treatment (MMT) programs have expanded rapidly in China during the last decade. However, variance in service providers' practice may have an impact on the quality of care received by the patients. This study examined Chinese service providers' adherence to the MMT protocol and its associated factors.

METHODS

The study used baseline data from a randomized intervention trial implemented in MMT clinics in five provinces of China. The data were collected from January 2012 to August 2013. A total of 418 service providers from 68 MMT clinics participated in the study. Demographic and job-related characteristics were collected. The providers' adherence to the MMT protocol, MMT knowledge, negative attitudes towards people who use drugs (PWUD), and perceived institutional support were assessed.

RESULTS

The average adherence score was 36.7 ± 4.3 (out of 9-45). Fewer providers adhered to the protocol items where communications with patients or families were required. After controlling for potential confounders, adherence to the MMT protocol was positively associated with perceived institutional support (standardized β = 0.130; p = 0.0052), and negatively associated with prejudicial attitudes towards PWUD (standardized β = -0.357; p < 0.0001). Reception of national-level MMT training was not associated with higher level of adherence to protocol.

CONCLUSION

The findings suggest the potential benefits of providing institutional support to MMT providers to enhance their level of adherence to the MMT protocol. Intervention effort is needed to reduce negative attitudes towards PWUD among MMT service providers to achieve greater consistency with best-practice recommendations.

Measuring Perceived Level of Integration During the Process of Primary Care Behavioral Health Implementation

Provider- and staff-perceived levels of integration were measured during implementation of a primary care behavioral health clinic; these data were used to tailor and evaluate quality improvement strategies. Providers and staff at an urban, academic, adult primary care clinic completed the 32-item Level of Integration Measure (LIM) at baseline and 7 months. The LIM assesses 6 domains of integrated care. Overall and domain scores were calibrated from 0 to 100, with ≥80 representing a highly integrated clinic. Response rate was 79% (N = 46/58) at baseline and 83% (N = 52/63) at follow-up. Overall, LIM score increased from 64.5 to 70.1, P = .001. The lowest scoring domains at baseline were targeted for quality improvement and increased significantly: integrated clinical practice, 60.0 versus 68.4, P < .001; systems integration, 57.0 versus 63.8, P = .001; and training, 56.7 versus 65.3, P = .001. Ongoing quality improvement, including organizational and financial strategies, is needed to achieve higher levels of integration.

Development and validation of the ASPIRE-VA coaching fidelity checklist (ACFC): a tool to help ensure delivery of high-quality weight management interventions

Practical and valid instruments are needed to assess fidelity of coaching for weight loss. The purpose of this study was to develop and validate the ASPIRE Coaching Fidelity Checklist (ACFC). Classical test theory guided ACFC development. Principal component analyses were used to determine item groupings. Psychometric properties, internal consistency, and inter-rater reliability were evaluated for each subscale. Criterion validity was tested by predicting weight loss as a function of coaching fidelity. The final 19-item ACFC consists of two domains (session process and session structure) and five subscales (sets goals and monitor progress, assess and personalize self-regulatory content, manages the session, creates a supportive and empathetic climate, and stays on track). Four of five subscales showed high internal consistency (Cronbach alphas > 0.70) for group-based coaching; only two of five subscales had high internal reliability for phone-based coaching. All five sub-scales were positively and significantly associated with weight loss for group- but not for phone-based coaching. The ACFC is a reliable and valid instrument that can be used to assess fidelity and guide skill-building for weight management interventionists.

Using the Primary Care Behavioral Health Provider Adherence Questionnaire (PPAQ) to identify practice patterns

Primary care-mental health integration (PC-MHI) is growing in popularity. To determine program success, it is essential to know if PC-MHI services are being delivered as intended. The investigation examines responses to the Primary Care Behavioral Health Provider Adherence Questionnaire (PPAQ) to explore PC-MHI provider practice patterns. Latent class analysis was used to identify clusters of PC-MHI providers based on their self-report of adherence on the PPAQ. Analysis revealed five provider clusters with varying levels of adherence to PC-MHI model components. Across clusters, adherence was typically lowest in relation to collaboration with other primary care staff. Clusters also differed significantly in regard to provider educational background and psychotherapy approach, level of clinic integration, and previous PC-MHI training. The PPAQ can be used to identify PC-MHI provider practice patterns that have relevance for future clinical effectiveness studies, development of provider training, and quality improvement initiatives.