Improving Pain Care for Service Members: Administrator, Provider, and Patient Perspectives on Treatment, Policies, and Opportunities for Change

Acute and chronic pain are common among service members, with musculoskeletal pain and injuries being the leading cause of nondeployability among active-duty service members. Given the significant implications for individual health and force readiness, providing high-quality pain care to service members is a priority of the Military Health System (MHS). Prior RAND research used administrative data to assess the quality and safety of pain care and opioid prescribing in the MHS, generated a set of quality measures that the MHS could adopt going forward, and identified strengths and opportunities for improvement in care provided to service members with pain conditions. In this study, authors document findings from interviews with MHS administrators, providers, and patients, providing valuable detail and context for those findings, along with on-the-ground perspectives on MHS pain care policies and guidance in practice. Staff and patients recommended prioritizing increases in treatment access and availability to improve pain care, and patients emphasized effective treatment and patient-centered care as the most important facilitators of high-quality pain care.

Virtual Behavioral Health for Army Soldiers: Soldier Perspectives and Patterns of Treatment

Delivery of high-quality behavioral health (BH) care is essential to supporting the readiness of the U.S. armed forces and their families. The coronavirus disease 2019 (COVID-19) pandemic led to a dramatic expansion of virtual behavioral health (VBH) care: remote patient access to BH care using technology such as a computer or cellular phone. The U.S. Army asked RAND Arroyo Center to examine the use of VBH to inform recommendations on the role of VBH care in the future of BH care in the Military Health System. The authors analyzed administrative data on VBH and in-person BH care from prior to the pandemic through March 2022 and surveyed soldiers who received BH care to assess their perceptions of VBH care. Administrative data analyses showed that direct care providers were less likely to deliver VBH care than private-sector providers and relied heavily on audio rather than video VBH. In addition, soldiers who received VBH care typically received a mix of VBH and in-person visits. Survey respondents who used VBH care had similar perceptions of the quality of their care and more-positive views of VBH than respondents who did not use VBH care. Few respondents had declined VBH care in favor of in-person care. Using these findings, the authors make recommendations on the role of VBH care in overall BH delivered by the military.

The need for a measurement-based care professional practice guideline

Professional practice guidelines (PPGs) are intended to promote a high level of professional practice and serve as an educational resource, providing pragmatic guidance in a clinical area for psychologists. Measurement-based care (MBC) is an evidence-based psychological practice with accumulating empirical support and alignment with patient-centered care. In connection with the American Psychological Association's Advisory Committee for Measurement-based Care and the Mental and Behavioral Health Registry, this article outlines various lines of support for the development and implementation of an MBC PPG. In addition to research evidence, we address the demonstrated need of this guideline across three domains: public benefit, professional guidance, and legal and regulatory issues. Consistent with the aspirational spirit of a PPG, this article proposes a draft PPG statement and highlights how an MBC PPG would improve service delivery, facilitate implementation of an evidence-based practice associated with symptom reduction, improved retention, and greater patient satisfaction, as well as create a framework that will better align changes in reimbursement models with patients' and providers' treatment goals. We also identify key future directions and critical gaps in MBC science and implementation that require attention. (PsycInfo Database Record (c) 2023 APA, all rights reserved).

The Impact of Mindfulness Meditation Programs on Performance-Related Outcomes: Implications for the U.S. Army

Although studies have suggested that mindfulness-based interventions might be effective in enhancing military readiness and resilience, this has not been rigorously evaluated. This study presents results from a systematic review and meta-analyses of research examining how mindfulness meditation affects 13 performance-related outcomes of interest to the U.S. Army and broader military. The authors supplemented the systematic review by examining how mindfulness meditation could support stress management and exploring characteristics of selected mindfulness programs. The goal was to develop recommendations for mindfulness meditation programs for soldiers, should the Army choose to implement such programs in the future. Findings suggest that mindfulness may improve some aspects of attention and emotion regulation, impulsivity, and work-related morale and social support. The available evidence does not suggest that mindfulness improves other outcomes of interest to the Army. Notably, mindfulness meditation programs reduce stress and may reduce parental stress, which could benefit Army families. Yet more research is needed to identify best practices for implementing mindfulness programs in the military. The authors recommend conducting high-quality evaluations of mindfulness meditation with soldiers and assessing the effect of mindfulness meditation on military families.

Optimizing the Role of Military Behavioral Health Technicians: A Survey of Behavioral Health Technicians and Mental Health Providers

Behavioral health technicians (BHTs), who are enlisted service members with the technical training to work alongside licensed mental health providers (MHPs), are an important part of the Military Health System (MHS) workforce. However, each service branch has different training requirements for BHTs, making it difficult to identify common qualifications across the BHT workforce and ensure that the MHS is making the best use of their skills. Building on prior RAND research that found inconsistencies in how BHTs were integrated across the force, researchers conducted what might be the largest survey to date of BHTs and MHPs. The results provide insights on BHTs' practice patterns, training and supervisory needs, and job satisfaction, as well as barriers to better integrating BHTs into clinical practice and steps that the MHS could take to optimize BHTs' contributions to the health and readiness of the force. Posing parallel sets of questions to BHTs and MHPs allowed comparisons of these groups' perspectives on these topics. The results revealed differences in views by service branch, time in practice, deployment history, and other characteristics. The researchers drew on these findings and recommendations to identify opportunities to optimize the BHT role.

Assessing the Quality of Outpatient Pain Care and Opioid Prescribing in the Military Health System

Pain conditions are the leading cause of disability among active-duty service members. Given the significant implications for force readiness and service member well-being, the Military Health System (MHS) has made it a strategic priority to provide service members with the highest-quality treatment for pain conditions. RAND researchers assessed MHS outpatient care for acute and chronic pain, including opioid prescribing. The assessment involved developing a set of 14 quality measures designed to assess aspects of outpatient care for pain, including care associated with dental and ambulatory procedures, acute low back pain, chronic pain, opioid prescribing, and medication treatment for opioid use disorder. This research offers the most comprehensive examination to date of the quality and safety of pain care in the MHS and its alignment with evidence-based clinical practice guidelines. It identifies several areas of strength in pain care delivery, along with some areas for improvement, and provides recommendations to support the MHS in continuing to improve pain care for service members.

Readiness of Soldiers and Adult Family Members Who Receive Behavioral Health Care: Identifying Promising Outcome Metrics

Behavioral health (BH) conditions-such as posttraumatic stress disorder, depression, and anxiety-are the second most common medical reasons for nondeployability in the U.S. Army. The authors of this report aimed to identify promising metrics to assess readiness among soldiers and adult family members who receive BH care. These metrics would expand the Army's outcome monitoring, which currently includes symptom improvement metrics, for patients who received BH care. The authors developed rigorous criteria to evaluate candidate readiness metrics, conducted interviews with stakeholders (Army subject-matter experts and BH providers), reviewed existing sources of data that could support the development of a readiness metric, and conducted a literature review to identify instruments that have been used to measure readiness-related domains in both military and civilian populations. The authors found that no existing data source or patient self-report instrument met criteria for implementation of a readiness metric for soldiers, but one instrument, the Walter Reed Functional Impairment Scale (WRFIS), is promising. No existing data source or patient self-report instrument met criteria for Army-wide implementation of a readiness metric for adult family members. Stakeholders reported that psychiatric symptoms, diagnosis, treatment, and impaired functioning are important indicators of lack of readiness among soldiers and adult family members. BH providers reported variability in assessing readiness and applying profiles, but behavioral experts provided suggestions for improving readiness assessment. The authors recommend that the Army conduct a pilot evaluation of a soldier readiness metric based on the WRFIS and increase standardization in applying profiles by continuing provider training.

Military Behavioral Health Staff Perspectives on Telehealth Following the Onset of the COVID-19 Pandemic

The COVID-19 pandemic prompted sweeping changes to behavioral health care delivery in the Military Health System (MHS), which turned to telehealth to minimize disruptions and ensure continuity of care for service members. Four to seven months into the pandemic, MHS behavioral health staff at ten military treatment facilities shared their experiences using telehealth and their perspectives on its utility, barriers to its wider integration in the MHS, and concerns about its use in the post-pandemic future. Telehealth use was previously low across the MHS, but it increased dramatically with the onset of the pandemic. At the time they were interviewed, nearly all providers who treated service members with posttraumatic stress disorder, depression, or substance use disorders were using audio-only telehealth in some capacity. Although most were not using video telehealth, three-quarters expressed an openness to using it in the future. However, the widespread integration of telehealth in the MHS will need to include efforts to overcome technical and administrative barriers and to address provider concerns about telehealth modalities for behavioral health care delivery-for example, the need for clinical guidance on using telehealth with specific types of patients, and provider and patient orientation on using telehealth technology.

Improving Behavioral Health Care for U.S. Army Personnel: Identifying Predictors of Treatment Outcomes

This article identifies factors associated with changes in outcomes for soldiers who received Army behavioral health (BH) specialty care and provides recommendations to improve BH care and outcomes. RAND researchers identified three samples of soldiers who received Army BH care with diagnoses of posttraumatic stress disorder (PTSD), depression, or anxiety and whose symptoms were assessed during their care. Multivariate analyses included 141 patient and treatment variables to identify factors associated with symptom improvement. Analyses also examined patterns in how the symptoms changed over time. Analyses suggest that the Behavioral Health Data Portal, an online system that allows for collection of multiple patient- and clinician-reported measures, is widely used to track symptoms of PTSD, depression, and anxiety, but there are opportunities to expand symptom tracking. Two treatment factors-therapeutic alliance and receipt of benzodiazepines-were associated with treatment outcomes. Specifically, a stronger therapeutic relationship or alliance with providers, as reported by soldiers, was associated with improved PTSD, depression, and anxiety outcomes. Further, receipt of more than a 30-day supply of benzodiazepines was associated with poorer PTSD, depression, and anxiety outcomes. Many soldiers' trajectories of symptom change did not demonstrate improvement. Recommendations include providing feedback and guidance to providers on how to strengthen alliance with their patients, expanding tracking and feedback on benzodiazepine prescribing, and increasing provider use of measurement-based BH care.

Discussing measurement-based care with patients: An analysis of clinician-patient dyads

Abstract Measurement-based care (MBC) refers to the use of three integrated strategies to improve effectiveness of behavioral health care: routine outcomes monitoring using symptom measures; regularly sharing these data with patients; and using these data to inform treatment decisions. This study examined how clinicians discuss MBC data with patients, including identifying what aspects of these discussions contribute to clinician-patient agreement on the value of MBC, and how clinicians use MBC data to inform treatment decisions. Twenty-six clinician-patient dyads participated in semi-structured interviews and provided a treatment session recording in which MBC data were discussed. Qualitative data analyses revealed four subtypes of dyads: clinician and patient both valued MBC; clinician valued MBC, patient passively participated in MBC; clinician valued MBC, patient had mixed perceptions of MBC; clinician and patient reported moderate or low value for MBC. In dyads for whom both the clinician and patient valued MBC, the clinician provided clear and repeated rationale for MBC, discussed data with patients at every administration, and connected observed scores to patient skills or strategies. Emerging best practices for discussing MBC include providing a strong rationale, discussing results frequently, actively engaging patients in discussions, and using graphs to visualize progress.

A qualitative evaluation of Veterans Health Administration's implementation of measurement-based care in behavioral health

Measurement-based care (MBC) in behavioral health involves the repeated collection of patient-reported data that is used to track progress, inform care, and engage patients in shared decision making about their treatment. Research suggests that MBC increases the quality and effectiveness of mental health care. However, there can be challenges to implementing MBC, such as time burden, lack of resources to support MBC, and clinician attitudes. The Veterans Health Administration (VHA) is currently undertaking a multiphase MBC roll-out, the first phase of which included 59 sites across the country. The present study examined implementation of this initiative in an effort to learn more about the process of implementation, including best practices, challenges, and innovations. Semistructured interviews were conducted with 20 MBC site champions and 60 staff members from 25 VHA medical centers across the country. Qualitative data analysis was conducted to identify key themes related to MBC implementation. Results were described for 3 components of MBC implementation: preparing for implementation, administering measures, and using and sharing data. Training and staff buy-in were key to the preparation phase. Staff members reported a variety of methods and frequencies for the collection of MBC data, with many staff members identifying a need to streamline the collection process. Staff members reported using data to track progress and adjust treatment with patients. Efforts to use data on a programmatic level were identified as a next step. Innovative solutions across clinics and sites are described in an effort to inform future MBC implementation, both within and outside of VHA. (PsycInfo Database Record (c) 2020 APA, all rights reserved).

Assessing Brief Intervention for Unhealthy Alcohol Use: A Comparison of Electronic Health Record Documentation and Patient Self-Report

OBJECTIVE

Alcohol screening and brief intervention (BI) are recommended preventive health practices. Veterans Health Administration (VA) uses a performance measure to incentivize BI delivery. Concerns have been raised about the validity of the BI performance measure, which relies on electronic health record (EHR) documentation. Our objective was to assess concordance between EHR-based documentation and patient-reported receipt of BI, and to examine correlates of concordance.

METHOD

Patients with a documented positive screen for unhealthy alcohol use at VA Greater Los Angeles primary care clinics were surveyed (within 15 days on average) in 2013-2014. Documented BI was indicated by an EHR note that the patient was advised to drink within recommended limits or reduce or abstain from drinking. Patient-reported receipt of BI corresponded to an affirmative response to questions on whether a VA provider advised the patient to drink less or abstain. Patient report and documentation were assessed over the same period.

RESULTS

Documented and patient-reported receipt of BI had low concordance. Almost all patients who reported receiving BI had documentation of BI (93%; 95% CI [90%, 95%]), but only 63% [59%, 67%] of patients with documented BI reported receiving it. BI concordance was associated with more severe unhealthy alcohol use and drinking-related consequences, mental health comorbidity, and greater readiness-to-change alcohol use.

CONCLUSIONS

Discrepancies between EHR documentation and patient-reported BI raise concerns about performance measure validity. Patient-reported receipt of BI could be an alternative or complementary measure of BI.

Does Documented Brief Intervention Predict Decreases in Alcohol Use in Primary Care?

BACKGROUND

Brief intervention (BI) is recommended for patients with unhealthy alcohol use, but the effectiveness of BI in usual care settings remains unclear.

OBJECTIVE

We evaluated whether BI predicts decreases in drinking 6 months after a positive screen for unhealthy alcohol use.

METHOD

We enrolled patients who recently screened positive for unhealthy alcohol use during a routine screen in Veterans Health Administration primary care. We conducted medical record review to assess whether providers documented advice to reduce or abstain, feedback about risks to health, feedback about how patient drinking compares to norms or recommended limits, and discussion of drinking-related goals. BI elements were coded from 7 days before the date of the positive screen to 60 days after. We conducted baseline and 6-month follow-up telephone interviews to assess change in past 30-day drinking. We fit regression models examining each BI element and another model for the total count of instances of any combination of elements.

RESULTS

Of the 327 patients included, 86% had at least one documented instance of receiving advice, 86% had risk feedback, 55% had normative feedback, 38% had goal discussion, and 75% had three or more instances of any combination of elements of BI. None of the individual BI elements, nor the total number of instances, were significantly associated with decreased drinking.

CONCLUSIONS

Results suggest that provider documentation of elements of BI and increasing numbers of instances of BI elements were not associated with decreased heavy drinking at 6-month follow-up among patients identified with unhealthy alcohol use.

Quality of Care for PTSD and Depression in the Military Health System: Final Report

The U.S. Department of Defense (DoD) strives to maintain a physically and psychologically healthy, mission-ready force, and the care provided by the Military Health System (MHS) is critical to meeting this goal. Attention has been directed to ensuring the quality and availability of programs and services for posttraumatic stress disorder (PTSD) and depression. This study is a comprehensive assessment of the quality of care delivered by the MHS in 2013-2014 for over 38,000 active-component service members with PTSD or depression. The assessment includes performance on 30 quality measures to evaluate the receipt of recommended assessments and treatments. These measures draw on multiple data sources including administrative encounter data, medical record review data, and patient self-reported outcome monitoring data. The assessment identified strengths and areas for improvement for the MHS. In particular, the MHS excels at screening for suicide risk and substance use, but rates of appropriate follow-up for service members with suicide risk are lower. Most service members received at least some psychotherapy, but less than half of psychotherapy delivered was evidence-based. In analyses focused on Army soldiers, outcome monitoring increased notably over time, yet preliminary analyses suggest that more work is needed to ensure that services are effective in reducing symptoms. When comparing performance between 2012-2013 and 2013-2014, most measures demonstrated slight improvement, but targeted efforts will be needed to support further improvements. RAND provides recommendations for strategies to improve the quality of care delivered for these conditions.

Delivering Clinical Practice Guideline-Concordant Care for PTSD and Major Depression in Military Treatment Facilities

Providing accessible, high-quality care for psychological health (PH) conditions, such as posttraumatic stress disorder (PTSD) and major depressive disorder (MDD), is important to maintaining a healthy, mission-ready force. It is unclear whether the current system of care meets the needs of service members with PTSD or MDD, and little is known about the barriers to delivering guideline-concordant care. RAND used existing provider workforce data, a provider survey, and key informant interviews to (1) provide an overview of the PH workforce at military treatment facilities (MTFs), (2) examine the extent to which care for PTSD and MDD in military treatment facilities is consistent with Department of Veterans Affairs/Department of Defense clinical practice guidelines, and (3) identify facilitators and barriers to providing this care. This study provides a comprehensive assessment of providers' perspectives on their capacity to deliver PH care within MTFs and presents detailed results by provider type and service branch. Findings suggest that most providers report using guideline-concordant psychotherapies, but use varied by provider type. The majority of providers reported receiving at least minimal training and supervision in at least one recommended psychotherapy for PTSD and for MDD. Still, more than one-quarter of providers reported that limits on travel and lack of protected time in their schedule affected their ability to access additional professional training. Finally, most providers reported routinely screening patients for PTSD and MDD with a validated screening instrument, but fewer providers reported using a validated screening instrument to monitor treatment progress.

Association Between Process-Based Quality Indicators and Mortality for Patients With Substance Use Disorders

OBJECTIVE

Substance use disorders (SUDs) are associated with elevated rates of mortality. Little is known about whether receiving appropriate care is associated with lower mortality for patients with SUDs. This study examined the association between the receipt of care for SUDs and subsequent 12- and 24-month mortality.

METHOD

This was a retrospective cohort study of veterans who received care for SUDs paid for by the Veterans Health Administration during October 2006- September 2007 (n = 339,966). Logistic regressions were used to examine the association between quality indicators measuring receipt of care and mortality while controlling for patient characteristics and facility service area.

RESULTS

There were four quality indicators: SUD treatment initiation, SUD treatment engagement, SUD-related psychosocial treatment, and SUD-related psychotherapy. Outcomes measured were mortality 12 and 24 months after the end of the observation period, through September 2009. Receipt of indicated care ranged from 26.5% to 58.6%, and 12- and 24-month mortality rates were 3% and 6%, respectively. Adjusted odds ratios [95% CI] of 12-month mortality by indicator were: initiation, 0.86 [0.79, 0.93]; engagement, 0.65 [0.58, 0.74]; psychosocial treatment, 0.88 [0.84, 0.92]; and psychotherapy, 0.84 [0.79, 0.89]. For the 24-month mortality outcome, adjusted odds ratios were: initiation, 0.88 [0.84, 0.93]; engagement, 0.78 [0.71, 0.85]; psychosocial treatment, 0.91 [0.88, 0.94]; and psychotherapy, 0.87 [0.83, 0.91]. Results were similar when controlling for facility service area.

CONCLUSIONS

Receiving appropriate care is associated with lower mortality for patients with SUDs. Significant overall and within-facility service area associations of quality indicators and mortality support their use in encouraging providers to deliver the indicated care. These indicators should be prioritized above others lacking comparably strong process-outcome associations.

Association Between Quality Measures and Perceptions of Care Among Patients With Substance Use Disorders

OBJECTIVE

This study evaluated whether eight quality measures assessing care for patients with a substance use disorder were associated with patient perceptions of their care, including perceived improvement and global rating of behavioral health care.

METHODS

Secondary data analyses were conducted of administrative and patient survey data collected as part of a national evaluation of Veterans Health Administration (VHA) mental health and substance use services. Data for patients who received care for substance use disorders during October 2006-September 2007 paid for by the VHA and who participated in a telephone interview about their care (N=2,074) were included. Measures of patient perceptions of care included perceived improvement and global rating of behavioral health care. Eight quality measures based on administrative data assessed initiation and engagement in substance use disorder care, receipt of psychotherapy or psychosocial treatment, and follow-up after hospitalization. Regression models were conducted in which each quality measure predicted each outcome, with analyses adjusting for patient characteristics and functioning.

RESULTS

Treatment engagement, two measures of psychotherapy receipt, and psychosocial treatment were significantly associated with perceived improvement, whereas treatment initiation and follow-up after hospitalization (seven and 30 days) were not. Psychotherapy receipt and follow-up after hospitalization (seven and 30 days) were significantly associated with global rating of behavioral health care.

CONCLUSIONS

Some quality measures assessing care for substance use disorders were significantly associated with patient perceptions of care. Results provide additional support for these quality measures and suggest that patient perceptions of care are an important outcome in assessing care.

Association between process measures and mortality in individuals with opioid use disorders

BACKGROUND

Individuals with opioid use disorders have high rates of mortality relative to the general population. The relationship between treatment process and mortality is unknown.

AIM

To examine the association between 7 process measures and 12- and 24-month mortality.

METHODS

Retrospective cohort study of patients with opioid use disorders who received care from the Veterans Administration between October 2006 and September 2007. Logistic regression models were used to examine the association between 12 and 24-month mortality and 7 patient-level process measures, while risk-adjusting for patient characteristics. Process measures included quarterly physician visits, any opioid use disorder pharmacotherapy, continuous pharmacotherapy, psychosocial treatment, Hepatitis B/C and HIV screening, and no prescriptions for benzodiazepines or opioids. We conducted sensitivity analyses to examine the robustness of our findings to an unobserved confounder.

RESULTS

Among individuals with opioid use disorders, not being prescribed opioids or benzodiazepines, receipt of any psychosocial treatment and quarterly physician visits were significantly associated with lower mortality at both 12 and 24 months, but Hepatitis and HIV screening, and measures related to opioid use disorder pharmacotherapy were not. Sensitivity analyses indicated that the difference in the prevalence of an unobserved confounder would have to be unrealistically large given the observed data, or there would need to be a large effect of the confounder, to render these findings non-significant.

CONCLUSIONS AND RELEVANCE

This is the first study to show an association between process measures and mortality in patients with opioid use disorders and provides initial evidence for their use as quality measures.

Quality of care measures for the management of unhealthy alcohol use

There is a paucity of quality measures to assess the care for the range of unhealthy alcohol use, ranging from risky drinking to alcohol use disorders. Using a two-phase expert panel review process, we sought to develop an expanded set of quality of care measures for unhealthy alcohol use, focusing on outpatient care delivered in both primary care and specialty care settings. This process generated 25 candidate measures. Eight measures address screening and assessment, 11 address aspects of treatment, and six address follow-up. These quality measures represent high priority targets for future development, including creating detailed technical specifications and pilot testing them to evaluate their utility in terms of feasibility, reliability, and validity.

"You Should Drink Less": Frequency and Predictors of Discussions Between Providers and Patients About Reducing Alcohol Use

BACKGROUND

Brief intervention is recommended for individuals who misuse alcohol, but studies vary on how frequently patients talk with their providers about alcohol use.

OBJECTIVES

We examined whether veterans who had recently screened positive for alcohol misuse reported having conversations about their alcohol use with their providers.

METHODS

Following a positive screening for alcohol misuse during a primary care visit in 2013, veterans completed a telephone interview on alcohol use, conversations with their providers about drinking, and factors potentially associated with such conversations. The final analysis sample included 881 veterans; we conducted descriptive statistics and multivariable regression analyses.

RESULTS

Most veterans (83%) reported that their provider asked about drinking. Among these, 65% reported being advised to drink less, and 36% reported being advised to abstain. Veterans who received their healthcare from Veterans Health Administration (VA) had over twice the odds of reporting advice to reduce/abstain from drinking (adjusted odds ratio (AOR) = 2.34, 95% confidence interval (CI) = 1.46, 3.75). Veterans who reported heavy episodic drinking were more likely to report advice to reduce/abstain from drinking than those who did not report (AOR = 1.83, 95% CI = 1.30, 2.57) and veterans who reported heavy drinking were more likely to report such advice (AOR = 2.40, 95% CI = 1.69, 3.40). Conclusions/Importance: Most veterans with alcohol misuse reported receiving advice to reduce or abstain from drinking. Veterans with excessive alcohol use and those receiving all or most of their care from VA were more likely to report receiving such advice. Self-report of receiving advice may be an important approach to assessing appropriate follow-up after detection of alcohol misuse.

Understanding Treatment of Mild Traumatic Brain Injury in the Military Health System

Traumatic brain injury (TBI) is considered a signature injury of modern warfare, though TBIs can also result from training accidents, falls, sports, and motor vehicle accidents. Among service members diagnosed with a TBI, the majority of cases are mild TBIs (mTBIs), also known as concussions. Many of these service members receive care through the Military Health System, but the amount, type, and quality of care they receive has been largely unknown. A RAND study, the first to examine the mTBI care of a census of patients in the Military Health System, assessed the number and characteristics (including deployment history and history of TBI) of nondeployed, active-duty service members who received an mTBI diagnosis in 2012, the locations of their diagnoses and next health care visits, the types of care they received in the six months following their mTBI diagnosis, co-occurring conditions, and the duration of their treatment. While the majority of service members with mTBI recover quickly, the study further examined a subset of service members with mTBI who received care for longer than three months following their diagnosis. Diagnosing and treating mTBI can be especially challenging because of variations in symptoms and other factors. The research revealed inconsistencies in the diagnostic coding, as well as areas for improvement in coordinating care across providers and care settings. The results and recommendations provide a foundation to guide future clinical studies to improve the quality of care and subsequent outcomes for service members diagnosed with mTBI.

Comparison of Mail and Telephone in Assessing Patient Experiences in Receiving Care from Medical Group Practices

The medical group survey from the CAHPS® (formerly Consumer Assessment of Health Plans Study) project, G-CAHPS, focuses on patient experiences in receiving care from their medical group practice. We compared mail and telephone responses to the GCAHPS survey in a sample of 880 patients fromfour physician groups. Patients were randomly assigned to mode. Analyses included comparison of response rates, missing data, internal consistency reliability of six multiitem scales, and mean scores. A total of 537 phone completes and 343 mail completes were obtained (54% response rate). There were no significant differences in internal consistency by mode. In addition, there was only one significant mode difference in item and composite means by mode of administration after adjusting for case-mix differences. This study indicates that mail and telephone modes of data collection for the G-CAHPS survey produce similar results.

Quality of Care for PTSD and Depression in the Military Health System: Phase I Report

The U.S. Department of Defense (DoD) strives to maintain a physically and psychologically healthy, mission-ready force, and the care provided by the Military Health System (MHS) is critical to meeting this goal. Given the rates of posttraumatic stress disorder (PTSD) and depression among U.S. service members, attention has been directed to ensuring the quality and availability of programs and services targeting these and other psychological health (PH) conditions. Understanding the current quality of care for PTSD and depression is an important step toward improving care across the MHS. To help determine whether service members with PTSD or depression are receiving evidence-based care and whether there are disparities in care quality by branch of service, geographic region, and service member characteristics (e.g., gender, age, pay grade, race/ethnicity, deployment history), DoD's Defense Centers of Excellence for Psychological Health and Traumatic Brain Injury (DCoE) asked the RAND Corporation to conduct a review of the administrative data of service members diagnosed with PTSD or depression and to recommend areas on which the MHS could focus its efforts to continuously improve the quality of care provided to all service members. This study characterizes care for service members seen by MHS for diagnoses of PTSD and/or depression and finds that while the MHS performs well in ensuring outpatient follow-up following psychiatric hospitalization, providing sufficient psychotherapy and medication management needs to be improved. Further, quality of care for PTSD and depression varied by service branch, TRICARE region, and service member characteristics, suggesting the need to ensure that all service members receive high-quality care.

Association Between Quality Measures and Mortality in Individuals With Co-Occurring Mental Health and Substance Use Disorders

IMPORTANCE

Individuals with co-occurring mental and substance use disorders have increased rates of mortality relative to the general population. The relationship between measures of treatment quality and mortality for these individuals is unknown.

OBJECTIVE

To examine the association between 5 quality measures and 12- and 24-month mortality.

DESIGN, SETTING AND PARTICIPANTS

Retrospective cohort study of patients with co-occurring mental illness (schizophrenia, bipolar disorder, post-traumatic stress disorder and major depression) and substance use disorders who received care for these disorders paid for by the Veterans Administration between October 2006 and September 2007. Logistic regression models were used to examine the association between 12 and 24-month mortality and 5 patient-level quality measures, while risk-adjusting for patient characteristics. Quality measures included receipt of psychosocial treatment, receipt of psychotherapy, treatment initiation and engagement, and a measure of continuity of care. We also examined the relationship between number of diagnosis-related outpatient visits and mortality, and conducted sensitivity analyses to examine the robustness of our findings to an unobserved confounder.

MAIN OUTCOMES MEASURE

Mortality 12 and 24 months after the end of the observation period.

RESULTS

All measures except for treatment engagement at 24 months were significantly associated with lower mortality at both 12 and 24 months. At 12 months, receiving any psychosocial treatment was associated with a 21% decrease in mortality; psychotherapy, a 22% decrease; treatment initiation, a 15% decrease, treatment engagement, a 31% decrease; and quarterly, diagnosis-related visits a 28% decrease. Increasing numbers of visits were associated with decreasing mortality. Sensitivity analyses indicated that the difference in the prevalence of an unobserved confounder would have to be unrealistically large given the observed data, or there would need to be a large effect of an unobserved confounder, to render these findings non-significant.

CONCLUSIONS AND RELEVANCE

This is the first study to show an association between process-based quality measures and mortality in patients with co-occurring mental and substance use disorders, and provides initial support for the predictive validity of the measures. By devising strategies to improve performance on these measures, health care systems may be able to decrease the mortality of this vulnerable population.

Assessing the Quality and Value of Psychological Health Care in Civilian Health Plans: Lessons and Implications for the Military Health System

The Military Health System (MHS) strives to provide high-quality care and improve outcomes for individuals with psychological health conditions. Over the last decade, the MHS has provided care to a growing number of individuals with psychological health conditions, such as post-traumatic stress disorder (PTSD) and major depressive disorder (MDD). However, little is known about the extent to which the MHS delivers care that is consistent with evidence-based clinical practice guidelines or if it is achieving positive outcomes for its service members. To better understand these issues, the Defense Centers of Excellence for Psychological Health and Traumatic Brain Injury (DCoE) asked the RAND Corporation to describe civilian health plansâ; approaches to systematically measuring the quality of psychological health care delivered by providers in their networks. This work was part of a larger effort by RAND to develop a framework and identify a set of measures for monitoring the quality of care provided by the MHS for psychological health conditions.

Measuring the Quality of Care for Psychological Health Conditions in the Military Health System: Candidate Quality Measures for Posttraumatic Stress Disorder and Major Depressive Disorder

In recent years, the number of U.S. service members treated for psychological health conditions has increased substantially. In particular, at least two psychological health conditions-posttraumatic stress disorder (PTSD) and major depressive disorder (MDD)-have become more common, with prevalence estimates up to 20 percent for PTSD and 37 percent for MDD. Delivering quality care to service members with these conditions is a high-priority goal for the military health system (MHS). Meeting this goal requires understanding the extent to which the care the MHS provides is consistent with evidence-based clinical practice guidelines and its own standards for quality. To better understand these issues, RAND Corporation researchers developed a framework to identify and classify a set of measures for monitoring the quality of care provided by the MHS for PTSD and MDD. The goal of this project was to identify, develop, and describe a set of candidate quality measures to assess care for PTSD and MDD. To accomplish this goal, the authors performed two tasks: (1) developed a conceptual framework for assessing the quality of care for psychological health conditions and (2) identified a candidate set of measures for monitoring, assessing, and improving the quality of care for PTSD and MDD. This article describes their research approach and the candidate measure sets for PTSD and MDD that they identified. The current task did not include implementation planning but provides the foundation for future RAND work to pilot a subset of these measures.

Targeting Alcohol Misuse: A Promising Strategy for Reducing Military Sexual Assaults?

On the 2012 Workplace and Gender Relations Survey on Active Duty Service Members, 23 percent of female and 4 percent of male service members indicated that they had experienced a completed or attempted sexual assault during their military service. In addition, official numbers show no decline in sexual assaults, despite the implementation of sexual assault prevention programs across the U.S. Department of Defense (DoD). Alcohol misuse is also a problem in the military: One-third of active-duty service members reported binge drinking, a rate that compares unfavorably with that of their civilian counterparts. DoD has invested considerable resources in universal sexual assault prevention programs and social media campaigns, but evaluation results are not yet available, and the effectiveness of these programs is unclear. Research on civilian populations-particularly college students, who share some characteristics with junior enlisted personnel-could provide insights for DoD. For example, the research indicates a connection between alcohol and aggression, including sexual aggression. Alcohol can also have a range of effects on the risk of victimization-from a reduced awareness of risk indicators to incapacitation or unconsciousness. An extensive review of the existing research provides some guidance for how DoD can implement and evaluate efforts to reduce alcohol misuse as part of a larger strategy to reduce the incidence of sexual assault among members of the armed forces.

The Affordable Care Act: an opportunity for improving care for substance use disorders?

The Patient Protection and Affordable Care Act (ACA) will greatly increase coverage for treatment of substance use disorders. To realize the benefits of this opportunity, it is critical to develop reliable, valid, and feasible measures of quality to ensure that treatment is accessible and of high quality. The authors review the availability of current quality measures for substance use disorder treatment and conclude there is a pressing need for development, validation, and use of quality measures. They provide recommendations for research and policy changes to increase the likelihood that patients, families, and society benefit from the increased coverage provided by the ACA.

Veterans' perceptions of behavioral health care in the veterans health administration: a national survey

OBJECTIVE

This study provided national estimates of perceptions of behavioral health care services among patients of the Veterans Health Administration (VHA) with a diagnosis of bipolar I disorder, major depression, posttraumatic stress disorder, schizophrenia, or substance use disorder.

METHODS

A stratified random sample of 6,190 patients completed telephone interviews from November 2008 through August 2009. Patients (N=5,185) who reported receiving VHA behavioral health care in the prior 12 months were asked about their need for housing and employment services, timeliness and recovery orientation of their care, satisfaction with care, and perceived improvement.

RESULTS

Half of patients reported always receiving routine appointments as soon as requested, and 42% were highly satisfied with their VHA mental health care. Approximately 74% of patients reported being helped by the treatment they received, yet only 32% reported that their symptoms had improved. After controlling for covariates, the analyses showed that patients with a substance use disorder reported lower satisfaction with care and perceived their treatment to be less helpful compared with patients without a substance use disorder.

CONCLUSIONS

Although matched sample comparison data were not available, the results showed that overall patient perceptions of VHA mental health care were favorable, but there was significant room for improvement across all areas of assessment. A majority reported being helped by treatment, but few reported symptom improvement. Variations in perceptions among patients with different disorders suggest the potential importance of psychiatric diagnosis, particularly substance use disorder, in assessing patient perceptions of care.

Perceptions of behavioral health care among veterans with substance use disorders: results from a national evaluation of mental health services in the Veterans Health Administration

Understanding patients' perceptions of care is essential for health care systems. We examined predictors of perceptions of behavioral health care (satisfaction with care, helpfulness of care, and perceived improvement) among veterans with substance use disorders (SUD; n = 1,581) who participated in a phone survey as part of a national evaluation of mental health services in the U.S. Veterans Health Administration. In multivariate analyses, SUD specialty care utilization and higher mental health functioning were associated positively with all perceptions of care, and comorbid schizophrenia, bipolar, and PTSD were associated positively with multiple perceptions of care. Perceived helpfulness of care was associated with receipt of SUD specialty care in the prior 12 months (adjusted OR = 1.77, p<.001). Controlling for patient characteristics, satisfaction with care exhibited strong associations with perceptions of staff as supportive and empathic, whereas perceived improvement was strongly linked to the perception that staff helped patients develop goals beyond symptom management. Survey responses that account for variation in SUD patients' perceptions of care could inform and guide quality improvement efforts with this population.

The cost-effectiveness of depression treatment for co-occurring disorders: a clinical trial

The authors aimed to determine the economic value of providing on-site group cognitive behavioral therapy (CBT) for depression to clients receiving residential substance use disorder (SUD) treatment. Using a quasi-experimental design and an intention-to-treat analysis, the incremental cost-effectiveness and cost-utility ratio of the intervention were estimated relative to usual care residential treatment. The average cost of a treatment episode was $908, compared to $180 for usual care. The incremental cost effectiveness ratio was $131 for each point improvement of the BDI-II and $49 for each additional depression-free day. The incremental cost-utility ratio ranged from $9,249 to $17,834 for each additional quality adjusted life year. Although the intervention costs substantially more than usual care, the cost effectiveness and cost-utility ratios compare favorably to other depression interventions. Health care reform should promote dissemination of group CBT to individuals with depression in residential SUD treatment.

Do client attributes moderate the effectiveness of a group cognitive behavioral therapy for depression in addiction treatment?

The study goal was to determine whether client attributes were associated with outcomes from group cognitive behavioral therapy for depression (GCBT-D) as delivered in community-based addiction treatment settings. Data from 299 depressed residential clients assigned to receive either usual care (N = 159) or usual care plus GCBT-D (N = 140) were examined. Potential moderators included gender, race/ethnicity, education, referral status, and problem substance use. Study outcomes at 6 months post-baseline included changes in depressive symptoms, mental health functioning, negative consequences from substance use, and percentage of days abstinent. Initial examination indicated that non-Hispanic Whites had significantly better outcomes than other racial/ethnic groups on two of the four outcomes. After correcting for multiple testing, none of the examined client attributes moderated the treatment effect. GCBT-D appears effective; however, the magnitude and consistency of treatment effects indicate that it may be less helpful among members of racial/ethnic minority groups and is worthy of future study.

Training Addiction Counselors to Implement an Evidence-Based Intervention: Strategies for Increasing Organizational and Provider Acceptance

One barrier to widespread public access to empirically supported treatments (ESTs) is the limited availability and high cost of professionals trained to deliver them. Our earlier work from two clinical trials demonstrated that front-line addiction counselors could be trained to deliver a manualized, group-based cognitive behavioral therapy (GCBT) for depression, a prototypic example of an EST, with a high level of adherence and competence. This follow-up article provides specific recommendations for the selection and initial training of counselors, and for the structure and process of their ongoing clinical supervision. Unique challenges in working with counselors unaccustomed to traditional clinical supervision are highlighted. The recommendations are based on comprehensive feedback derived from clinician notes taken throughout the clinical trials, a focus group with counselors conducted one year following implementation, and interviews with key organization executives and administrators.

Treating depression and substance use: a randomized controlled trial

Few integrated substance use and depression treatments have been developed for delivery in outpatient substance abuse treatment settings. To meet the call for more "transportable" interventions, we conducted a pilot study to test a group cognitive-behavioral therapy (CBT) for depression and substance use that was designed for delivery by outpatient substance abuse treatment counselors. Seventy-three outpatient clients were randomized to usual care enhanced with group CBT or usual care alone and assessed at three time points (baseline and 3 and 6 months postbaseline). Our results demonstrated that the treatment was acceptable and feasible for delivery by substance abuse treatment staff despite challenges with recruiting clients. Both depressive symptoms and substance use were reduced by the intervention but were not significantly different from the control group. These results suggest that further research is warranted to enhance the effectiveness of treatment for co-occurring disorders in these settings.

Suicidal ideation among patients with bladder pain syndrome/interstitial cystitis

OBJECTIVE

To estimate the prevalence of suicidal ideation (SI) and compare respondents who endorsed SI with respondents who denied SI within a national probability sample of women with bladder pain syndrome or interstitial cystitis (BPS/IC).

METHODS

Data were collected as part of the RAND Interstitial Cystitis Epidemiology (RICE) Study, which screened 146,246 US households to identify adult women who met BPS/IC symptom criteria. In addition to estimating SI prevalence, women with and without recent SI were compared based on demographics, depression symptoms, BPS/IC symptoms, functioning, and treatment.

RESULTS

Of 1019 women with BPS/IC symptoms asked about SI, 11.0% (95% CI = 8.73-13.25) reported SI in the past 2 weeks. Those with SI were more likely to be younger, unemployed, unmarried, uninsured, less educated, and of lower income. Women who endorsed SI reported worse mental health functioning, physical health functioning, and BPS/IC symptoms. Women with SI were more likely to have received mental health treatment, but did not differ on whether they had received BPS/IC treatment. Multivariate logistic regression analyses indicated that severity of BPS/IC symptoms did not independently predict likelihood of endorsing SI.

CONCLUSION

Results suggest that BPS/IC severity may not increase the likelihood of SI except via severity of depression symptoms. Additional work is needed to understand how to address the increased needs of women with both BPS/IC and SI.

The moderating effects of group cognitive-behavioral therapy for depression among substance users

This study examined the prospective longitudinal relationship between changes in depressive symptoms on alcohol and/or drug (i.e., substance) use among addiction participants in treatment, and whether group cognitive-behavioral therapy for depression (GCBT-D) moderated the relationship. Using a quasi-experimental intent-to-treat design, 299 residential addiction treatment clients with depressive symptoms (Beck Depression Inventory-II, BDI-II scores > 17; Beck, Steer, & Brown, 1996) were assigned to either usual care (n = 159) or usual care plus a 16-session GCBT-D intervention (n = 140). Two follow-up interviews were conducted, one 3 months after the baseline interview corresponding to the end of the intervention, and then one 3 months later. Parallel-process growth modeling was used to examine changes in depressive symptoms and the associated changes in abstinence and negative consequences from substance use over time. Treatment group was included as a moderator of the association. Participants in the GCBT-D condition showed a greater increase in abstinence and greater decreases in depressive symptoms and negative consequences over time. There were significant interaction effects, such that the associations between depressive symptoms, negative consequences, and abstinence changes were larger in the usual-care condition than in the GCBT-D condition. The results suggest that the intervention may be effective by attenuating the association between depressive symptoms and substance use outcomes. These findings contribute to the emerging literature on the prospective longitudinal associations between depressive symptoms and substance use changes by being the first to examine them among a sample receiving GCBT-D in an addiction treatment setting.

Training addiction counselors to implement CBT for depression

Many clients in publicly funded substance abuse treatment programs suffer from depression yet lack access to effective mental health treatment. This study sought to examine whether addiction counselors could be effectively trained to deliver group CBT for depression and to ascertain client perceptions of the treatment. Five counselors were trained in the therapy and treated 113 clients with depression symptoms. Counselors demonstrated high fidelity to the therapy and client perceptions of the therapy were positive. Our results suggest that training addiction counselors to deliver group CBT for depression is a promising integrated treatment approach for co-occurring depression and substance disorders.

An effectiveness trial of group cognitive behavioral therapy for patients with persistent depressive symptoms in substance abuse treatment

CONTEXT

Although depression frequently co-occurs with substance abuse, few individuals entering substance abuse treatment have access to effective depression treatment.

OBJECTIVE

The Building Recovery by Improving Goals, Habits, and Thoughts (BRIGHT) study is a community-based effectiveness trial that compared residential substance abuse treatment with residential treatment plus group cognitive behavioral therapy for depression delivered by substance abuse treatment counselors. We hypothesized that intervention clients would have improved depression and substance use outcomes compared with those of clients receiving usual care.

DESIGN

A nonrandomized controlled trial using a quasi-experimental intent-to-treat design in which 4 sites were assigned to alternate between the intervention and usual care conditions every 4 months for 2½ years.

SETTING

Four treatment programs in Los Angeles County.

PARTICIPANTS

We screened 1262 clients for persistent depressive symptoms (Beck Depression Inventory-II score >17). We assigned 299 clients to receive either usual care (n = 159) or usual care plus the intervention (n = 140). Follow-up rates at 3 and 6 months after the baseline interview were 88.1% and 86.2%, respectively, for usual care and 85.7% and 85.0%, respectively, for the intervention group.

INTERVENTION

Sixteen 2-hour group sessions of cognitive behavioral therapy for depression.

MAIN OUTCOME MEASURES

Change in depression symptoms, mental health functioning, and days of alcohol and problem substance use.

RESULTS

Intervention clients reported significantly fewer depressive symptoms (P < .001 at 3 and 6 months) and had improved mental health functioning (P < .001 at 3 months and P < .01 at 6 months). At 6 months, intervention clients reported fewer drinking days (P < .05) and fewer days of problem substance use (P < .05) on days available.

CONCLUSIONS

Providing group cognitive behavioral therapy for depression to clients with persistent depressive symptoms receiving residential substance abuse treatment is associated with improved depression and substance use outcomes. These results provide support for a new model of integrated care.

TRIAL REGISTRATION

clinicaltrials.gov Identifier: NCT01191788.

Development of a clinician report measure to assess psychotherapy for depression in usual care settings

Although mental health policy initiatives have called for quality improvement in depression care, practical tools to describe the quality of psychotherapy for depression are not available. We developed a clinician-report measure of adherence to three types of psychotherapy for depression—cognitive behavioral therapy, interpersonal therapy, and psychodynamic therapy. A total of 727 clinicians from a large, national managed behavioral health care organization responded to a mail survey. The measure demonstrated good psychometric properties, including appropriate item-scale correlations, internal consistency reliability, and a three-factor structure. Our results suggest that this questionnaire may be a promising approach to describing psychotherapy for depression in usual care.

Usual care psychotherapy for depression in a large managed behavioral health organization

Evidence-based psychotherapies to treat depression are available, yet it remains unknown the extent to which these practices are used in routine care for depression. Using survey and administrative data, we sought to describe usual care psychotherapy for depression for adult patients receiving care through a large, managed behavioral health care organization. Data from 420 patients receiving psychotherapy for depression and 159 of their therapists provide evidence that some practitioners are using evidence-based psychotherapy techniques for depression, but also demonstrate the need for improved tools to monitor and improve quality of psychotherapy in usual care.

Developing an integrated treatment for substance use and depression using cognitive-behavioral therapy

Providing a unified treatment approach to meet the substance abuse and mental health needs of clients is the preferred model for addressing co-occurring disorders. We developed a group-based cognitive-behavioral (CBT) integrated treatment for depression and substance use disorders (SUD) that could be delivered by counselors in SUD treatment settings and evaluated its feasibility and acceptability. We conducted an in-depth case study examining one implementation of the treatment using 15 focus groups with clients (n = 7) and semistructured interviews with counselors (n = 2) and administrators (n = 3). Using CBT as a treatment approach to integrate the treatment was widely accepted by clients, counselors, and administrators. Clients stated the treatment was applicable to multiple aspects of their lives and allowed them to recognize their clinical improvements over time. Counselors and administrators discussed challenges for long-term feasibility. Key decisions used to develop the treatment and recommendations for implementing integrated care in SUD settings are discussed.

Development of a patient-report measure of psychotherapy for depression

Despite clear indications of need to improve depression treatment, practical tools that efficiently measure psychotherapy are not available. We developed a patient-report measure of psychotherapy for depression that assesses Cognitive Behavioral (CBT), Interpersonal (IPT), and Psychodynamic therapies. 420 patients with depression from a large managed behavioral health care organization completed the measure. The three subscales measuring CBT, IPT, and Psychodynamic Therapy showed good internal consistency, appropriate item-total correlations, and were supported by a 3-factor structure. Our results suggest that a patient questionnaire is a promising approach for assessing psychotherapy in quality improvement interventions.

A comparison of two depressive symptomatology measures in residential substance abuse treatment clients

Comorbid depression is common among substance abusers, making routine assessment of depression critical for high-quality care. We evaluated two of the most commonly used depressive symptomatology measures in a sample of clients (N = 240) in residential substance abuse treatment settings. The Beck Depression Inventory (BDI-II) has previously been used in clients receiving substance abuse treatment. The Patient Health Questionnaire (PHQ-9), originally developed for primary care settings, has not been used as frequently in substance abuse treatment settings, and it is unknown how it performs in this population. The measures were highly correlated with each other (r = .76) and demonstrated good internal consistency reliability (BDI-II = 0.91, PHQ-9 = 0.87); however, the PHQ-9 classifies more individuals as having "mild" depression symptoms relative to the BDI-II, which tends to suggest these individuals have no depression symptoms. Implications for assessing depression symptoms in individuals receiving substance abuse treatment are discussed.

Evaluating differential item functioning of the PRIME-MD mood module among impoverished black and white women in primary care

BACKGROUND

Appropriate treatment of depression requires accurate screening and diagnosis. It is important to evaluate depression screening instruments for differential item functioning (DIF) across diverse populations. The PRIME-MD is commonly used in primary care settings to screen for the most common psychiatric disorders, including depression. The purpose of this study was to determine whether items in the mood module of the PRIME-MD perform similarly in 2 high-risk populations: impoverished black and white women.

METHODS

Data were collected during screening for a randomized controlled trial of treatment for depression in women receiving county health and welfare services. Analyses are based on a sample of 3,506 black (n = 3,191) and white (n = 315) women who completed the PRIME-MD mood module. Responses were compared using an item response theory approach to DIF assessment. Mean scores, missing data, and internal consistency reliability were also compared.

RESULTS

None of the 9 items exhibited significant DIF. Missing data rates and internal consistency reliability did not differ for the 2 groups. Mean comparisons indicated that white women endorsed higher levels of depression compared with black women on 6 of the 9 items (p < .05).

CONCLUSIONS

These results suggest that all items of the mood module of the PRIME-MD performed similarly for white and black women. Differences in endorsed depressive symptomatology on the mood module may be attributed to actual differences in DSM-IV depression symptoms between white and black women.

The effect of adherence to practice guidelines on depression outcomes

BACKGROUND

Few studies have assessed clinician adherence to depression practice guidelines and the relationship between clinician adherence and depression outcomes.

OBJECTIVE

To estimate how frequently specific guideline recommendations are followed and to assess whether following guideline recommendations is linked to improved depression outcomes.

DESIGN

Observational analysis of data collected from 1996 to 1998 in 3 randomized clinical trials.

SETTING

45 primary care practices in 13 U.S. states.

PATIENTS

1131 primary care patients with depression.

MEASUREMENTS

Expert panel methods were used to develop a patient survey-based index that measured adherence to clinical practice guidelines on depression. Rates of adherence to the 20 indicators that form the index were evaluated. Multivariable regression that controlled for case mix was used to assess how index scores predicted continuous and dichotomous depression measures at 12, 18, and 24 months.

RESULTS

Quality of care was high (clinician adherence > or =79%) for 6 indicators, including primary care clinician detection of depression. Quality of care was low (adherence, 20% to 38%) for 8 indicators, including management of suicide risk (3 indicators), alcohol abuse (2 indicators), and elderly patients; assessment of symptoms and history of depression; and treatment adjustment for patients who did not respond to initial treatment. Greater adherence to practice guidelines significantly predicted fewer depressive symptoms on continuous measures (P < 0.001 for 12 months, P < 0.01 for 18 months, and P < 0.001 for 24 months) and dichotomous measures (P < 0.05 for 18 and 24 months).

LIMITATIONS

Data are based on patient self-report. Possible changes in practice since 1998 may limit the generalizability of the findings.

CONCLUSIONS

Adherence to guidelines was high for one third of the recommendations that were measured but was very low for nearly half of the measures, pointing to specific needs for quality improvement. Guideline-concordant depression care appears to be linked to improved outcomes in primary care patients with depression.