Differences in Patient Health Questionnaire and Aachen Depression Item Bank scores between tablet versus paper-and-pencil administration

Mental health and substance use screening in HIV primary care before and during the early COVID-19 pandemic

BACKGROUND

Mental health and substance use disorders disproportionately affect people with HIV (PWH), and may have been exacerbated during COVID-19. The Promoting Access to Care Engagement (PACE) trial was designed to assess the effectiveness of electronic screening for mental health and substance use in HIV primary care and enrolled PWH from October 2018 to July 2020. Our objective here was to compare screening rates and results for PWH before (October 2018 - February 2020) and early in the COVID-19 pandemic (March-July 2020).

METHODS

Adult (≥ 18 years) PWH from 3 large HIV primary care clinics in a US-based integrated healthcare system were offered electronic screening online or via in-clinic tablet computer every 6 months. Screening completion and results (for depression, suicidal ideation, anxiety, and substance use) were analyzed using logistic regression with generalized estimating equations to estimate prevalence ratios (PR) before and after the start of the regional COVID-19 shelter-in-place orders on March 17, 2020. Models adjusted for demographics (age, sex, race/ethnicity), HIV risk factors (men who have sex with men, injection drug use, heterosexual, other), medical center, and modality of screening completion (online or tablet). We conducted qualitative interviews with providers participating in the intervention to evaluate how the pandemic impacted patient care.

RESULTS

Of 8,954 eligible visits, 3,904 completed screenings (420 during COVID, 3,484 pre-COVID), with lower overall completion rates during COVID (38% vs. 44%). Patients completing screening during COVID were more likely to be White (63% vs. 55%), male (94% vs. 90%), and MSM (80% vs., 75%). Adjusted PRs comparing COVID and pre-COVID (reference) were 0.70 (95% CI), 0.92 (95% CI), and 0.54 (95% CI) for tobacco use, any substance use, and suicidal ideation, respectively. No significant differences were found by era for depression, anxiety, alcohol, or cannabis use. These results were in contrast to provider-reported impressions of increases in substance use and mental health symptoms.

CONCLUSION

Findings suggest PWH had modest declines in screening rates early in the COVID-19 pandemic which may have been affected by the shift to telemedicine. There was no evidence that mental health problems and substance use increased for PWH in primary care.

TRIAL REGISTRATION

NCT03217058 (First registration date: 7/13/2017); https://clinicaltrials.gov/ct2/show/NCT03217058.

Psychometric Properties of a Chatbot Version of the PHQ-9 With Adults and Older Adults

Background: The Patient Health Questionnaire-9 (PHQ-9) is a brief depression measure that has been validated. A chatbot version of the PHQ-9 would allow the assessment of depressive symptoms remotely, at a large scale and low cost.

Objective: The current study aims to: Assess the feasibility of administering the PHQ-9 in a sample of adults and older adults via chatbot, report the psychometric properties of and identify the relationship between demographic variables and PHQ-9 total scores.

Methods: A sample of 3,902 adults and older adults in the US and Canada were recruited through Facebook from August 2019 to February 2020 to complete the PHQ-9 using a chatbot.

Results: A total of 3,895 (99.82%) completed the PHQ-9 successfully. The internal consistency of the PHQ-9 was 0.896 (p < 0.05). A one factor structure was found to have good model fit [X² (27, N = 1,948) = 365.396, p < 0.001; RMSEA = 0.080 (90% CI: 0.073, 0.088); CFI and TLI were 0.925 and 0.900, respectively, and SRMR was 0.039]. All of the demographic characteristics in this study were found to significantly predict PHQ-9 total score, however; their effect was negligible to weak.

Conclusions: There was a large sample of adults and older adults were open to completing assessments via chatbot including those over 75. The psychometric properties of the chatbot version of the PHQ-9 provide initial support to the utilization of this assessment method.

[Fears in Dealing with Suicidal Patients: A Comparative Examination of Licensed Psychotherapists and Psychotherapeutic Trainees]

OBJECTIVE

A patient's suicide is the most frequently mentioned occupational fear of psychotherapists. In the present study, fears in dealing with suicidal patients shall be specified - regarding licensed psychotherapists (LP) as well as psychotherapeutic trainees (PT). The results were compared to an analogous examination from 1996.

METHODS

N=271 psychologists, thereof n=90 licensed psychotherapists and n=181 psychotherapeutic trainees, participated in an online survey. Fears in dealing with suicidal patients and occupational experiences with suicidal patients were investigated using a German Questionnaire of Capturing Therapists' Fears with Suicidal Patients by Dorrmann (2016). Furthermore, suicide-linked knowledge was examined with a short self-designed test. The following hypotheses were investigated: (1) LP have less fears in dealing with suicidal patients than PT, (2) PT and LP differ from each other regarding their suicide-linked knowledge and occupational experience, (3) the results of the current survey show less fears in dealing with suicidal patients than the results of a preceding survey by Dorrmann (1996). Eventually, the following exploratory issue was considered: Does the status (LP vs. PT) have impact on the fears while being mediated by the occupational experience as well as the suicide-linked knowledge?

RESULTS

The following fears are most commonly mentioned by therapists: fear of feelings of guilt/self-blame after a suicide/attempted suicide, fear of misjudgment and the associated consequences, fear of legal consequences after a suicide/attempted suicide and fear of accusations by others (relatives of the patient/colleagues) after a suicide/attempted suicide. Psychotherapeutic trainees report higher fears dealing with suicidal patients than approbated psychotherapists. Professional experience mediates the correlation between professional status and fears. In comparison, therapists today report less fears than 20 years ago.

CONCLUSION

Therapists are mainly afraid of the consequences of a suicide/attempted suicide. However, in total, fears are represented in a more moderate form and seem to be less distinctive than 20 years ago. It can be assumed that an increasing professionalization of the therapeutic interaction with suicidal patients has led to a reduction of therapists' fears.

Is There Equivalence Between the Electronic and Paper Version of the Questionnaires for Assessment of Patients With Chronic Low Back Pain?

STUDY DESIGN

Cross-sectional study.

OBJECTIVE

To investigate the equivalence of electronic and paper version of self-report questionnaires for the assessment of disability, pain, fear of movement, depression, and physical activity of patients with chronic low back pain (LBP).

SUMMARY OF BACKGROUND DATA

Paper and electronic versions of self-report questionnaires are commonly used for assessment of patients with LBP. However, the equivalence of self-report questionnaires commonly used for assessment of patients with chronic LBP remains unclear.

METHODS

Seventy-nine individuals with chronic LBP seeking physiotherapy care were recruited. Participants attended the clinic twice with an interval of 1 week and completed the self-reported questionnaires in a random order. The following questionnaires were administered: Roland Morris Disability Questionnaire (RMDQ); 11-point numerical rating scale (NRS); Tampa Scale for Kinesiophobia (TSK); Center for Epidemiological Studies-Depression (CES-D), and Baecke Habitual Physical Activity Questionnaire (BPAQ). To investigate the equivalence between the two questionnaire versions, intraclass correlation coefficient with 95% confidence interval and Bland-Altman plotting was used.

RESULTS

The paper and electronic versions of the RMDQ, TSK, and CES-D showed good reliability and the showed moderate reliability. In contrast, the NRS showed poor reliability between the electronic and paper versions.

CONCLUSION

Our findings support that the electronic version of the RMDQ, TSK, CES-D, and BPAQ can be administered in clinical and research settings for assessment of patients with chronic LBP. Nevertheless, electronic version of the NRS for assessment of pain intensity should not be used interchangeably in clinical practice in patients with chronic LBP.

LEVEL OF EVIDENCE

3.

Patient Health Questionnaire-9 scores do not accurately estimate depression prevalence: individual participant data meta-analysis

OBJECTIVES

Depression symptom questionnaires are not for diagnostic classification. Patient Health Questionnaire-9 (PHQ-9) scores ≥10 are nonetheless often used to estimate depression prevalence. We compared PHQ-9 ≥10 prevalence to Structured Clinical Interview for Diagnostic and Statistical Manual of Mental Disorders (SCID) major depression prevalence and assessed whether an alternative PHQ-9 cutoff could more accurately estimate prevalence.

STUDY DESIGN AND SETTING

Individual participant data meta-analysis of datasets comparing PHQ-9 scores to SCID major depression status.

RESULTS

A total of 9,242 participants (1,389 SCID major depression cases) from 44 primary studies were included. Pooled PHQ-9 ≥10 prevalence was 24.6% (95% confidence interval [CI]: 20.8%, 28.9%); pooled SCID major depression prevalence was 12.1% (95% CI: 9.6%, 15.2%); and pooled difference was 11.9% (95% CI: 9.3%, 14.6%). The mean study-level PHQ-9 ≥10 to SCID-based prevalence ratio was 2.5 times. PHQ-9 ≥14 and the PHQ-9 diagnostic algorithm provided prevalence closest to SCID major depression prevalence, but study-level prevalence differed from SCID-based prevalence by an average absolute difference of 4.8% for PHQ-9 ≥14 (95% prediction interval: -13.6%, 14.5%) and 5.6% for the PHQ-9 diagnostic algorithm (95% prediction interval: -16.4%, 15.0%).

CONCLUSION

PHQ-9 ≥10 substantially overestimates depression prevalence. There is too much heterogeneity to correct statistically in individual studies.

Tailored Screening for Late-Life Depression: A Short Version of the Teate Depression Inventory (TDI-E)

A number of assessment instruments have been developed as efficacy measures of geriatric depression in clinical trials but most showed several weaknesses, such as time-consuming administration, development and validation in younger populations, and lack of discrimination between anxiety and depression. Among the extant self-report measures of depression, the 21-item Teate Depression Inventory (TDI; Balsamo and Saggino, 2013), developed via Rasch analysis, showed a satisfactory level of diagnostic accuracy, and allowed the reduction of false positives in test scoring in adult population. The present study explored the potential improvement in the psychometric performance of the TDI in the elderly by item refinement through Rasch analysis in a sample of 836 elderly people (49.5% males; mean age = 73.28; SD = 6.56). A resulting shorter version was composed of the best-fitting and discriminative nine items from the full form. The Teate Depression Inventory (TDI-E) (E for elderly) presented good internal construct validity, with unidimensional structure, local dependency, good reliability (person separation index and Cronbach's alpha), and no signs of differential item functioning or measurement bias due to gender and age (65 vs. 75+ years). Cut-off points and normative data provided could enhance the clinical usefulness of the TDI-E, which seems to be a promising valid and reliable tool for the screening of geriatric depression, with less risk of finding false positives due to overlapping of depression in elderly with other comorbid conditions.

Implementing electronic substance use disorder and depression and anxiety screening and behavioral interventions in primary care clinics serving people with HIV: Protocol for the Promoting Access to Care Engagement (PACE) trial

BACKGROUND

Substance use disorders (SUDs) and psychiatric disorders are common among people with HIV (PWH) and lead to poor outcomes. Yet these conditions often go unrecognized and untreated in primary care.

METHODS

The Promoting Access to Care Engagement (PACE) trial currently in process examines the impact of self-administered electronic screening for SUD risk, depression and anxiety in three large Kaiser Permanente Northern California primary care clinics serving over 5000 PWH. Screening uses validated measures (Tobacco, Alcohol, Prescription medication, and other Substance use [TAPS]; and the Adult Outcomes Questionnaire [AOQ], which includes the Patient Health Questionnaire [PHQ-9] and Generalized Anxiety Disorder [GAD-2]) delivered via three modalities (secure messaging, tablets in waiting rooms, and desktop computers in exam rooms). Results are integrated automatically into the electronic health record. Based on screening results and physician referrals, behavioral health specialists embedded in primary care initiate motivational interviewing- and cognitive behavioral therapy-based brief treatment and link patients to addiction and psychiatry clinics as needed. Analyses examine implementation (screening and treatment rates) and effectiveness (SUD, depression and anxiety symptoms; HIV viral control) outcomes using a stepped-wedge design, with a 12-month intervention phase implemented sequentially in the clinics, and a 24-month usual care period prior to implementation in each clinic functioning as sequential observational phases for comparison. We also evaluate screening and treatment costs and implementation barriers and facilitators.

DISCUSSION

The study examines innovative, technology-facilitated strategies for improving assessment and treatment in primary care. Results may help to inform substance use, mental health, and HIV services.

TRIAL REGISTRATION

NCT03217058.

Computer-Guided Problem-Solving Treatment for Depression, PTSD, and Insomnia Symptoms in Student Veterans: A Pilot Randomized Controlled Trial

Depression is a highly prevalent psychological disorder experienced disproportionately by college student military veterans with many deleterious effects including risk for suicide. Treatment can help, but the debilitating nature of depression often makes seeking in-person treatment difficult and many are deterred by stigma, inconvenience, concerns about privacy, or a preference to manage problems themselves. The current study examines the efficacy of a computer-guided Problem-Solving Treatment (ePST^®) for reducing symptoms of depression, posttraumatic stress disorder (PTSD), and insomnia in student military veterans. Twenty-four student veterans (Mean_age = 32.7) with symptoms of depression were randomly assigned either to a treatment group receiving six weekly sessions of ePST or to a minimal contact control group (MCC). Participants completed the Patient Health Questionnaire-9 (PHQ-9) depression scale at baseline and then weekly through post-ePST or post-MCC. PTSD and insomnia questionnaires were also completed at baseline and posttreatment. A linear mixed model regression showed a statistically significant Group (ePST vs. MCC) × Time (pretreatment through posttreatment) interaction for depression, with the ePST showing substantial improvements in depressive symptoms over the 6-week period. Significant improvements were also seen in PTSD and insomnia symptoms. Results suggest that ePST can effectively treat depression, PTSD, and insomnia symptoms in student military veterans and may be a viable alternative for those who are not able to access live therapy. Future work should examine the durability of treatment effects and utility for more severe depression and suicide prevention.

Can the e-OAKHQOL be an alternative to measure health-related quality of life in knee osteoarthritis?

OBJECTIVE

To assess the validity of the e-OAKHQOL questionnaire and analyze whether the answers were affected by the form of administration (electronic vs. paper).

METHODS

Two samples of patients with knee osteoarthritis were constituted. The first was recruited by general practitioners. Patients could choose to respond to the electronic or paper version. The second included subjects who responded to the paper version and were matched with respondents to the electronic version in the first sample. The OAKHQOL questionnaire measures health-related quality of life in five dimensions (43 items): physical activity, mental health, pain, social functioning, and social support. Validity was assessed by the classical test theory (CTT) and a Rasch measurement model (partial credit model).

RESULTS

The electronic form was preferred by 471 (89.7%) patients: 345 were matched to respondents of the paper version. The percentage of missing responses was lower with the electronic than paper form (1.6 vs. 2.0%, p = .01). Rasch analysis revealed four items with underfitting. Internal consistency was excellent for physical activity (PSI = 0.96) and mental health (PSI = 0.93) but was slightly < 0.85 for the other dimensions. The top-down purification highlighted the significance of DIF by gender in the pain dimension and by form of questionnaire in the mental health dimension.

CONCLUSION

CTT and Rasch analysis demonstrated acceptable measurement properties for the five dimensions of the e-OAKHQOL, so it may be a valuable alternative to the paper form for measuring HRQoL.

Agreement between electronic and paper Epworth Sleepiness Scale responses in obstructive sleep apnoea: secondary analysis of a randomised controlled trial undertaken in a specialised tertiary care clinic

OBJECTIVES

Originally developed as a paper questionnaire, the electronic Epworth Sleepiness Scale (ESS) is widely used in sleep clinics and sleep population research. Despite potential differences between computer-based and conventional questionnaire delivery, studies have not evaluated the agreement between electronic and paper versions of the ESS. Given the widespread use of the ESS, a bias between results would present considerable data concerns. Thus, the aim of this study was to examine agreement between electronic and paper ESS responses in obstructive sleep apnoea (OSA).

DESIGN

We undertook a secondary analysis of baseline data from a randomised controlled trial (ANZCTR: ACTRN12611000847910).

SETTING

Data were collected in a tertiary sleep research laboratory located in Sydney, Australia.

PARTICIPANTS

Data were analysed from 112 adult patients with OSA.

MEASUREMENTS

Patients were given the English version of the ESS as part of a battery of sleep laboratory questionnaires. They completed electronic and subsequently paper ESS questionnaires on the same day.

RESULTS

We found no significant difference between electronic and paper ESS questionnaires (mean=0.1, SD=2.1, 95% CI -0.3 to 0.5, P=0.57) or heteroscedasticity. There was no evidence of bias along the range of the measure. 95% limits of agreement at 4.3 and -4.1 were comparable with previous data.

CONCLUSIONS

We found no evidence of bias between electronic and paper ESS questionnaires in this sample of patients with OSA, as the two formats displayed sufficient agreement to be clinically comparable. Regardless of severity, patients reported the same level of daytime sleepiness with the same level of accuracy across both measures.

TRIAL REGISTRATION NUMBER

ACTRN12611000847910; Pre-results.

Interformat reliability of the patient health questionnaire: Validation of the computerized version of the PHQ-9

BACKGROUND

Computerized versions of well-established measurements such as the PHQ-9 are widely used, but data on the comparability of psychometric properties are scarce.

OBJECTIVE

Our objective was to compare the interformat reliability of the paper-and-pen version with a computerized version of the PHQ-9 in a clinical sample.

METHODS

130 participants with mental health disorders were recruited during psychotherapeutic treatment in a mental health clinic. In a crossover design, they all completed the PHQ-9 in both the computerized and paper-and-pen versions in randomized order.

RESULTS

The internal consistency was comparable for the computer (α = 0.88) and paper versions (α = 0.89), and highly significant correlations were found between the formats (r = 0.92). PHQ-9 total scores were not significantly different between the paper and the computer delivered versions. There was a significant interaction effect between format and order of administration for the PHQ-9, indicating that the first administration delivered slightly higher scores.

LIMITATIONS

In order to reduce the required effort for the participants, we did not ask them to fill out anything but the PHQ-9 once in paper and once in computer version.

CONCLUSIONS

Our findings suggest that the PHQ-9 can be transferred to computerized use without affecting psychometric properties in a clinically meaningful way.

More adaptive versus less maladaptive coping: What is more predictive of symptom severity? Development of a new scale to investigate coping profiles across different psychopathological syndromes

BACKGROUND

Lack of adaptive and enhanced maladaptive coping with stress and negative emotions are implicated in many psychopathological disorders. We describe the development of a new scale to investigate the relative contribution of different coping styles to psychopathology in a large population sample. We hypothesized that the magnitude of the supposed positive correlation between maladaptive coping and psychopathology would be stronger than the supposed negative correlation between adaptive coping and psychopathology. We also examined whether distinct coping style patterns emerge for different psychopathological syndromes.

METHODS

A total of 2200 individuals from the general population participated in an online survey. The Patient Health Questionnaire-9 (PHQ-9), the Obsessive-Compulsive Inventory revised (OCI-R) and the Paranoia Checklist were administered along with a novel instrument called Maladaptive and Adaptive Coping Styles (MAX) questionnaire. Participants were reassessed six months later.

RESULTS

MAX consists of three dimensions representing adaptive coping, maladaptive coping and avoidance. Across all psychopathological syndromes, similar response patterns emerged. Maladaptive coping was more strongly related to psychopathology than adaptive coping both cross-sectionally and longitudinally. The overall number of coping styles adopted by an individual predicted greater psychopathology. Mediation analysis suggests that a mild positive relationship between adaptive and certain maladaptive styles (emotional suppression) partially accounts for the attenuated relationship between adaptive coping and depressive symptoms.

LIMITATIONS

Results should be replicated in a clinical population.

CONCLUSIONS

Results suggest that maladaptive and adaptive coping styles are not reciprocal. Reducing maladaptive coping seems to be more important for outcome than enhancing adaptive coping. The study supports transdiagnostic approaches advocating that maladaptive coping is a common factor across different psychopathologies.