Cognitive testing of the PHQ-9 for depression screening among pregnant and postpartum women in Kenya

Acceptability and content validity of suicidality screening items: a qualitative study with perinatal women

Background

Suicide is a leading cause of death for perinatal women. It is estimated that up to 50% of women with mental health issues during pregnancy and/or after birth are not identified, despite regular contact with healthcare services. Screening items are one way in which perinatal women needing support could be identified. However, research examining the content validity and acceptability of suicide-related screening items with perinatal women is limited.

Aims

This study sought to: (i) assess the acceptability and content validity of 16 suicide-related items that have been administered and/or validated in perinatal populations; and (ii) explore the potential barriers and facilitators that may affect how women respond to these items when administered during pregnancy and after birth.

Methods

Twenty-one cognitive and semi-structured interviews were conducted with pregnant and postnatal women in the UK. The sample included women who had experienced self-reported mental health problems and/or suicidality during the perinatal period, and those who had not. Interviews were transcribed verbatim, and a coding framework based on the Theoretical Framework of Acceptability was applied to explore the data using deductive and inductive approaches.

Results

Findings indicated that the acceptability and content validity of suicide-related items were largely unacceptable to perinatal women in their current form. Women found terms such as 'better off dead' or 'killing myself' uncomfortable. Most women preferred the phrase 'ending your life' as this felt less confronting. Comprehensibility was also problematic. Many women did not interpret 'harming myself' to include suicidality, nor did they feel that abstract language such as 'leave this world' was direct enough in relation to suicide. Stigma, fear, and shame was central to non-disclosure. Response options and recall periods further affected the content validity of items, which created additional barriers for identifying those needing support.

Conclusions

Existing suicide-related screening items may not be acceptable to perinatal women. Maternity practitioners and researchers should consider the phrasing, clarity, context, and framing of screening items when discussing suicidality with perinatal women to ensure potential barriers are not being reinforced. The development of specific suicidality screening measures that are acceptable, appropriate, and relevant to perinatal women are warranted.

Investigating the PHQ-9 With Mokken Scale Analysis and Cognitive Interviews

Scores on the Patient Health Questionnaire-9 (PHQ-9) are frequently used to assess depression both in research and in clinical practice. The aim was to examine the validity of the PHQ-9 sum score by using Mokken scale analysis (Study I) and cognitive interviews (Study II) on the Icelandic version of PHQ-9. A primary care sample of 618 individuals was used in Study I. The results indicate that the PHQ-9 items are not close enough to perfectly unidimensional for their sum score to accurately order people on the depression severity dimension. In Study II, the sample consisted of 53 individuals, with 28 having a history of depression and 25 not. The findings reveal a number of issues concerning respondents' use of the PHQ-9. No systematic differences were found in the results of the two groups. The PHQ-9 sum score should thus be interpreted and used with great care. We provide scale revision recommendations to improve the quality of PHQ-9.

Interpretation of the Patient Health Questionnaire 9 in High-Impact Chronic Pain: Do We Measure Depressive Symptoms the Way We Think?

OBJECTIVES

Depression is prevalent among patients with chronic pain and may impact pain management. An accurate assessment is, however, complicated by overlapping symptoms. This study investigated how patients with high-impact chronic pain interpreted and responded to the Patient Health Questionnaire 9 (PHQ-9) to identify problematic items and causes hereof.

MATERIALS AND METHODS

Cognitive interviews using the Three-Step Test-Interview procedure were conducted during the completion of the PHQ-9 in 33 patients with high-impact chronic pain referred to interdisciplinary treatment. Responses were analyzed using 4 coding categories: (1) "congruent" (response consistent with intention); (2) "incongruent" (response not consistent intention); (3) "ambiguous" (response both congruent and incongruent or insufficient to evaluate congruency); and (4) "confused" (response with confused or misunderstood statements). Next, the content of responses to problematic items was analyzed to identify causes for noncongruency, and encountered response difficulties were identified across all items.

RESULTS

Three items (items 2, 6, and 9) performed as intended (>97% congruent responses), while 7 items (items 1, 3, 4, 5, 7, 8, and 10) were identified as problematic (<50% congruent responses). Problematic items had 1 or more issues: Responses were based on (1) pain-related issues or (2) other (non-pain) factors unrelated to depression, or item structure caused response difficulties due to wordings, reversion, or having 2 questions in 1.

DISCUSSION

Problematic items limit the construct validity of the PHQ-9, leaving an increased risk of inflated depression scores in high-impact chronic pain. Identified problems should guide future revisions to enhance validity and screening accuracy for the benefit of both research and clinical practice.

Higher rates of mental health screening of adolescents recorded after provider training using simulated patients in a Kenyan HIV clinic: results of a pilot study

Background

Kenyan adolescent girls and young women (AGYW) experience a dual burden of HIV and common mental disorders (CMD). HIV clinics are a key entry point for AGYW in need of integrated CMD and HIV care; however, rates of screening and referral for CMDs are low. Our objective was to test an evidence-based provider training strategy, simulated patient encounters (SPEs), on CMD service delivery for AGYW in a Kenyan HIV clinic.

Methods

This pilot study was conducted in a public HIV clinic in Thika, Kenya from January to November 2021. The simulated patient encounter (SPE) implementation strategy included case script development from prior qualitative work, patient actor training, and a three-day SPE training including four standardized mock clinical encounters followed by quantitative surveys assessing provider competencies for each encounter. We abstracted medical record data related to HIV and CMDs such as HIV status, reason for visit, CMD screening test performed, and counselling or referral information. We conducted an interrupted time series analysis using abstracted HIV and CMD screening rates from AGYW ages 16-25 years visiting the clinic 7 months before and 3 months after SPE training. We used generalized linear models to assess changes in CMD screening rates after training.

Results

A total of 10 providers participated in the training. Competency ratings improved across four mock encounters (mean score from 8.1 to 13.7) between first and fourth encounters. We abstracted all medical records (n = 1,154) including from 888 (76%) AGYW seeking HIV treatment, 243 (21%) seeking prevention services, and 34 (3%) seeking other services. CMD screening rates increased immediately following training from 8 to 21% [relative risk (RR) = 2.57, 95% confidence interval (CI) = 1.34-4.90, p < 0.01]. The 3 months following the SPE training resulted in an 11% relative increase in CMD screening proportion compared to the 7 months pre-SPE (RR: 1.11, 95% CI: 1.04-1.17, p < 0.01). Finally, 1% of all pre-SPE screens resulted in referral versus 5% of post-SPE screens (p = 0.07).

Conclusion

The SPE model is a promising implementation strategy for improving HIV provider competencies and CMD service delivery for adolescents in HIV clinics. Future research is needed to explore effects on adolescent clinical outcomes in larger trials.

A Fast and Minimal System to Identify Depression Using Smartphones: Explainable Machine Learning-Based Approach

BACKGROUND

Existing robust, pervasive device-based systems developed in recent years to detect depression require data collected over a long period and may not be effective in cases where early detection is crucial. Additionally, due to the requirement of running systems in the background for prolonged periods, existing systems can be resource inefficient. As a result, these systems can be infeasible in low-resource settings.

OBJECTIVE

Our main objective was to develop a minimalistic system to identify depression using data retrieved in the fastest possible time. Another objective was to explain the machine learning (ML) models that were best for identifying depression.

METHODS

We developed a fast tool that retrieves the past 7 days' app usage data in 1 second (mean 0.31, SD 1.10 seconds). A total of 100 students from Bangladesh participated in our study, and our tool collected their app usage data and responses to the Patient Health Questionnaire-9. To identify depressed and nondepressed students, we developed a diverse set of ML models: linear, tree-based, and neural network-based models. We selected important features using the stable approach, along with 3 main types of feature selection (FS) approaches: filter, wrapper, and embedded methods. We developed and validated the models using the nested cross-validation method. Additionally, we explained the best ML models through the Shapley additive explanations (SHAP) method.

RESULTS

Leveraging only the app usage data retrieved in 1 second, our light gradient boosting machine model used the important features selected by the stable FS approach and correctly identified 82.4% (n=42) of depressed students (precision=75%, F1-score=78.5%). Moreover, after comprehensive exploration, we presented a parsimonious stacking model where around 5 features selected by the all-relevant FS approach Boruta were used in each iteration of validation and showed a maximum precision of 77.4% (balanced accuracy=77.9%). Feature importance analysis suggested app usage behavioral markers containing diurnal usage patterns as being more important than aggregated data-based markers. In addition, a SHAP analysis of our best models presented behavioral markers that were related to depression. For instance, students who were not depressed spent more time on education apps on weekdays, whereas those who were depressed used a higher number of photo and video apps and also had a higher deviation in using photo and video apps over the morning, afternoon, evening, and night time periods of the weekend.

CONCLUSIONS

Due to our system's fast and minimalistic nature, it may make a worthwhile contribution to identifying depression in underdeveloped and developing regions. In addition, our detailed discussion about the implication of our findings can facilitate the development of less resource-intensive systems to better understand students who are depressed and take steps for intervention.

Measures of suicidality in perinatal women: A systematic review

BACKGROUND

Suicide is a leading cause of death for perinatal women. Identifying women at risk of suicide is critical. Research on the validity and/or reliability of measures assessing suicidality in perinatal women is limited. This review sought to: (1) identify; and (2) evaluate the psychometric properties of suicidality measures validated in perinatal populations.

METHODS

Nine electronic databases were systematically searched from inception to January 2022. Additional articles were identified through citation tracking. Study quality was assessed using an adapted tool, and the psychometric properties of measures were reviewed and presented using a narrative synthesis.

RESULTS

A total of 208 studies were included. Thirty-five studies reported psychometric data on ten suicidality measures. Fifteen studies reported both validity and reliability data, 12 reported more than one type of validity, seven validated more than one measure and four only reported reliability. Nearly all measures primarily screened for depression, with an item or subscale assessing suicidal ideation and/or behaviours. Three measures were specifically developed for perinatal women, but only two were validated in more than one study. The Postpartum Depression Screening Scale (PDSS), suicidal thoughts subscale, was validated most frequently.

LIMITATIONS

Methodological differences and variability between the measures (e.g., suicidality construct assessed, number of items and administration) precluded direct comparisons.

CONCLUSION

Further validation of suicidality measures is needed in perinatal women. Screening for perinatal suicidality often occurs in the context of depression. The development of a standalone measure specifically assessing suicidality in perinatal women may be warranted, particularly for use in maternity care settings.

Convergent Validity of the Edinburgh Postnatal Depression Scale and the Patient Health Questionnaire (PHQ-9) in Pregnant and Postpartum Women: Their Construct Correlations with Functional Disability

This study aimed to evaluate the convergent validity of the Edinburgh Postnatal Depression Scale (EPDS) and the Patient Health Questionnaire (PHQ-9) in Thai pregnant and postpartum women, using the 12-item WHO Disability Assessment Schedule (WHODAS) as the reference standard. Participants completed the EPDS, PHQ-9, and WHODAS during the third trimester of pregnancy (over 28 weeks in gestational age) and six weeks postpartum. The sample included 186 and 136 participants for the antenatal and postpartum data analyses, respectively. The antenatal and postpartum data showed moderate correlations between both the EPDS and the PHQ-9 scores and the WHODAS scores (Spearman's correlation coefficients = 0.53-0.66, p < 0.001). The EPDS and PHQ-9 were moderately accurate in distinguishing disability (WHODAS score ≥ 10) from non-disability (WHODAS score < 10) in pregnant and postpartum participants, but the area under the curve of the PHQ-9 receiver operating characteristic curves in postpartum participants was significantly larger than that of the EPDS, with a difference (95% CI; p-value) of 0.08 (0.16, 0.01; p = 0.044). In conclusion, the EPDS and PHQ-9 are valid for assessing PND-related disability in pregnant and postpartum women. The PHQ-9 may perform better than the EPDS in distinguishing disability from non-disability in postpartum women.

Review of the psychometric properties of the Patient Health Questionnaire-9 (PHQ-9) Spanish version in a sample of Puerto Rican workers

Background

This study aimed to examine the internal structure and assess the psychometric properties of the Patient Health Questionnaire (PHQ-9) in a Puerto Rican sample of workers. This instrument is a nine-item questionnaire, which was conceptualized as a unidimensional structure; however, there are mixed results regarding this internal structure. This measure is used in the occupational health psychology context in organizations in Puerto Rico; nevertheless, there is little evidence of its psychometric properties with samples of workers.

Materials and methods

A total of 955 samples from two different study samples were used in this cross-sectional study design in which the PHQ-9 was used. We conducted confirmatory factor analysis, bifactor analysis, and random intercept item factor analysis to examine the internal structure of the PHQ-9. Moreover, a two-factor model was examined by randomly assigning items to the two factors. Measurement invariance across sex and the relationship with other constructs were examined.

Results

The best-fitted model was the bifactor model followed by the random intercept item factor. The five sets of two-factor models with items randomly assigned obtained acceptable and similar fit indices regardless of the items.

Conclusion

The results suggest that the PHQ-9 appears to be a reliable and valid instrument to measure depression. The more parsimonious interpretation of its scores, for now, is a unidimensional structure. Comparison across sex appears to be useful in occupational health psychology research settings since the results suggest that the PHQ-9 is invariant regarding this variable.

Depressive symptoms and associated social and environmental factors among women living in informal settlements in Nairobi, Kenya

Approximately 280 million people around the world suffer from depression, and the rates are higher among women than men. For women living in informal settlements in lower - and middle-income countries (LMICs) the prevalence and associated burden of depressive symptoms may be particularly high. The purpose of this paper was to explore factors associated with possible major depressive disorder (MDD) in a probability sample of women living in Mathare informal settlement in Nairobi, Kenya and to identify potential points for intervention and/or support. Quantitative surveys were conducted with 552 women aged 18-75. Possible MDD was measured using the Patient Health Questionnaire and regressed on individual, household/familial-, and community/interpersonal-level factors. Findings highlight the potential importance of factors such as physical health, economic stress, access to water and sanitation, household and family dynamics, and neighbourhood/village differences in possible MDD among women living in informal settlements. We identify potential points for research, intervention and policy including: providing appropriate tangible assistance or interventions to reduce economic stress/strain; expanding access to water and sanitation and, in doing so, reducing potential burdens to physical health; providing and expanding healthcare to include mental healthcare; and investigating family dynamics and bolstering support for families, particularly for those experiencing conflict.

Cultural and contextual adaptation of mental health measures in Kenya: An adolescent-centered transcultural adaptation of measures study

INTRODUCTION

There is paucity of culturally adapted tools for assessing depression and anxiety in children and adolescents in low-and middle-income countries. This hinders early detection, provision of appropriate and culturally acceptable interventions. In a partnership with the University of Nairobi, Nairobi County, Kenyatta National Hospital, and UNICEF, a rapid cultural adaptation of three adolescent mental health scales was done, i.e., Revised Children's Anxiety and Depression Scale, Patient Health Questionnaire-9 and additional scales in the UNICEF mental health module for adolescents.

MATERIALS AND METHODS

Using a qualitative approach, we explored adolescent participants' views on cultural acceptability, comprehensibility, relevance, and completeness of specific items in these tools through an adolescent-centered approach to understand their psychosocial needs, focusing on gender and age-differentiated nuances around expression of distress. Forty-two adolescents and 20 caregivers participated in the study carried out in two primary care centers where we conducted cognitive interviews and focused group discussions assessing mental health knowledge, literacy, access to services, community, and family-level stigma.

RESULTS

We reflect on process and findings of adaptations of the tools, including systematic identification of words adolescents did not understand in English and Kiswahili translations of these scales. Some translated words could not be understood and were not used in routine conversations. Response options were changed to increase comprehensibility; some statements were qualified by adding extra words to avoid ambiguity. Participants suggested alternative words that replaced difficult ones and arrived at culturally adapted tools.

DISCUSSION

Study noted difficult words, phrases, dynamics in understanding words translated from one language to another, and differences in comprehension in adolescents ages 10-19 years. There is a critical need to consider cultural adaptation of depression and anxiety tools for adolescents.

CONCLUSION

Results informed a set of culturally adapted scales. The process was community-driven and adhered to the principles of cultural adaptation for assessment tools.

Reliability and validity of a perinatal depression screening instrument in rural Mali

Background

In order to reduce the burden of perinatal depression in low- and middle-income countries, health systems must be able to identify and treat women suffering from depression. The objective of our study was to develop a locally valid and reliable screening instrument for use in identifying pregnant women and mothers of young children with a local depression syndrome, dusukasi, in rural Mali.

Methods

We administered a locally adapted screening instrument containing items from the Edinburgh Postpartum Depression Scale (EPDS) and Hopkins Symptom Checklist (HSCL-25) to 180 pregnant women and mothers of children under age 2 in Sélingué, Mali to assess the instrument's psychometric properties and validity. Item Response Theory was used to develop an abbreviated version of the measure and the validity and psychometric properties of this shortened version were compared with the full-length scale.

Results

The full 28-item scale exhibited a single factor structure with good internal consistency (Cronbach's alpha = 0.92). Women who self-identified as suffering from dusukasi (n = 87) in a known groups analysis to assess construct validity had significantly higher depression and anxiety symptom scores (p < 0.0001) and functional impairment scores (p < 0.0001) compared to women not reporting dusukasi (n = 93). The shortened 16-item scale performed as well as the full scale in identifying women with dusukasi.

Conclusions

Construct validity of our adapted screening instrument was supported for identifying dusukasi in rural Malian women. Our methodology can be applied in other settings to develop similarly valid screening instruments for perinatal depression.

Continued attendance in a PrEP program despite low adherence and non-protective drug levels among adolescent girls and young women in Kenya: Results from a prospective cohort study

BACKGROUND

In sub-Saharan Africa (SSA), adolescent girls and young women (AGYW) ages 15 to 24 years represent <10% of the population yet account for 1 in 5 new HIV infections. Although oral pre-exposure prophylaxis (PrEP) with tenofovir disoproxil fumarate/emtricitabine (TDF/FTC) can be highly effective, low persistence in PrEP programs and poor adherence have limited its ability to reduce HIV incidence among women.

METHODS AND FINDINGS

A total of 336 AGYW participating in the PEPFAR-funded DREAMS PrEP program in western Kenya were enrolled into a study of PrEP use conducted between 6/2019 to 1/2020. AGYW, who used daily oral TDF/FTC, completed interviews and provided dried blood spots (DBS) for measurement of tenofovir-diphosphate (TFV-DP) concentrations at enrollment and 3 months later, and 176/302 (58.3%, 95% confidence interval [95% CI 52.3 to 63.8]) met our definition of PrEP persistence: having expressed intention to use PrEP and attended both the second interview and an interim refill visit. Among AGYW with DBS taken at the second interview, only 9/197 (4.6%, [95% CI 1.6 to 7.5]) had protective TFV-DP levels (≥700 fmol/punch) and 163/197 (82.7%, [95% CI 77.5 to 88]) had levels consistent with no recent PrEP use (<10 fmol/punch). Perception of being at moderate-to-high risk for HIV if not taking PrEP was associated with persistence (adjusted odds ratio, 10.17 [95% CI 5.14 to 20.13], p < 0.001) in a model accounting for county of residence and variables that had p-value <0.1 in unadjusted analysis (age, being in school, initiated PrEP 2 to 3 months before the first interview, still active in DREAMS, having children, having multiple sex partners, partner aware of PrEP use, partner very supportive of PrEP use, partner has other partners, AGYW believes that a partner puts her at risk, male condom use, injectable contraceptive use, and implant contraceptive use). Among AGYW who reported continuing PrEP, >90% indicated they were using PrEP to prevent HIV, although almost all had non-protective TFV-DP levels. Limitations included short study duration and inclusion of only DREAMS participants.

CONCLUSIONS

Many AGYW persisted in the PrEP program without taking PrEP frequently enough to receive benefit. Notably, AGYW who persisted had a higher self-perceived risk of HIV infection. These AGYW may be optimal candidates for long-acting PrEP.

On the Relationship Between Item Stem Formulation and Criterion Validity of Multiple-Component Measuring Instruments

The possible dependency of criterion validity on item formulation in a multicomponent measuring instrument is examined. The discussion is concerned with evaluation of the differences in criterion validity between two or more groups (populations/subpopulations) that have been administered instruments with items having differently formulated item stems. The case of complex item stems involving two stimuli description sentences (double-barreled questions) is thereby compared with the setting where items contained a single sentence. Using empirical data, the latent criterion validity differences are evaluated across three groups that are randomly assigned to conditions characterized by item stems with differing number of stimuli. The results indicate that validity of an instrument can be influenced by the specific way item stem is formulated. Implications for empirical educational, behavioral, and social science research are discussed.

Depression During Pregnancy Risk Scale: elaboration of a theoretical model

This study aim is to propose a theoretical model on the construct risk of depression during pregnancy as an initial part of the process of building and validating the Depression during Pregnancy Risk Scale. This is a theoretical study based on the methodology recommended by Pasquali, which establishes four steps for the elaboration of the theoretical model: psychological system, property of the psychological system, dimensionality, definition of the construct. In the first step, the psychological object was defined as "risk of depression during pregnancy". Thereafter, "depression during pregnancy" was defined as the property of the psychological system. In the third step, dimensionality was established through the antecedents and consequences of depression during pregnancy, understood as its risk factors and consequences, respectively. In the fourth step, the constitutive and operational definition of the construct risk of depression during pregnancy was established. The elaboration of the theoretical model advanced when it addressed the risk of depression during pregnancy as a process that articulates several concepts in which antecedents and consequences promoting repercussions on the health of the pregnant woman are inserted; and it contributed to the development of an original scale.

Effects of a Home-Based Intervention on HIV Prevention Health Behaviors in Pregnant/Postpartum Kenyan Women: Estimating Moderating Effects of Depressive Symptoms

We estimated effects of maternal depressive symptoms, utilizing the Patient Health Questionnaire-8 (PHQ-8), on women's HIV prevention behaviors in Migori County, Kenya. Pregnant women ≥ 18 years old, with gestational age of < 37 weeks, were randomized into standard care or three home visits (2 during pregnancy, 1 postpartum) promoting couple HIV testing and counseling (CHTC) and HIV prevention. Of 105 female participants, 37 (35.24%) reported depressive symptoms and 50 (47.62%) were HIV-positive. Three Poisson regressions with robust variance (univariable, multivariable, and multivariable with depressive symptoms/study arm interaction) were modeled for three outcomes: CHTC, infant HIV testing, health-seeking postpartum. In multivariable analysis with interaction, a moderating trend for the interaction between depressive symptoms and individual health-seeking was observed (p-value = 0.067). Women scoring ≤ 9 (n = 68) on the PHQ-8 and participating in home visits were 1.76 times more likely to participate in individual health-seeking compared to participants in standard care (ARR 1.76, 95% CI 1.17-2.66).