Measurement invariance and psychometric properties of Perceived Stigma toward People who use Substances (PSPS) among three types of substance use disorders: Heroin, amphetamine, and alcohol

Substance use stigma: A systematic review of measures and their psychometric properties

Background

Instruments to measure substance use stigma are emerging, however little is known regarding their psychometric properties. While research has evolved to view substance use stigma as a context sensitive international phenomenon that is embedded within cultures, validated self-report measures are lacking and comprehensive reviews of the existing measures are extremely limited. In this systematic review of substance use stigma and shame measures, we aim to contextualize results from existing research, lay the groundwork for future measurement development research, and provide a thorough resource for research scientists currently designing studies to measure substance use stigma.

Methods

We searched three databases using Boolean search terms for psychometric evaluations of measures of substance use stigma and shame and evaluated the quality/psychometric properties using an adaptation of the COnsensus-based Standards for the selection of health Measurement Instruments (COSMIN) systematic review guidelines.

Results

We identified 18 measures of substance use stigma. Overall, most measures had minimal psychometric assessments and none of the measures met all domains of the COSMIN measure quality criteria. However, most studies reported satisfactory factor analyses and internal consistency scores.

Conclusions

Most measures of substance use stigma and shame had psychometric assessment across a limited range of criteria and no measures of structural substance use stigma were found. The most reported psychometric properties were structural validity and convergent validity. We suggest future researchers investigate test-retest reliability and cross-cultural validity for existing substance use stigma measures, as well as develop and evaluate novel measures assessing structural stigma of substance use.

The eleven-item Alcohol, Smoking and Substance Involvement Screening Test (ASSIST-11): Cross-cultural psychometric evaluation across 42 countries

The Alcohol, Smoking and Substance Involvement Screening Test (ASSIST) is an instrument to screen substance-use-related health risks. However, little is known whether the ASSIST could be further shortened while remaining psychometrically sound across different countries, languages, gender identities, and sexual-orientation-based groups. The study aimed to validate a shortened 11-item ASSIST (ASSIST-11). Using the International Sex Survey data, 82,243 participants (M age = 32.39 years) across 42 countries and 26 languages completed questions from the ASSIST-11 regarding gender identity, sexual orientation, and other information. Confirmatory factor analysis (CFA) and multigroup CFA (MGCFA) evaluated the ASSIST-11's structure and tested measurement invariance across groups. Cronbach's α and McDonald's ω were used to examine the internal consistency. Cohen's d and independent t-tests were used to examine known-group validity. The ASSIST-11 was unidimensional across countries, languages, age groups, gender identities (i.e., men, women, and gender-diverse individuals), and sexual orientations (i.e., heterosexual and sexual minority individuals). Cronbach's α was 0.63 and McDonald's ω was 0.68 for the ASSIST-11. Known-group validity was supported by Cohen's d (range between 0.23 and 0.40) with significant differences (p-values<0.001). The ASSIST-11 is a modified instrument with a unidimensional factor structure across different languages, age groups, countries, gender identities, and sexual orientations. The low internal consistency of the ASSIST-11 might be acceptable as it assesses a broad concept (i.e., use of several different substances). Healthcare providers and researchers may use the ASSIST-11 to quickly assess substance-use information from general populations and evaluate the need to follow up with more detailed questions about substance use.

Psychological distress and quality of life among Opioid Agonist Treatment service users with a history of injecting and non-injecting drug use: A cross-sectional study in Kathmandu, Nepal

BACKGROUND

Opioid use disorder is a serious public health problem in Nepal. People who use opioids often experience psychological distress and poor quality of life. Opioid agonist Treatment (OAT) is central in managing opioid dependence. This study aimed to examine factors associated with quality of life and serious psychological distress among OAT service users in the Kathmandu Valley, Nepal and compare those who had injected opioids prior to OAT and those who had not.

METHODS

A cross-sectional study with 231 was conducted using a semi-structured questionnaire, the Nepalese versions of the Kessler 6 psychological distress scale and World Health Organization Quality of Life scale (WHOQOL-BREF). Bivariate and multivariate analyses were undertaken to examine factors associated with quality of life and serious psychological distress.

RESULTS

Most participants were males (92%) and about half had injected opioids before initiating OAT. Serious psychological distress in the past four weeks was significantly more prevalent among participants with a history of injecting (32.2%) than those who did not inject (15.9%). In the adjusted linear regression model, those who had history of injecting were likely to have lower physical quality of life compared to non-injectors. Those self-reporting a past history of mental illness were more than seven times and those with medical comorbidity twice more likely to have serious psychological distress over last four weeks. Lower socioeconomic status and a history of self-reported mental illness in the past were found to be significantly associated with lower quality of life on all four domains.

CONCLUSION

Those who had history of injecting were younger, had frequent quit attempts, higher medical comorbidity, lower socioeconomic status and remained longer in OAT services. Alongside OAT, the complex and entangled needs of service users, especially those with a history of injecting drugs, need to be addressed to improve quality of life and lessen psychological distress.

Temporal associations between depressive features and self-stigma in people with substance use disorders related to heroin, amphetamine, and alcohol use: a cross-lagged analysis

BACKGROUND

Depression is a mental health problem and substance use concerns are socially unacceptable behaviors. While depression and substance use may individually impact self-concept and social relationships, their co-occurrence can increase the risk of self-stigmatization. However, there is no evidence regarding how depression and self-stigma may influence each other over time. The aim of the current study was to evaluate the cross-sectional and longitudinal relationships between features of depression and self-stigma in people with substance use disorders.

METHODS

Overall, 319 individuals with substance use disorders (273 males) with a mean (± SD) age of 42.2 (± 8.9) years were recruited from a psychiatric center in Taiwan by convenience sampling. They were assessed for features of depression and self-stigma at four times over a period of nine months using the depression subscale of the Depression Anxiety Stress Scales (DASS-21) and Self-Stigma Scale-Short S (SSS-S), respectively. Repeated-measures analyses of variance, Pearson correlations and cross-lagged models using structural equation modeling examined cross-sectional and temporal associations between depression and self-stigma.

RESULTS

Positive cross-sectional associations were found between depressive features and all assessed forms of self-stigma over time (0.13 < r < 0.92). Three models of cross-lagged associations between different forms of self-stigma and depressive features indicated good fit indices (comparative fit index > 0.98). The direction of associations between depressive features towards self-stigma was stronger than the opposite direction.

CONCLUSION

Positive associations between depressive features and self-stigma were found in people with substance use disorders. Although these associations may be bidirectional longitudinally, the directions from depressive features to self-stigma may be stronger than the reverse directions, suggesting treatment of depression in earlier stages may prevent self-stigmatization and subsequent poor outcomes in people with substance use disorders.

Comparisons of psychological distress and self-stigma among three types of substance use disorders receiving treatment-as-usual approaches: real-world data from a 9-month longitudinal study

BACKGROUND

Substance use is an important issue worldwide and people with substance use disorders (SUDs) have been reported to have high levels of psychological distress and self-stigma. Therefore, psychological distress and self-stigma in people with SUDs are considerable.

OBJECTIVE

The present study used a longitudinal design to examine whether treatment-as-usual approaches in Taiwan improve psychological distress and self-stigma among people with three types of SUDs (heroin, amphetamine, and alcohol use disorders).

DESIGN

A 9-month longitudinal design involving four assessments spaced 3 months apart.

METHODS

Convenience sampling was used to recruit people with heroin (n = 112), amphetamine (n = 151), and alcohol (n = 56) use disorders from outpatient psychiatric center in Southern Taiwan. Psychological distress was assessed using the Depression, Anxiety, Stress Scale (DASS-21), and self-stigma was assessed using the Self-Stigma Scale-Short (SSS-S). Generalized estimating equation (GEE) models were constructed to understand between-group differences in psychological distress and self-stigma over time.

RESULTS

Patients with heroin and amphetamine use disorders had lower levels of psychological distress as compared with those with alcohol use disorder. Levels of psychological distress were lower at Time 2 to Time 4 as compared with Time 1. Patients with heroin and amphetamine use disorders had higher levels of self-stigma as compared with those with alcohol use disorder. Self-stigma levels remained stable over time. The dropout rate of receiving treatment-as-usual approach in the 9-month study was 60%.

CONCLUSION

Treatment as usual for SUDs among outpatients in Taiwan may decrease psychological distress but not self-stigma. However, such effects need to be further examined given the high drop-out rates and absence of a control condition. The findings suggest that self-stigma may warrant additional treatment for patients with SUDs.

Temporal associations between problematic use of the internet and self-stigma among people with substance use disorders: A cross-lagged model across one year

Self-stigma is a common experience for people with substance use disorders (SUDs). Understanding factors associated with self-stigma may aid in intervention development. This study investigated the reciprocal relationship between three types of problematic use of the internet [PUI; i.e. problematic use of social media (PUSM), problematic smartphone use (PSPU), and problematic gaming (PG)] and self-stigma among people with SUDs. This longitudinal study involved five waves of a survey given to individuals with SUDs in Taiwan. A total of 319 participants (85% male), with a mean age of 42.2 years (SD = 8.9), were recruited. The Smartphone Application-Based Addiction Scale, Bergen Social Media Addiction Scale, Internet Gaming Disorder-Short Form, and Self-Stigma Scale-Short Form were used. No significant associations between PUI and self-stigma were found in early waves (i.e., Waves 1 and 2). The earliest significant finding was identified between Wave 2 PSPU (smartphone) and Wave 3 self-stigma. Additionally, Wave 3 PSPU (smartphone) and PG (gaming) were associated with Wave 4 self-stigma, and Wave 4 PSPU (smartphone), PG (gaming), and PUSM (social media) were associated with Wave 5 self-stigma. Therefore, all three types of PUI (internet) may elevate self-stigma at different time points for individuals with SUDs. However, the reciprocal effects between self-stigma and PUI (internet) only occurred in PUSM (social media) at a later stage (i.e., from Wave 4 to Wave 5). In conclusion, people with SUDs who have PUI (internet) are at increased likelihood of developing more self-stigma, which may then increase subsequent PUSM (social media), forming a vicious cycle.

Effectiveness of an educational program for reducing mental illness stigma targeting family medicine trainees in Tunisia: A quasi-experimental study

Reducing stigma among mental health and health professionals has been an ultimate priority in many countries worldwide. This study aimed to evaluate the effectiveness of a four-session educational intervention for reducing stigma of mental illness targeting family medicine trainees in Tunisia. A quasi-experimental design was adopted with an intervention group (N = 51) and a control group (N = 56). Pre-intervention data were collected using an online survey. A four-session seminar series was implemented and organized. Post-intervention data were collected immediately after the end of the intervention then 2 months thereafter. Instruments included Attribution Questionnaire (AQ-27), Self-Determination Scale (SDS), Empowerment Scale (ES), and Recovery Scale (RS). Repeated measures analysis of covariance and multiple analysis of covariance tests were carried out. Results revealed that the intervention had moderate effects on the AQ-27 score and on six of its stigma factors including factors of the dangerousness model. The intervention improved SDS score, but not ES or RS scores. Positive effects were observed immediately after the intervention and 2 months thereafter. Regular implementation of educational programs in clinical practice would be beneficial. Developing other anti-stigma methods is needed to address the concepts of recovery and responsibility of patients with mental illness.

Rasch Modeling and Differential Item Functioning of the Self-Stigma Scale-Short Version among People with Three Different Psychiatric Disorders

Self-stigma is prevalent in individuals with psychiatric disorders and can profoundly affect people. A unified assessment with sound psychometric properties is needed for evaluating self-stigma across psychiatric conditions. The aim of this study was to examine the psychometric properties of the Self-Stigma Scale-Short version (SSS-S) using Rasch modeling. Six-hundred and twelve participants with substance use disorders (n = 319), attention-deficit/hyperactivity disorder (n = 100), and schizophrenia (n = 193) completed the SSS-S. Rasch results confirmed the unidimensionality of the nine items of the SSS-S. The four-point Likert scale of the SSS-S reflected monotonical increases along the self-stigma continuum. No ceiling or floor effects were detected. Among the three subdomains of the SSS-S, cognitive items appeared to be the most robustly endorsed, and behavioral items were the least endorsed. Two items in the SSS-S displayed differential item functioning across the three diagnoses. Additionally, SSS-S scores showed weak to moderate correlation with depression, anxiety, and stress scale scores. The SSS-S had overall satisfactory psychometric properties. Healthcare professionals may use this assessment to assess self-stigma in multiple psychiatric groups, and information gained may facilitate improved care.

The mediating role of perceived social support in the relationship between perceived stigma and depression among individuals diagnosed with substance use disorders

WHAT IS KNOWN ON THE SUBJECT?: Individuals diagnosed with substance use disorders may perceive stigma and suffer from mental health problems. Perceived stigma is related to poor mental health among individuals diagnosed with substance use disorders. The social support deterioration deterrence model proposes that stressors (e.g. perceived stigma) negatively affect mental health via reduced perceived social support. To the best of the present authors' knowledge, the model has never been tested in the context of perceived stigma among individuals diagnosed with substance use disorders. WHAT THE PAPER ADDS TO EXISTING KNOWLEDGE?: The paper used structural equation modelling to show that the social support deterioration deterrence model could explain the relationship between perceived stigma and depression among individuals diagnosed with substance use disorders. Perceived support from family and perceived support from friends are mediators in the association between perceived stigma and depression among individuals diagnosed with substance use disorders. WHAT ARE THE IMPLICATIONS FOR PRACTICE?: Psychosocial interventions to increase perceived support from family and friends would be helpful in addressing perceived stigma effects on mental health. ABSTRACT: Introduction Although the relationship between perceived stigma and mental health outcomes is documented in the existing literature, very few studies have investigated the mechanism linking perceived stigma and mental health outcomes among individuals diagnosed with substance use disorders. To the best of the present authors' knowledge, the social support deterioration deterrence model has never been tested in the context of perceived stigma among individuals diagnosed with substance use disorders. Aim/Question Guided by the social support deterioration deterrence model, the present study investigated the mediating role of perceived support from three types of social network members (i.e. significant others, family members, and friends) in the association between perceived stigma and depression in individuals diagnosed with substance use disorders. Method The study employed a cross-sectional survey design comprising 300 participants diagnosed with substance use disorders in Taiwan. Results Results of a structural equation modelling analysis indicated that perceived stigma was significantly associated with depression. The relationship between perceived stigma and depression was partially mediated by perceived family support and perceived friend support. Discussion Consistent with the prediction of the social support deterioration deterrence model, the negative effect of perceived stigma on depression for individuals diagnosed with substance use disorders is through the mediating effect of social support. Implications for practices Based on the present study's results, psychosocial interventions to increase perceived support from family and friends would be helpful in addressing negative effects of perceived stigma on mental health among individuals diagnosed with substance use disorders.

The Relationship Between Children's Problematic Internet-related Behaviors and Psychological Distress During the Onset of the COVID-19 Pandemic: A Longitudinal Study

BACKGROUND

The outbreak of the coronavirus disease 2019 (COVID-19) pandemic has generated negative effects on psychological well-being worldwide, including in schoolchildren. Government requirements to stay at home and avoid social and school settings may impact psychological well-being by modifying various behaviors such as problematic phone and Internet use, yet there is a paucity of research on this issue. This study examined whether the COVID-19 outbreak may have impacted problematic smartphone use (PSU), problematic gaming (PG), and psychological distress, specifically the pattern of relationships between PSU, PG, and psychological distress in schoolchildren.

METHODS

Longitudinal data on psychological distress, PSU, and PG were collected from 575 children in primary schools in 3 waves: Waves 1 and 2 were conducted before the COVID-19 outbreak and Wave 3 during the outbreak. Cross-lagged panel models were used to examine relationships between factors across the 3 waves.

RESULTS

Cross-lagged models found that higher levels of PSU were not significantly related prospectively to greater psychological distress before the COVID-19 outbreak, but this prospective relationship became significant during the COVID-19 outbreak. Whereas PG was associated prospectively with psychological distress before the COVID-19 outbreak (ie, between Waves 1 and 2), this association became nonsignificant during the COVID-19 lockdown (ie, between Waves 2 and 3).

CONCLUSIONS

The COVID-19 outbreak has seemed to change prospective relationships between PSU and psychological distress and PG and psychological distress in schoolchildren. Future research should examine whether restrictions on or information provided to schoolchildren may exacerbate PSUs effects on psychological distress.

Validating Insomnia Severity Index (ISI) in a Bangladeshi Population: Using Classical Test Theory and Rasch Analysis

The COVID-19 outbreak is associated with sleep problems and mental health issues among individuals. Therefore, there is a need to assess sleep efficiency during this tough period. Unfortunately, the commonly used instrument on insomnia severity-the Insomnia Severity Index (ISI)-has never been translated and validated among Bangladeshis. Additionally, the ISI has never been validated during a major protracted disaster (such as the COVID-19 outbreak) when individuals encounter mental health problems. The present study aimed to translate the ISI into Bangla language (ISI-Bangla) and validate its psychometric properties. First, the linguistic validity of the ISI-Bangla was established. Then, 9790 Bangladeshis (mean age = 26.7 years; SD = 8.5; 5489 [56.1%] males) completed the Bangla versions of the following questionnaires: ISI, Fear of COVID-19 Scale (FCV-19S), and Patient Health Questionnaire-9 (PHQ-9). All the participants also answered an item on suicidal ideation. Classical test theory and Rasch analyses were conducted to evaluate the psychometric properties of the ISI-Bangla. Both classical test theory and Rasch analyses support a one-factor structure for the ISI-Bangla. Moreover, no substantial differential item functioning was observed across different subgroups (gender, depression status (determined using PHQ-9), and suicidal ideation). Additionally, concurrent validity of the ISI-Bangla was supported by significant and moderate correlations with FCV-19S and PHQ-9; known-group validity was established by the significant difference of the ISI-Bangla scores between participants who experienced suicidal ideation and those without. The present psychometric validation conducted during the COVID-19 outbreak suggests that the ISI-Bangla is a promising and operationally adequate instrument to assess insomnia in Bangladeshis.

Treatment-seeking behaviour among people with opioid use disorder in the high-income countries: A systematic review and meta-analysis

Objectives

To determine treatment seeking behaviour in those with opioid use disorder (OUD) in the high-income countries.

Methods

Five databases were searched in November 2019 for quantitative studies that reported OUD treatment seeking behaviour. Data analysis involved determining an overall pooled proportion estimate of treatment seeking behaviour for the two base groups, lifetime treatment and past 12-month or less treatment using the IVhet effect model. Subgroup analysis included heroin OUD, prescription OUD and general OUD. The sensitivity analysis included removal of outliers, separating adults and adolescents and the metaXL sensitivity analysis (studies are excluded if outside the pooled proportion confidence interval of the base case). Systematic review Prospero database registration number [CRD42020159531].

Results

There were 13 quantitative studies included in the systematic review, with all studies being from the United States of America (USA). IVhet models showed that 40% (95% CI: 23%, 58%) and 21% (95% CI: 16%, 26%) sought treatment in their lifetime and past 12 months respectively. Sub-group analysis found that lifetime treatment seeking for prescription OUD, 29% (95% CI: 27%, 31%), was less than for heroin plus combined OUD, 54% (95% CI: 26%, 82%). Most of the pooled results had high heterogeneity statistics except for results of lifetime treatment seeking for prescription OUD and past 12-month treatment seeking for prescription OUD.

Conclusion

All included studies in this meta-analysis were from the USA and indicate modest levels of treatment seeking for those with OUD. In particular, this review found that in the USA one in five people with OUD sought OUD treatment in the previous 12 months and two in five people with OUD sought OUD treatment in their lifetime. Further research is urgently required to explore the barriers and facilitators that can improve this low treatment seeking in those with OUD.

Psychometric performance of the perceived stigma of substance abuse scale (PSAS) among patients on methadone maintenance therapy in Vietnam

BACKGROUND

People who inject drugs (PWID) and patients on methadone maintenance therapy (MMT) face severe stigma and discrimination. However, there are limited measures assessing stigma towards individuals with substance use disorders or MMT patients, particularly in Vietnam, and few studies have examined the psychometric properties of existing measures. This study aims to examine the performance of the eight-item Perceived Stigma of Substance Abuse Scale (PSAS), created in the United States, among a population of MMT patients in Vietnam.

METHODS

A cross-sectional survey was conducted among 400 adult patients enrolled in an urban MMT clinic. Substance use stigma was measured using the PSAS. We conducted confirmatory factor analysis (CFA) and assessed construct validity, reliability and known-group validity.

RESULTS

The original eight-item scale was unidimensional, but yielded mixed goodness-of-fit indicators. Ultimately, dropping two items and allowing the errors of the items related to childcare to correlate improved the goodness-of-fit indicators. (RMSEA = 0.025; CFI = 0.999; and SRMR = 0.018). The shortened scale demonstrated acceptable reliability (Cronbach's α = 0.766). The mean stigma scores were significantly higher among individuals not working, but did not significantly vary by length of time in MMT, marital status, education attainment, HIV status, depression, concurrent injection drug use or missed methadone dose.

CONCLUSIONS

The shortened six-item scale demonstrated good construct validity and acceptability reliability, but it did not demonstrate many a priori hypothesized known-group validity associations. Further research should consider a mixed-methods validation approach.

The Prevalence of Post-traumatic Stress Disorder Symptoms, Sleep Problems, and Psychological Distress Among COVID-19 Frontline Healthcare Workers in Taiwan

The adverse effect of COVID-19 pandemic among individuals has been very disturbing especially among healthcare workers. This study aims to examine the prevalence of post-traumatic stress disorder (PTSD) symptoms, sleep problems, and psychological distress among COVID-19 frontline healthcare workers in Taiwan. Hence, a total of 500 frontline healthcare workers were recruited to participate in this cross-sectional study. They responded to measures on fear of COVID-19, depression, anxiety, stress, insomnia, PTSD, perceived stigma, and self-stigma. The results indicated a prevalence rate of 15.4% for PTSD symptoms, 44.6% for insomnia, 25.6% for depressive symptoms, 30.6% for anxiety symptoms, and 23.4% for stress among the participants. There were significantly positive interrelationships between all these variables. Anxiety symptoms and fear of COVID-19 predicted PTSD whereas symptoms of anxiety, fear of COVID-19, and stress predicted insomnia. The prevalence rates of the psychological problems reveal a worrying view of mental health challenges among Taiwanese frontline healthcare workers. Anxiety symptoms and fear of COVID-19 are the common predictive factors of PTSD and sleep problems suggesting that mental healthcare services for them may help prevent future occurrence of psychological problems by allaying fears of healthcare workers. Therefore, there should be mental healthcare services for healthcare workers during the COVID-19 pandemic.

Perceived stigma and associated factors among adults with problematic substance use in Northwest Ethiopia

Background

Substance use-related problems including cigarette smoking and alcohol use are among leading preventable risk factors for premature death. However, people with these problems did not get the appropriate treatment they need. Stigma against substance use could be the potential barrier for people with problematic substance use to seek professional help. Therefore, the objective of this study was to investigate magnitude and associated factors of perceived stigma towards problematic substance use.

Methods

A total of 2400 participants were screened using the Cut down, Annoyed, Guilty, and Eye-opener (CAGE) Adapted to Include Drugs (CAGE-AID) questionnaire. We found 540 participants screened positive for problematic substance use (alcohol, hashish, tobacco and khat) and interviewed them for perceived stigma using Perceived Stigma of Substance Abuse Scale (PSAS). Logistic regression was used to examine associated factors with perceived stigma.

Results

Three hundred forty-five (63.9%) participants reported perceived stigma above the mean value of Perceived Stigma of Substance Abuse Scale (PSAS). Variables positively associated with perceived stigma were lower wealth and joblessness, history of separation from family members before age of 18 years, poly-substance misuse and awareness about economic crisis of substance use.

Conclusion

Approximately, three in five people with problematic substance use perceived having been stigmatized by others. Health planning for problematic substance use should focus on stigma.