Competing factor structures of the Rosenberg Self-Esteem Scale (RSES) and its measurement invariance across clinical and non-clinical samples

Structural validity of the Rosenberg self-esteem scale in patients with schizophrenia in Indonesia

BACKGROUND

The Rosenberg self-esteem scale (RSES) is a commonly employed instrument for measuring self-esteem in the general population and those with mental illness. However, confirmatory factor analyses (CFA) to determine the structural validity of the RSES for schizophrenia patients in Indonesia are limited.

OBJECTIVES

We examined the structural validity of the RSES as a measurement for patients with schizophrenia in Indonesia through confirmatory factor analyses (CFA), as well as assessing internal consistency and reliability.

METHODS

The sample comprised 260 participants. Over two weeks, 30 subjects were added to investigate test-retest reliability. The structural validity analyzed was based on a CFA to determine the model fit. We used internal consistency (Ordinal alpha) to evaluate the reliability evidence.

RESULTS

Four different models were analyzed in this study. Considering the single-factor model (Model 1a), the overall fit criteria were inadequate. However, after some modification indices, all fit criteria were significantly adequate (Model 1b). The adequacy of all fit standards remained satisfactory when the two-factor model (Model 2) and hierarchical model (Model 3) were applied. The RSES had an ordinal alpha coefficient of 0.75. While 0.89 and 0.88 for the positive and negative self-esteem subscale, respectively. Test-retest reliability yielded adequate results with an interclass correlation score ranging from 0.87 to 0.93.

CONCLUSIONS

The current investigation provided evidence supporting the structural validity, internal consistency, and reliability of the RSES, indicating that the RSES can be considered a valid and reliable measurement. A two-factor model of RSES was an appropriate model to measure self-esteem in our study. This finding suggests that the use of the RSES is beneficial and applicable in assessing levels of self-esteem in individuals diagnosed with schizophrenia in Indonesia.

The interplay between emotion regulation, interpersonal problems and eating symptoms in individuals with obesity: A network analysis study

INTRODUCTION

A complex and bidirectional relationship between eating and psychological symptoms in individuals with obesity has been proposed. This study aims to identify the specific processes playing a role in this association, using a data-driven approach.

METHODS

Two hundred ninety-four adults with obesity, including 106 (36 %) with binge-eating disorder, were consecutively admitted to a specialized public center. They completed self-report questionnaires to assess emotion regulation, interpersonal problems, self-esteem, binge-eating symptoms, and expectancies regarding eating behaviors. To assess the interplay among eating and psychological variables, a network analysis was used. The bridge function analysis was also performed to identify the bridge nodes among three communities (eating symptoms, interpersonal and emotional problems).

RESULTS

The network was stable. Limited access to emotion regulation strategies, eating helps manage negative affect, and non-assertiveness were the nodes with the highest strength centrality. Lack of emotional clarity, non-assertiveness, socially inhibition, and binge-eating were the nodes with the highest bridge strength.

LIMITATIONS

The main limitation of the study is the cross-sectional nature of the findings which prevents to infer causality regarding the association between symptoms in the network.

DISCUSSION

An interplay between eating symptoms and affective and interpersonal factors characterizes individuals with obesity. Across the variety of psychological problems associated with obesity, the present study suggests specific psychological variables and their connections that could be addressed to improve treatment outcome.

A solution for factorial validity testing of three-item scales: An example of tau-equivalent strict measurement invariance of three-item loneliness scale

Ultra-short scales are increasingly popular in surveys. Congeneric model fit of a three-item scale cannot be tested with Confirmatory Factor Analysis (CFA) without additional assumptions because the number of degrees of freedom is equal to zero. A more rigorous tau-equivalent model, assuming equality of factor loadings can be tested instead. The objective of this study was to demonstrate this approach with an example of the psychometric study of the Polish version of the Three-Item Loneliness Scale (TILS), and to discuss the arising problems and possible solutions. There seems to be a high need for such analysis because currently, some properties of CFA make it an approach still predominant over Item Response Theory (IRT) models in the quality of life research. A sample of 3510 students completed TILS together with the questionnaires measuring a variety of indicators of well-being. The results provided evidence for a good fit of a tau-equivalent model. Furthermore, multi-group CFAs provided support for strict measurement invariance of this model. To the Authors' knowledge, it is the first practical application of a tau-equivalent model to testing the factorial validity of an ultra-short scale and probably the first empirical case of tau-equivalent measurement invariance in psychological literature in general. TILS showed good criterion validity and satisfactory reliability. Unidimensionality of three-item scales can be examined with a tau-equivalent model that has some favorable psychometric properties. However, it might be exceedingly restrictive in certain practical cases. When developing a new short scale, it is recommended to maintain at least four items.

An Empirical Identification Issue of the Bifactor Item Response Theory Model

Using the bifactor item response theory model to analyze data arising from educational and psychological studies has gained popularity over the years. Unfortunately, using this model in practice comes with challenges. One such challenge is an empirical identification issue that is seldom discussed in the literature, and its impact on the estimates of the bifactor model's parameters has not been demonstrated. This issue occurs when an item's discriminations on the general and specific dimensions are approximately equal (i.e., the within-item discriminations are similar in strength), leading to difficulties in obtaining unique estimates for those discriminations. We conducted three simulation studies to demonstrate that within-item discriminations being similar in strength creates problems in estimation stability. The results suggest that a large sample could alleviate but not resolve the problems, at least when considering sample sizes up to 4,000. When the discriminations within items were made clearly different, the estimates of these discriminations were more consistent across the data replicates than that observed when the discriminations within the items were similar. The results also show that the similarity of an item's discriminatory magnitudes on different dimensions has direct implications on the sample size needed in order to consistently obtain accurate parameter estimates. Although our goal was to provide evidence of the empirical identification issue, the study further reveals that the extent of similarity of within-item discriminations, the magnitude of discriminations, and how well the items are targeted to the respondents also play factors in the estimation of the bifactor model's parameters.

Internal Structure of Beck Hopelessness Scale: An Analysis of Method Effects Using the CT-C(M-1) Model

ABTRACTThe construct validity in relation to the dimensionality or factor structure of the Beck Hopelessness Scale (BHS) has long been debated in psychometrics. Irrelevant variance due to item wording (method effects) can distort the factor structure, and recent studies have examined the method factor's role in the factor structure of the BHS. However, the models used to control the method effects have severe limitations, and new models are needed. One such model is the correlated trait-correlated method minus one (CT-C(M-1)), which is a powerful approach that gives the trait factor an unambiguous meaning and prevents the anomalous results associated with fully symmetrical bifactor modeling. The present work compares the fit and factor structure of the CT-C(M-1) model to bifactor models proposed in previous literature and evaluates the criterion validity of the CT-C(M-1) model and its discriminatory capacity by taking suicidal ideation as the criterion variable. This study used a large and heterogeneous open mode online sample of Argentinian people (N = 2,164). The results indicated that the CT-C(M-1) model with positive words as referenced items achieves the most adequate factor structure. The factorial scores derived from this model demonstrate good predictive and discriminating capabilities.

Psychometric evaluation of the Rosenberg Self-Esteem Scale in primary school students with mild intellectual disability: First evidence

BACKGROUND

Although the Rosenberg Self-Esteem Scale (RSES) is the most widely used measure of self-esteem, the evidential basis to confirm the RSES factor validity and reliability in children with intellectual disabilities (ID) has not been previously addressed. The purpose of this study was to evaluate the psychometric properties of the Greek version of the RSES into a sample consisting of primary school students with mild ID, bearing in mind the aspect of multidimensionality. In addition, gender differences were also investigated.

METHODS

The participants were 103 primary school students with mild ID aged 9-12 years old. Fifty-four (52.4 %) of the participants were boys and forty-nine were girls (47.6 %). Using the LISREL software, six different models of factor structure were estimated. The psychometric properties of the RSES, including internal consistency, content validity, convergent and discriminant validity as well as confirmatory factor analysis, were assessed.

RESULTS

The findings of this study provide some preliminary support to the robustness of the bifactor model, with a general self-esteem factor and two method effect factors that capture the direction of positive and negative item wording.

CONCLUSIONS

Although it is inappropriate to conclude that the results will be extended to all other populations and cultures, it can be assumed that bifactor models, which specify method effects due to wording, fit better than strictly unidimensional or two factor models.

Bifactor analysis of the rosenberg self-esteem scale in morbid obesity

Self-esteem is a set of feelings and thoughts a person has about his/her own worth and competence, which is reflected in a positive or negative attitude toward himself/herself. This study examined the factor structure of the Rosenberg Self-Esteem Scale with scores of 288 obese brazilian women waiting for bariatric surgery. Psychometric studies have found controversial results regarding the factor structure of this measure with samples from different profiles. In this investigation, the unifactor, two-oblique-factor and bifactor models were tested by Confirmatory Factor Analysis. The results clearly support the existence of a single dimension for the scale, but also for the method effects relating to the positively and negatively worded items. Further investigations with the inclusion of obese males are suggested.

Self-esteem and binge eating: Do patients with binge eating disorder endorse more negatively worded items of the Rosenberg Self-Esteem Scale?

OBJECTIVE

Self-esteem is a core aspect of eating disorder symptomatology. This study aims to examine whether method effects associated with negatively worded items of the Rosenberg Self-Esteem Scale (RSES) may interact the negative self-evaluations experienced by patients with obesity and binge eating disorder (BED). We also examined whether negatively worded items were associated with psychological distress and eating symptoms.

METHOD

Five hundred thirty three female outpatients (mean age: 42.59) with BED (n = 160) or obesity without BED (n = 373) completed the RSES and measures of interpersonal problems, psychological distress, and eating symptoms.

RESULTS

Patients with BED responded more strongly to the negatively worded items of the RSES than those with obesity. The RSES negatively worded item factor was negatively associated with higher interpersonal problems, psychological distress, and binge eating.

CONCLUSIONS

Patients with BED may be more responsive to negatively phrased items on the RSES consistent with their negative self-evaluations and self-perceptions.

Hidden Invalidity Among 15 Commonly Used Measures in Social and Personality Psychology

It has recently been demonstrated that metrics of structural validity are severely underreported in social and personality psychology. We comprehensively assessed structural validity in a uniquely large and varied data set ( N = 144,496 experimental sessions) to investigate the psychometric properties of some of the most widely used self-report measures ( k = 15 questionnaires, 26 scales) in social and personality psychology. When the scales were assessed using the modal practice of considering only internal consistency, 88% of them appeared to possess good validity. Yet when validity was assessed comprehensively (via internal consistency, immediate and delayed test-retest reliability, factor structure, and measurement invariance for age and gender groups), only 4% demonstrated good validity. Furthermore, the less commonly a test was reported in the literature, the more likely the scales were to fail that test (e.g., scales failed measurement invariance much more often than internal consistency). This suggests that the pattern of underreporting in the field may represent widespread hidden invalidity of the measures used and may therefore pose a threat to many research findings. We highlight the degrees of freedom afforded to researchers in the assessment and reporting of structural validity and introduce the concept of validity hacking ( v-hacking), similar to the better-known concept of p-hacking. We argue that the practice of v-hacking should be acknowledged and addressed.

Adapting and validating the Rosenberg Self-Esteem Scale for elderly Spanish population

OBJECTIVES

This study aims to adapt and validate the most common measure of self-esteem, the Rosenberg Self-Esteem Scale (RSES), in the elderly Spanish population based on the initial one-factor model proposed by the author of the scale.

DESIGN

The factorial validity of the scale was tested using confirmatory factor analysis.

SETTING

The study was carried out in the city of Valencia (Spain).

PARTICIPANTS

A total of 231 elderly people with a mean age 72.68 (SD=8.55).

MEASUREMENTS

The participants completed the questionnaire RSES for the validation process, sociodemographic data and Mini-Mental State Examination.

RESULTS

Confirmatory factor analysis with a five-item structure for the one-factor structure showed good fit indexes (Chi square [5] = 217.20, p < .05; CFI = .965; GFI = .980; RMSEA = .070 [90% confidence interval of RMSEA, .022-.087]), and reliability, as internal consistency, measure with Cronbach's alpha was .732.

CONCLUSION

The adaptation of the RSES showed a unifactorial structure with good internal consistency. This reduced adaptation/version of the scale may facilitate clinical practice and be useful in research in older people.

Rosenberg Self-Esteem Scale: Method Effect and Gender Invariance

Abstract This study aimed to evaluate the dimensionality of the Rosenberg Self-Esteem Scale (RSES), by testing the adjustment of eight factorial models: a one-factor and two-factor model and six single-factor models controlling for the method effect associated with the wording of negative and positive items, through the correlated traits-correlated uniqueness (CTCU) and correlated traits-correlated methods (CTCM) approaches. We also tested measurement invariance across gender. A total of 689 participants took part in the study, with ages between 18 and 70 years (M = 25.5; SD = 8.06), mainly females (77.1%), who answered the RSES and sociodemographic questions. The results showed that single-factor models controlling for the effect of negative items alone or positive and negative items together best fit the data. The results also indicated that the RSES is invariant across gender, presenting the same theoretical structure and psychological meaning for men and women.

Observational Application Comparing Problem-Based Learning with the Conventional Teaching Method for Clinical Acupuncture Education

Aim

Although the problem-based learning (PBL) teaching method was introduced in 1969, its rapid and widespread application in Malaysia started in 1979. This study aimed to evaluate satisfaction with PBL compared to that of conventional learning, using satisfaction surveys and the Rosenberg Self-Esteem scores, of students learning clinical acupuncture at the School of Traditional Chinese Medicine (TCM), Xiamen University Malaysia.

Method

The participants of this study (N=36) were registered for a bachelor's degree program in TCM in 2016 and enrolled in the Science of Acupuncture and Moxibustion course beginning in September 2018. The students were randomly allocated into two groups: PBL group and conventional group. A self-administered learning satisfaction survey and the Rosenberg Self-Esteem scores were used for data collection. An independent sample t-test was used to compare the results between the two groups. A p-value <0.05 was considered significant.

Results

The results of the learning satisfaction survey and Rosenberg Self-Esteem scores were significantly better in the PBL group than in the conventional group (p<0.05).

Conclusions

PBL appears to be more effective for clinical acupuncture education than the conventional teaching method. However, further studies are needed to identify the mechanisms by which PBL excels in clinical acupuncture education, as well as other related TCM fields.

The Italian Version of the Inventory of Interpersonal Problems (IIP-32): Psychometric Properties and Factor Structure in Clinical and Non-clinical Groups

All versions of the Inventory of Interpersonal Problems (IIP) are broadly used to measure people's interpersonal functioning. The aims of the current study are: (a) to examine the psychometric properties and factor structure of the Italian version of the Inventory of Interpersonal Problems—short version (IIP-32); and (b) to evaluate its associations with core symptoms of different eating disorders. One thousand two hundred and twenty three participants (n = 623 non-clinical and n = 600 clinical participants with eating disorders and obesity) filled out the Inventory of Interpersonal Problems—short version (IIP-32) along with measures of self-esteem (Rosenberg Self-Esteem Scale, RSES), psychological functioning (Outcome Questionnaire, OQ-45), and eating disorders (Eating Disorder Inventory, EDI-3). The present study examined the eight-factor structure of the IIP-32 with Confirmatory Factor Analysis (CFA) and Exploratory Structural Equation Modeling (ESEM). ESEM was also used to test the measurement invariance of the IIP-32 across clinical and non-clinical groups. It was found that CFA had unsatisfactory model fit, whereas the corresponding ESEM solution provided a better fit to the observed data. However, six target factor loadings tend to be modest, and ten items showed cross-loadings higher than 0.30. The configural and metric invariance as well as the scalar and partial strict invariance of the IIP-32 were supported across clinical and non-clinical groups. The internal consistency of the IIP-32 was acceptable and the construct validity was confirmed by significant correlations between IIP-32, RSES, and OQ-45. Furthermore, overall interpersonal difficulties were consistently associated with core eating disorder symptoms, whereas interpersonal styles that reflect the inability to form close relationships, social awkwardness, the inability to be assertive, and a tendency to self-sacrificing were positively associated with general psychological maladjustment. Although further validation of the Italian version of the IIP-32 is needed to support these findings, the results on its cross-cultural validity are promising.

Cognitive Abilities Explain Wording Effects in the Rosenberg Self-Esteem Scale

There is consensus that the 10 items of the Rosenberg Self-Esteem Scale (RSES) reflect wording effects resulting from positively and negatively keyed items. The present study examined the effects of cognitive abilities on the factor structure of the RSES with a novel, nonparametric latent variable technique called local structural equation models. In a nationally representative German large-scale assessment including 12,437 students competing measurement models for the RSES were compared: a bifactor model with a common factor and a specific factor for all negatively worded items had an optimal fit. Local structural equation models showed that the unidimensionality of the scale increased with higher levels of reading competence and reasoning, while the proportion of variance attributed to the negatively keyed items declined. Wording effects on the factor structure of the RSES seem to represent a response style artifact associated with cognitive abilities.