Reliability estimation in a multilevel confirmatory factor analysis framework

Ignoring Clustering in Confirmatory Factor Analysis: Some Consequences for Model Fit and Standardized Parameter Estimates

In many situations, researchers collect multilevel (clustered or nested) data yet analyze the data either ignoring the clustering (disaggregation) or averaging the micro-level units within each cluster and analyzing the aggregated data at the macro level (aggregation). In this study we investigate the effects of ignoring the nested nature of data in confirmatory factor analysis (CFA). The bias incurred by ignoring clustering is examined in terms of model fit and standardized parameter estimates, which are usually of interest to researchers who use CFA. We find that the disaggregation approach increases model misfit, especially when the intraclass correlation (ICC) is high, whereas the aggregation approach results in accurate detection of model misfit in the macro level. Standardized parameter estimates from the disaggregation and aggregation approaches are deviated toward the values of the macro- and micro-level standardized parameter estimates, respectively. The degree of deviation depends on ICC and cluster size, particularly for the aggregation method. The standard errors of standardized parameter estimates from the disaggregation approach depend on the macro-level item communalities. Those from the aggregation approach underestimate the standard errors in multilevel CFA (MCFA), especially when ICC is low. Thus, we conclude that MCFA or an alternative approach should be used if possible.

Optimizing prediction of binge eating episodes: a comparison approach to test alternative conceptualizations of the affect regulation model

BACKGROUND

Although a wealth of studies have tested the link between negative mood states and likelihood of a subsequent binge eating episode, the assumption that this relationship follows a typical linear dose-response pattern (i.e., that risk of a binge episode increases in proportion to level of negative mood) has not been challenged. The present study demonstrates the applicability of an alternative, non-linear conceptualization of this relationship, in which the strength of association between negative mood and probability of a binge episode increases above a threshold value for the mood variable relative to the slope below this threshold value (threshold dose response model).

METHODS

A sample of 93 women aged 18 to 40 completed an online survey at random intervals seven times per day for a period of one week. Participants self-reported their current mood state and whether they had recently engaged in an eating episode symptomatic of a binge.

RESULTS

As hypothesized, the threshold approach was a better predictor than the linear dose-response modeling of likelihood of a binge episode. The superiority of the threshold approach was found even at low levels of negative mood (3 out of 10, with higher scores reflecting more negative mood). Additionally, severity of negative mood beyond this threshold value appears to be useful for predicting time to onset of a binge episode.

CONCLUSIONS

Present findings suggest that simple dose-response formulations for the association between negative mood and onset of binge episodes miss vital aspects of this relationship. Most notably, the impact of mood on binge eating appears to depend on whether a threshold value of negative mood has been breached, and elevation in mood beyond this point may be useful for clinicians and researchers to identify time to onset.

Thought self-leadership and effectiveness in self-management teams

This study empirically examines the multilevel nature of thought self-leadership at work. Furthermore, this study tests the relationship between team level thought self-leadership and team effectiveness (i.e. performance and viability) through collective efficacy. A total of 103 self-management teams (453 individuals), enrolled in a five-week management competition participated in the study. The results from multilevel confirmatory factor analysis suggest that thought self-leadership is functionally equivalent across levels of analysis (i.e. individuals and teams). In addition, we found an indirect effect of team level thought self-leadership on team effectiveness criteria, through collective efficacy. These findings extend previous work on thought self-leadership and team effectiveness, and open new roads for research in self-managing work teams. Finally, this study also provides guidelines for organizations in case they wish to foster team performance and viability in their work force.

Relationship satisfaction moderates the associations between male partner responses and depression in women with vulvodynia: a dyadic daily experience study

Vulvodynia is a prevalent vulvovaginal pain condition that interferes with women's psychological health. Given the central role of sexuality and relationships in vulvodynia, relationship satisfaction may be an important moderator of daily partner responses to this pain and associated negative sequelae, such as depression. Sixty-nine women (M age=28.12 years, SD=6.68) with vulvodynia and their cohabiting partners (M age=29.67 years, SD=8.10) reported their daily relationship satisfaction, and male partner responses on sexual intercourse days (M=3.74, SD=2.47) over 8 weeks. Women also reported their depressive symptoms. Relationship satisfaction on the preceding day moderated the associations between partner responses and women's depressive symptoms in several significant ways: (1) On days after women reported higher relationship satisfaction than usual, their perception of greater facilitative male partner responses was associated with their decreased depression; (2) on days after women reported lower relationship satisfaction than usual, their perception of greater negative male partner responses was associated with their increased depression; (3) on days after men reported higher relationship satisfaction than usual, their self-reported higher negative responses were associated with decreased women's depression, and higher solicitous responses were associated with increased women's depression, whereas (4) on days after men reported lower relationship satisfaction than usual, their self-reported higher negative responses were related to increased women's depression, and higher solicitous responses were associated with decreased women's depression. Targeting partner responses and relationship satisfaction may enhance the quality of interventions aimed at reducing depression in women with vulvodynia.

The concept of mental toughness: tests of dimensionality, nomological network, and traitness

Mental toughness has received increased scholarly attention in recent years, yet conceptual issues related to its (a) dimensionality, (b) nomological network, and (c) traitness remain unresolved. The series of studies reported in this article were designed to examine these three substantive issues across several achievement contexts, including sport, education, military, and the workplace. Five studies were conducted to examine these research aims-Study 1: N = 30; Study 2: calibration sample (n = 418), tertiary students (n = 500), athletes (n = 427), and employees (n = 550); Study 3: N = 497 employees; Study 4: N = 203 tertiary students; Study 5: N = 115 army candidates. Collectively, the results of these studies revealed that mental toughness may be best conceptualized as a unidimensional rather than a multidimensional concept; plays an important role in performance, goal progress, and thriving despite stress; and can vary and have enduring properties across situations and time. This series of studies provides a foundation for further basic and applied research of mental toughness across various achievement contexts.

Differences in within- and between-person factor structure of positive and negative affect: analysis of two intensive measurement studies using multilevel structural equation modeling

The Positive and Negative Affect Schedule (PANAS) is a widely used measure of emotional experience. The factor structure of the PANAS has been examined predominantly with cross-sectional designs, which fails to disaggregate within-person variation from between-person differences. There is still uncertainty as to the factor structure of positive and negative affect and whether they constitute 2 distinct independent factors. The present study examined the within-person and between-person factor structure of the PANAS in 2 independent samples that reported daily affect over 7 and 14 occasions, respectively. Results from multilevel confirmatory factor analyses revealed that a 2-factor structure at both the within-person and between-person levels, with correlated specific factors for overlapping items, provided good model fit. The best-fitting solution was one where within-person factors of positive and negative affect were inversely correlated, but between-person factors were independent. The structure was further validated through multilevel structural equation modeling examining the effects of cognitive interference, daily stress, physical symptoms, and physical activity on positive and negative affect factors.

Differences in within- and between-person factor structure of positive and negative affect: analysis of two intensive measurement studies using multilevel structural equation modeling

The Positive and Negative Affect Schedule (PANAS) is a widely used measure of emotional experience. The factor structure of the PANAS has been examined predominantly with cross-sectional designs, which fails to disaggregate within-person variation from between-person differences. There is still uncertainty as to the factor structure of positive and negative affect and whether they constitute 2 distinct independent factors. The present study examined the within-person and between-person factor structure of the PANAS in 2 independent samples that reported daily affect over 7 and 14 occasions, respectively. Results from multilevel confirmatory factor analyses revealed that a 2-factor structure at both the within-person and between-person levels, with correlated specific factors for overlapping items, provided good model fit. The best-fitting solution was one where within-person factors of positive and negative affect were inversely correlated, but between-person factors were independent. The structure was further validated through multilevel structural equation modeling examining the effects of cognitive interference, daily stress, physical symptoms, and physical activity on positive and negative affect factors.