Comparing community detection algorithms in psychometric networks: A Monte Carlo simulation

Comparing the Clique Percolation algorithm to other overlapping community detection algorithms in psychological networks: A Monte Carlo simulation study

In psychological networks, one limitation of the most used community detection algorithms is that they can only assign each node (symptom) to a unique community, without being able to identify overlapping symptoms. The clique percolation (CP) is an algorithm that identifies overlapping symptoms but its performance has not been evaluated in psychological networks. In this study, we compare the CP with model parameters chosen based on fuzzy modularity (CPMod) with two other alternatives, the ratio of the two largest communities (CPRat), and entropy (CPEnt). We evaluate their performance to: (1) identify the correct number of latent factors (i.e., communities); and (2) identify the observed variables with substantive (and equally sized) cross-loadings (i.e., overlapping symptoms). We carried out simulations under 972 conditions (3x2x2x3x3x3x3): (1) data categories (continuous, polytomous and dichotomous); (2) number of factors (two and four); (3) number of observed variables per factor (four and eight); (4) factor correlations (0.0, 0.5, and 0.7); (5) size of primary factor loadings (0.40, 0.55, and 0.70); (6) proportion of observed variables with substantive cross-loadings (0.0%, 12.5%, and 25.0%); and (7) sample size (300, 500, and 1000). Performance was evaluated through the Omega index, Mean Bias Error (MBE), Mean Absolute Error (MAE), sensitivity, specificity, and mean number of isolated nodes. We also evaluated two other methods, Exploratory Factor Analysis and the Walktrap algorithm modified to consider overlap (EFA-Ov and Walk-Ov, respectively). The Walk-Ov displayed the best performance across most conditions and is the recommended option to identify communities with overlapping symptoms in psychological networks.

Revisiting the Structure of the Chinese Version of the Questionnaire of Cognitive and Affective Empathy and Its Relationships with Schizotypy and Paranoia Using Network Approaches

Empathy is predominantly assessed with self-report questionnaires. However, their structural validities were not well-supported. This study aimed to re-explore and refine the factor structure of the Chinese version of the Questionnaire of Cognitive and Affective Empathy (QCAE) and investigate the pathways linked between dimensions of empathy and schizotypy. Data from a valid sample of 1,360 community-dwelling adults (aged 18-35) were subjected to the exploratory graph analysis (EGA) and bootstrap EGA for factor retention. A goodness-of-fit evaluation was conducted using confirmatory factor analysis (CFA). Lastly, a Gaussian graphical model with sum scores of the resultant empathy dimensions, positive, negative, and disorganized schizotypy, and paranoia as nodes was estimated. Results supported a three-factor structure for the revised 20-item QCAE, demonstrating a good model fit. The new Online simulation subscale was associated with reduced disorganized schizotypy, whereas the new Perspective-taking subscale was associated with decreased disorganized schizotypy and increased positive schizotypy. The composite Affective empathy subscale was associated with decreased negative schizotypy and increased positive and disorganized schizotypy and paranoia. Overall, the revised QCAE demonstrated good structural validity, measuring three separable and internally cohesive factors of empathy. Each factor possessed unique and differential relationships with schizotypy dimensions that merit research and clinical attention.

Dimensionality assessment in the presence of wording effects: A network psychometric and factorial approach

This study proposes a procedure for substantive dimensionality estimation in the presence of wording effects, the inconsistent response to regular and reversed self-report items. The procedure developed consists of subtracting an approximate estimate of the wording effects variance from the sample correlation matrix and then estimating the substantive dimensionality on the residual correlation matrix. This is achieved by estimating a random intercept factor with unit loadings for all the regular and unrecoded reversed items. The accuracy of the procedure was evaluated through an extensive simulation study that manipulated nine relevant variables and employed the exploratory graph analysis (EGA) and parallel analysis (PA) retention methods. The results indicated that combining the proposed procedure with EGA or PA achieved high accuracy in estimating the substantive latent dimensionality, but that EGA was superior. Additionally, the present findings shed light on the complex ways that wording effects impact the dimensionality estimates when the response bias in the data is ignored. A tutorial on substantive dimensionality estimation with the R package EGAnet is offered, as well as practical guidelines for applied researchers.

Speech-Gesture Matching and Schizotypal Traits: A Network Approach

BACKGROUND AND HYPOTHESIS

Impaired speech-gesture matching has repeatedly been shown in patients with schizophrenia spectrum disorders. Here, we tested the hypothesis that schizotypal traits in the general population are related to reduced speech-gesture matching performance and reduced self-reports about gesture perception. We further explored the relationships between facets of schizotypy and gesture processing in a network model.

STUDY DESIGN

Participants (1094 mainly healthy adults) were presented with concrete or abstract sentences accompanied with videos showing related or unrelated gestures. For each video, participants evaluated the alignment between speech and gesture. They also completed self-rating scales about the perception and production of gestures (Brief Assessment of Gesture scale) and schizotypal traits (Schizotypal Personality Questionnaire-Brief 22-item version). We analyzed bivariate associations and estimated a non-regularized partial Spearman correlation network. We characterized the network by analyzing bridge centrality and controllability metrics of nodes.

STUDY RESULTS

We found a negative relationship between both concrete and abstract gesture-speech matching performance and overall schizotypy. In the network, disorganization had the highest average controllability and it was negatively related to abstract speech-gesture matching. Bridge centralities indicated that self-reported production of gestures to enhance communication in social interactions connects self-reported gesture perception, schizotypal traits, and gesture processing task performance.

CONCLUSION

The association between impaired abstract speech-gesture matching and disorganization supports a continuum between schizophrenia and schizotypy. Using gestures to facilitate communication connects subjective and objective aspects of gesture processing and schizotypal traits. Future interventional studies in patients should test the potential causal pathways implied by this network model.

New Psychometric Evidence of the Grief Impairment Scale (GIS) in People Who Have Experienced the Death of a Loved One From a Network Psychometric Approach in Two Latin American Countries

This study aimed to evaluate the psychometric properties of the Grief Impairment Scale (GIS) using a network psychometric model. A total of 1048 individuals from Peru and El Salvador participated. A network psychometric model was used to determine internal structure, reliability, and cross-country invariance. The results indicate that the GIS items were grouped into a single network structure through Exploratory Graph Analysis. Reliability was estimated by structural consistency, and it was found that when replicating the network structure within an empirical dimension, a single network structure was consistently obtained, and all items remained stable. Furthermore, the network structure was invariant, thus functioning similarly across the different country groups. In conclusion, the GIS presented solid psychometric evidence of validity based on its internal structure, reliability, and cross-country invariance. Therefore, the GIS is a psychometrically sound measure of functional impairment symptoms due to grief for Peruvian and Salvadoran individuals.

Burnout and depression in college students

Research on burnout has garnered considerable attention since its inception. However, the ongoing debate persists regarding the conceptual model of burnout and its relationship with depression. Thus, we conducted a network analysis to determine the dimensional structure of burnout and the burnout-depression overlap. The Maslach Burnout Inventory-Student Survey and Patient Health Questionnaire-9 were used to measure burnout and depression among 1096 college students. We constructed networks for burnout, depression, and a burnout-depression co-occurrence network. The results showed that cynicism symptom was the most central to the burnout network. In the co-occurrence network, depressive symptoms ("anhedonia", "fatigue") and burnout symptom ("doubting the significance of studies") were the most significant in causing burnout-depression comorbidity. Community detection revealed three communities within burnout symptoms, aligning closely with their three dimensions identified through factor analysis. Additionally, there was no overlap between burnout and depression. In conclusion, our findings support a multidimensional structure of burnout, affirming it as a distinct concept separate from depression. Cynicism, rather than exhaustion, plays the most important role in burnout and the burnout-depression comorbidity.

A network approach to subjective cognitive decline: Exploring multivariate relationships in neuropsychological test performance across Alzheimer's disease risk states

Subjective cognitive decline (SCD) is characterized by subjective concerns of cognitive change despite test performance within normal range. Although those with SCD are at higher risk for developing further cognitive decline, we still lack methods using objective cognitive measures that reliably distinguish SCD from cognitively normal aging at the group level. Network analysis may help to address this by modeling cognitive performance as a web of intertwined cognitive abilities, providing insight into the multivariate associations determining cognitive status. Following previous network studies of mild cognitive impairment (MCI) and Alzheimer's dementia (AD), the current study centered upon the novel visualization and analysis of the SCD cognitive network compared to cognitively normal (CN) older adult, MCI, and AD group networks. Cross-sectional neuropsychological data from CIMA-Q and COMPASS-ND cohorts were used to construct Gaussian graphical models for CN (n = 122), SCD (n = 207), MCI (n = 210), and AD (n = 79) groups. Group networks were explored in terms of global network structure, prominent edge weights, and strength centrality indices. CN and SCD group networks were contrasted using the Network Comparison Test. Results indicate that CN and SCD groups did not differ in univariate cognitive performance or global network structure. However, measures of strength centrality, principally in executive functioning and processing speed, showed a CN-SCD-MCI gradient where subtle differences within the SCD network suggest that SCD is an intermediary between CN and MCI stages. Additional results may indicate a distinctiveness of network structure in AD, a reversal in network influence between age and general cognitive status as clinical impairment increases, and potential evidence for cognitive reserve. Together, these results provide evidence that network-specific metrics are sensitive to cognitive performance changes across the dementia risk spectrum and can help to objectively distinguish SCD group cognitive performance from that of the CN group.

Development and validation of an 8-item version of the Real Relationship Inventory-Client form

OBJECTIVE

To develop and validate a very brief version of the 24-item Real Relationship Inventory-Client (RRI-C) form.

METHOD

Two independent samples of individual psychotherapy patients (Nsample1 = 700, Nsample2 = 434) completed the RRI-C along with other measures. Psychometric scale shortening involved exploratory factor analysis, item response theory analysis, confirmatory factor analysis (CFA), and multigroup CFA. Reliability and convergent and discriminant validity of the scale and subscales were also assessed.

RESULTS

The 8-item RRI-C (RRI-C-SF) preserves the two-factor structure: Genuineness (k = 4, α = .86) and Realism (k = 4, α = .87), which were correlated at r = .74. CFA provided the following fit indices for the bifactor model: X2/df = 2.16, CFI = .99, TLI = .96, RMSEA = .07, and SRMR = .03. Multigroup CFA showed that the RRI-C-SF was invariant across in-person and remote session formats. The RRI-C-SF demonstrated high reliability (α = .91); high correlation with the full-length scale (r = .96); and excellent convergent and discriminant validity with measures of other elements of the therapeutic relationship, personality characteristics, current mental health state, and demographic-clinical variables. Clinical change benchmarks were calculated to serve as valuable tools for both research and clinical practice.

CONCLUSION

The RRI-C-SF is a reliable measure that can be used for both research and clinical purposes. It enables a nuanced assessment of the genuineness and the realism dimensions of the real relationship.

Improving the Walktrap Algorithm Using K-Means Clustering

The walktrap algorithm is one of the most popular community-detection methods in psychological research. Several simulation studies have shown that it is often effective at determining the correct number of communities and assigning items to their proper community. Nevertheless, it is important to recognize that the walktrap algorithm relies on hierarchical clustering because it was originally developed for networks much larger than those encountered in psychological research. In this paper, we present and demonstrate a computational alternative to the hierarchical algorithm that is conceptually easier to understand. More importantly, we show that better solutions to the sum-of-squares optimization problem that is heuristically tackled by hierarchical clustering in the walktrap algorithm can often be obtained using exact or approximate methods for K-means clustering. Three simulation studies and analyses of empirical networks were completed to assess the impact of better sum-of-squares solutions.

Aesthetic emotions are affected by context: a psychometric network analysis

Aesthetic emotions are defined as emotions arising when a person evaluates a stimulus for its aesthetic appeal. Whether these emotions are unique to aesthetic activities is debated. We address this debate by examining if recollections of different types of engaging activities entail different emotional profiles. A large sample of participants were asked to recall engaging aesthetic (N = 167), non-aesthetic (N = 160), or consumer (N = 172) activities. They rated the extent to which 75 candidate aesthetic emotions were evoked by these activities. We applied a computational psychometric network approach to represent and compare the space of these emotions across the three conditions. At the behavioral level, recalled aesthetic activities were rated as the least vivid but most intense compared to the two other conditions. At the network level, we found several quantitative differences across the three conditions, related to the typology, community (clusters) and core nodes (emotions) of these networks. Our results suggest that aesthetic and non-aesthetic activities evoke emotional spaces differently. Thus, we propose that aesthetic emotions are distributed differently in a multidimensional aesthetic space than for other engaging activities. Our results highlight the context-specificity of aesthetic emotions.