Modeling differences in the dimensionality of multiblock data by means of clusterwise simultaneous component analysis

Detecting which variables alter component interpretation across multiple groups: A resampling-based method

In psychology, many studies measure the same variables in different groups. In the case of a large number of variables when a strong a priori idea about the underlying latent construct is lacking, researchers often start by reducing the variables to a few principal components in an exploratory way. Herewith, one often wants to evaluate whether the components represent the same construct in the different groups. To this end, it makes sense to remove outlying variables that have significantly different loadings on the extracted components across the groups, hampering equivalent interpretations of the components. Moreover, identifying such outlying variables is important when testing theories about which variables behave similarly or differently across groups. In this article, we first scrutinize the lower bound congruence method (LBCM; De Roover, Timmerman, & Ceulemans in Behavior Research Methods, 49, 216-229, 2017), which was recently proposed for solving the outlying-variable detection problem. LBCM investigates how Tucker's congruence between the loadings of the obtained cluster-loading matrices improves when specific variables are discarded. We show that LBCM has the tendency to output outlying variables that either are false positives or concern very small, and thus practically insignificant, loading differences. To address this issue, we present a new heuristic: the lower and resampled upper bound congruence method (LRUBCM). This method uses a resampling technique to obtain a sampling distribution for the congruence coefficient, under the hypothesis that no outlying variable is present. In a simulation study, we show that LRUBCM outperforms LBCM. Finally, we illustrate the use of the method by means of empirical data.

Personalized Models of Psychopathology

The personalized approach to psychopathology conceptualizes mental disorder as a complex system of contextualized dynamic processes that is nontrivially specific to each individual, and it seeks to develop formal idiographic statistical models to represent these individual processes. Although the personalized approach draws on long-standing influences in clinical psychology, there has been an explosion of research in recent years following the development of intensive longitudinal data capture and statistical techniques that facilitate modeling of the dynamic processes of each individual's pathology. Advances are also making idiographic analyses scalable and generalizable. We review emerging research using the personalized approach in descriptive psychopathology, precision assessment, and treatment selection and tailoring, and we identify future challenges and areas in need of additional research. The personalized approach to psychopathology holds promise to resolve thorny diagnostic issues, generate novel insights, and improve the timing and efficacy of interventions.

Improved Insight into and Prediction of Network Dynamics by Combining VAR and Dimension Reduction

To understand within-person psychological processes, one may fit VAR(1) models (or continuous-time variants thereof) to multivariate time series and display the VAR(1) coefficients as a network. This approach has two major problems. First, the contemporaneous correlations between the variables will frequently be substantial, yielding multicollinearity issues. In addition, the shared effects of the variables are not included in the network. Consequently, VAR(1) networks can be hard to interpret. Second, crossvalidation results show that the highly parametrized VAR(1) model is prone to overfitting. In this article, we compare the pros and cons of two potential solutions to both problems. The first is to impose a lasso penalty on the VAR(1) coefficients, setting some of them to zero. The second, which has not yet been pursued in psychological network analysis, uses principal component VAR(1) (termed PC-VAR(1)). In this approach, the variables are first reduced to a few principal components, which are rotated toward simple structure; then VAR(1) analysis (or a continuous-time analog) is applied to the rotated components. Reanalyzing the data of a single participant of the COGITO study, we show that PC-VAR(1) has the better predictive performance and that networks based on PC-VAR(1) clearly represent both the lagged and the contemporaneous variable relations.

Simultaneous Component Analysis by Means of Tucker3

A new model for simultaneous component analysis (SCA) is introduced that contains the existing SCA models with common loading matrix as special cases. The new SCA-T3 model is a multi-set generalization of the Tucker3 model for component analysis of three-way data. For each mode (observational units, variables, sets) a different number of components can be chosen and the obtained solution can be rotated without loss of fit to facilitate interpretation. SCA-T3 can be fitted on centered multi-set data and also on the corresponding covariance matrices. For this purpose, alternating least squares algorithms are derived. SCA-T3 is evaluated in a simulation study, and its practical merits are demonstrated for several benchmark datasets.

KSC-N: Clustering of Hierarchical Time Profile Data

Quite a few studies in the behavioral sciences result in hierarchical time profile data, with a number of time profiles being measured for each person under study. Associated research questions often focus on individual differences in profile repertoire, that is, differences between persons in the number and the nature of profile shapes that show up for each person. In this paper, we introduce a new method, called KSC-N, that parsimoniously captures such differences while neatly disentangling variability in shape and amplitude. KSC-N induces a few person clusters from the data and derives for each person cluster the types of profile shape that occur most for the persons in that cluster. An algorithm for fitting KSC-N is proposed and evaluated in a simulation study. Finally, the new method is applied to emotional intensity profile data.

What's hampering measurement invariance: detecting non-invariant items using clusterwise simultaneous component analysis

The issue of measurement invariance is ubiquitous in the behavioral sciences nowadays as more and more studies yield multivariate multigroup data. When measurement invariance cannot be established across groups, this is often due to different loadings on only a few items. Within the multigroup CFA framework, methods have been proposed to trace such non-invariant items, but these methods have some disadvantages in that they require researchers to run a multitude of analyses and in that they imply assumptions that are often questionable. In this paper, we propose an alternative strategy which builds on clusterwise simultaneous component analysis (SCA). Clusterwise SCA, being an exploratory technique, assigns the groups under study to a few clusters based on differences and similarities in the component structure of the items, and thus based on the covariance matrices. Non-invariant items can then be traced by comparing the cluster-specific component loadings via congruence coefficients, which is far more parsimonious than comparing the component structure of all separate groups. In this paper we present a heuristic for this procedure. Afterwards, one can return to the multigroup CFA framework and check whether removing the non-invariant items or removing some of the equality restrictions for these items, yields satisfactory invariance test results. An empirical application concerning cross-cultural emotion data is used to demonstrate that this novel approach is useful and can co-exist with the traditional CFA approaches.

Common and cluster-specific simultaneous component analysis

In many fields of research, so-called 'multiblock' data are collected, i.e., data containing multivariate observations that are nested within higher-level research units (e.g., inhabitants of different countries). Each higher-level unit (e.g., country) then corresponds to a 'data block'. For such data, it may be interesting to investigate the extent to which the correlation structure of the variables differs between the data blocks. More specifically, when capturing the correlation structure by means of component analysis, one may want to explore which components are common across all data blocks and which components differ across the data blocks. This paper presents a common and cluster-specific simultaneous component method which clusters the data blocks according to their correlation structure and allows for common and cluster-specific components. Model estimation and model selection procedures are described and simulation results validate their performance. Also, the method is applied to data from cross-cultural values research to illustrate its empirical value.