Investigating the Dimensionality of Early Numeracy Using the Bifactor Exploratory Structural Equation Modeling Framework

HBMIRT: A SAS macro for estimating uni- and multidimensional 1- and 2-parameter item response models in small (and large!) samples

Item response theory (IRT) has evolved as a standard psychometric approach in recent years, in particular for test construction based on dichotomous (i.e., true/false) items. Unfortunately, large samples are typically needed for item refinement in unidimensional models and even more so in the multidimensional case. However, Bayesian IRT approaches with hierarchical priors have recently been shown to be promising for estimating even complex models in small samples. Still, it may be challenging for applied researchers to set up such IRT models in general purpose or specialized statistical computer programs. Therefore, we developed a user-friendly tool - a SAS macro called HBMIRT - that allows to estimate uni- and multidimensional IRT models with dichotomous items. We explain the capabilities and features of the macro and demonstrate the particular advantages of the implemented hierarchical priors in rather small samples over weakly informative priors and traditional maximum likelihood estimation with the help of a simulation study. The macro can also be used with the online version of SAS OnDemand for Academics that is freely accessible for academic researchers.

Empirical development and verification of career well-being scale for teachers in Taiwan: Implications for workplace counseling

As it is one decade since the establishment of Kidd's model, an analysis of the career well-being (CWB) experienced by Eastern workers is both timely and necessary. To this end, we conducted a series of logical investigations of CWB in Taiwanese school teachers. Study 1 was conducted to conceptualize the main features of CWB (n = 135), and Study 2 was conducted using exploratory factor analysis to determine the validity of a four-factor measurement structure (n = 191). In Study 3, tests were completed to confirm the factor structure of the CWB (n = 533). Accordingly, we established a theory-based CWB measurement approach, and statistical analysis verified the convergent, divergent, and criterion validity of our CWB measurement model. Exploratory structural equation modeling rather than confirmatory factor analysis is recommended in discussions of CWB theory and practice in educational contexts. However, because our sample solely comprised Taiwanese teachers, our results are not generalizable to other occupations or cultures, even Eastern or Chinese-derived cultures. Implications for both theory and workplace counseling practice are presented.

The development and preliminary validation of a brief scale of emotional distress in young people using combined classical test theory and item response theory approaches: The Brief Emotional Distress Scale for Youth (BEDSY)

Reliable, valid, and brief measures are important for identifying young people in community contexts who experience mental health problems. This paper reports the development and preliminary validation of the Brief Emotional Distress Scale for Youth (BEDSY), a measure based on anxiety and depression symptoms that load strongly upon the general construct of emotional distress. Participants, aged 11-17 years, included 2663 from a community population and 281 referred anxious youth. From a pool of 20 items, eight were selected for the final scale using methods from classical test theory, followed by item response theory (IRT). The final eight items met the pre-specified criteria for skewness and kurtosis, item-total correlations, IRT characteristics, and discrimination between referred vs. community samples. Exploratory structural equation modeling for a bi-factor model indicated that 81% of total variance was explained by the general emotional distress factor. The 8-item BEDSY showed strong internal consistency, good construct validity, and acceptable sensitivity and specificity in discriminating between a community sample vs anxious youth, and between youth with and without high levels of depressive symptoms. As such the scale has strong potential as a brief screen for identifying emotionally distressed young people in community contexts.