The self-reflection and insight scale: applying item response theory to craft an efficient short form

Reliability and validity of the Self-Reflection and Insight Scale for psychologists and the development and validation of the revised short version

Self-reflection is broadly considered a core competency for psychologists; however, there is an absence of measures of self-reflection, limiting the extent to which self-reflection can be assessed in both research and practice contexts. Whilst the Self-Reflection and Insight Scale (Grant et al., 2002) has been validated in a range of formats with different populations, it has not yet been validated with psychologists. Further, the psychometric properties of a short version of the scale (Silvia, 2021) have not been examined for use with psychologists. This study tested the factor structure, internal consistency and convergent and divergent validity of the Self-Reflection and Insight Scale with registered psychologists (N = 123), finding both the full scale and short version to have sound psychometrics. However, as there were low loading items across both versions of the measure, and the short version also excluded high-loading items, the SRIS-Revised (SRIS-R) was formed through model improvement, retaining a total of 14 items. This revised version of the scale captures high loading items without redundancy of low-loading items, resulting in a measure that parsimoniously captures the construct of self-reflection as relevant to psychologists. The SRIS-R demonstrated good internal consistency (α = .882), convergent, divergent and construct validity. Scores on the SRIS-R were used to test whether there was a correlation between self-reflection and years of professional registration, with this not being significant.

Application of Item Response Theory (IRT)-Graded Response Model (GRM) to Entrepreneurial Ecosystem Scale

The scale of entrepreneurial ecosystems (EE) assesses the perceptions about entrepreneurial ecosystem domains, finances, capital finances, support, support professions, policies, markets, human resources, and culture. The scales are always error-prone—these scales must possess properties that enable them it to provide maximum information and validity reliability. Convenient sampling data from (n = 474) founders, co-founders, and entrepreneurs were collected. The IRT-GRM model is used to validate and test the instrument-based on polytomous scales. IRT yields discriminating power—the level of difficulty of the items of the scale. The scale consists of 48 items. The item Pol5 (4.13) was found to have the highest discriminating value (4.13), the item mar5 had the lowest discriminating value (1.57), and all items had discriminating values greater than the threshold value of 0.60. The EE Scale showed good reliability based on McDonald’s omega and Cronbach’s alpha (0.80 and 0.88). The parallel and factor analysis showed good agreement of the one-dimesnionality of the scale. The model goodness of fit statistics based on the comparative fit index (CFI) and the Tucker–Lewis index, (TLI) and the standardized root mean square residual (SRMR) showed a satisfactory level of fit; however, the root mean square error of approximation (RMSE) showed a poor fit. The item characteristic curves showed that the all item responses were properly ordered. The items of the scale showed a satisfactory level of discrimination power and level of difficulty, and it was found to have three levels of agreement about entrepreneurial ecosystem scale. It is concluded that the EE scale possesses good psychometric properties and that it is reliable and valid instrument to measure the entrepreneurial ecosystem of the given region.

An Item Response Theory to Analyze the Psychological Impacts of Rail-Transport Delay

Questionnaire instruments have been used extensively by researchers in the literature review for evaluation of various aspects of public transportation. Important implications have been derived from those instruments to improve various aspects of the transport. However, it is important that instruments, which are designed to measure various stimuli, meet criteria of reliability to reflect a real impact of the stressors. Particularly, given the diverse range of commuter characteristics considered in this study, it is necessary to ensure that instruments are reliable and accurate. This can be achieved by finding the relationship between the item’s properties and the underlying unobserved trait, being measured. The item response theory (IRT) refers to measurement of an instrument’s reliability by examining the relationship between the unobserved trait and various observed items. In this study, to determine if our instrument suffers from any potentially associated problems, the IRT analysis was conducted. The analysis was employed based on the graded response model (GRM) due to the ordinal nature of the data. Various aspects of the instruments, such as discriminability and informativity of the items were tested. For instance, it was found while the classical test theory (CTT) confirm the reliability of the instrument, IRT highlight some concerns regarding the instrument. Also, the person fit assessment measure, for instance, highlights some concern regarding respondents answering some of the questions due to lack of interest, choosing answers randomly. Not many studies have examined instruments’ reliability in determining the psychological impacts of public transportation on commuters in the way that was performed here.