The Australian Sheep-Goat Scale: An Evaluation of Factor Structure and Convergent Validity

Re-evaluation of the relationship between paranormal belief and perceived stress using statistical modelling

Recent research indicates that paranormal belief, in the absence of allied cognitive-perceptual and psychopathology-related factors, is not associated with negative wellbeing outcomes. However, investigators have historically reported relationships between specific facets of belief (e.g., superstition) and stress vulnerability. These typically derive from the Revised Paranormal Belief Scale (RPBS), which has questionable psychometric integrity. The main issue being that several RPBS items perform poorly. Noting this, the present paper re-examined the relationship between paranormal belief and stress using the Rasch purified version of the RPBS. This comprises two dimensions, called Traditional Paranormal Belief (TPB) and New Age Philosophy (NAP). These are operationalised in terms of function. Specifically, whether belief provides a sense of control at the social (TPB) or individual level (NAP). Accordingly, this study examined whether TPB and NAP were differentially predictive of levels of perceived stress. In this context, stress served as an indicator of well-being. A sample of 3084 participants (Mage = 50.31, SD = 15.20, range 18-91) completed the RPBS alongside the 10-item Perceived Stress Scale (PSS-10). Confirmatory factor analysis and structural equation modelling revealed that TPB was significantly predictive of higher Distress, and lower Coping. NAP was neither predictive of Distress nor Coping. These findings support the notion that TPB is attendant with external control, particularly the notion that unknown supernatural forces/powers influence existence.

The Illusory Health Beliefs Scale: preliminary validation using exploratory factor and Rasch analysis

Illusory health beliefs are ill-founded, erroneous notions about well-being. They are important as they can influence allied attitudes, actions, and behaviors to the detriment of personal and societal welfare. Noting this, and the prevalence of paranormal beliefs in contemporary Western society, researchers developed the Paranormal Health Beliefs Scale (PHBS). Modification of the PHBS for use with a United Kingdom-based sample resulted in the instrument broadening to incorporate illusory rather than merely paranormal health beliefs. The present study psychometrically assessed the emergent Illusory Health Beliefs Scale (IHBS). The principal objective was to validate the IHBS using a large, representative sample. Eight hundred and fifty participants (360 males, 482 females, eight non-binary) completed the IHBS alongside instruments assessing theoretically associated constructs (i.e., magical thinking, faith in scientifically unsubstantiated notions, and forms of self-referential, intuitive causation). Exploratory factor analysis revealed the existence of six meaningful IHBS dimensions: Religious/Spiritual, Superstition, Precognitive, Health Myths, Skepticism, and Health Pseudoscience. The IHBS demonstrated satisfactory reliability and convergent validity with theoretically aligned constructs. Rasch analysis at the subscale level revealed good item/person fit and item/person reliability, unidimensionality, and equivalency of items across subgroups (gender and religious affiliation). Analysis confirmed the IHBS was an effective measure of illusory health beliefs. However, researchers should undertake further work to refine the scale and evaluate its performance across different samples and time points.

The paranormal health beliefs scale: an evaluation using cognitive interviewing

Paranormal health beliefs denote the inclination to endorse illusory supernatural notions about well-being and treatment. These ideations are important since they potentially influence perceptions of health and allied behaviors. Noting this, researchers in Italy developed and verified the Paranormal Health Beliefs Scale (PHBS). Despite initial promising outcomes, the construct and measurement properties of the PHBS have remained under investigated. This is likely due to the fact that the instrument draws heavily on traditional Italian social, political, and religious influences and is overly culturally specific. Hence, items do not generalize well across populations and nationalities. Acknowledging these factors, this study used cognitive interviewing (think aloud protocol and concurrent probing) to assess the suitability of the PHBS for general use. Concurrently, the intention was to identify necessary modifications that would enhance scale performance. Fourteen interviewees (eight males and six females), evenly distributed across two rounds, participated. Round 1 focused on comprehension and perception of the PHBS. Cognitive interviews identified issues with culturally particular content/points of reference, phraseology, and wording. To address these a modified version of the PHBS was produced. Round 2 then examined the effectiveness of changes. Analysis revealed fewer concerns, although difficulties with ambiguity, complex terminology, and response scale appropriateness persisted. Overall, interviews indicated that a focus on illusory (rather than paranormal) health beliefs would improve scale utility. Methodologically, cognitive interviewing provided invaluable insights into the effectiveness of the PHBS and identified ways in which researchers could adapt the instrument for use with other cultures.

Longitudinal assessment of the temporal stability and predictive validity of the Revised Paranormal Belief Scale

The Revised Paranormal Belief Scale (RPBS) is the prevailing measure of supernatural credence. However, there exists only limited evidence to support the temporal stability and predictive validity of the instrument over time. Acknowledging this, the present study assessed the test-retest reliability of the RPBS using a large, heterogeneous sample across multiple trials. In addition, predictive validity was tested using a longitudinal statistical model, which focused on allied health outcomes (Perceived Stress and Somatic Complaints). A sample of 1,665 (M _age = 54.40, 853 females, 804 males, five non-binary and three not disclosing of gender) completed study measures at three time points separated by 2 month intervals. Prior to assessing temporal stability, assessment of structural validity and longitudinal invariance occurred. Test-retest reliability of the RPBS was in the moderate to high range across time intervals, and good internal consistency was observed. Furthermore, satisfactory stability coefficients existed for RPBS subfactors. Data-model fit for the predictive model was acceptable. Belief in the paranormal explained low variance over time in Perceived Stress and Somatic Complaints (between 2.4 and 4.2%). Findings supported the stability and reliability of the RPBS. In addition, they aligned with the notion that paranormal belief in the absence of high scores on cognitive-perceptual factors (e.g. transliminality and schizotypy), has a benign influence on perceived health.

Paranormal belief and well-being: The moderating roles of transliminality and psychopathology-related facets

Evaluation of prior research suggests that belief in the paranormal is more likely to be associated with negative psychological functioning, when presented alongside cognitive-perceptual factors that askew thinking and insight. The current study examined this notion using a sample of 3,084 participants (1,382 males, 1,693 females, nine non-binary). Respondents completed self-report measures assessing Paranormal Belief, Transliminality, psychopathology-related characteristics (Schizotypy and Manic-Depressive Experience), and well-being (Perceived Stress and Somatic Complaints). Responses were analysed via correlations and moderation. Paranormal Belief correlated positively with Transliminality, psychopathology-related measures, Perceived Stress, and Somatic Complaints. Moderation analyses revealed that Transliminality and psychopathology-related variables (i.e., the Unusual Experiences and Cognitive Disorganisation subscales of schizotypy, and Manic-Depressive Experience) interacted with Paranormal Belief in complex ways and were allied to higher scores on negative well-being outcomes. This indicated that within paranormal believers, Transliminality and specific psychopathology-related variables in combination predicted susceptibility to negative well-being outcomes.

Paranormal beliefs and cognitive function: A systematic review and assessment of study quality across four decades of research

BACKGROUND

Research into paranormal beliefs and cognitive functioning has expanded considerably since the last review almost 30 years ago, prompting the need for a comprehensive review. The current systematic review aims to identify the reported associations between paranormal beliefs and cognitive functioning, and to assess study quality.

METHOD

We searched four databases (Scopus, ScienceDirect, SpringerLink, and OpenGrey) from inception until May 2021. Inclusion criteria comprised papers published in English that contained original data assessing paranormal beliefs and cognitive function in healthy adult samples. Study quality and risk of bias was assessed using the Appraisal tool for Cross-Sectional Studies (AXIS) and results were synthesised through narrative review. The review adhered to the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines and was preregistered as part of a larger registration on the Open Science Framework (https://osf.io/uzm5v).

RESULTS

From 475 identified studies, 71 (n = 20,993) met our inclusion criteria. Studies were subsequently divided into the following six categories: perceptual and cognitive biases (k = 19, n = 3,397), reasoning (k = 17, n = 9,661), intelligence, critical thinking, and academic ability (k = 12, n = 2,657), thinking style (k = 13, n = 4,100), executive function and memory (k = 6, n = 810), and other cognitive functions (k = 4, n = 368). Study quality was rated as good-to-strong for 75% of studies and appears to be improving across time. Nonetheless, we identified areas of methodological weakness including: the lack of preregistration, discussion of limitations, a-priori justification of sample size, assessment of nonrespondents, and the failure to adjust for multiple testing. Over 60% of studies have recruited undergraduates and 30% exclusively psychology undergraduates, which raises doubt about external validity. Our narrative synthesis indicates high heterogeneity of study findings. The most consistent associations emerge for paranormal beliefs with increased intuitive thinking and confirmatory bias, and reduced conditional reasoning ability and perception of randomness.

CONCLUSIONS

Although study quality is good, areas of methodological weakness exist. In addressing these methodological issues, we propose that authors engage with preregistration of data collection and analysis procedures. At a conceptual level, we argue poorer cognitive performance across seemingly disparate cognitive domains might reflect the influence of an over-arching executive dysfunction.

Self-Ascribed Paranormal Ability: Reflexive Thematic Analysis

This study investigated personal perceptions (involvements) and comprehensions (interpretations) of self-ascribed paranormal abilities. Twelve participants with supposed supernatural powers took part in semi-structured interviews exploring the origin, phenomenology, and nature of their powers. Interview transcripts were analysed using reflexive thematic analysis (RTA), a qualitative method that identifies patterns within data. Four major themes expressed meanings and representations held by participants: Formative Influences (sub-themes: Gifted Family Members and Anomalous Occurrence), (Inter) Subjective Paranormal Experience (sub-themes: Transcendental/Mystic and Extra-Sensory Perception), Embodied Processes (sub-theme: Control), and Perception of Reality (two sub-themes: Self-Awareness and Fantastic/Surreal Perceptions). Consideration of themes identified an inextricable link between perception, interpretation, and belief in ability. Within narratives, interviewees outlined, contextualised, and established the validity of their powers. They drew upon supporting autobiographical evidence from their life histories and obfuscated and/or discounted conventional explanations. Generally, accounts reflected individual attempts to comprehend and justify the nature and experience of professed abilities. The authors discuss these processes and suggest ways to extend and develop ensuing research.

Paranormal Experience Profiles and Their Association With Variations in Executive Functions: A Latent Profile Analysis

This study investigated relationships between inter-class variations in paranormal experience and executive functions. A sample of 516 adults completed self-report measures assessing personal encounter-based paranormal occurrences (i.e., Experience, Practitioner Visiting, and Ability), executive functions (i.e., General Executive Function, Working and Everyday Memory, and Decision Making) together with Emotion Regulation and Belief in the Paranormal. Paranormal belief served as a measure of convergent validity for experience-based phenomena. Latent profile analysis (LPA) combined experience-based indices into four classes based on sample subpopulation scores. Multivariate analysis of variance (MANOVA) then examined interclass differences. Results revealed that breadth of paranormal experience was associated with higher levels of executive functioning difficulties for General Executive Function, Working Memory, Decision Making, and Belief in the Paranormal. On the Everyday Memory Questionnaire, scores differed on Attention Tracking (focus loss) and Factor 3 (visual reconstruction), but not Retrieval (distinct memory failure). In the case of the Emotion Regulation Scale, class scores varied on Expressive Suppression (control), however, no difference was evident on Cognitive Reappraisal (reframing). Overall, inter-class comparisons identified subtle differences in executive functions related to experience. Since the present study was exploratory, sampled only a limited subset of executive functions, and used subjective, self-report measures, further research is necessary to confirm these outcomes. This should employ objective tests and include a broader range of executive functions.

Paranormal Belief, Thinking Style and Delusion Formation: A Latent Profile Analysis of Within-Individual Variations in Experience-Based Paranormal Facets

This study examined the degree to which within-individual variations in paranormal experience were related to belief in the paranormal, preferential thinking style, and delusion formation. A sample of 956 non-clinical adults completed measures assessing experience-based paranormal indices (i.e., paranormal experience, paranormal practitioner visiting, and paranormal ability), paranormal belief, belief in science, proneness to reality testing deficits, and emotion-based reasoning. Latent profile analysis (LPA) combined the experience-based indices to produce six underlying groups. Inter-class comparison via multivariate analysis of variance (MANOVA) indicated that both breadth and intensity of experiential factors were associated with higher belief in in the paranormal, increased proneness to reality testing deficits, and greater emotion-based reasoning. Belief in science, however, was less susceptible to experiential variations. Further analysis of reality testing subscales revealed that experiential profiles influenced levels of intrapsychic activity in subtle and intricate ways, especially those indexing Auditory and Visual Hallucinations and Delusional Thinking. Collectively, identification of profiles and inter-class comparisons provided a sophisticated understanding of the relative contribution of experiential factors to differences in paranormal belief, belief in science, proneness to reality testing deficits, and emotion-based reasoning.

Development of the Paranormal and Supernatural Beliefs Scale using classical and modern test theory

Background

This study describes the construction and validation of a new scale for measuring belief in paranormal phenomena. The work aims to address psychometric and conceptual shortcomings associated with existing measures of paranormal belief. The study also compares the use of classic test theory and modern test theory as methods for scale development.

Method

We combined novel items and amended items taken from existing scales, to produce an initial corpus of 29 items. Two hundred and thirty-one adult participants rated their level of agreement with each item using a seven-point Likert scale.

Results

Classical test theory methods (including exploratory factor analysis and principal components analysis) reduced the scale to 14 items and one overarching factor: Supernatural Beliefs. The factor demonstrated high internal reliability, with an excellent test–retest reliability for the total scale. Modern test theory methods (Rasch analysis using a rating scale model) reduced the scale to 13 items with a four-point response format. The Rasch scale was found to be most effective at differentiating between individuals with moderate-high levels of paranormal beliefs, and differential item functioning analysis indicated that the Rasch scale represents a valid measure of belief in paranormal phenomena.

Conclusions

The scale developed using modern test theory is identified as the final scale as this model allowed for in-depth analyses and refinement of the scale that was not possible using classical test theory. Results support the psychometric reliability of this new scale for assessing belief in paranormal phenomena, particularly when differentiating between individuals with higher levels of belief.

Supplementary Information

The online version contains supplementary material available at 10.1186/s40359-021-00600-y.

Differences in Cognitive-Perceptual Factors Arising From Variations in Self-Professed Paranormal Ability

This study examined whether scores on indices related to subclinical delusion formation and thinking style varied as a function of level of self-professed paranormal ability. To assess this, the researchers compared three groups differing in personal ascription of paranormal powers: no ability, self-professed ability, and paranormal practitioners (i.e., Mediums, Psychics, Spiritualists, and Fortune-Tellers). Paranormal practitioners (compared with no and self-professed ability conditions) were expected to score higher on paranormal belief, proneness to reality testing deficits, emotion-based reasoning, and lower on belief in science. Comparable differences were predicted between the self-professed and no ability conditions. A sample of 917 respondents (329 males, 588 females) completed self-report measures online. Multivariate analysis of variance (MANOVA) revealed an overall main effect. Further investigation, using discriminant descriptive analysis, indicated that paranormal practitioners scored higher on proneness to reality testing deficits, paranormal belief, and emotion-based reasoning. Belief in science did not meaningfully contribute to the discriminant function. Overall, results were consistent with previous academic work in the domains of paranormal belief and experience, which has reported that paranormal-related cognitions and perceptions are associated with factors related to subclinical delusion formation (i.e., emotion-based/intuitive thinking).

Evidence of the psychological effects of pseudoscientific information about COVID-19 on rural and urban populations

This research aims to analyze the effects of pseudoscientific information (PI) about COVID-19 on the mental well-being of the general population. A total of 782 participants were classified according to the type of municipality in which they lived (rural municipalities and urban municipalities). The participants answered psychometric questionnaires that assessed psychological well-being, pseudoscientific beliefs and the ability to discriminate between scientific and pseudoscientific information about COVID-19. The results indicated the following: the greater the ability to discriminate between false information and true information, the greater the levels of psychological well-being perceived by the participant. The ability to discriminate predicts up to 32% of psychological well-being only for subjects living in rural municipalities. Residents in urban municipalities showed lower levels of well-being than residents in rural municipalities. It is concluded that new social resources are needed to help the general population of urban municipalities discriminate between pseudoscientific and scientific information.

Pseudoscientific beliefs and psychopathological risks increase after COVID-19 social quarantine

BACKGROUND

The health crisis caused by COVID-19 has led many countries to opt for social quarantine of the population. During this quarantine, communication systems have been characterized by disintermediation, the acceleration of digitization and an infodemic (excess and saturation of information). The following debate arises: Do the levels related to the psychotic phenotype and pseudoscientific beliefs related to the interpretation of information vary before and after social quarantine?

OBJECTIVES

This research aims to examine the psychological effects of social quarantine on the psychotic phenotype and pseudoscientific beliefs-experiences of the general nonclinical population. The following hypothesis was posed: social quarantine alters the levels of magical thinking, pseudoscientific beliefs and anomalous perceptions due to quarantine.

METHODS

A pre- and posttest analysis design was applied based on the difference in means, and complementary Bayesian estimation was performed. A total of 174 Spanish subjects responded to different questionnaires that evaluated psychopathological risks based on psychotic phenotypes, pseudoscientific beliefs and experiences before and after quarantine.

RESULTS

Significant differences were obtained for the variables positive psychotic symptoms, depressive symptoms, and certain perceptual alterations (e.g., cenesthetic perceptions), and a significant increase in pseudoscientific beliefs was also observed. The perceptual disturbances that increased the most after quarantine were those related to derealization and depersonalization. However, paranoid perceptions showed the highest increase, doubling the initial standard deviation. These high increases could be related to the delimitation of physical space during social quarantine and distrust towards information communicated by the government to the population. Is it possible that social alarmism generated by the excess of information and pseudoscientific information has increased paranoid perceptual alterations?

CONCLUSIONS

Measures taken after quarantine indicate that perceptual disturbances, subclinical psychotic symptoms and beliefs in the pseudoscience have increased. We discuss which elements of quarantine coincide with the social marginality theory and its clinical repercussions.

Psychometric assessment of the Generic Conspiracist Beliefs Scale

The Generic Conspiracist Beliefs Scale (GCBS) is the most widely used measure of general belief in conspiracy theories. The scale comprises five related but distinct factors (Government Malfeasance, Extraterrestrial Cover-up, Malevolent Global Conspiracies, Personal Wellbeing, and Control of Information). Despite this, investigators have typically treated the GCBS as unidimensional by referencing only overall total. Although, the GCBS possesses established psychometric properties, critics question its factorial structure, suggest alternative models, and recommend routine examination of GCBS dimensions as part of analysis. Through two studies, the present paper assessed GCBS factorial structure, internal reliability, convergent validity, and invariance. This involved comparing the original five-factor solution with alternative one, two, and three-factor models. To ensure that the best fitting model was robust, the authors conducted analysis in two independent samples (Study one, N = 794, UK university-based sample; and Study two, N = 418, UK respondents collected via a market research company). Results in both studies indicated superior fit for the correlated five-factor solution. This solution demonstrated invariance across gender, and samples (Study one and two). Furthermore, the total scale and five subfactors evinced good alpha and omega total reliability. Convergent validity testing exhibited associations of an expected strength between conspiracist beliefs, reality testing, and cognitive insight. Large intercorrelations existed among GCBS subfactors, suggesting that the measure reflects a narrow set of interrelated conspiracist assumptions. These findings support the use of overall scale scores as an index of belief in conspiracy theories.

An Evaluation of the Belief in Science Scale

The Belief in Science Scale (BISS) is a unidimensional measure that assesses the degree to which science is valued as a source of superior knowledge. Due to increased academic interest in the concept of belief in science, the BISS has emerged as an important measurement instrument. Noting an absence of validation evidence, the present paper, via two studies, evaluated the scale’s factorial structure. Both studies drew on data collected from previous research. Study 1 (N = 686), using parallel analysis and exploratory factor analysis, identified a unidimensional solution accounting for 56.43% of the observed variance. Study 2 (N = 535), using an independent sample, tested the unidimensional solution using confirmatory factor analysis (CFA). Data-model fit was good (marginal for RMSEA): CFI = 0.93, TLI = 0.91, RMSEA = 0.09 (90% CI of 0.08 to 0.10), SRMR = 0.04. Invariance testing across gender supported invariance of form, factor structure, and item intercepts for this one-factor model. BISS at the overall level correlated negatively with the reality testing dimension of the Inventory of Personality Organization (IPO-RT), demonstrating convergent validity. Researchers often use the IPO-RT as an indirect index of preference for experiential processing (intuitive thinking). In this context, only BISS scores above the median (second quartile) produced a reduction in experiential-based thinking. The authors discuss these findings in the context of belief in science as a psychometric construct.