Dealing with Careless Responding in Survey Data: Prevention, Identification, and Recommended Best Practices

The role of caregiver emotion regulation in youth mental health during the COVID-19 pandemic: A longitudinal study

The COVID-19 pandemic has presented youth and families with a broad spectrum of unique stressors. Given that adolescents are at increased risk for mental health and emotional difficulties, it is critical to explore family processes that confer resilience for youth in the face of stress. The current study investigated caregiver emotion regulation (ER) as a familial factor contributing to youth ER and risk for psychopathology following stressful life events. In a longitudinal sample of 224 youth (M age = 12.65 years) and their caregivers, we examined whether caregiver and youth engagement in ER strategies early in the pandemic mediated the associations of pandemic-related stress with youth internalizing and externalizing symptoms six months later. Leveraging serial mediation analysis, we demonstrated that caregiver and youth rumination, but not expressive suppression or cognitive reappraisal, mediated the prospective associations of pandemic-related stress with youth internalizing and externalizing symptoms. Greater exposure to pandemic-related stressors was associated with greater caregiver rumination, which, in turn, related to greater rumination in youth, and higher levels of youth internalizing and externalizing symptoms thereafter. Family interventions that target caregiver ER, specifically rumination, may buffer against the consequences of stress on youth engagement in maladaptive ER strategies and risk for psychopathology.

Detecting inattentive respondents by machine learning: A generic technique that substitutes for the directed questions scale and compensates for its shortcomings

Web surveys are often used to collect data for psychological research. However, the inclusion of many inattentive respondents can be a problem. Various methods for detecting inattentive respondents have been proposed, most of which require the inclusion of additional items in the survey for detection or the calculation of variables for detection after data collection. This study proposes a method for detecting inattentive respondents in web surveys using machine learning. The method requires only the collection of response time and the inclusion of a Likert scale, eliminating the need to include special detection items in the survey. Based on data from 16 web surveys, a method was developed using predictor variables not included in existing methods. While previous machine learning methods for detecting inattentive respondents can only be applied to the same surveys as the data on which the models were developed, the proposed model is generic and can be applied to any questionnaire as long as response time is available, and a Likert scale is included. In addition, the proposed method showed partially higher accuracy than existing methods.

Can you tell people's cognitive ability level from their response patterns in questionnaires?

Questionnaires are ever present in survey research. In this study, we examined whether an indirect indicator of general cognitive ability could be developed based on response patterns in questionnaires. We drew on two established phenomena characterizing connections between cognitive ability and people's performance on basic cognitive tasks, and examined whether they apply to questionnaires responses. (1) The worst performance rule (WPR) states that people's worst performance on multiple sequential tasks is more indicative of their cognitive ability than their average or best performance. (2) The task complexity hypothesis (TCH) suggests that relationships between cognitive ability and performance increase with task complexity. We conceptualized items of a questionnaire as a series of cognitively demanding tasks. A graded response model was used to estimate respondents' performance for each item based on the difference between the observed and model-predicted response ("response error" scores). Analyzing data from 102 items (21 questionnaires) collected from a large-scale nationally representative sample of people aged 50+ years, we found robust associations of cognitive ability with a person's largest but not with their smallest response error scores (supporting the WPR), and stronger associations of cognitive ability with response errors for more complex than for less complex questions (supporting the TCH). Results replicated across two independent samples and six assessment waves. A latent variable of response errors estimated for the most complex items correlated .50 with a latent cognitive ability factor, suggesting that response patterns can be utilized to extract a rough indicator of general cognitive ability in survey research.

The Association between Discrepancies in Parental Emotional Expressivity, Adolescent Loneliness and Depression: A Multi-Informant Study Using Response Surface Analysis

Incongruent perceptions of parental emotional expressivity between parents and adolescents may signify relational challenges, potentially impacting adolescents' socioemotional adjustment. Direct evidence is still lacking and father-adolescent discrepancies are overlooked. This study employed a multi-informant design to investigate whether both mother-adolescent and father-adolescent discrepancies in perceptions of parental expressivity are related to adolescents' mental well-being, specifically focusing on loneliness and depression. Analyzing data from 681 families (mean age of adolescents = 15.5 years old, 51.2% girls, 40% only-children) in China revealed that adolescents tended to perceive paternal and maternal emotional expressivity more negatively than their parents, particularly fathers. Polynomial regression and response surface analysis showed significant links between parent-adolescent congruence and incongruence and adolescent loneliness. (In)Congruence between adolescents and mothers or fathers predicted later adolescent depression, mediated by adolescent loneliness and varied by the dimension of emotional expressivity. These findings provide insights into the roles of mothers' and fathers' emotional expressivity in shaping children's mental well-being during adolescence.

Validating the IDRIS and IDRIA: Two infrequency/frequency scales for detecting careless and insufficient effort survey responders

To detect careless and insufficient effort (C/IE) survey responders, researchers can use infrequency items - items that almost no one agrees with (e.g., "When a friend greets me, I generally try to say nothing back") - and frequency items - items that almost everyone agrees with (e.g., "I try to listen when someone I care about is telling me something"). Here, we provide initial validation for two sets of these items: the 14-item Invalid Responding Inventory for Statements (IDRIS) and the 6-item Invalid Responding Inventory for Adjectives (IDRIA). Across six studies (N1 = 536; N2 = 701; N3 = 500; N4 = 499; N5 = 629, N6 = 562), we found consistent evidence that the IDRIS is capable of detecting C/IE responding among statement-based scales (e.g., the HEXACO-PI-R) and the IDRIA is capable of detecting C/IE responding among both adjective-based scales (e.g., the Lex-20) and adjective-derived scales (e.g., the BFI-2). These findings were robust across different analytic approaches (e.g., Pearson correlations; Spearman rank-order correlations), different indices of C/IE responding (e.g., person-total correlations; semantic synonyms; horizontal cursor variability), and different sample types (e.g., US undergraduate students; Nigerian survey panel participants). Taken together, these results provide promising evidence for the utility of the IDRIS and IDRIA in detecting C/IE responding.

Temporal dynamics in psychological assessments: a novel dataset with scales and response times

The growing prevalence of mental health issues underscores the need for innovative screening methods. Large-scale, internet-based psychological screening has emerged as a vital tool to accurately determine morbidity rates and facilitate early diagnosis of mental disorders. However, conventional psychological screening methods often struggle with non-genuine responses and lack objective metrics. To bridge this gap, we have compiled a novel dataset derived from an expansive screening initiative at Xinxiang Medical University. The study, conducted from February 27 to March 17, 2021, yielded a dataset comprising responses from 24,292 students to four well-established psychological scales-PHQ-9, GAD-7, ISI, and PSS. A distinctive feature of this dataset is the inclusion of response time data, which captures the temporal dynamics of participants' interactions with the scales, offering valuable insights into their response behaviour. The release of this dataset offers a substantial opportunity for researchers in the domains of psychology and public health to explore new insights into mental health, scale reliability, and the dynamics of psychological assessment.

Social cure model: testing the link between identity centrality and body appreciation in diverse sexual orientation and gender identity groups

BACKGROUND

The level of experienced sociocultural pressure to have an idealized body can vary depending on a person's gender identity and sexual orientation. The current study explored whether differences in levels of body appreciation among people with different sexual orientations and gender identities vary because of differing levels of experienced pressure by in-group members and varying levels of experienced hostile behaviors because of their looks or body. Thereby, the study tests the social cure model, according to which high levels of identity centrality are associated with better mental health.

METHODS

An online cross-sectional questionnaire study was conducted with 1,587 people (51.3% cisgender women, 39.3% cisgender men, 9.5% non-binary; 52.9% identified as heterosexual, 27.7% identified as bisexual/pansexual, 11.2% identified as gay/lesbian, 8.2% identified as asexual/demi/queer; Mage = 32.9, SD = 12.6) from German-speaking countries. Variables were assessed with German-language versions of the Multidimensional and Multicomponent Measure of Social Identification, Body Appreciation Scale-2, the Perceived Stigmatization Questionnaire, and the Sociocultural Attitudes Towards Appearance Questionnaire-4, revised. A manifest-path model was calculated.

RESULTS

Non-binary persons reported lower levels of body appreciation than did cisgender men and sexual minority persons reported lower levels of body appreciation than did heterosexual persons. Furthermore, sexual minority persons experienced more hostile behaviors directed towards them because of their looks or body than did heterosexual persons. Similarly, non-binary persons experienced more hostile behaviors than did men. Non-binary persons were subjected to lower levels of in-group pressure than were men. Gay/lesbian persons and asexual persons were subjected to lower levels of in-group pressure than were heterosexual persons. More hostile behaviors and stronger in-group pressure were related to lower body appreciation. In cisgender women and men indirect links revealed associations between strong identity centrality and low levels of body appreciation through the mediator of high in-group pressure.

CONCLUSIONS

Data in sexual minority individuals or non-binary persons supported the social cure model, according to which persons can find support and validation for their looks and body from in-group members. In cisgender women and men, strong identification as a woman or man can be related to stronger in-group pressure and in turn to lower body appreciation.

Machine learning identifies different related factors associated with depression and suicidal ideation in Chinese children and adolescents

BACKGROUND

Depression and suicidal ideation often co-occur in children and adolescents, yet they possess distinct characteristics. This study sought to identify the different related factors associated with depression and suicidal ideation.

METHODS

A nationwide cross-sectional survey collected data from Chinese children and adolescents aged 8 to 18 (N = 160,962; 48.91 % girls). The survey included inquiries about demographics, depression, suicidal ideation, anxiety, perceived stress, academic burnout, internet addiction, non-suicidal self-injury, bullying, and being bullied. Fifteen machine learning algorithms were conducted to identify the different related factors associated with depression and suicidal ideation. Additionally, we conducted external validation on an independent sample of 1,812,889 children and adolescents.

RESULTS

Our findings revealed seven related factors linked to depression and six associated with suicidal ideation, with average accuracy rates of 86.86 % and 85.82 %, respectively. For depression, the most influential factors were anxiety, perceived stress, academic burnout, internet addiction, non-suicidal self-injury, experience of bullying, and age. Similarly, anxiety, non-suicidal self-injury, perceived stress, internet addiction, academic burnout, and age emerged as paramount factors for suicidal ideation. Moreover, these related factors showed notable variations in their predictive capacities for depression and suicidal ideation across different subgroups.

CONCLUSION

Anxiety emerged as the predominant shared factor for both depression and suicidal ideation, whereas the other related factors displayed distinct predictive patterns for each condition. These findings highlight the critical need for tailored strategies from public mental health service providers and policymakers to address the pressing concerns of depression and suicidal ideation.

Preoperative expectations of patients with degenerative cervical myelopathy: an observational study from the Canadian Spine Outcomes and Research Network

BACKGROUND

Despite an abundance of literature on degenerative cervical myelopathy (DCM), little is known about preoperative expectations of these patients.

PURPOSE

The primary objective was to describe patient preoperative expectations. Secondary objectives included identifying patient characteristics associated with high preoperative expectations and to determine if expectations varied depending on myelopathy severity.

STUDY DESIGN

This was a retrospective study of a prospective multicenter, observational cohort of patients with DCM.

PATIENT SAMPLE

Patients who consented to undergo surgical treatment between January 2019 and September 2022 were included.

OUTCOMES MEASURES

An 11-domain expectation questionnaire was completed preoperatively whereby patients quantified the expected change in each domain.

METHODS

The most important expected change was captured. A standardized expectation score was calculated as the sum of each expectation divided by the maximal possible score. The high expectation group was defined by patients who had an expectation score above the 75th percentile. Predictors of patients with high expectations were determined using multivariable logistic regression models.

RESULTS

There were 262 patients included. The most important patient expectation was preventing neurological worsening (40.8%) followed by improving balance when standing or walking (14.5%), improving independence in everyday activities (10.3%), and relieving arm tingling, burning and numbness (10%). Patients with mild myelopathy were more likely to select no worsening as the most important expected change compared to patients with severe myelopathy (p<.01). Predictors of high patient expectations were: having fewer comorbidities (OR -0.30 for every added comorbidity, 95% CI -0.59 to -0.10, p=.01), a shorter duration of symptoms (OR 0.92, 95% CI 0.35-1.19, p=.02), no contribution from "failure of other treatments" on the decision to undergo surgery (OR 1.49, 95% CI 0.56-2.71, p=.02) and more severe neck pain (OR 0.19 for 1 point increase, 95% CI 0.05-0.37, p=.01).

CONCLUSIONS

Most patients undergoing surgery for DCM expect prevention of neurological decline, better functional status, and improvement in their myelopathic symptoms. Stopping neurological deterioration is the most important expected outcomes by patients.

The effectiveness of warning statements in reducing careless responding in crowdsourced online surveys

Carelessness or insufficient effort responding is a widespread problem in online research, with estimates ranging from 3% to almost 50% of participants in online surveys being inattentive. While detecting carelessness has been subject to multiple studies, the factors that reduce or prevent carelessness are not as well understood. Initial evidence suggests that warning statements prior to study participation may reduce carelessness, but there is a lack of conclusive high-powered studies. This preregistered randomized controlled experiment aimed to test the effectiveness of a warning statement and an improved implementation of a warning statement in reducing participant inattention. A study with 812 participants recruited on Amazon Mechanical Turk was conducted. Results suggest that presenting a warning statement is not effective in reducing carelessness. However, requiring participants to actively type the warning statement statistically significantly reduced carelessness as measured with self-reported diligence, even-odd consistency, psychometric synonyms and antonyms, and individual response variability. The active warning statements also led to statistically significantly more attrition and potentially deterred those who were likely to be careless from even participating in this study. We show that the current standard practice of implementing warning statements is ineffective and novel methods to prevent and deter carelessness are needed.

Creating a resilient pedagogy: Character strengths intervention for aspiring educators

Teachers play a crucial role in guiding learners through life's challenges. They face educational and socio-economic shifts while striving to teach for a better future. Our study focuses on equipping future teachers, called pre-service teachers, with resilience-building resources during their teacher training program. A potential antecedent to resilience, which facilitates cognitive strategies and attentional processes, is cognitive flexibility. We first tested whether cognitive flexibility predicts resilience. Next, relying on the tenets of positive psychology, which studies resilience, we developed and tested the effectiveness of character strengths intervention in enhancing pre-service teachers' resilience and cognitive flexibility. An individual's belief in their ability to change personal resources could influence how an intervention manifests. Hence, we studied how mindset impacts the intervention's effect on cognitive flexibility and, thus, resilience. We adopted a multi-method approach, guided by Polk's theory of resilience, to test out objectives. Using a cross-sectional design, study one (n = 273) found that cognitive flexibility significantly predicted resilience. Study two (N = 193; nexp = 133, ncont = 60) was a multi-site field experiment. We found that intervention significantly enhanced resilience (experimental group M = 29.62, control group M = 28.33) and cognitive flexibility (experimental group M = 54.42, control group M = 52.01). Further, a growth mindset, was found to moderate the indirect effect of character strengths intervention on resilience via cognitive flexibility. The study contributes to theoretical and practical advancements in resilience. Taken together, the findings highlight the cognitive-affective-behavioural makeup of resilience and, importantly, the role of cognitive flexibility. The intervention can be seamlessly integrated into teacher training curricula for a resilient future.

The Bergen-Yale Sexual Addiction Scale (BYSAS): Longitudinal Measurement Invariance Across a Two-Year Interval

The Bergen-Yale Sexual Addiction Scale (BYSAS; [1]) is arguably the most popular questionnaire at present for assessing sex addiction. Employing Confirmatory Factor Analysis (CFA) and treating item scores as ordered categorical, we applied Weighted Least Square Mean and Variance Adjusted Chi-Square (WLSMV) extraction to investigate the longitudinal measurement and structural invariance of ratings on the BYSAS among 276 adults (mean = 31.86 years; SD = 9.94 years; 71% male) over a two-year period, with ratings at three yearly intervals. Overall, there was support for configural invariance, full loading, full threshold, the full unique factor invariance; and all structural (latent variances and covariances) components. Additionally, there was no difference in latent mean scores across the three-time points. The psychometric and practical implications of the findings are discussed.

Careless responding detection revisited: Accuracy of direct and indirect measures

To screen for careless responding, researchers have a choice between several direct measures (i.e., bogus items, requiring the respondent to choose a specific answer) and indirect measures (i.e., unobtrusive post hoc indices). Given the dearth of research in the area, we examined how well direct and indirect indices perform relative to each other. In five experimental studies, we investigated whether the detection rates of the measures are affected by contextual factors: severity of the careless response pattern, type of item keying, and type of item presentation. We fully controlled the information environment by experimentally inducing careless response sets under a variety of contextual conditions. In Studies 1 and 2, participants rated the personality of an actor that presented himself in a 5-min-long videotaped speech. In Studies 3, 4, and 5, participants had to rate their own personality across two measurements. With the exception of maximum longstring, intra-individual response variability, and individual contribution to model misfit, all examined indirect indices performed better than chance in most of the examined conditions. Moreover, indirect indices had detection rates as good as and, in many cases, better than the detection rates of direct measures. We therefore encourage researchers to use indirect indices, especially within-person consistency indices, instead of direct measures.

Food insecurity is related to eating disorder psychopathology beyond psychological distress in rural Chinese adolescents

OBJECTIVE

This study aimed to examine the relationship between food insecurity (FI) and eating disorder psychopathology in a large sample of rural Chinese adolescents.

METHODS

Analyses included 1654 adolescents (55.4% girls; Mage = 16.54 years, SD = 1.45) from a rural high school in southwestern China. FI, eating disorder psychopathology, and psychological distress (i.e., symptoms of depression, anxiety, and stress) were assessed. Data were analyzed by sex. Pearson correlation analysis was performed to investigate the zero-order association between FI and eating disorder psychopathology. Hierarchical linear regressions were used to explore whether FI could explain meaningful variance in eating disorder psychopathology beyond psychological distress and demographic covariates (e.g., socioeconomic status).

RESULTS

FI was significantly associated with higher eating disorder psychopathology for boys (r = 0.44, p < 0.001) and girls (r = 0.43, p < 0.001), with medium-to-large effect sizes. FI accounted for significant unique variance in eating disorder psychopathology beyond psychological distress and demographic covariates for boys (ΔR2 = 0.14, p < 0.001) and girls (ΔR2 = 0.10, p < 0.001).

DISCUSSION

Using a large sample of rural Chinese adolescents, this study extends the connection between FI and eating disorder pathology in adolescents beyond the Western context. Future investigations on the mechanisms underlying FI and eating disorder psychopathology are warranted for developing prevention strategies for eating disorders among rural Chinese adolescents.

PUBLIC SIGNIFICANCE

This is the first investigation that examined the link between FI and eating disorder psychopathology among rural Chinese adolescents. Our findings highlight the importance of incorporating FI as a potential risk factor to screen for the prevention and intervention of eating disorders among rural Chinese adolescents.

Do aversive well-being comparisons mediate the effects of childhood adversity on anxiety and depression?

BACKGROUND

Childhood adversity (CA) is strongly associated with depression and anxiety in later life. Many adults with a history of CA may have internalized an insecure self-concept, which may contribute to negative evaluations of one's current well-being relative to different standards. Yet, there is lack of research on well-being comparisons in adults with a history of CA.

OBJECTIVE

We examined aversive well-being comparisons (i.e., comparisons threatening the comparer's motives) in the context of CA and their predictive value in depression and anxiety beyond self-esteem, emotion regulation, and external control beliefs. Further, we investigated whether well-being comparison processes mediate the relationship between CA and depression and anxiety.

PARTICIPANTS AND SETTING

We conducted a two-wave longitudinal study with 942 adult participants (mean age: 31.56 years, SD = 10.49, 18-75 years).

METHODS

Participants completed measures of CA, aversive well-being comparisons (social, temporal, counterfactual, and criteria-based comparisons), self-esteem, emotion regulation, and locus of control at two time points, three months apart.

RESULTS

CA was significantly linked to more frequent aversive well-being comparisons. These comparisons were associated with greater discrepancies relative to the comparison standard and a more negative affective impact, ultimately contributing to higher levels of subsequent anxiety and depression symptoms. Comparison frequency emerged as key mediator, highlighting potential pathways through which CA affects adult mental health. These associations emerged despite controlling for established variables in this context, namely self-esteem, emotion regulation, and external locus of control.

CONCLUSION

Our findings underscore the unique importance of aversive well-being comparisons in individuals with a history of CA.

Drivers and Barriers Influencing Adherence to the Mediterranean Diet: A Comparative Study across Five Countries

Given the global decline in adherence to the Mediterranean Diet (MD), even within its native region, it is key to identify the factors influencing this trend to mitigate the negative health outcomes associated with westernized diets. To this end, 4025 individuals (49.6% women, 42.6 ± 14.2 y/o) from Greece, Italy, Morocco, Slovenia, and Tunisia remotely completed a series of measures assessing motives, attitudes, and psychosocial factors related to MD adherence, which was evaluated using the MEDAS questionnaire. The results suggested medium-to-low adherence across all countries, with the highest adherence in Italy and Morocco and the lowest in Slovenia. Structural equation modeling revealed that positive attitudes toward the healthiness of food were the strongest predictors of adherence, whereas picky eating was a significant negative predictor in all countries except Greece. Adherence to the MD was positively influenced by health motivations in Morocco and weight control in Slovenia and Greece, while sensory appeal negatively influenced adherence in Italy. Additionally, price and convenience were significant barriers in Tunisia and Greece, whereas a preference for local and seasonal foods promoted adherence in Morocco and Greece. Overall, our findings underscore the need for country-specific interventions and policies that address distinct local factors and motivations to ease favorable shifts in dietary patterns toward MD principles.

How Needs-Supplies Fit Processes With Teachers, Peers, and Parents Relate to Youth Outcomes: A Theoretical and Methodological Extension of Self-Determination Theory

According to self-determination theory (SDT), relationships that support the needs for autonomy, competence, and relatedness are essential to youth development. It is yet unknown whether adolescents differ in what constitutes "optimal" supplies of support. This research proposes methodological extensions to analyze how the degree of fit or misfit between needs versus supplies in support (i.e., from teachers, parents, and peers) relates to engagement in class, academic achievement, and well-being. Data were collected on 389 adolescents (M(age) = 14.3, SD(age) = 2.1, 58% female, low to high SES). Extending SDT's contention that "the more supplies the better", results suggest that the impact of supplies actually depends on the level of needs, and that commensurate (for parents) or surplus supplies (for teachers, peers) are most optimal. Therefore, while some youth require strongly supportive relationships to experience optimal development, others require much lower support, and may even suffer from higher support.

Validation of the ACSID-11 for consistent screening of specific Internet-use disorders based on ICD-11 criteria for gaming disorder: A multitrait-multimethod approach

INTRODUCTION

With the inclusion of gaming disorder in the ICD-11, diagnostic criteria were introduced for this relatively new disorder. These criteria may be applied to other potential specific Internet-use disorders. The 11-item Assessment of Criteria for Specific Internet-use Disorders (ACSID-11) was developed for consistent screening of gaming disorder, online buying-shopping disorder, online pornography-use disorder, social networks-use disorder, and online gambling disorder. This study tested the construct validity of the ACSID-11, including convergent and divergent measures.

METHODS

The ACSID-11 measures five behavioral addictions with the same set of items by following the principles of the Alcohol, Smoking and Substance Involvement Screening Test (ASSIST). The ACSID-11 was administered to a convenience sample of active Internet users (N = 1597) together with validated and established measures of each specific Internet-use disorder along with screeners for mental health. Included are the Ten-Item Internet Gaming Disorder Test (IGDT-10), the Bergen Shopping Addiction Scale (BSAS), the Problematic Pornography Consumption Scale (PPCS), the Bergen Social Media Addiction Scale (BSMAS) and the Berlin Inventory of Gambling behavior - Screening (BIG-S). The ACSID-11 was compared convergently and divergently through a multitrait-multimethod approach along with contingency tables with the other Internet-use disorder screeners.

RESULTS

The multitrait-multimethod results shows that each behavior assessed with the ACSID-11 has moderate to strong correlations (r's from 0.462 to 0.609) with the scores of the corresponding established measures and, furthermore, positive correlations (r's from 0.122 to 0.434) with measures of psychological distress and further shows that the ACSID-11 can be used for a comprehensive assessment of different behaviors. The contingency tables reveal large divergences between the ACSID-11 and other screening instruments concerning the classification of problematic specific Internet use based on the given cut-off values.

CONCLUSION

The current work provides additional validation for the ACSID-11. Accordingly, this tool can be considered as reliable and valid for the simultaneous assessment of different Internet-use disorders: gaming disorder, online buying-shopping disorder, online pornography use disorder, social networks use disorder, and online gambling disorder. With a subsequent clinical validation of the scale and the proposed cut-off score, the ACSID-11 will be a thoroughly validated useful screening tool for clinical practice.

Estimating the Prevalence of Using Suspected Counterfeit Medications in the General Population

INTRODUCTION

Counterfeit medications, sometimes referred to as "fake" or falsified drugs or pills, are drugs that are illicitly manufactured but designed to look like legitimate pharmaceuticals. Counterfeit medications are a growing public health concern. This study estimated the prevalence of self-reported use of suspected counterfeit medications by adults in the US and to assess what ingredients these individuals suspected were in the counterfeit medications.

METHODS

This general population survey, drawn from an online panel, was administered across 2 waves in 2022 (15 April 3 June and 9 September 21 October) to 59,041 adults aged 18 and older. Statistical calibration weighting was used to calculate estimates representative of the national adult population.

RESULTS

An estimated 1.8% (95% CI 1.7%-1.9%) of respondents, corresponding to approximately 4.6 million adults, suspected past 12-month use of counterfeit medications. Fentanyl was the most commonly suspected ingredient in the counterfeit product (16.1%, 95% CI 12.8%-19.3%). The next most prevalent response was "I don't know" (15.0%, 95% CI 11.0%-18.9%) followed by methamphetamine (14.9%, 95% CI 11.4%-18.4%).

CONCLUSIONS

These data show the scale of the issue in relation to other well established drug use data points in the US. System-level methods, such as drug scanning software, should be implemented to reduce the likelihood that counterfeit drugs end up in the hands of individuals.

On assessing trait rumination using the Ruminative Response Scale

Introduction

This study explores the stability of scores on psychometrically validated trait questionnaires over time. We illustrate potential pitfalls through a larger study that used the Ruminative Response Scale (RRS) to categorize participants prior to study inclusion into two groups based on their habitual tendency to ruminate. Surprisingly, when we re-administered the RRS at the start of an experimental session, significant score changes occurred, resulting in participants shifting between the two groups.

Methods

To address this, we modified our recruitment process, aiming to reduce careless responses, including an online RRS assessment a week before the lab appointment. We analyzed the different samples prior to and after changing the recruitment procedure, as well as the total sample regarding the psychometric properties of the RRS. We also explored various indices to identify and predict score changes due to careless responding; however, only a subgroup of participants was successfully identified.

Results

Our findings suggest that Mahalanobis distances are effective for identifying substantial score changes, with baseline state rumination emerging as a marginally significant predictor.

Discussion

We discuss the importance of conducting manipulation checks and offer practical implications for research involving psychometrically validated trait questionnaires.

Validity and Reliability of the Turkish Version of the Glottal Function Index

OBJECTIVES

A comprehensive evaluation is necessary for voice-related complaints, as it can benefit both the patient and physician in busy clinical settings. This study aimed to examine the Turkish adaptation of the Glottal Function Index (GFI-T), which can be quickly administered.

STUDY DESIGNS

Phase 1 methodological, phase 2 prospective cohort.

METHODS

This study was conducted in two phases. Firstly, the GFI was translated into Turkish, and its content validity was examined. The GFI-T was administered to 40 participants with voice disorders (M=41.3, SD=10) in the study group and 40 participants without voice disorders (M=37.5, SD=11.3) in the control group. Then GFI-T was readministered 2weeks later. The collected data were used for structural and convergent validity [correlation with Turkish version of the Voice Handicap Index-10 (VHI-10)], internal consistency, and test-retest reliability analyses. Secondly, 24 participants with vocal nodules were recruited separately from the first phase and were randomly divided into three groups. The first group underwent lax-vox therapy+vocal hygiene, the second group underwent resonance therapy+vocal hygiene, and the third group was provided only with vocal hygiene recommendations. The discriminative ability and construct validity of the GFI-T were examined by comparing pre- and post-assessments.

RESULTS

The results indicated that the content validity indexes were 0.98 in the experts and 0.99 in the participants. Confirmatory factor analysis of the scale confirmed that a single-factor structure and goodness-of-fit indices were suitable. The GFI-T correlated 0.92 with the Turkish version of the VHI-10. The internal consistency was 0.96, and the test-retest value was 0.99. Significant differences (P < 0.001) and correlations with the Turkish version of VHI-10 were found in intragroup comparisons.

CONCLUSIONS

The GFI-T is a reliable and valid tool for the self-assessment of voice disorders. The adaptation of this study to the pediatric population is recommended.

Construct Validity and Measurement Invariance of the Difficulties in Emotion Regulation Scale - Short Form (DERS-SF): Further Evidence From Community and Student Samples

The current study aimed to evaluate the psychometric properties of the Difficulties in Emotion Regulation Scale-Short Form (DERS-SF) in Iran, including testing its measurement invariance across sexes, as well as community and student populations. Two samples were recruited: a community sample of 583 participants (58.7% female; Mage = 33.55) and a university student sample of 409 participants (67.2% female; Mage = 24.48). Besides the DERS-SF, participants completed a battery of instruments online, measuring mentalizing capacity and borderline personality features. Confirmatory factor analyses supported the tenability of the five-factor model, excluding the awareness subscale. Except for the awareness subscale, acceptable to excellent internal consistencies were found for the DERS-SF and its subscales. The awareness-excluded DERS-SF was significantly and strongly associated with relevant constructs (|rs| = .49 to .59). This study also found evidence for configural, metric, and scalar invariance of the DERS-SF across sexes and community and student populations. Our findings extended the evidence for the validity and reliability of the DERS-SF and its awareness-excluded version by administering it in Iranian samples and supporting its cross-cultural applicability.

Comparisons of Self-Report With Objective Measurements Suggest Faster Responding but Little Change in Response Quality Over Time in Ecological Momentary Assessment Studies

Response times (RTs) to ecological momentary assessment (EMA) items often decrease after repeated EMA administration, but whether this is accompanied by lower response quality requires investigation. We examined the relationship between EMA item RTs and EMA response quality. In one data set, declining response quality was operationalized as decreasing correspondence over time between subjective and objective measures of blood glucose taken at the same time. In a second EMA study data set, declining response quality was operationalized as decreasing correspondence between subjective ratings of memory test performance and objective memory test scores. We assumed that measurement error in the objective measures did not increase across time, meaning that decreasing correspondence across days within a person could be attributed to lower response quality. RTs to EMA items decreased across study days, while no decrements in the mean response quality were observed. Decreasing EMA item RTs across study days did not appear problematic overall.

Establishing circularity: development and validation of the circular work value scale (CWVS)

Objectives

Addressing the lack of German-language instruments, this study aims to develop a questionnaire that enables the measurement of work values. According to the theory of basic human values (Schwartz, 1992), a culturally fitting questionnaire is validated by covering constructs in the four broader dimensions of Social, Prestige, Intrinsic, and Extrinsic work values. Convergent, discriminant and incremental congruent validity are assessed.

Method

Data were collected in a cross-sectional online-based panel survey. Individuals working more than 20 h per week were included (N = 1,049). Using a genetic algorithm, an economical and valid questionnaire was designed to assess work values.

Results

The 11 work values are measurable with three items each. They provide a good fit to the data with support for strict measurement invariance. The empirical associations to estimate construct validity overall reflect expected relations to social and individualistic work motives, neuroticism, environmental awareness, and basic values. Furthermore, congruent incremental validity is supported with relations to value congruence of the person-organization fit, and multidimensional scaling supports the assumed theoretical circularity of the work values.

Implications

This study developed a questionnaire that enables a theory-based valid measurement of work values. The questionnaire allows practitioners to economically collect information about the value structure of employees or applicants. Future research should consider the development of work values over time and investigate whether more distinctive constructs provide a better fit in the nomological network.

Check your outliers! An introduction to identifying statistical outliers in R with easystats

Beyond the challenge of keeping up to date with current best practices regarding the diagnosis and treatment of outliers, an additional difficulty arises concerning the mathematical implementation of the recommended methods. Here, we provide an overview of current recommendations and best practices and demonstrate how they can easily and conveniently be implemented in the R statistical computing software, using the {performance} package of the easystats ecosystem. We cover univariate, multivariate, and model-based statistical outlier detection methods, their recommended threshold, standard output, and plotting methods. We conclude by reviewing the different theoretical types of outliers, whether to exclude or winsorize them, and the importance of transparency. A preprint of this paper is available at: 10.31234/osf.io/bu6nt.

Designing a questionnaire with retrospective pre-post items: Format matters

Evaluators are frequently asked to evaluate educational interventions that are one-time events. The Retrospective Pretest (RPT) methodology is well suited for these circumstances and the evaluation literature is replete with discussions about the pros and cons of this approach. In RPT, program participants rate their attitudes or knowledge now, and also rate how they were before participation in the intervention. The difference between now and before ratings constitutes the measure of change. Little published literature exists about whether the layout of RPT items within the evaluation questionnaire yields different results. This study compared six different layouts using a sample of 1941 caregivers who participated in one of 96 training workshops. The layouts were compared on inattentiveness, unexpected decline in perceived knowledge, and the degree of before-now change. Findings show that design matters. The best performing layout is where items are placed in the center with before response options on the left of the page and the now response options on the right. Results point to the need for evaluators to pay attention to RPT layout, and for the field to establish criteria for assessing survey layout quality. The unexpectedly high rate of inattentiveness calls for evaluators to pay more attention identifying and addressing this in their survey data.

Public perceptions and support of climate intervention technologies across the Global North and Global South

Novel, potentially radical climate intervention technologies like carbon dioxide removal and solar geoengineering are attracting attention as the adverse impacts of climate change are increasingly felt. The ability of publics, particularly in the Global South, to participate in discussions about research, policy, and deployment is restricted amidst a lack of familiarity and engagement. Drawing on a large-scale, cross-country exercise of nationally representative surveys (N = 30,284) in 30 countries and 19 languages, this article establishes the first global baseline of public perceptions of climate-intervention technologies. Here, we show that Global South publics are significantly more favorable about potential benefits and express greater support for climate-intervention technologies. The younger age and level of climate urgency and vulnerability of these publics emerge as key explanatory variables, particularly for solar geoengineering. Conversely, Global South publics express greater concern that climate-intervention technologies could undermine climate-mitigation efforts, and that solar geoengineering could promote an unequal distribution of risks between poor and rich countries.

The TeamSTEPPS for Improving Diagnosis Team Assessment Tool: Scale Development and Psychometric Evaluation

INTRODUCTION

One in three patients is affected by diagnosis-related communication failures. Only a few valid and reliable instruments that measure teamwork and communication exist, and none of those focus on improving diagnosis. The authors developed, refined, and psychometrically evaluated the TeamSTEPPSⓇ for Improving Diagnosis Team Assessment Tool (TAT), which assesses diagnostic teamwork and communication in five critical teamwork domains and can be used to identify strengths and opportunities for improvement and monitor performance.

METHODS

The TAT was administered as a cross-sectional survey to 360 health professionals across nine diverse US health systems. Content and construct validity were evaluated through pilot implementation and subject matter expert review. Reliability and internal consistency were assessed with Cronbach's alpha. To understand sources of variation in TAT scores and assess the tool's consistency across diverse health care organizations, generalizability theory (G-theory) was used. Best practices in screening for careless responding identified participants with random or nonvarying responses.

RESULTS

Analyses indicated strong support for the tool. Content validity findings indicated that the TAT encompassed relevant diagnostic improvement teamwork and communication content. Construct validity, evaluated through pilot implementations, demonstrated the tool's effectiveness in assessing teamwork categories. Reliability analyses confirmed the TAT's internal consistency, with an overall Cronbach's alpha of 0.97. Each dimension of the TAT exhibited good reliability coefficients, ranging from 0.83 to 0.95. G-theory analysis showed that variations in TAT scores were primarily attributed to respondents (28.0%) and scale dimensions (59.6%); both are desirable facets of variation. Further, examination of careless respondents ensured the accuracy and quality of the results, enhancing the TAT's credibility as a valuable diagnostic improvement tool.

CONCLUSION

Psychometric evaluation demonstrated that the TAT is a reliable and valid instrument for assessing teamwork and communication among and across diagnostic teams. The TAT adds a novel, evidence-based, psychometrically sound measurement tool to help advance diagnostic teamwork and communication to improve patient care and outcomes.

Subjective rather than objective patient death experiences link with physicians' and nurses' professional quality of life

BACKGROUND

Patient deaths are impactful events for professional caregivers in both their professional and personal lives. The present study aims to explore how both subjective and objective patient death experiences are related to various aspects of professional quality of life (ProQOL) among physicians and nurses.

METHODS

Secondary analyses of cross-sectional data were conducted, and 306 Chinese physicians and nurses whose most recent patient death experience was more than one month prior were included. Objective and subjective patient death experiences were measured based on the number of past patient deaths and the Accumulated Global Changes (AGC) subscale of the Professional Bereavement Scale, respectively. ProQOL was measured with the Professional Quality of Life Scale. Regressions were run following bivariate analyses.

RESULTS

The number of past patient deaths was not significantly linked with any of the three ProQOL scores in either the bivariate analyses or regressions. Meanwhile, higher AGC scores were associated with higher burnout, secondary traumatic stress, and compassion satisfaction scores after participants' age, occupation (physician/nurse), department, work experience, job commitment, and sense of mission were controlled.

CONCLUSION

Subjective rather than objective past patient death experiences link significantly with all three aspects of physicians' and nurses' ProQOL. The more professional caregivers think that they have been changed by all past patient deaths in their career, the more they experience burnout and secondary traumatic stress, but, the more satisfied they are with their job and the helping itself.

Stress at Work and Well-being Before and During the COVID-19 Pandemic: A 1-Year Longitudinal Study in Switzerland

OBJECTIVE

The aim of the study is to analyze the development of conditions at work and health-related variables (notably exhaustion) in Switzerland longitudinally before and during the COVID-19 pandemic.

METHODS

Questionnaire data were collected from a population-based sample of 1,553 employees in February 2020 and 1 year later. Health and well-being associated with ( a ) working conditions in general and ( b ) COVID-19-specific predictors such as worries about being infected and conditions for working at home were analyzed using analysis of (co)variance and multiple regression.

RESULTS

Conditions at work and well-being were stable overall, even indicating slight improvements, notably for men compared with women. Both an index representing stressors and resources at work in general (Job Stress Index) and a COVID-19-related demand index showed consistent effects on health and the effect of COVID-19-related demands was stronger if the Job Stress Index deteriorated than when it improved.

Development of an Inconsistent Responding Scale for the HEXACO Personality Inventory-Revised

Inconsistent or careless responding is a significant threat to the validity of self-reported personality data. Using archival samples of undergraduate and community participants, we developed an inconsistent responding scale using items that appear on both the 60- and 100-item versions of the HEXACO Personality Inventory-Revised-two widely used measures of the HEXACO model of personality trait structure. We identified pairs of correlated HEXACO items in Sample 1 and created a total inconsistent responding score by summing absolute differences between each item pair. The Brief Response Inconsistency Evaluation (BRIE) for the HEXACO effectively differentiated between genuine and randomly generated responses across samples. The BRIE also correlated as expected with other measures of careless responding and relevant personality traits (e.g., conscientiousness). Tentative cut scores for the BRIE that appear to provide a reasonable balance between sensitivity and specificity in Sample 1 were investigated. Future research should examine the BRIE with different populations and translations of the HEXACO inventories and further investigate the effectiveness of the recommended cut scores.

Genetic Diversity and Phylogenetic Analysis of Zygophyllum loczyi in Northwest China's Deserts Based on the Resequencing of the Genome

In order to study the genetics of local adaptation in all main deserts of northwest China, whole genomes of 169 individuals were resequenced, which covers 20 populations of Zygophyllum loczyi (Zygophyllales: Zygophylaceae). We describe more than 15 million single nucleotide polymorphisms and numerous InDels. The expected heterozygosity and PIC values associated with local adaptation varied significantly across biogeographic regions. Variation in environmental factors contributes largely to the population genetic structure of Z. loczyi. Bayesian analysis performed with STRUCTURE defined four genetic clusters, while the results of principle component analysis were similar. Our results shows that the Qaidam Desert group appears to be diverging into two branches characterized by significant geographic separation and gene flow with two neighboring deserts. Geological data assume that it is possible that the Taklamakan Desert was the original distribution site, and Z. loczyi could have migrated later on and expanded within other desert areas. The above findings provide insights into the processes involved in biogeography, phylogeny, and differentiation within the northwest deserts of China.

Assessing Validity and Bias of Within-Person Variability in Affect and Personality

Within-person variability in affect (e.g., Neuroticism) and personality have been linked to well-being. These are measured either by asking people to report how variable they are or to give multiple reports on the construct and calculating a within-person standard deviation adjusted for confounding by the person-level mean. The two measures are weakly correlated with one another and the links of variability with well-being depend on which measure researchers use. Recent research suggests that people's repeated ratings may be biased by response styles. In a 7-day study (N = 399) with up to five measurements per day, we confirmed that the measures of variability lacked sufficient convergent validity to be used interchangeably. We found only 1 significant correlation (of 10) between variability in repeated ratings of affect or personality and variability in repeated ratings of a theoretically unrelated construct (i.e., features of images). There was very little evidence supporting the response styles hypothesis.

Developmental Pathway from Childhood Abuse to Adolescent Peer Victimization: The Role of Rejection Sensitivity and Aggression

Despite the well-established relationship between early experiences of victimization and later re-victimization, little is known about the exact mechanism of this cycle of victimization. The present study examined whether the route from rejection sensitivity to aggression mediates the associations between different forms of childhood abuse and later peer victimization longitudinally. A total of 3525 adolescents (56.6% male; Mage = 13.21 ± 0.85) participated in this three-wave study, with a 6-month lag and a 9-month lag respectively. The results indicated that the association between childhood emotional abuse and peer victimization were independently mediated by aggression, and sequentially mediated by rejection sensitivity and aggression in both sexes. Sex differences existed regarding the association between childhood physical abuse and aggression, such that only in adolescent boys did physical abuse show significant effect on aggression, resulting in later peer victimization. In general, these findings suggest that maladaptive social-cognitive processes and behavioral patterns are crucial for understanding the mechanism of the vicious cycle of victimization, and sex differences must be considered when examining different types of childhood abuse.

Crying over spilled milk? A network analysis of aversive well-being comparison, brooding rumination and depressive symptoms

BACKGROUND

Comparative thinking about one's well-being is ubiquitous. Comparisons that threaten an individual's self-motives are aversive and interact with rumination and depression. Aversive well-being comparisons include upward social, past temporal, counterfactual, and criteria-based comparisons, as well as downward prospective temporal comparisons. Although the frequency, discrepancy, and affective impact of aversive comparison total scores have been associated with brooding rumination and depression, no study has investigated the interaction of specific comparison standards (e.g., social or counterfactual) with symptom cascades of brooding and depressive symptoms.

METHODS

To examine this interaction, we conducted network analyses on the interplay between aversive well-being comparisons, brooding rumination, and depression. Specifically, we conducted a cross-sectional study in N = 500 dysphoric individuals and a longitudinal study in N = 921 participants at two timepoints, three months apart. Participants completed measures of depression, brooding, and the Comparison Standards Scale for Well-being, which assessed the frequency, perceived discrepancy, and affective impact of aversive well-being comparisons.

RESULTS

Feelings of worthlessness emerged as the most central attribute in the networks of the dysphoric sample. Longitudinally, brooding and depressive symptoms predicted aversive comparisons, but not the other way around, which accounted for social and other-referent counterfactual comparisons to a greater degree than for other comparison types.

LIMITATIONS

We used nonclinical samples.

CONCLUSIONS

The findings highlight the critical role of comparison standards in depression. Further research is warranted to detect potential intervention targets for mitigating negative effects of negative self-evaluation.

Using heterogeneous sources of data and interpretability of prediction models to explain the characteristics of careless respondents in survey data

Prior to further processing, completed questionnaires must be screened for the presence of careless respondents. Different people will respond to surveys in different ways. Some take the easy path and fill out the survey carelessly. The proportion of careless respondents determines the survey's quality. As a result, identifying careless respondents is critical for the quality of obtained results. This study aims to explore the characteristics of careless respondents in survey data and evaluate the predictive power and interpretability of different types of data and indices of careless responding. The research question focuses on understanding the behavior of careless respondents and determining the effectiveness of various data sources in predicting their responses. Data from a three-month web-based survey on participants' personality traits such as honesty-humility, emotionality, extraversion, agreeableness, conscientiousness and openness to experience was used in this study. Data for this study was taken from Schroeders et al.. The gradient boosting machine-based prediction model uses data from the answers, time spent for answering, demographic information on the respondents as well as some indices of careless responding from all three types of data. Prediction models were evaluated with tenfold cross-validation repeated a hundred times. Prediction models were compared based on balanced accuracy. Models' explanations were provided with Shapley values. Compared with existing work, data fusion from multiple types of information had no noticeable effect on the performance of the gradient boosting machine model. Variables such as "I would never take a bribe, even if it was a lot", average longstring, and total intra-individual response variability were found to be useful in distinguishing careless respondents. However, variables like "I would be tempted to use counterfeit money if I could get away with it" and intra-individual response variability of the first section of a survey showed limited effectiveness. Additionally, this study indicated that, whereas the psychometric synonym score has an immediate effect and is designed with the goal of identifying careless respondents when combined with other variables, it is not necessarily the optimal choice for fitting a gradient boosting machine model.

Choosing connection: relational values as a career choice motivation predict teachers' relational goal setting

Relational goals have a positive impact on teachers' classroom performance, but little is known about the antecedents of these goals. One of the most important reasons for choosing teaching as a career is the desire to work with children/adolescents. This study examined this reason along with other relational career choice motives as predictors of relational goal orientation, complementing other studies that have examined the relationship between reasons for career choice and goal orientations but did not consider the relational component. We hypothesized that relational motives for career choice would predict relational goal setting for teaching better than other reasons for career choice. The sample comprised N = 167 student teachers at a large German university who answered an online questionnaire assessing motivations for choosing teaching as a career, professional self-concepts and relational goal orientation. Adopting an expectancy-value perspective, we set up a structural equation (N = 167) and two linear regression models (n₁ = 86, n₂ = 81) to examine the effects of student teachers' career choice motives on relational goal orientation. Analyses showed that the relational motive of educational interest was the only significant predictor in a structural equation model with educational interest, subject-specific interest, and general ability beliefs as predictors and relational goal orientation as the criterion. The first regression model found that the social utility motive work with children/adolescents was a significant predictor of relational goal orientation when combined with other career choice motives, namely educational interest, subject-specific interest, general abilitiy beliefs, and three other social utility factors. The second regression model found no significant effects of educational interest, subject-specific interest, educational self-concept and subject-specific self-concept on relational goal orientation. The results suggest that teachers who choose their profession because they enjoy working with children and adolescents are likely to strive to build satisfactory student-teacher relationships. Implications for future research and teacher education are discussed.