Are Attention Check Questions a Threat to Scale Validity?

Detecting inattentive respondents by machine learning: A generic technique that substitutes for the directed questions scale and compensates for its shortcomings

Web surveys are often used to collect data for psychological research. However, the inclusion of many inattentive respondents can be a problem. Various methods for detecting inattentive respondents have been proposed, most of which require the inclusion of additional items in the survey for detection or the calculation of variables for detection after data collection. This study proposes a method for detecting inattentive respondents in web surveys using machine learning. The method requires only the collection of response time and the inclusion of a Likert scale, eliminating the need to include special detection items in the survey. Based on data from 16 web surveys, a method was developed using predictor variables not included in existing methods. While previous machine learning methods for detecting inattentive respondents can only be applied to the same surveys as the data on which the models were developed, the proposed model is generic and can be applied to any questionnaire as long as response time is available, and a Likert scale is included. In addition, the proposed method showed partially higher accuracy than existing methods.

Difficulties in Emotion Regulation in Avoidant/Restrictive Food Intake Disorder

OBJECTIVE

Despite substantial research indicating difficulties with emotion regulation across eating disorder presentations, emotion regulation has yet to be studied in adults with avoidant/restrictive food intake disorder (ARFID). We hypothesized that (1) those with ARFID would report greater overall emotion regulation difficulties than nonclinical participants, and (2) those with ARFID would not differ from those with other eating disorders on the level of emotion regulation difficulty.

METHODS

One hundred and thirty-seven adults (age 18-30) from an outpatient clinic with ARFID (n = 27), with other primarily restrictive eating disorders (e.g., anorexia nervosa; n = 34), and with binge/purge eating disorders (e.g., bulimia nervosa; n = 51), as well as nonclinical participants (n = 25) recruited via Amazon Mechanical Turk (MTurk) completed the Difficulties in Emotion Regulation Scale (DERS). We compared DERS scores across groups.

RESULTS

In line with expectations, patients with ARFID scored significantly higher than nonclinical participants on the DERS Total (p = 0.01) with a large effect size (d = 0.87). Also as hypothesized, those with ARFID did not differ from those with other primarily restrictive (p = 0.99) or binge/purge disorders (p = 0.29) on DERS Total.

DISCUSSION

Adults with ARFID appear to exhibit emotion regulation difficulties which are greater than nonclinical participants, and commensurate with other eating disorders. These findings highlight the possibility of emotion regulation difficulties as a maintenance mechanism for ARFID.

Bridging health self-efficacy and patient engagement with patient-centered culturally sensitive health care for Black American adults

This study investigates whether systems-level interventions, specifically patient-centered culturally sensitive health care (PC-CSHC) from healthcare providers, office staff, and the clinic environment, moderate the relationship between health self-efficacy and patient engagement among Black American adults. An online survey was completed by 198 Black American adults. PC-CSHC from healthcare providers, office staff, and the clinic environment did not mitigate the adverse effects of low health self-efficacy on patient engagement. However, PC-CSHC from healthcare providers (b = 0.38) was as significant as health self-efficacy (b = 0.37) in predicting patient engagement, R2 = 0.47, F(9, 177) = 19.61, p < 0.001. Provider-delivered PC-CSHC can enhance patient engagement among Black American adults. This systems-level approach has the potential to reach more patients than intrapersonal interventions alone and alleviates the undue burden placed on Black Americans to leverage intrapersonal strengths in the face of health disparities rooted in structural racism.

Adaptation and psychometric investigation of the Gameful Experience Questionnaire (GAMEFULQUEST) in Brazilian Portuguese

Over the years, the use of questionnaires has become one of the most used methods for analyzing individuals' experiences. Especially in the area of gameful environments (e.g., games, gamification, and simulators), the Gameful Experience Questionnaire, a self-report instrument to measure gameful experience, became one of the most popular. Despite the instrument's popularity, there is no Brazilian Portuguese version, preventing studies from being carried out in Brazil (i.e., a country with more than 200 million inhabitants), where only 5.1% of the population have adequate English comprehension skills. To face this challenge, we conducted a cross-cultural adaptation of the Gameful Experience Questionnaire, providing a version of the questionnaire in the Brazilian Portuguese language. For this process, we conducted a mixed-methods (i.e., qualitative and quantitative) psychometric study (N = 384) organized in six steps (i.e., (i) translation, (ii) synthesis, (iii) experts evaluation, (iv) target audience evaluation, (v) adapted instrument application, and (vi) validation (i.e., confirmatory factor analysis)). The results indicate that the cross-cultural adaptation took place efficiently, where the resulting instrument maintained the psychometric properties of the original, measuring the construct of interest with similar effectiveness (i.e.,χ 2 / d f = 2.4, RMSEA = 0.061, CFI = 0.991, TLI = 0.989, GFI = 0.986 and SRMR = 0.061), enabling its application with Brazilian Portuguese speakers. With this study, we contribute to researchers and practitioners in the field of gameful environments by providing an instrument to measure gameful experience in the Brazilian Portuguese language.

Values in Romantic Relationships

There are substantive theoretical questions about whether personal values affect romantic relationship functioning. The current research tested the association between personal values and romantic relationship quality while considering potential mediating mechanisms related to pro-relational attitudes, communal strength, intrinsic relationship motivation, and entitlement. Across five studies using different measures of value priorities, we found that the endorsement of self-transcendence values (i.e., benevolence, universalism) was related to higher romantic relationship quality. The findings provided support for the mediating roles of pro-relational attitudes, communal strength, and intrinsic relationship motivation. Finally, a dyadic analysis in our fifth study showed that self-transcendence values mostly influence a person's own relationship quality but not that of their partner. These findings provide the first evidence that personal values are important variables in romantic relationship functioning while helping to map the mechanisms through which this role occurs.

Testing the reciprocal relationship between depressive symptoms and insomnia

BACKGROUND

Although the importance of sleep difficulties in emotional disorders has long been acknowledged, the nature of the potential reciprocal relationship between sleep and depressive symptoms is not yet well understood. The coronavirus disease 19 pandemic provided a unique opportunity to study the interrelation of these symptoms over a period marked by increases in sleep and psychological difficulties.

METHODS

Using online data collection, we followed 1200 adults (59% male) through 1 year of the pandemic. Measures of sleep disturbance and depressive symptoms were assessed at eight time points. Factor analysis of the items from these two measures suggested separate insomnia and depressive symptom factors. A random intercept cross-lagged panel model was used to assess within-person relationships between factor analysis-informed subscales of insomnia and depressive symptoms.

RESULTS

Depressive symptoms predicted subsequent changes in insomnia symptoms; however, insomnia did not predict changes in depressive symptoms.

CONCLUSIONS

Our findings suggest the impact of depressive symptoms on insomnia is evident, but the reverse is not. Implications of this finding along with the need for research addressing depressive symptoms and insomnia as treatment targets are discussed.

Patient reported outcomes and patient experiences of immune checkpoint modulators for advanced or recurrent melanoma: a mixed methods study

PURPOSE

Little is known about late and long-term patient-reported outcomes (PROs) of immune checkpoint modulators (ICMs) outside clinical trials. We conducted a cross-sectional, mixed-methods study to describe long-term PROs among advanced melanoma patients who began standard of care treatment with ICMs at least 1 year previously.

METHODS

All participants completed the Functional Assessment of Cancer Therapy-Immune Checkpoint Modulator (FACT-ICM), assessing 46 immune-related side effects on a 5-point Likert scale, and a subset completed individual interviews. Descriptive statistics were computed for quantitative data and applied thematic analysis was used to examine qualitative data.

RESULTS

Participants (N = 80) had a mean age of 67 years, and the majority were male (66%), non-Hispanic White (96%), and college graduates (61%). Single-agent nivolumab was the most common first (47%) and current/recent ICM (64%). On the FACT-ICM, 98% of participants reported at least one side effect, and 78% reported moderate or severe side effects. The most common moderate or severe side effects were aching joints (43%) and fatigue (38%). In interviews (n = 20), we identified five themes regarding patients' longer-term experiences after ICMs: lasting fatigue or decline in functioning, minimal side effects, manageable thyroid and pituitary dysfunction, skin conditions can be difficult to manage, and treating the cancer is worth the side effects.

CONCLUSIONS

Nearly all patients reported side effects of ICMs at least 1 year after starting treatment. Our findings suggest that ICM side effect screening and management-especially for aching joints and fatigue-are indicated during long-term care of people living with advanced melanoma.

Associations between attitudes towards and reported intakes of sugars, low/no-calorie sweeteners, and sweet-tasting foods in a UK sample

Public health initiatives are currently aiming to lower free sugar intakes for health benefits, but attitudes towards sugars, their alternatives such as low/no-calorie sweeteners (LNCS), and towards sweet-tasting foods may be hampering efforts. This work investigated associations between attitudes towards and the reported intakes of sugars, LNCS and sweet-tasting foods, and identified latent attitude profiles in subpopulations of adults in the United Kingdom. A total of 581 adults completed a questionnaire assessing their usual intake of sugars, LNCS and sweet-tasting foods, attitudes towards these foods and various demographic characteristics. Six principal components explained 39.1% of the variance in the attitude responses, named: 'Personal Impact', 'Personal Management', 'Apathy', 'Negativity', 'Perceived Understanding' and 'Perceived Nonautonomy'. Personal Impact was negatively associated with reported consumption of sugar-food and sweet-tasting food groups more frequently (smallest β = -0.24, p < .01). Personal Management was positively associated with reporting adding sugar and consuming sugar-food and sweet-tasting food groups more frequently (smallest β = 0.14, p < .01). Three latent classes of participants with distinct patterns of attitudes were identified, labelled: 'Feeling Ill-equipped' (n = 52), 'Actively Engaged' (n = 162) or 'Unopinionated' (n = 367). Individuals who were classed as Actively Engaged reported adding LNCS more frequently than those classed as Feeling Ill-equipped (t(212) = -2.14, p<.01), who reported consuming sweet-tasting food groups more frequently than those classed as Unopinionated (t(417) = 2.65, p < .01). These findings suggest the need for personalised approaches within public health initiatives, to reduce free sugar intakes.

Avoidant/restrictive food intake disorder differs from anorexia nervosa in delay discounting

BACKGROUND

Avoidant/restrictive food intake disorder (ARFID) and anorexia nervosa (AN) are the two primary restrictive eating disorders; however, they are driven by differing motives for inadequate dietary intake. Despite overlap in restrictive eating behaviors and subsequent malnutrition, it remains unknown if ARFID and AN also share commonalities in their cognitive profiles, with cognitive alterations being a key identifier of AN. Discounting the present value of future outcomes with increasing delay to their expected receipt represents a core cognitive process guiding human decision-making. A hallmark cognitive characteristic of individuals with AN (vs. healthy controls [HC]) is reduced discounting of future outcomes, resulting in reduced impulsivity and higher likelihood of favoring delayed gratification. Whether individuals with ARFID display a similar reduction in delay discounting as those with AN (vs. an opposing bias towards increased delay discounting or no bias) is important in informing transdiagnostic versus disorder-specific cognitive characteristics and optimizing future intervention strategies.

METHOD

To address this research question, 104 participants (ARFID: n = 57, AN: n = 28, HC: n = 19) completed a computerized Delay Discounting Task. Groups were compared by their delay discounting parameter (ln)k.

RESULTS

Individuals with ARFID displayed a larger delay discounting parameter than those with AN, indicating steeper delay discounting (M ± SD = -6.10 ± 2.00 vs. -7.26 ± 1.73, p = 0.026 [age-adjusted], Hedges' g = 0.59), with no difference from HC (p = 0.514, Hedges' g = -0.35).

CONCLUSION

Our findings provide a first indication of distinct cognitive profiles among the two primary restrictive eating disorders. The present results, together with future research spanning additional cognitive domains and including larger and more diverse samples of individuals with ARFID (vs. AN), will contribute to identifying maintenance mechanisms that are unique to each disorder as well as contribute to the optimization and tailoring of treatment strategies across the spectrum of restrictive eating disorders.

Do media objectivity and frequency of informing mediate the relationship between traditionalist social attitudes and COVID-19 conspiracy beliefs?

In this study, we hypothesized that traditionalist social attitudes (conservatism, religiousness, and authoritarianism) significantly predict COVID-19 conspiracy beliefs (Hiding Information and Harmless Virus), as well as conspiracy mentality in general. We also hypothesized that these relationships are mediated by the objectivity of the media through which individuals inform themselves, and the frequency with which people informed themselves about the pandemic. The sample consisted of 341 participants from Serbia (mean age 33.51 years), of which 40.5% were women. The results revealed that conservatism predicts both conspiracy belief sets and conspiracy mentality, authoritarianism only COVID-19 conspiracy beliefs, and religiousness only beliefs that the virus is harmless. Media objectivity does not mediate these relationships. The frequency of informing is a significant mediator only of the relationships between authoritarianism, and conspiracy beliefs and conspiracy mentality, indicating that the role of seeking information is in reducing the threat perceived by more authoritarian individuals. The study reveals that media objectivity might not play a role in reducing conspiracy beliefs. An explanation might be found in the importance of the perceived credibility of the media.

The positive-negative-competence (PNC) model of psychological responses to representations of robots

Robots are becoming an increasingly prominent part of society. Despite their growing importance, there exists no overarching model that synthesizes people's psychological reactions to robots and identifies what factors shape them. To address this, we created a taxonomy of affective, cognitive and behavioural processes in response to a comprehensive stimulus sample depicting robots from 28 domains of human activity (for example, education, hospitality and industry) and examined its individual difference predictors. Across seven studies that tested 9,274 UK and US participants recruited via online panels, we used a data-driven approach combining qualitative and quantitative techniques to develop the positive-negative-competence model, which categorizes all psychological processes in response to the stimulus sample into three dimensions: positive, negative and competence-related. We also established the main individual difference predictors of these dimensions and examined the mechanisms for each predictor. Overall, this research provides an in-depth understanding of psychological functioning regarding representations of robots.

Prevalence of questionable health behaviours in Serbia and their psychological roots: protocol for a nationally representative survey

INTRODUCTION

We will launch a national survey in Serbia to document the prevalence of two types of questionable health behaviours: (1) intentional non-adherence to medical recommendations and (2) use of traditional, complementary and alternative medicine practices, as well as the relation between the two. We will also investigate their psychological roots, including (a) 'distal' predictors such as HEXACO personality traits (plus Disintegration) and thinking dispositions (rational/experiential thinking and cognitive reflexivity), and (b) 'proximal' predictors under the umbrella 'irrational mindset' (set of unfounded beliefs consisting of conspiratorial thinking, superstition, magical health beliefs as well as selected cognitive biases), which have more content-wise overlap with the health behaviours.

METHODS AND ANALYSIS

In this cross-sectional study, a research agency will collect data from a nationally representative sample (n=1043; age 18-75 years; estimated start/end-June/November 2021) recruited online (approximately, 70% of the sample, aged 18-54; 11 years) and face-to-face (approximately, 30% of the sample, aged 55-75 years). Participants will complete a battery of tests assessing questionable health behaviours, basic personality traits, thinking dispositions, irrational mindset, sociopolitical beliefs, sociodemographic and health-related variables. Prevalence rates will be calculated using descriptive statistics. To explore the relation between (psychological) predictors and questionable health behaviours, we will use hierarchical regression and partial mediation models (path analysis or full SEM models).

ETHICS AND DISSEMINATION

Ethical Committees of the Faculty of Philosophy in Belgrade (#935/1), Faculty of Special Education and Rehabilitation (#139/1) and Faculty of Media and Communications (#228) approved the protocol. Only participants who provide informed consent will participate in the study. A research report based on the study results will be submitted to peer-reviewed journals and results will be made available to stakeholders through reports on the project website https://reasonforhealth.f.bg.ac.rs/en/ and disseminated via social media.

TRIAL REGISTRATION NUMBER

NCT05808660.

Development and Validation of an Ability Measure of Emotion Understanding: The Core Relational Themes of Emotion (CORE) Test

Emotion understanding (EU) ability is associated with healthy social functioning and psychological well-being. Across three studies, we develop and present validity evidence for the Core Relational Themes of Emotions (CORE) Test. The test measures people's ability to identify relational themes underlying 19 positive and negative emotions. Relational themes are consistencies in the meaning people assign to emotional experiences. In Study 1, we developed and refined the test items employing a literature review, expert panel, and confusion matrix with a demographically diverse sample. Correctness criteria were determined using theory and prior research, and a progressive (degrees of correctness) paradigm was utilized to score the test. In Study 2, the CORE demonstrated high internal consistency and a confirmatory factor analysis supported the unidimensional factor structure. The CORE showed evidence of convergence with established EU ability measures and divergent relationships with verbal intelligence and demographic characteristics, supporting its construct validity. Also, the CORE was associated with less relational conflict. In Study 3, the CORE was associated with more adaptive and less maladaptive coping and higher well-being on multiple indicators. A set of effects remained, accounting for variance from a widely used EU test, supporting the CORE's incremental validity. Theoretical and methodological contributions are discussed.

Frustration and ennui among Amazon MTurk workers

Academics are increasingly turning to crowdsourcing platforms to recruit research participants. Their endeavors have benefited from a proliferation of studies attesting to the quality of crowdsourced data or offering guidance on managing specific challenges associated with doing crowdsourced research. Thus far, however, relatively little is known about what it is like to be a participant in crowdsourced research. Our analysis of almost 1400 free-text responses provides insight into the frustrations encountered by workers on one widely used crowdsourcing site: Amazon's MTurk. Some of these frustrations stem from inherent limitations of the MTurk platform and cannot easily be addressed by researchers. Many others, however, concern factors that are directly controllable by researchers and that may also be relevant for researchers using other crowdsourcing platforms such as Prolific or CrowdFlower. Based on participants' accounts of their experiences as crowdsource workers, we offer recommendations researchers might consider as they seek to design online studies that demonstrate consideration for respondents and respect for their time, effort, and dignity.

Free from your experiences to grow: belief in free will moderates the relationship between attachment avoidance and personal growth initiative

BACKGROUND

Attachment theory proposes that attachment security facilitates personal growth. However, attachment security origins in relationship history, and thus, how people treat their experiences may influence the outcomes of attachment security. People differ in the degree in believing that human beings have free will, and belief in free will may influence the relationship between experiences and outcomes. The present cross-sectional study investigated the relationships between attachment security, belief in free will, and personal growth initiative.

METHODS

We used the cross-sectional data of 346 Chinese college students for data analysis, including correlational analyses, regression, and moderation analyses. The nine-item Chinese version of the Experiences in Close Relationships-Relationship Structures Scale, the sixteen-item Chinese version of the Personal Growth Initiative Scale-II, and the seven-item Free Will subscale of the Chinese version of the Free Will and Determinism Plus Scale were utilized.

RESULTS

Results showed attachment avoidance and belief in free will, not attachment anxiety, was associated with personal growth initiative. Belief in free will moderated the association between attachment avoidance and personal growth initiative. When the centered score of belief in free will was higher than 0.64, attachment avoidance was no longer associated with personal growth initiative. 85.84% of our data were below this Johnson-Neyman significance region, and 14.16% were above. In other words, only those who scored higher than 0.64 on free will beliefs were able to pursue personal growth despite their high attachment avoidance.

CONCLUSIONS

These findings suggest that when believing in free will, avoidantly attached people may believe in their ability to pursue personal growth and think their future has more possibilities, not influenced by other factors like social support, which they think they lack.

The Influence of Health Care Provider-Initiated HIV Screening on the Rate of HIV Testing among Black and Latinx People in the Midwest

HIV continues to impact people of color disproportionately. In 2015, Black Americans accounted for 42% of those living with HIV, and Latinx individuals accounted for 30% of new diagnoses. Using a sample of 364 people of color, demographic data, HIV testing history, and interactions with health care providers were collected. Over half of the participants (59.3%) had never been offered an HIV test, and only 19% reported a provider had offered an HIV test once, followed by 14% who have had a provider offer an HIV test more than once. Participants who were offered an HIV test once were 13.23 times more likely to report a history of HIV screening, and those offered an HIV test more than once were 18.02 times more likely to report a history of HIV testing. Participants who reported feeling a "little" judged were 6.85 times less likely to report being screened for HIV.

Hovering or invalidating? Examining nuances in the associations between controlling parents and problematic outcomes for college students

Objective: The purpose of these studies was to examine whether college students' beliefs about themselves (i.e., self-compassion and beliefs about emotions) could be mechanisms explaining the relationship between problematic parenting behaviors (helicopter parenting and parental invalidation) and outcomes including perfectionism, affective distress, locus of control, and distress tolerance. Participants: Respondents included 255 (Study 1) and 277 (Study 2) college undergraduates. Methods: Simultaneous regressions and separate path analyses with helicopter parenting and parental invalidation as predictors, with self-compassion and emotion beliefs as mediators. Results: Across both studies, parental invalidation predicted perfectionism, affective distress, distress tolerance, and locus of control, and these links were often mediated by self-compassion. Self-compassion emerged as the most consistent and strongest link between parental invalidation and negative outcomes. Conclusion: People who internalize their parents' criticism and invalidation such that they hold negative beliefs about themselves (i.e., low self-compassion) may be vulnerable to negative psychosocial outcomes.

Adaptation and Validation of a French Version of the Vaccination Attitudes Examination (VAX) Scale

Over the past decades, vaccination has proven to be largely beneficial to global health. Despite vaccine efficacy, the French population has been recently affected by more anti-vaccination attitudes and vaccine refusal, and it is therefore necessary to validate tools to study this health issue. The Vaccination Attitudes Examination scale (VAX) is a 12-item questionnaire targeting adults that assesses general attitudes towards vaccination. The aims of the study were to translate and adapt the original English version of the scale into French and to test the psychometric properties of the scale in a French-population-based sample of adults. We included 450 French speaking adults that completed the French VAX and other questionnaires to assess convergent and divergent validities. Exploratory and confirmatory factor analyses showed that the French version of the VAX replicated the factorial structure of the original scale. Moreover, it demonstrated high internal consistency, good convergent and divergent validities, and excellent temporal stability. Furthermore, scores on the scale differentiated vaccinees from non-vaccinee respondents. Results on the scale provide us with insight into factors involved in vaccine hesitancy in France, therefore allowing French authorities and policy makers to address these specific concerns and improve vaccine acceptance rates in this country.

Development and Validation of a Novel Instrument to Measure the Community Well-Being of Residency Programs

PURPOSE

To develop and validate the Residency Community Well-Being (RCWB) instrument, a novel instrument to measure the subjective community well-being of an individual residency program, and to explore differences in RCWB scores between demographic groups.

METHOD

An initial questionnaire to measure a residency program's community well-being was developed after literature review. Items were pilot tested, and the questionnaire was reviewed by experts in the fields of residency education, survey design, and sociology. The questionnaire was administered electronically between March and July 2021 to U.S. residents in 18 specialties recruited through convenience and snowball sampling using social media, a listserv, and personal emails to residency program leaders. Three previously validated instruments were administered as well to examine criterion validity: the Professional Fulfillment Index, the Brief Inventory of Thriving, and a single-item burnout measure. Data were analyzed with descriptive statistics, and exploratory factor analysis was performed using principal axis factoring with direct oblimin rotation to reduce the items and identify subscales.

RESULTS

Of the 366 participants who opened and started the survey, 219 completed it (completion rate: 59.8%). Most respondents were women (133, 60.7%), 26-30 years old (132, 60.3%), and White (149, 68.0%). Three subscales emerged with 18 items: program leadership, structures, and practices (PLSP); resident interpersonal relationships (RIR); and resident mistreatment (RM). The Cronbach's alphas were 0.96 for PLSP, 0.92 for RIR, 0.82 for RM, and 0.95 for the overall RCWB. RCWB score positively correlated with professional fulfillment ( r = .52, P < .001) and thriving ( r = .45, P < .001) and inversely correlated with burnout ( r = -.39, P < .001).

CONCLUSIONS

The RCWB instrument demonstrates strong internal consistency and content and criterion validity that shows that a residency program's subjective community well-being is primarily composed of program leadership quality, supportive interpersonal relationships, and the absence of mistreatment.

Experiential purchases and feeling autonomous: Their implications for gratitude and ease of justification

In four studies, we tested the influence of type of purchase on autonomy support and the relationships between autonomy support, gratitude, and ease of justification. In each of the three studies, participants were randomly assigned to either the experiential purchase condition or the material purchase condition. In our fourth and last study, participants were assigned to an either autonomy supportive purchase condition or ordinary purchase condition. Results from study 1 showed a positive direct influence of experiential purchases on autonomy support and a direct and indirect significant relationship with gratitude. Results from study 2 with a sample of older consumers showed a positive influence of experiential purchases on autonomy support and a direct and indirect positive relationship with gratitude. In study 3, consumers who brought to mind an expensive experiential purchase reported higher autonomy support than participants who brought to mind an expensive material purchase and this experimental effect had an indirect positive relationship with gratitude and ease of justification. Last, consumers who brought to mind a purchase that truly reflected who they were reported higher levels of autonomy support than consumers who reported an ordinary purchase and this elicited autonomy had a positive relationship with gratitude. The implications of the results were discussed.

Awareness of and interaction with physician rating websites: A cross-sectional study in Austria

To date, the digital assessment of service experiences represents a decisive process step of a feedback culture in numerous economic areas. In view of this digitalization of service assessments, the importance of Physician Rating Websites (PRWs) has also increased steadily in recent years. Even though these websites could be perceived as a powerful communication tool for the exchange of health specific information, the knowledge about whether and how different population segments use these portals has been limited so far. For this reason, our aim was to investigate the level of awareness regarding PRWs among the study population and to discover how users interact with this specific type of online portals. We performed an online survey including 558 participants. To ensure the attention and integrity of participants, attention checks were included in the questionnaire. Study participants who did not exceed the mentioned security levels were excluded from the study. Statistical analyses were carried out, using IBM SPSS Statistics 27. To illustrate the relationship between demographic variables and dependent variables, two tailed chi square tests were performed. Comparison of means and t-testing was used to investigate the relationship between psychographic variables and the dependent variables. In addition to that, the awareness levels regarding different rating portals were evaluated using descriptive methods. Our results suggest that the general awareness regarding PRWs is relatively high (75.6%, 423/558), especially among female (x21 = 9.880, P = .002), middle-aged (x29 = 26.810, P = .002), more highly educated (x24 = 19.038, P = .001), urban (x21 = 6.274, P = .012), digitally literate (t203 = 2.63, P = .009) individuals and particularly among respondents with a higher eHealth literacy (t203 = 2.37, P = .019). Even though more than three quarters of the respondents know that PRWs exist, compared to other rating platforms, they are only in the lower midfield. The upper ranks are taken by websites on which restaurant visits (98.9%, 552/558), hotel stays (97.7%, 545/558) or movies (95.5%, 533/558) can be rated. The most popular PRWs in Austria include Docfinder.at (31.3%, 175/558; 77.8%, 434/558) followed by the evaluation tools provided by Google.at (8.24%, 46/558; 70.3%, 392/558) and Herold.at (1.61%, 9/558; 44.8%, 250/558). In Austria, PRWs seem to be characterized by a high degree of interaction (89.2%, 498/558) with a wide variety of different types of interactions. While many respondents use PRWs to retrieve general information (83.2%, 464/558), there are significantly fewer who read physicians' reviews (60.9%, 340/558) and use this portal to select a physician (60.6%, 338/558). Respondents who have already rated a doctor themselves belong to the smallest group accounting for just 14.7% (82/558). Significant effects regarding the interaction with PRWs exist between different genders, ages, education levels, marital statuses, occupations and areas of living. In addition to that, respondents with better feelings towards the internet, greater digital literacy as well as a higher eHealth literacy were also characterized with a higher interaction rate regarding PRWs. According to the high level of awareness of and interaction with PRWs within our study population, PRWs appear to be a successful medium for health-related communication. Especially for female, middle-aged, more highly educated, urban and more technology savvy population segments, PRWs seem to represent an effective tool to support the health-specific decision-making process.

A scenario-based quasi-experimental study of co-workers’ cognitive responses to an individual’s resource-focused job crafting

Research on job crafting has demonstrated a more positive effect of an individual’s approach crafting on co-workers and supervisors compared to the effect of avoidance crafting, but how the availability of resources and demands affects this relationship remains unclear. Our study investigates co-workers’ cognitive responses to an individual’s resource-focused job crafting when resources are finite. We applied a scenario-based quasi-experimental research design to test the moderating effect of resource availability on the relationship between an individual’s resource-focused job crafting and co-workers’ evaluation. The results show that co-workers rate avoidance resources crafting as more destructive than approach resources crafting. When an individual steps away from unlimited resources, co-workers perceive the behavior more negatively than they do when the individual avoids limited resources. For approaching resources, the effect is reversed. The study provides insights into co-workers’ responses to job crafting and the influence of contextual factors.

Eating Disorder Examination-Questionnaire and Clinical Impairment Assessment norms for intersectional identities using an MTurk sample

OBJECTIVE

There are limited data to guide the interpretation of scores on measures of eating-disorder psychopathology among underrepresented individuals. We aimed to provide norms for the Eating Disorder Examination-Questionnaire (EDE-Q) and Clinical Impairment Assessment (CIA) across racial/ethnic, gender, and sexual identities, and sexual orientations and their intersections by recruiting a diverse sample of Amazon MTurk workers (MTurkers; N = 1782).

METHOD

We created a comprehensive, quantitative assessment of racial/ethnic identification, gender identification, sex assigned at birth, current sexual identification, and sexual orientation called the Demographic Assessment of Racial, Sexual, and Gender Identities (DARSGI). We calculated normative data for each demographic category response option.

RESULTS

Our sample was comprised of 68% underrepresented racial/ethnic identities, 42% underrepresented gender identities, 13% underrepresented sexes, and 49% underrepresented sexual orientations. We reported means and standard deviations for each demographic category response option and, where possible, mean estimates by percentile across intersectional groups. EDE-Q Global Score for a subset of identities and intersections in the current study were higher than previously reported norms for those identities/intersections.

DISCUSSION

This is the most thorough reporting of norms for the EDE-Q and CIA among racial/ethnic, sexual, and gender identities, and sexual orientations and the first reporting on multiple intersections, filling some of the gaps for commonly used measures of eating-disorder psychopathology. These norms may be used to contextualize eating-disorder psychopathology reported by underrepresented individuals. The data from the current study may help inform research on the prevention and treatment of eating-disorder psychopathology in underrepresented groups.

PUBLIC SIGNIFICANCE

We provide the most thorough reporting on racial/ethnic, sexual, and gender identities, and sexual orientations for the Eating Disorder Examination - Questionnaire and Clinical Impairment Assessment, and the first reporting on intersections, which fills some of the gaps for commonly used measures of eating-disorder psychopathology. These norms help inform research on the prevention and treatment of eating-disorder psychopathology in underrepresented groups.

The Impact of Social Influence on the Intention to Use Physician Rating Websites: Moderated Mediation Analysis Using a Mixed Methods Approach

BACKGROUND

Physician rating websites (PRWs) have become increasingly important in the cross-section between health and digitalization. Social influence plays a crucial role in human behavior in many domains of life, as can be demonstrated by the increase in high-profile influential individuals such as social media influencers (SMIs). Particularly in the health-specific environment, the opinion of family and friends has a significant influence on health-related decisions. However, so far, there has been little discussion about the role of social influence as an antecedent of behavioral intention to use PRWs.

OBJECTIVE

On the basis of theories of social psychology and technology acceptance and theories from the economic perspective, this study aimed to evaluate the impact of social influence on the behavioral intention to use PRWs.

METHODS

We conducted 2 studies by applying a mixed methods approach including a total of 712 participants from the Austrian population. The impact of social influence on the behavioral intention to use PRWs was investigated through linear regression and mediation and moderated mediation analysis using the PROCESS macro 4.0 in SPSS 27 (IBM Corp).

RESULTS

The 2 studies show similar results. In study 1, an experiment, no direct effect of social influence on the behavioral intention to use PRWs could be detected. However, an indirect effect of social influence on the behavioral intention to use PRWs via credibility (b=0.572; P=.005) and performance expectancy (b=0.340; P<.001) could be confirmed. The results of study 2, a cross-sectional study, demonstrate that social influence seems to have a direct impact on the behavioral intention to use PRWs (b=0.410; P<.001). However, when calculating the proposed mediation model, it becomes clear that this impact may partly be explained through the 2 mediator variables-credibility (b=0.208; P<.001) and performance expectancy (b=0.312; P<.001). In contrast to the observed direct and indirect effect, neither demographic nor psychographic variables have a significant moderating impact on the influencing chain in study 2.

CONCLUSIONS

This study provides an indication that social influence has at least an indirect impact on the behavioral intention to use PRWs. It was observed that this impact is exerted through credibility and performance expectancy. According to the findings of both studies, social influence has the potential to boost the use of PRWs. As a result, these web-based networks might be a promising future interface between health care and digitalization, allowing health care practitioners to gain a beneficial external impact while also learning from feedback. Social influence nowadays is not just limited to friends and family but can also be exerted by SMIs in the domain of PRW use. Thus, from a marketing perspective, PRW providers could think of collaborating with SMIs, and our results could contribute to stimulating discussion in this vein.

Evidence for the reliability and validity of a Spanish translation of the Medication Management Ability Assessment administered via tele-assessment

We translated the Medication Management Ability Assessment (MMAA) from English to Spanish for use via tele-assessment and examined its reliability and validity. Following International Test Commission Guidelines for Translating and Adapting Tests, we used translation/back-translation and a small focus group (n = 6) to adapt a Spanish version of the MMAA. Eighty-six Spanish-speaking adults completed the adapted MMAA via tele-assessment at baseline and at a two-week follow-up visit. Participants also completed several self-report and performance-based cognitive and functional measures. The internal consistency of the MMAA was excellent (standardized Cronbach's α = 0.90). Performance-based functional assessments (PBFAs) and objective cognition were positively associated with the MMAA at small to medium effect sizes. Self-report measures of daily function and cognition, measures of health literacy, and estimates of premorbid intellectual functioning were not significantly associated with MMAA performance. The test-retest reliability of the MMAA was good (CCC = 0.73, 95% CI [0.62, 0.81]; rs = 0.37, p < 0.001) and demonstrated a small practice effect (Cohen's d = 0.36, p = 0.001). Preliminary evidence for the construct validity of a Spanish-language MMAA administered via tele-assessment further expands the potential clinical utility of PBFAs in culturally diverse, Spanish-speaking populations.

A Comprehensive Assessment of Human Factors in Cyber Security Compliance toward Enhancing the Security Practice of Healthcare Staff in Paperless Hospitals

Recent reports indicate that over 85% of data breaches are still caused by a human element, of which healthcare is one of the organizations that cyber criminals target. As healthcare IT infrastructure is characterized by a human element, this study comprehensively examined the effect of psycho-socio-cultural and work factors on security behavior in a typical hospital. A quantitative approach was adopted where we collected responses from 212 healthcare staff through an online questionnaire survey. A broad range of constructs was selected from psychological, social, cultural perception, and work factors based on earlier review work. These were related with some security practices to assess the information security (IS) knowledge, attitude and behavior gaps among healthcare staff in a comprehensive way. The study revealed that work emergency (WE) has a positive correlation with IS conscious care behavior (ISCCB) risk. Conscientiousness also had a positive correlation with ISCCB risk, but agreeableness was negatively correlated with information security knowledge (ISK) risk and information security attitude (ISA) risk. Based on these findings, intrinsic and extrinsic motivation methods combined with cutting-edge technologies can be explored to discourage IS risks behaviors while enhancing conscious care security practice.

Burnout Profiles Among Young Researchers: A Latent Profile Analysis

Introduction

Burnout is a growing problem among young researchers, affecting individuals, organizations and society. Our study aims to identify burnout profiles and highlight the corresponding job demands and resources, resulting in recommendations to reduce burnout risk in the academic context.

Methods

This cross-sectional study collected data from young researchers (n = 1,123) at five Flemish universities through an online survey measuring burnout risk, work engagement, sleeping behavior, and the most prominent job demands (e.g., publication pressure) and resources (e.g., social support). We conducted Latent Profile Analysis (LPA) to identify burnout profiles in young researchers and subsequently compared these groups on job demands and resources patterns.

Results

Five burnout profiles were identified: (1) High Burnout Risk (9.3%), (2) Cynical (30.1%), (3) Overextended (2.3%), (4) Low Burnout Risk (34.8%), and (5) No Burnout Risk (23.6%). Each burnout profile was associated with a different pattern of job demands and resources. For instance, high levels of meaningfulness (OR = −1.96) decreased the odds to being classified in the Cynical profile.

Conclusion

Our findings show that the Cynical profile corresponds to a relatively high number of young researchers, which may imply that they are particularly vulnerable to the cynicism dimension of burnout. Additionally, work-life interference and perceived publication pressure seemed the most significant predictors of burnout risk, while meaningfulness, social support from supervisor and learning opportunities played an important protective role.

Stronger Together: Examining the Interaction Effects of Workplace Dignity and Workplace Inclusion on Employees' Job Performance

Despite growing interest in workplace dignity, there is a paucity of empirical research regarding whether and when it leads to higher job performance. To address these research gaps, this study examines the relationship between workplace dignity and job performance, identifying and examining the boundary condition role of workplace inclusion. Multi-source and time-lagged data were obtained from employee-supervisor dyads (n = 169) in non-governmental organizations in Pakistan to test the hypothesized model, employing techniques, such as confirmatory factor analysis, moderated multiple regression, post-hoc slope, and Johnson-Neyman analyses. As predicted, workplace dignity and workplace inclusion positively influenced employees' job performance, while workplace inclusion moderated the dignity-performance relationship such that this relationship was more strongly positive when workplace inclusion was high. At the theoretical level, this study adds new insights to the job demands-resources (JD-R) model, which is used as theoretical lens in this study. Specifically, this study is the first to examine workplace dignity and its consequences from the perspective of the JD-R model, thus introducing a new theoretical perspective into the dignity literature. This study also provides useful advice for management practice, policymaking, and employees, and is germane to the United Nations' Sustainable Development Goal 8.

Conducting organizational survey and experimental research online: From convenient to ambitious in study designs, recruiting, and data quality

Conducting organizational research via online surveys and experiments offers a host of advantages over traditional forms of data collection when it comes to sampling for more advanced study designs, while also ensuring data quality. To draw attention to these advantages and encourage researchers to fully leverage them, the present paper is structured into two parts. First, along a structure of commonly used research designs, we showcase select organizational psychology (OP) and organizational behavior (OB) research and explain how the Internet makes it feasible to conduct research not only with larger and more representative samples, but also with more complex research designs than circumstances usually allow in offline settings. Subsequently, because online data collections often also come with some data quality concerns, in the second section, we synthesize the methodological literature to outline three improvement areas and several accompanying strategies for bolstering data quality.

Plain Language Summary: These days, many theories from the fields of organizational psychology and organizational behavior are tested online simply because it is easier. The point of this paper is to illustrate the unique advantages of the Internet beyond mere convenience—specifically, how the related technologies offer more than simply the ability to mirror offline studies. Accordingly, our paper first guides readers through examples of more ambitious online survey and experimental research designs within the organizational domain. Second, we address the potential data quality drawbacks of these approaches by outlining three concrete areas of improvement. Each comes with specific recommendations that can ensure higher data quality when conducting organizational survey or experimental research online.

Disclosure of suicidal thoughts and behaviors: The impact of suicide event type

OBJECTIVES

Despite its importance, limited work has investigated the nuances of suicidal thoughts and behavior self-disclosure. The present study aimed to examine potential differences in self-disclosure based on whether an individual has disclosed suicidal thinking versus behavior.

METHODS

Two hundred and four participants having disclosed their suicidal thoughts or behaviors completed a battery of online questionnaires assessing several key aspects of disclosure (i.e., disclosure recipient, perceived helpfulness of disclosure, impact on treatment seeking), as it pertained to both one's first and overall disclosure experiences.

RESULTS

Individuals who disclosed a suicide attempt, versus ideation, were more likely to have disclosed to a formal support (i.e., health professional) and to seek professional help following disclosure. No significant group differences in perceived helpfulness of experiences were found.

CONCLUSION

It may be beneficial to increase opportunities for disclosure of suicidal thinking. Overall, disclosures were perceived as helpful and may not impede future help-seeking behavior.

Typologies of stress appraisal and problem-focused coping: associations with compliance with public health recommendations during the COVID-19 pandemic

BACKGROUND

Given prior research finding that young adults are less likely to engage in recommended public health behaviors (PHBs) than older adults, understanding who is and is not likely to engage in PHBs among young adults is crucial to mitigating the effects of the COVID-19 pandemic. Drawing on the Transactional Theory of Stress and Coping, this study examined how typologies of stress appraisal (SA) and problem-focused coping (PFC) among young adults were associated with compliance with public health recommendations during the pandemic.

METHODS

An online sample of young adults in the United States, ages 18-35, was recruited during the early phase of the pandemic (April-May 2020). Participants reported their appraisals of how central, threatening, and uncontrollable the pandemic was, their tendencies to engage in instrumental, problem-focused coping strategies, and how frequently they engaged in three recommended PHBs (social distancing, mask wearing, and hand washing).

RESULTS

Using latent class analysis, we identified three classes of individuals: Low-SA/Low-PFC, Low-SA/High-PFC, and High-SA/High-PFC. Demographics did not efficiently distinguish membership in the three classes. The former two classes reported less compliance with public health recommendations than did the latter class. Tests of measurement invariance for gender indicated trivial differences in the composition of class membership and relations to compliance.

CONCLUSIONS

This research uncovered three qualitatively distinct classes of people who differed in their appraisal of the pandemic and their tendency to engage in PFC. Individuals who view the pandemic as central and threatening and engage in problem-focused coping were more likely than their peers to comply with guidelines recommending social distancing, mask wearing, and hand washing. These results contribute to our understanding of why people do and do not comply with public health guidelines and highlight the importance of attending to psychological variables in public health research. Understanding what drives poor compliance with public health recommendations can contribute to efforts promoting better compliance, and ultimately better health outcomes.

Focusing on cybersickness: pervasiveness, latent trajectories, susceptibility, and effects on the virtual reality experience

Although virtual reality (VR) usage has become widespread in the last decade, its adoption has been hampered by experiences of user discomfort known as cybersickness. The present study, in line with the "2020 cybersickness R&D agenda", sought to provide a broad examination of the cybersickness phenomenon, assessing its pervasiveness, latent trajectories, impacts on the VR experience, and predictor variables. The study was composed of 92 participants living in the Dominican Republic with ages ranging from 18 to 52 years (M = 26.22), who experienced a 10-min VR immersion in two environments designed for psychotherapy. The results indicated that cybersickness was pervasive, with 65.2% of the participants experiencing it, and 23.9% severely. Additionally, the latent trajectories of cybersickness were positive and curvilinear, with large heterogeneity across individuals. Cybersickness also had a substantive negative impact on the user experience and the intentions to adopt the VR technology. Finally, motion sickness susceptibility, cognitive stress, and recent headaches uniquely predicted greater severity of cybersickness, while age was negatively related. These combined results highlight the critical role that cybersickness plays on the VR experience and underscore the importance of finding solutions to the problems, such as technological advancements or special usage protocols for the more susceptible individuals.

SUPPLEMENTARY INFORMATION

The online version contains supplementary material available at 10.1007/s10055-022-00636-4.

Practice makes perfect: Commentary on Burnette et al. (2021)

Underrepresented identities have been overlooked in the development of measures assessing eating disorders; therefore, limited normative data exist for these identities. To address this, Burnette et al. sought to provide Eating Disorder Examination-Questionnaire and Eating Attitudes Test-26 norms for transgender adults using Amazon's MTurk. However, they were unable to achieve this goal due to what they perceived as high rates of invalid responses. Instead, they provided recommendations for conducting MTurk research. However, little or no evidence supports the validity of several recommendations, partly because their study was not designed to derive or validate recommendations. By their own admission, their strategies failed to address what they identified as the central problem. We express concern about Burnette et al.'s recommendations because (a) the recommendations are built on assumptions about the problem that may not be true; and (b) the recommendations are not provided within the context of limitations of self-report/online data collection writ large. We detail these concerns and propose that strategies for mitigating inattentive/invalid responding be subjected to validation prior to being recommended to prevent the implementation of procedures that result in the exclusion of the target population, individuals who we historically, and perhaps still, unjustly exclude from research.

Can I show my skills? Affective responses to artificial intelligence in the recruitment process

Companies increasingly use artificial intelligence (AI) and algorithmic decision-making (ADM) for their recruitment and selection process for cost and efficiency reasons. However, there are concerns about the applicant’s affective response to AI systems in recruitment, and knowledge about the affective responses to the selection process is still limited, especially when AI supports different selection process stages (i.e., preselection, telephone interview, and video interview). Drawing on the affective response model, we propose that affective responses (i.e., opportunity to perform, emotional creepiness) mediate the relationships between an increasing AI-based selection process and organizational attractiveness. In particular, by using a scenario-based between-subject design with German employees (N = 160), we investigate whether and how AI-support during a complete recruitment process diminishes the opportunity to perform and increases emotional creepiness during the process. Moreover, we examine the influence of opportunity to perform and emotional creepiness on organizational attractiveness. We found that AI-support at later stages of the selection process (i.e., telephone and video interview) decreased the opportunity to perform and increased emotional creepiness. In turn, the opportunity to perform and emotional creepiness mediated the association of AI-support in telephone/video interviews on organizational attractiveness. However, we did not find negative affective responses to AI-support earlier stage of the selection process (i.e., during preselection). As we offer evidence for possible adverse reactions to the usage of AI in selection processes, this study provides important practical and theoretical implications.

Sexual Communication Self-Efficacy and PrEP Literacy Helps to Meet HIV Prevention Outcomes Among Black and Latinx Individuals

Background:

Ending the HIV Epidemic is a campaign dedicated to reducing new HIV infections in the United States by 90% by 2030. Preexposure prophylaxis (PrEP) holds significant promise as a prevention tool. However, uptake has not improved much since then. As a result, this research looked at how PrEP literacy relates to sexual communication self-efficacy

Methods:

Between August 4 and 21, 2020, we performed a community-informed cross-sectional study of Black and Latino residents in Indiana. We collected demographic information as well as PrEP literacy, sexual communication self-efficacy, and awareness of HIV status.

Results:

Being unaware of one’s own HIV status and being unsure of one’s sexual identity were both linked to reduced self-efficacy in the domain of sex communication. Those who had a greater level of PrEP literacy felt more confident in their ability to communicate with others about sexually related topics. People living in rural areas showed a significantly lower degree of sexual communication self-efficacy than participants in urban settings.

Conclusion:

Providing information about PrEP to those at risk of acquiring the virus may help them connect with treatment or prevention services. Healthcare professionals should take the time to understand their patients’ levels of PrEP literacy and communication self-efficacy regarding sexual health.

The Effectiveness of Adaptation Methods in Improving User Engagement and Privacy Protection on Social Network Sites

Research finds that the users of Social Networking Sites (SNSs) often fail to comprehensively engage with the plethora of available privacy features— arguably due to their sheer number and the fact that they are often hidden from sight. As different users are likely interested in engaging with different subsets of privacy features, an SNS could improve privacy management practices by adapting its interface in a way that proactively assists, guides, or prompts users to engage with the subset of privacy features they are most likely to benefit from. Whereas recent work presents algorithmic implementations of such privacy adaptation methods, this study investigates the optimal user interface mechanism to present such adaptations. In particular, we tested three proposed “adaptation methods” (automation, suggestions, highlights) in an online between-subjects user experiment in which 406 participants used a carefully controlled SNS prototype. We systematically evaluate the effect of these adaptation methods on participants’ engagement with the privacy features, their tendency to set stricter settings (protection), and their subjective evaluation of the assigned adaptation method. We find that the automation of privacy features afforded users the most privacy protection, while giving privacy suggestions caused the highest level of engagement with the features and the highest subjective ratings (as long as awkward suggestions are avoided). We discuss the practical implications of these findings in the effectiveness of adaptations improving user awareness of, and engagement with, privacy features on social media.