Reliability estimation in a multilevel confirmatory factor analysis framework

Self-control demands and alcohol-related problems: Within- and between-person associations

This study tested a multilevel structural model of associations between two aspects of self-control (effortful control and reactivity), self-control demands, alcohol consumption, and alcohol problems and related risk behaviors using daily diary data from 196 young adults (4,177 person-days). Self-control demands were hypothesized to be positively associated with alcohol consumption and alcohol problems and related risk behaviors both within- and between-persons. At the between-person level, self-control demands were hypothesized to mediate the association between trait self-control and alcohol problems and related risk behaviors. At the within-person level, self-control demands had a direct positive effect on alcohol problems and related risk behaviors, over and above alcohol consumption. However, contrary to expectation, self-control demands were inversely associated with alcohol consumption. In contrast, self-control demands were positively associated with alcohol consumption at the between-person level and partially mediated the positive effects of reactivity on consumption and alcohol problems and related risk behaviors. That is, reactivity was associated with higher perceived self-control demands, which in turn predicted higher rates of consumption and alcohol problems and related risk behaviors. Effortful control was not significantly associated with alcohol consumption or self-control demands. The pattern of self-control demand effects at the within-person level suggest that young adults are less likely to drink when struggling to manage their day-to-day behavior, yet if they do drink they are more susceptible to negative consequences. Trait effects suggest that individual differences in self-control may be associated with alcohol use patterns in part attributable to development of, and response to, structured daily routines. (PsycINFO Database Record

The Cultural Intelligence Scale (CQS): A Contribution to the Italian Validation

In the current globalized working context, professionals are asked to be able to implement specific competences. Cultural Intelligence is a construct referring to an individual's ability to function and manage effectively in culturally diverse settings and is conceived as an aggregate multidimensional construct. Purpose of this study was to examine the validity of score interpretations of the Italian version of the Cultural Intelligence Scale (CQS). CQS is aimed to measure individual ability to understand, act and manage effectively in culturally diverse settings. Participants were 755 professionals (females = 64.2%) from different organizational contexts, ranging from 20 to 63 years old (M = 40.4; SD = 10.29). Data were collected with the Italian translated version of the CQS. Results of confirmatory factor analysis (CFA) suggested good data-model fit. As proposed in the original version, CQS is composed of 20 items and four different theoretical dimensions (Metacognitive, Cognitive, Motivational, and Behavioral) that correlate with each other. This study could be considered a first contribution to fill the lack of self-report measure concerning cultural intelligence in the Italian context with a scale showing promising results.

Procrastination in Daily Working Life: A Diary Study on Within-Person Processes That Link Work Characteristics to Workplace Procrastination

Procrastination is a form of self-regulation failure characterized by the irrational delay of tasks despite potentially negative consequences. Previous research on procrastination was mainly conducted in academic settings, oftentimes combined with a focus on individual differences. As a consequence, scholarly knowledge about how situational factors affect procrastination in work settings is still scarce. Drawing on job stress literature, we assumed that work characteristics go along with cognitive appraisals of the work situation as a challenge and/or hindrance, that these cognitive appraisals affect employees' self-regulation effort to overcome inner resistances, and that self-regulation effort should in turn be related to workplace procrastination. In our study, we focused on three specific work characteristics that we expected to trigger both challenge and hindrance appraisal simultaneously: time pressure, problem solving, and planning and decision-making. We hypothesized serial indirect effects of these work characteristics on workplace procrastination via cognitive appraisal and self-regulation processes that unfold within individuals over short periods of time. Consequently, we conducted a diary study with three measurement occasions per workday over a period of 12 days. Overall, 762 day-level datasets from 110 employees were included in Bayesian multilevel structural equation modeling (MSEM; controlled for sleep quality and occupational self-efficacy). Our results revealed negative serial indirect effects of all three work characteristics on workplace procrastination via increased challenge appraisal and subsequently reduced self-regulation effort. Further, our results showed a positive serial indirect effect of time pressure (but not of problem solving or planning and decision making) on workplace procrastination via increased hindrance appraisal and subsequently increased self-regulation effort. Overall, our study showed that work characteristics are linked to workplace procrastination via within-person processes of cognitive appraisal and self-regulation. Because not all work characteristics triggered hindrance appraisal, we argue that it may make sense to further differentiate challenge stressors in the future. Moreover, cognitive appraisals affected self-regulation effort only on the within-person level. On the between-person level self-regulation effort was strongly negatively related with occupational self-efficacy. Thus, we conclude that depending the perspective on procrastination (e.g., differential psychology perspective vs. situational perspective) different variables will be considered relevant to explain the emergence of procrastination.

The Structure of Need Fulfillment

Abstract. Self-Determination Theory predicts that fulfillment of the three psychological needs for autonomy, competence, and relatedness predicts well-being. Fulfillment of these needs has long been considered a uni-dimensional construct consisting of need satisfaction and (reverse coded) need dissatisfaction. Recent research suggests that satisfaction and dissatisfaction should be separated. We tested whether need satisfaction and dissatisfaction can be distinguished psychometrically and whether they have unique effects in predicting well-being. We used data from a daily-diary study of 135 participants over the course of 42 days. A six factor solution (with one satisfaction and one dissatisfaction factor per need) for the Balanced Measure of Psychological Needs scale (BMPN) fitted the data best at both the between-person and the within-person level of analysis. We concluded that (a) the BMPN can be used to reliably assess satisfaction and dissatisfaction of the three needs specified by Self-Determination Theory; (b) need satisfaction and dissatisfaction can and should be separated psychometrically; (c) these findings hold at both the between-person and the within-person level of analysis; (d) all three needs predict well-being at the within-person level, but only competence and relatedness predict well-being at the between-between-person level; and (e) need satisfaction and dissatisfaction predict unique variance in well-being.

Comparing Approaches to Mobile Depression Assessment for Measurement-Based Care: Prospective Study

BACKGROUND

To inform measurement-based care, practice guidelines suggest routine symptom monitoring, often on a weekly or monthly basis. Increasingly, patient-provider contacts occur remotely (eg, by telephone and Web-based portals), and mobile health tools can now monitor depressed mood daily or more frequently. However, the reliability and utility of daily ratings are unclear.

OBJECTIVE

This study aimed to examine the association between a daily depressive symptom measure and the Patient Health Questionnaire-9 (PHQ-9), the most widely adopted depression self-report measure, and compare how well these 2 assessment methods predict patient outcomes.

METHODS

A total of 547 individuals completed smartphone-based measures, including the Patient Health Questionnaire-2 (PHQ-2) modified for daily administration, the PHQ-9, and the Sheehan Disability Scale. Multilevel factor analyses evaluated the reliability of latent depression based on the PHQ-2 (for repeated measures) between weeks 2 and 4 and its correlation with the PHQ-9 at week 4. Regression models predicted week 8 depressive symptoms and disability ratings with daily PHQ-2 and PHQ-9.

RESULTS

The daily PHQ-2 and PHQ-9 are highly reliable (range: 0.80-0.88) and highly correlated (r=.80). Findings were robust across demographic groups (age, gender, and ethnic minority status). Daily PHQ-2 and PHQ-9 were comparable in predicting week 8 disability and were independent predictors of week 8 depressive symptoms and disability, though the unique contribution of the PHQ-2 was small in magnitude.

CONCLUSIONS

Daily completion of the PHQ-2 is a reasonable proxy for the PHQ-9 and is comparable to the PHQ-9 in predicting future outcomes. Mobile assessment methods offer researchers and clinicians reliable and valid new methods for depression assessment that may be leveraged for measurement-based depression care.

Do acute dissociation reactions predict subsequent posttraumatic stress and growth? A prospective experience sampling method study

While peritraumatic dissociation has been identified as a predictor of posttraumatic stress disorder, it may also have some protective aspect. The study uses experience sampling methods to assess acute dissociation reactions during conflict, and to investigate these reactions as predictors of subsequent posttraumatic stress symptoms (PTSS) and posttraumatic growth (PTG). During the 2014 Israel-Gaza conflict, Israeli civilians (n = 96) exposed to rocket fire gave twice-daily experience sampling method (ESM) reports of dissociation symptoms for 30 days via mobile phone. PTSS and PTG were assessed two months later. A mixed effects random intercepts and slopes model estimated acute dissociation reactions. Individual slope coefficients for acute dissociative reactivity were entered as predictors of subsequent PTSS and PTG in regression analyses investigating linear and curvilinear associations. Exposure to sirens elicited acute dissociation reactions. Dissociative reactivity gradually reduced over the conflict. Higher acute dissociative reactivity during conflict predicted PTSS in a curvilinear manner (inverted U) and PTG in a positive linear manner two months later. The current study provides an important and novel contribution to the field by using ESM methods to assess peritraumatic dissociation, and in demonstrating that peritraumatic dissociation may be both adaptive and maladaptive, which has implications for risk assessment and clinical practice.

Moral Punishment in Everyday Life

The present research investigated event-related, contextual, demographic, and dispositional predictors of the desire to punish perpetrators of immoral deeds in daily life, as well as connections among the desire to punish, moral emotions, and momentary well-being. The desire to punish was reliably predicted by linear gradients of social closeness to both the perpetrator (negative relationship) and the victim (positive relationship). Older rather than younger adults, conservatives rather than people with other political orientations, and individuals high rather than low in moral identity desired to punish perpetrators more harshly. The desire to punish was related to state anger, disgust, and embarrassment, and these were linked to lower momentary well-being. However, the negative effect of these emotions on well-being was partially compensated by a positive indirect pathway via heightened feelings of moral self-worth. Implications of the present field data for moral punishment research and the connection between morality and well-being are discussed.

Well-Being Correlates of Perceived Positivity Resonance: Evidence From Trait and Episode-Level Assessments

Positivity resonance is a type of interpersonal connection characterized by shared positivity, mutual care and concern, and behavioral and biological synchrony. Perceived positivity resonance is hypothesized to be associated with well-being. In three studies ( N = 175, N = 120, N = 173), perceived positivity resonance was assessed at the trait level (Study 1) or the episode level, using the Day Reconstruction Method (Studies 2 and 3). Primary analyses reveal that perceived positivity resonance is associated with flourishing mental health, depressive symptoms, loneliness, and illness symptoms. These associations largely remain statistically significant when controlling for daily pleasant emotions or social interaction more generally. Ancillary analyses in Studies 2 and 3 support the construct validity of the episode-level assessment of perceived positivity resonance. The overall pattern of results is consistent with Positivity Resonance Theory. Discussion centers on avenues for future research and the need for behavioral interventions.

V. DESIGN-BASED APPROACHES FOR IMPROVING MEASUREMENT IN DEVELOPMENTAL SCIENCE

The study of change and variation within individuals, and the relative comparison of changes across individuals, relies on the assumption that observed measurements reflect true change in the construct being measured. Measurement properties that change over time, contexts, or people pose a fundamental threat to validity and lead to ambiguous conclusions about change and variation. We highlight such measurement issues from a within-person perspective and discuss the merits of measurement-intensive research designs for improving precision of both within-person and between-person analysis. In general, intensive measurement designs, potentially embedded within long-term longitudinal studies, provide developmental researchers an opportunity to more optimally capture within-person change and variation as well as provide a basis to understand changes in dynamic processes and determinants of these changes over time.

The Development and Psychometric Properties of the Multidimensional Assessment of Teamwork in Sport

The purpose of this research was to develop a questionnaire to assess the multidimensional construct of teamwork in sport and to examine various aspects of validity related to that instrument. A preliminary questionnaire was first created, and feedback on this instrument was then obtained from a sample of team-sport athletes (n = 30) and experts in sport psychology (n = 8). A modified version of the questionnaire was then completed by 607 athletes from 48 teams, and 5 multilevel confirmatory factor analyses were conducted to examine the structural properties of data derived from this instrument. Evidence of adequate model-data fit along with measurement reliability was obtained for each of the 5 models. Taken together, the results from this research provide support for the content, substantive, and structural aspects of construct validity for data derived from the 66-item Multidimensional Assessment of Teamwork in Sport.

Teaching in ethnically diverse classrooms: Examining individual differences in teacher self-efficacy

Using data of 40 native Dutch teachers and their native majority (n=112) and ethnic minority students (n=180), this study examined to what extent teachers experience differences in self-efficacy in teaching individual majority and minority students. We hypothesized that teachers would feel less self-efficacious in relation to ethnic minority students and that the difference in self-efficacy would be more pronounced when ethnic group differences are more salient (i.e., in the context of behavioral problems, ethnically less diverse classrooms, and for teachers with high ethnic identification). Our results show that teachers feel somewhat less self-efficacious with ethnic minority versus majority students. And, the difference in self-efficacy with minority versus majority students was more pronounced in relation to internalizing problem behaviors and somewhat more distinct in classrooms with relatively few ethnic minority students. The findings indicate the importance of a student specific assessment of teacher self-efficacy in diverse school contexts.

Using iMCFA to Perform the CFA, Multilevel CFA, and Maximum Model for Analyzing Complex Survey Data

To construct CFA, MCFA, and maximum MCFA with LISREL v.8 and below, we provide iMCFA (integrated Multilevel Confirmatory Analysis) to examine the potential multilevel factorial structure in the complex survey data. Modeling multilevel structure for complex survey data is complicated because building a multilevel model is not an infallible statistical strategy unless the hypothesized model is close to the real data structure. Methodologists have suggested using different modeling techniques to investigate potential multilevel structure of survey data. Using iMCFA, researchers can visually set the between- and within-level factorial structure to fit MCFA, CFA and/or MAX MCFA models for complex survey data. iMCFA can then yield between- and within-level variance-covariance matrices, calculate intraclass correlations, perform the analyses and generate the outputs for respective models. The summary of the analytical outputs from LISREL is gathered and tabulated for further model comparison and interpretation. iMCFA also provides LISREL syntax of different models for researchers' future use. An empirical and a simulated multilevel dataset with complex and simple structures in the within or between level was used to illustrate the usability and the effectiveness of the iMCFA procedure on analyzing complex survey data. The analytic results of iMCFA using Muthen's limited information estimator were compared with those of Mplus using Full Information Maximum Likelihood regarding the effectiveness of different estimation methods.

Multilevel influences of team identification and transactive memory on team effectiveness

Purpose

The purpose of this study was to examine the mediating effect of transactive memory between team identification and two outcomes of team effectiveness (i.e. team member satisfaction and team performance).

Design/methodology/approach

Data were obtained from a survey among 502 employees working in 53 teams, and analyzed by Multilevel Structural Equation Modeling.

Findings

Results showed that transactive memory partially mediated the relationship between team identification and team effectiveness at the individual level. Moreover, transactive memory, specifically the coordination component, fully mediated the relationship between team identification and team effectiveness at the team level.

Research limitations/implications

The study used a cross-sectional design for the questionnaire and no objective measure of team performance.

Practical implications

Managers who want to develop effective work teams may be advised to organize team-building activities to strengthen both affective and cognitive aspects.

Originality value

This is the first empirical study to examine the relationships between team identification, transactive memory and team effectiveness from a multilevel perspective.

I Am So Tired… How Fatigue May Exacerbate Stress Reactions to Psychological Contract Breach

Previous research showed that perceptions of psychological contract (PC) breach have undesirable individual and organizational consequences. Surprisingly, the PC literature has paid little to no attention to the relationship between PC breach perceptions and stress. A better understanding of how PC breach may elicit stress seems crucial, given that stress plays a key role in employees' physical and mental well-being. Based on Conservation of Resources Theory, we suggest that PC breach perceptions represent a perceived loss of valued resources, subsequently leading employees to experience higher stress levels resulting from emerging negative emotions. Moreover, we suggest that this mediated relationship is moderated by initial levels of fatigue, due to fatigue lowering the personal resources necessary to cope with breach events. To tests our hypotheses, we analyzed the multilevel data we obtained from two experience sampling designs (Study 1: 51 Belgian employees; Study 2: 53 US employees). Note that the unit of analysis is "observations" rather than "respondents," resulting in an effective sample size of 730 (Study 1) and 374 (Study 2) observations. In both studies, we found evidence for the mediating role of negative emotions in the PC breach-stress relationship. In the second study, we also found evidence for the moderating role of fatigue in the mediated PC breach-stress relationship. Implications for research and practice are discussed.

Assessing risk of bias in randomized controlled trials of methylphenidate for children and adolescents with attention deficit hyperactivity disorder (ADHD)

To test how reliable the tool recommend by Cochrane Collaboration for assessing risk of bias systematic reviews of randomized clinical trials is in the context of methylphenidate for children and adolescents with attention deficit hyperactivity disorder. Confirmatory factor analysis was used to evaluate a unidimensional model for the 7 indicators, applied to 184 Randomized Clinical Trial (RCTs) within a 2015 Cochrane systematic review titled "Methylphenidate for children and adolescents with attention deficit hyperactivity disorder." A unidimensional model resulted in excellent adequacy indices, but only 2 indicators had very high factor loadings and low measurement errors. In terms of content, the 7 indicators showed poor reliability (ω = 0.642); however, the set of indicators was precise in evaluating studies with a high amount of bias risk. The Cochrane model of risk of bias as it is, exhibited good fit indices but the majority of the items were not reliable to adequately capture risk of bias in the context of clinical trials of methylphenidate for ADHD.

The Schizotypal Personality Questionnaire-Brief lacks measurement invariance across three countries

The Schizotypal Personality Questionnaire-Brief (SPQ-B) is a commonly-used tool for measuring schizotypal personality traits and due to its wide application, its cross-cultural validity is of interest. Previous studies suggest that the SPQ-B either has a three- or four-factor structure, but the majority of studies have been conducted in Western contexts and little is known about the psychometric properties of the scale in other populations. In this study factorial invariance testing across three cultural contexts-Australia, China and Chile was conducted. In total, 729 young adults (Mean age = 23.99 years, SD = 9.87 years) participated. Invariance testing did not support the four-factor model across three countries. Confirmatory Factor Analyses revealed that neither the four- nor three-factor model had strong fit in any of the settings. However, in comparison with other competing models, the four-factor model showed the best for the Australian sample, while the three-factor model was the most reasonable for both Chinese and Chilean samples. The reliability of the SPQ-B scores, estimated with Omega, ranged from 0.86 to 0.91. These findings suggest that the SPQ-B factors are not consistent across different cultural groups. We suggest that these differences could be attributed to potential confounding cultural and translation issues.

Assessing Risk of Bias in Randomized Controlled Trials for Autism Spectrum Disorder

AIM

To determine construct validity and reliability indicators of the Cochrane risk of bias (RoB) tool in the context of randomized clinical trials (RCTs) for autism spectrum disorder (ASD).

METHODS

Confirmatory factor analysis was used to evaluate a unidimensional model consisting of 9 RoB categorical indicators evaluated across 94 RCTs addressing interventions for ASD.

RESULTS

Only five of the nine original RoB items returned good fit indices and so were retained in the analysis. Only one of this five had very high factor loadings. The remaining four indicators had more measurement error than common variance with the RoB latent factor. Together, the five indicators showed poor reliability (ω = 0.687; 95% CI: 0.613-0.761).

CONCLUSION

Although the Cochrane model of RoB for ASD exhibited good fit indices, the majorities of the items have more residual variance than common variance and, therefore, did not adequately capture the RoB in ASD intervention trials.

One Big Happy Family? Unraveling the Relationship between Shared Perceptions of Team Psychological Contracts, Person-Team Fit and Team Performance

With the knowledge that team work is not always associated with high(er) performance, we draw from the Multi-Level Theory of Psychological Contracts, Person-Environment Fit Theory, and Optimal Distinctiveness Theory to study shared perceptions of psychological contract (PC) breach in relation to shared perceptions of complementary and supplementary fit to explain why some teams perform better than other teams. We collected three repeated survey measures in a sample of 128 respondents across 46 teams. After having made sure that we met all statistical criteria, we aggregated our focal variables to the team-level and analyzed our data by means of a longitudinal three-wave autoregressive moderated-mediation model in which each relationship was one-time lag apart. We found that shared perceptions of PC breach were directly negatively related to team output and negatively related to perceived team member effectiveness through a decrease in shared perceptions of supplementary fit. However, we also demonstrated a beneficial process in that shared perceptions of PC breach were positively related to shared perceptions of complementary fit, which in turn were positively related to team output. Moreover, best team output appeared in teams that could combine high shared perceptions of complementary fit with modest to high shared perceptions of supplementary fit. Overall, our findings seem to indicate that in terms of team output there may be a bright side to perceptions of PC breach and that perceived person-team fit may play an important role in this process.

Trajectories of job demands and control: risk for subsequent symptoms of major depression in the nationally representative Swedish Longitudinal Occupational Survey of Health (SLOSH)

Purpose

Depression is a global health concern. High job demands, low job control, and the combination (high strain) are associated with depression. However, few longitudinal studies have investigated changed or repeated exposure to demands and control related to depression. We investigated how trajectories of exposure to job demands and control jointly influence subsequent depression.

Methods

We included 7949 subjects from the Swedish Longitudinal Occupational Survey of Health, who completed questionnaires of perceived job demands and control, and depressive symptoms from 2006 to 2014. None of them were depressed between 2006 and 2012. Univariate and joint group-based trajectory models identified groups with similar development of demands and control across 2006–2012. Logistic regression estimated the risk for symptoms of major depression in 2014 according to joint trajectory groups.

Results

The joint trajectory model included seven groups, all with fairly stable levels of demands and control over time. Subjects in the high strain and active (high demands and high control) trajectories were significantly more likely to have subsequent major depressive symptoms compared to those having low strain, controlling for demographic covariates (OR 2.15; 95% Cl 1.24–3.74 and OR 2.04; 95% CI 1.23–3.40, respectively). The associations did not remain statistically significant after adjusting for previous depressive symptoms in addition to demographic covariates.

Conclusions

The results indicate that the levels of job demands and control were relatively unchanged across 6 years and suggest that long-term exposure to a high strain or active job may be associated with increased risk for subsequent depression.

Electronic supplementary material

The online version of this article (doi:10.1007/s00420-017-1277-0) contains supplementary material, which is available to authorized users.

Relating Measurement Invariance, Cross-Level Invariance, and Multilevel Reliability

Data often have a nested, multilevel structure, for example when data are collected from children in classrooms. This kind of data complicate the evaluation of reliability and measurement invariance, because several properties can be evaluated at both the individual level and the cluster level, as well as across levels. For example, cross-level invariance implies equal factor loadings across levels, which is needed to give latent variables at the two levels a similar interpretation. Reliability at a specific level refers to the ratio of true score variance over total variance at that level. This paper aims to shine light on the relation between reliability, cross-level invariance, and strong factorial invariance across clusters in multilevel data. Specifically, we will illustrate how strong factorial invariance across clusters implies cross-level invariance and perfect reliability at the between level in multilevel factor models.

What's interpersonal in interpersonal perception? The role of target's attachment in the accuracy of perception

OBJECTIVE

We examined the influence of attachment orientation on the accuracy of perception of negative affect in close relationships. We hypothesized that tracking accuracy of perceiving negative affect (a) would be lower among perceivers and targets with higher attachment avoidance and (b) would be lowest when both the target and perceiver were high on attachment avoidance. Tracking accuracy would be (c) higher among perceivers and targets with higher attachment anxiety and (d) highest when both the target and perceiver were high on attachment anxiety.

METHOD

We collected data from 92 couples who reported their negative affect and perception of their partner's negative affect in interactions with each other on 20 days.

RESULTS

Results supported the hypotheses for attachment avoidance and tracking accuracy. Tracking accuracy of perceived negative affect was low when the target was high on attachment avoidance; accuracy was lowest when both the target and the perceiver were high on attachment avoidance.

CONCLUSIONS

Lower "readability" of high avoidantly attached targets' emotions may inhibit intimacy and sensitive responding, which thereby may contribute to poor relationship outcomes.

Maintaining Affection Despite Pain: Daily Associations Between Physical Affection and Sexual and Relationship Well-Being in Women with Genito-Pelvic Pain

Provoked vestibulodynia (PVD) is a recurrent, genito-pelvic pain condition that affects 8-12 % of women and has negative implications for sexual and relationship functioning. Many women with PVD report avoiding physical affection because they are concerned that affectionate behavior will lead to painful sexual activity. In community samples, physical affection is associated with improved sexual and relational well-being; however, no research has assessed the influence of physical affection on well-being in women with PVD. The current study examined day-to-day, within-person associations between affectionate behavior (hugging/kissing, cuddling) and sexual satisfaction, relationship satisfaction, sexual functioning, and pain intensity in women with PVD. Seventy women diagnosed with PVD completed an 8-week daily survey. Data were analyzed using multilevel modeling. All outcomes were assessed on days involving sexual activity (n = 401 days). Physical affection was assessed on days with and without sexual activity. Hugging/kissing was positively associated with sexual satisfaction, relationship satisfaction, and sexual functioning within any given day and when predicting the next day. Hugging/kissing was unrelated to pain intensity. Cuddling was not associated with any outcomes. Results persisted for affection that occurred on days with and without sexual activity. Findings suggest physical affection is beneficial for the sexual and relationship well-being of women with PVD. These results may inform interventions that encourage women coping with PVD to engage in more daily physical affection with their partners.

The impact of Black cancer patients' race-related beliefs and attitudes on racially-discordant oncology interactions: A field study

OBJECTIVE

Both physician and patient race-related beliefs and attitudes are contributors to racial healthcare disparities, but only the former have received substantial research attention. Using data from a study conducted in the Midwestern US from 2012 to 2014, we investigated whether 114 Black cancer patients' existing race-related beliefs and attitudes would predict how they and 18 non-Black physicians (medical oncologists) would respond in subsequent clinical interactions.

METHOD

At least two days before interacting with an oncologist for initial discussions of treatment options, patients completed measures of perceived past discrimination, general mistrust of physicians, and suspicion of healthcare systems; interactions were video-recorded. Measures from each interaction included patients' verbal behavior (e.g., level of verbal activity), patients' evaluations of physicians (e.g., trustworthiness), patients' perceptions of recommended treatments (e.g., confidence in treatment), physicians' evaluations of patient personal attributes (e.g., intelligence) and physicians' expectations for patient treatment success (e.g., adherence).

RESULTS

As predicted, patients' race-related beliefs and attitudes differed in their associations with patient and physician responses to the interactions. Higher levels of perceived past discrimination predicted more patient verbal activity. Higher levels of mistrust also predicted less patient positive affect and more negative evaluations of physicians. Higher levels of suspicion predicted more negative evaluations of physicians and recommended treatments. Stronger patient race-related attitudes were directly or indirectly associated with lower physician perceptions of patient attributes and treatment expectations.

CONCLUSION

Results provide new evidence for the role of Black patients' race-related beliefs and attitudes in racial healthcare disparities and suggest the need to measure multiple beliefs and attitudes to identify these effects.

A Solution to Modeling Multilevel Confirmatory Factor Analysis with Data Obtained from Complex Survey Sampling to Avoid Conflated Parameter Estimates

The issue of equality in the between-and within-level structures in Multilevel Confirmatory Factor Analysis (MCFA) models has been influential for obtaining unbiased parameter estimates and statistical inferences. A commonly seen condition is the inequality of factor loadings under equal level-varying structures. With mathematical investigation and Monte Carlo simulation, this study compared the robustness of five statistical models including two model-based (a true and a mis-specified models), one design-based, and two maximum models (two models where the full rank of variance-covariance matrix is estimated in between level and within level, respectively) in analyzing complex survey measurement data with level-varying factor loadings. The empirical data of 120 3rd graders' (from 40 classrooms) perceived Harter competence scale were modeled using MCFA and the parameter estimates were used as true parameters to perform the Monte Carlo simulation study. Results showed maximum models was robust to unequal factor loadings while the design-based and the miss-specified model-based approaches produced conflated results and spurious statistical inferences. We recommend the use of maximum models if researchers have limited information about the pattern of factor loadings and measurement structures. Measurement models are key components of Structural Equation Modeling (SEM); therefore, the findings can be generalized to multilevel SEM and CFA models. Mplus codes are provided for maximum models and other analytical models.

Therapist report of adaptations to delivery of evidence-based practices within a system-driven reform of publicly funded children's mental health services

OBJECTIVE

This study examined clinical adaptations reported by community therapists to multiple evidence-based practices (EBPs) currently implemented in children's mental health services. Based on an item set informed by Stirman and colleagues' model (2015), 2 factors emerged describing Augmenting adaptations and Reducing/Reordering adaptations. We used multilevel modeling to examine therapist- and practice-level predictors of therapist reports of each type of adaptation.

METHOD

Data were drawn from an online survey, including a novel therapist report measure of EBP adaptations, completed by 572 therapists (89.2% female, Mage = 37.08 years, 33.4% non-Hispanic White) delivering EBPs in the context of a system-driven, fiscally mandated implementation effort.

RESULTS

Analyses revealed that the 2 types of therapist adaptations (Augmenting and Reducing/Reordering) could be readily discriminated, with therapists reporting significantly more Augmenting than Reducing/Reordering adaptations. Therapists of Hispanic/Latino ethnicity and with fewer years of experience reported more extensive Augmenting adaptations, but no therapist background characteristics were associated with Reducing/Reordering adaptations. Therapists' general attitudes that EBPs diverged from their personal approach to therapy were associated with reporting more Augmenting and Reducing/Reordering adaptations. In contrast, negative perceptions toward the specific EBP predicted Reducing/Reordering adaptations, but not Augmenting adaptations.

CONCLUSIONS

Community therapist reports suggest that most adaptations undertaken involve engaging with the practice to augment the fit of the EBPs for local contexts; however, when practices were perceived negatively, therapists were more likely to make adaptations reducing or rearranging components. (PsycINFO Database Record

Daily Stress, Coping, and Negative and Positive Affect in Depression: Complex Trigger and Maintenance Patterns

Major depressive disorder is characterized by emotional dysfunction, but mood states in daily life are not well understood. This study examined complex explanatory models of daily stress and coping mechanisms that trigger and maintain daily negative affect and (lower) positive affect in depression. Sixty-three depressed patients completed perfectionism measures, and then completed daily questionnaires of stress appraisals, coping, and affect for 7 consecutive days. Multilevel structural equation modeling (MSEM) demonstrated that, across many stressors, when the typical individual with depression perceives more criticism than usual, he/she uses more avoidant coping and experiences higher event stress than usual, and this is connected to daily increases in negative affect as well as decreases in positive affect. In parallel, results showed that perceived control, less avoidant coping, and problem-focused coping commonly operate together when daily positive affect increases. MSEM also showed that avoidant coping tendencies and ongoing stress, in combination, explain why people with depression and higher self-critical perfectionism maintain daily negative affect and lower positive affect. These findings advance a richer and more detailed understanding of specific stress and coping patterns to target in order to more effectively accomplish the two predominant therapy goals of decreasing patients' distress and strengthening resilience.

Daily Autonomy Support and Sexual Identity Disclosure Predicts Daily Mental and Physical Health Outcomes

Using a daily diary methodology, we examined how social environments support or fail to support sexual identity disclosure, and associated mental and physical health outcomes. Results showed that variability in disclosure across the diary period related to greater psychological well-being and fewer physical symptoms, suggesting potential adaptive benefits to selectively disclosing. A multilevel path model indicated that perceiving autonomy support in conversations predicted more disclosure, which in turn predicted more need satisfaction, greater well-being, and fewer physical symptoms that day. Finally, mediation analyses revealed that disclosure and need satisfaction explained why perceiving autonomy support in a conversation predicted greater well-being and fewer physical symptoms. That is, perceiving autonomy support in conversations indirectly predicted greater wellness through sexual orientation disclosure, along with feeling authentic and connected in daily interactions with others. Discussion highlights the role of supportive social contexts and everyday opportunities to disclose in affecting sexual minority mental and physical health.

The PMA Scale: A Measure of Physicians' Motivation to Adopt Medical Devices

BACKGROUND

Studies have often stated that individual-level determinants are important drivers for the adoption of medical devices. Empirical evidence supporting this claim is, however, scarce. At the individual level, physicians' adoption motivation was often considered important in the context of adoption decisions, but a clear notion of its dimensions and corresponding measurement scales is not available.

OBJECTIVES

To develop and subsequently validate a scale to measure the motivation to adopt medical devices of hospital-based physicians.

METHODS

The development and validation of the physician-motivation-adoption (PMA) scale were based on a literature search, internal expert meetings, a pilot study with physicians, and a three-stage online survey. The data collected in the online survey were analyzed using exploratory factor analysis (EFA), and the PMA scale was revised according to the results. Confirmatory factor analysis (CFA) was conducted to test the results from the EFA in the third stage. Reliability and validity tests and subgroup analyses were also conducted.

RESULTS

Overall, 457 questionnaires were completed by medical personnel of the National Health Service England. The EFA favored a six-factor solution to appropriately describe physicians' motivation. The CFA confirmed the results from the EFA. Our tests indicated good reliability and validity of the PMA scale.

CONCLUSIONS

This is the first reliable and valid scale to measure physicians' adoption motivation. Future adoption studies assessing the individual level should include the PMA scale to obtain more information about the role of physicians' motivation in the broader adoption context.

Helping motivation and well-being of chronic pain couples: a daily diary study

Receiving support from a romantic partner may yield benefits for individuals with chronic pain (ICPs), but may also carry unintended side effects. The conditions under which partner support provision yields (mal)adaptive effects deserve greater attention. Grounded in Self-determination theory, partners may provide help for autonomous or volitional (eg, enjoyment, full commitment) or rather controlled or pressured (eg, avoiding guilt and criticism) motives. This study examined associations between day-to-day fluctuations in partners' type of helping motivation and several outcomes, among partners and ICPs. Seventy couples, with 1 partner having chronic pain (75.7% female), completed a diary for 14 consecutive days. Daily helping motivation was assessed together with daily affect, relational conflict, and relationship-based need satisfaction. Partners (Mage = 55.14) additionally reported on daily helping exhaustion, whereas ICPs (Mage = 54.71) reported on daily pain intensity, disability, satisfaction with received help, and amount of received help. Providing autonomous help related to improvements in partners' affective (eg, positive affect), relational (eg, conflict), and help-specific (eg, exhaustion) functioning, which were accounted for by improvements in daily relationship-based psychological need satisfaction. Similarly, daily autonomously motivated help yielded a direct (ie, relational conflict; perceived amount of help) or indirect (ie, positive and negative affects; relational conflict; satisfaction with help, disability) contribution in explaining ICP outcomes-through improvements in ICPs' relationship-based psychological need satisfaction. Findings highlight the importance of a motivational and dynamic perspective on help provision within chronic pain couples. Considering reasons why a partner provides help is important to understand when partners and ICPs may benefit from daily support.

Tracking daily fatigue fluctuations in multiple sclerosis: ecological momentary assessment provides unique insights

Studies investigating the prevalence, cause, and consequence of multiple sclerosis (MS) fatigue typically use single measures that implicitly assume symptom-stability over time, neglecting information about if, when, and why severity fluctuates. We aimed to examine the extent of moment-to-moment and day-to-day variability in fatigue in relapsing-remitting MS and healthy individuals, and identify daily life determinants of fluctuations. Over 4 weekdays, 76 participants (38 relapsing-remitting MS; 38 controls) recruited from multiple sites provided real-time self-reports six times daily (n = 1661 observations analyzed) measuring fatigue severity, stressors, mood, and physical exertion, and daily self-reports of sleep quality. Fatigue fluctuations were evident in both groups. Fatigue was highest in relapsing-remitting MS, typically peaking in late-afternoon. In controls, fatigue started lower and increased steadily until bedtime. Real-time stressors and negative mood were associated with increased fatigue, and positive mood with decreased fatigue in both groups. Increased fatigue was related to physical exertion in relapsing-remitting MS, and poorer sleep quality in controls. In relapsing-remitting MS, fatigue fluctuates substantially over time. Many daily life determinants of fluctuations are similar in relapsing-remitting MS and healthy individuals (stressors, mood) but physical exertion seems more relevant in relapsing-remitting MS and sleep quality most relevant in healthy individuals.

Covariate-free and Covariate-dependent Reliability

Classical test theory reliability coefficients are said to be population specific. Reliability generalization, a meta-analysis method, is the main procedure for evaluating the stability of reliability coefficients across populations. A new approach is developed to evaluate the degree of invariance of reliability coefficients to population characteristics. Factor or common variance of a reliability measure is partitioned into parts that are, and are not, influenced by control variables, resulting in a partition of reliability into a covariate-dependent and a covariate-free part. The approach can be implemented in a single sample and can be applied to a variety of reliability coefficients.