Editorial: an author's checklist for measure development and validation manuscripts

Development and Validation of a Pediatric Celiac Disease-Specific Quality of Life Measure

INTRODUCTION

Quality of life (QOL) is critical in screening and management of chronic medical conditions, including celiac disease (CD). The aim of this project was to develop a CD-specific pediatric QOL measure (Celiac Disease Life Inventory of Family Experiences [CDLIFE]) with parallel self-report and parent-report forms by generating items through concept elicitation interviews, iterative refinement using cognitive debriefing interviews, and evaluating its psychometric properties and validity.

METHODS

Concept elicitation interviews were conducted to develop items (9 youth ages 8-19 years with CD; 10 parents of youth with CD), followed by cognitive interviews with additional stakeholders (3 youth with CD, 3 parents, and 8 clinicians) and item administration (parent/youth reports: n = 103/102). Analyses included response frequencies, internal consistency reliability, exploratory factor analyses, and correlations with related measures (Patient-Reported Outcomes Measurement Information System, Pediatric Quality of Life Inventory, and Gluten-Free Diet-Visual Analog Scale).

RESULTS

From concept elicitation interviews, 42 youth and 45 parent items were developed. Cognitive debriefing interviews yielded 36 refined items. Psychometric analyses identified 15 items to remove due to ceiling/floor effects, poor item-to-test correlations, and youth-parent mismatch or conceptual mismatch. Total score internal consistency was high (αs = 0.89-0.90). A 4-factor model solution had the best fit (Social Impact, External Support, Adaptive Vigilance, Eating Behaviors/Adjustment) with a fifth single-item domain (Financial Resources). The final CDLIFE (21 items) total scores correlated with most related measures in expected directions for parent and youth forms.

DISCUSSION

The CDLIFE may facilitate insight into CD-specific QOL for youth ages 2-18 years, capturing important dimensions of physical and socioemotional health. Administering the CDLIFE will help identify and track families needing support.

The impact of nursing work environment, emotional intelligence, and empathy fatigue on nurses' presenteeism: a structural equation model

PURPOSE

This study aimed to investigate the impact of the work environment, emotional intelligence, and empathy fatigue on nurse presenteeism and to examine the mediating roles of emotional intelligence and empathy fatigue.

METHODS

This study employed a cross-sectional research design and conducted a questionnaire survey from April to July 2024 among 1,375 nurses (aged 18-24, 25-34, 35-44, and ≥ 45 years) from six tertiary hospitals in Henan Province. The questionnaire included demographic characteristics, the Nursing Practice Environment Scale, the Emotional Intelligence Scale, the Empathy Fatigue Scale, and the Stanford Presenteeism Scale. Statistical analyses were conducted using SPSS 27.0 and AMOS 26.0. A structural equation model was constructed, and the Bootstrap method was employed to assess the mediating effects.

RESULTS

The average presenteeism score among nurses was 19.49 ± 5.910. A partial mediation effect exists among the four variables: work environment, emotional intelligence, empathy fatigue, and nurse presenteeism. Specifically, the nursing work environment not only directly negatively influences nurse presenteeism but also indirectly affects it through the mediating roles of emotional intelligence and empathy fatigue. Furthermore, emotional intelligence and empathy fatigue serve as a chain mediator between the work environment and nurse presenteeism.

CONCLUSION

The results indicate that the nursing work environment not only directly affects nurse presenteeism but also indirectly influences their presenteeism through emotional intelligence and empathy fatigue. These findings provide theoretical support and guidance for reducing nurse presenteeism rates, emphasizing the importance of optimizing the nursing work environment, enhancing emotional intelligence, and alleviating empathy fatigue in nursing practice.

The Validation of the Gender Minority Stress and Resilience Measure and Mental Health Among Chinese Transgender and Gender Nonconforming People

Purpose

Gender minority stress is a key factor contributing to mental health problems among transgender and gender nonconforming (TGNC) people. The Gender Minority Stress and Resilience Measure (GMSR) is a valid instrument to assess distal stressors (discrimination, rejection, victimization, and nonaffirmation), proximal stressors (internalized transphobia, negative expectations, and nondisclosure), and resilience factors (pride and community connectedness) in Western societies. This study aimed to examine the psychometric characteristics of the Chinese version of the GMSR and mental health in Chinese TGNC people.

Methods

A total of 282 (Meanage=20.9, Standard deviation=5.02) Chinese TGNC individuals completed measures of the GMSR, Depression Anxiety Stress Scale, and Multidimensional Scale of Perceived Social Support.

Results

The confirmatory factor analysis showed that a Chinese revision of the 42-item GMSR with 9-factor model had adequate fit to the data. All the stressors were positively correlated with mental health problems. However, pride and community connectedness were not associated with mental health problems. Three stressors (rejection, nonaffirmation, and negative expectations) were negatively correlated with social support, and both pride and community connectedness were positively correlated with social support. All correlations between constructs were below 0.60. The criterion and convergent and discriminant validities of the Chinese version of the GMSR were greatly supported. Moreover, in line with the minority stress model, distal stressors had a significant indirect effect on mental health problems through proximal stressors.

Conclusion

Our results validate a revised 42-item Chinese version of the GMSR, which indicated the cross-cultural validation of the gender minority stress model in China.

A child-centred research checklist to improve the design and reporting of paediatric research studies: A descriptive mixed methods study

BACKGROUND

No internationally developed child-centred research checklist is currently available to enhance the quality and transparency of the development, reporting and evaluation of research undertaken with children.

OBJECTIVE

To develop an internationally relevant, expert informed child-centred research checklist.

DESIGN

A descriptive mixed methods study was undertaken in five sequential phases, including a Delphi component.

SETTING(S)

Academic/international context.

METHODS

This study involved five sequential stages: 1. Literature review using four databases (CINAHL, MEDLINE, Scopus, PsycINFO) and analysis to identify key themes in child-centred research (January 2020). 2. Generate a questionnaire based on the key themes for international experts in child research to provide their opinions on what should be included in a child-centred research checklist (March 2020). 3. Inductive thematic analysis of the experts' responses to generate the initial draft checklist (June 2020). 4. The checklist progressed through three rounds of Delphi study for a wider range of experts to provide their consensus on what a child-centred research checklist should contain (August 2020-February 2021). 5. Refinement of the child-centred research checklist based on the Delphi study (March 2021-November 2022).

RESULTS

A total of 160 articles met the inclusion criteria for review and were considered in the development of a 10-item open-ended questionnaire, adapted for four age-brackets (0-1 yrs., 2-4 yrs., 5-10 yrs., >11 yrs). Responses from 14 experts across 10 countries generated 205 generic statements and 76 examples to inform a child-centred research checklist. Following this, 158 experts from eleven disciplines across 18 countries participated in the three round Delphi study (38 % retention rate over the three rounds). The final checklist includes 11 statements and 17 examples represented under three categories of "child-parent consent, assent and dissent", "code of conduct" and "child focused methods".

CONCLUSION

The child-centred research checklist was generated from a mixed methods study undertaken in five sequential phases, with input by 172 experts from 11 disciplines across 19 countries. The child-centred research checklist is the first international, expert informed tool to support good quality and transparent child-centred research. We call on researchers, clinicians, journal editors, organisations, and ethics committees to use this checklist for future research with children. The next phase of this project is engagement with children and their families to refine the checklist.

TWEETABLE ABSTRACT

New checklist to support good quality child research practices @IFNAorg.

Examining the psychometric properties of the CEFIS-AYA using item response theory

OBJECTIVE

The COVID-19 Exposure and Family Impact Scale, Adolescent and Young Adult Version (CEFIS-AYA; Schwartz, L. A., Lewis, A. M., Alderfer, M. A., Vega, G., Barakat, L. P., King-Dowling, S., Psihogios, A. M., Canter, K. S., Crosby, L., Arasteh, K., Enlow, P., Hildenbrand, A. K., Kassam-Adams, N., Pai, A., Phan, T. L., Price, J., Schultz, C. L., Sood, E., Wood, J., & Kazak, A. (2022). COVID-19 exposure and family impact scales for adolescents and young adults. Journal of Pediatric Psychology, 47, 631-640. https://doi.org/10.1093/jpepsy/jsac036) was developed to assess the pandemic's effects on adolescents and young adults (AYA). Via principal component analysis, measure developers examined the structure and reliability of the CEFIS-AYA and identified seven exposure and five impact components. This study built upon prior work through use of item response theory (IRT) models to characterize the dimensionality of the CEFIS-AYA, determine the strength of relations between items and underlying trait(s), and examine associations between trait scores and pandemic-related distress.

METHODS

This was a secondary analysis of data collected between July 2020 and July 2021 from three studies of emerging adults (ages 18-29; N = 834).

RESULTS

The CEFIS-AYA structure was multidimensional, with the strongest support for five traits. Trait 1 represented pandemic impact on social/emotional functioning and self-care. Trait 2 reflected other pandemic disruptions. Trait 3 represented pandemic disruptions to education and/or other milestones. Trait 4 represented pandemic impact on physical well-being. Trait 5 assessed pandemic disruptions to work/financial circumstances. Item loadings and parameters indicated variability in how consistently trait level was associated with item endorsement. Trait scores did not predict distress, except that increases in Trait 3 were associated with lower distress.

CONCLUSIONS

The present study examined the psychometric properties of the CEFIS-AYA among emerging adults using a statistical framework better suited for modeling categorical data. The identified dimensional structure was relatively consistent with the initial psychometric evaluation of the CEFIS-AYA, albeit more parsimonious. However, replication is critical in light of sample demographic characteristics.

Inclusive measure development: amplifying the voices of adolescents and young adults with spina bifida in a new measure of benefit-finding and growth

OBJECTIVE

Benefit-finding and growth is an important process across a range of medical populations. However, it has been understudied in the context of lifelong chronic conditions, such as spina bifida (SB). This study aimed to develop a new measure of benefit-finding and growth for youth with SB, confirm its factor structure, and examine its psychometric properties.

METHOD

To generate items for the new measure, 20 adolescents and young adults with SB completed qualitative interviews regarding their experience of living with SB. Interviews were coded for benefits. Questionnaire items were generated from these benefits, and an expert panel refined the wording of these items. The resultant 31-item measure was shared with six of the 20 participants for feedback and then piloted among 251 youth with SB. The factor structure of the measure was confirmed and reliability and convergent validity were assessed.

RESULTS

Both a one- and four-factor structure were supported. The four factors include: Life Perspectives and Priorities, Personal Characteristics and Traits, Connections and Opportunities, and Problem Solving. Higher total and factor scores represent greater benefit-finding and growth. The measure demonstrated excellent internal consistency (α = 0.95). The new measure also showed significant positive correlations with optimism, positive affect, and life satisfaction.

CONCLUSIONS

This study produced a measure of benefit-finding and growth for youth with SB. Clinically, information about what youth with SB perceive to be their areas of strength and growth from their condition provides crucial insight into which factors to enhance in this population.

The feeding siblings questionnaire (FSQ): Development of a self-report tool for parents with children aged 2-5 years

Over the last decade, there have been repeated calls to expand the operationalisation of food parenting practices. The conceptualisation and measurement of these practices has been based primarily on research with parent-child dyads. One unexplored dimension of food parenting pertains to the evaluation of practices specific to feeding siblings. This study describes the development and validation of the Feeding Siblings Questionnaire (FSQ) - a tool designed to measure practices in which siblings are positioned as mediators in parents' attempts to prompt or persuade a child to eat. Item development was guided by a conceptual model derived from mixed-methods research and refined through expert reviews and cognitive interviews. These interviews were conducted in two phases, where parents responded to the questionnaire primarily to test i) the readability and relevance of each item, and ii) its overall feasibility. The instrument was completed by 330 parents (96.1% mothers) in Australia with two children aged 2-5 years, and repeated by 133 parents (40.3%) two weeks later. Exploratory factor analysis was performed on baseline data. Internal consistency and test re-test reliability of the subsequent subscales were examined. Construct validity was assessed through comparisons with existing measures of food parenting practices and child eating behaviours. The final FSQ scale included 22 items, reflecting five food parenting practices: sibling competitiveness, active sibling influence, threatening unequal division of food, sibling role modelling, and vicarious operant conditioning. Internal consistency and test re-test reliability estimates were high, and there was some evidence of convergent construct validity. While its factor structure should be confirmed in a different sample, the FSQ offers a novel tool for assessing, monitoring, and evaluating feeding interactions beyond those confined to the parent-child dyad.

The Maintain High Blood Glucose subscale of the child hypoglycemia fear survey: proposed preliminary cut points for screening youth with type 1 diabetes

OBJECTIVE

To improve the clinical utility of the Maintain High Blood Glucose subscale of the Hypoglycemia Fear Surveys (HFS) by identifying clinically meaningful cut points associated with glycemic outcomes.

METHODS

Youth (N = 994; 13.96 ± 2.3 years) with type 1 diabetes and their caregivers (N = 1,111; 72% female) completed the Child or Parent version of the HFS. Modal Score Distribution, Standard Deviation Criterion, and Elevated Item Criterion approaches were used to identify proposed preliminary cut points for the Maintain High Blood Glucose subscale. The association between proposed preliminary cut points was examined with youth glycemic outcomes.

RESULTS

A cut point of ≥7 for the Maintain High Blood Glucose subscale on the Child HFS was associated with a greater percentage of blood glucose readings >180 mg/dl (p < .01), higher mean blood glucose (p < .001), and a higher hemoglobin A1c (p < .05). In subsequent multiple regression analyses, controlling for other factors associated with glycemia, the significant association between scores above ≥7 and higher mean blood glucose and higher hemoglobin A1c remained. A clinically useful cut point was not identified for caregivers. However, elevated youth scores on the Maintain High Blood Glucose subscale were positively associated with elevated caregiver scores (phi = .171, p < .001).

CONCLUSIONS

The proposed preliminary cut point for the Maintain High Blood Glucose subscale will aid the type 1 diabetes care team in identifying youth whose behaviors may be contributing to their suboptimal glycemia.

Measuring emotional contagion as a multidimensional construct: the development and initial validation of the contagion of affective phenomena scales

We offer an alternative conceptualization of the construct of susceptibility to emotional contagion and four related studies where two separate measures were developed and initially validated. The Contagion of Affective Phenomena Scale-General (CAPS-G) is a 5-item scale that measures the general susceptibility to the contagion of affect, and the Contagion of Affective Phenomena Scale - Emotion (CAPS-E) assesses six distinct emotions. Study 1 generated items with experts. Study 2 explored and confirmed construct validity and the factorial structure of both measures using exploratory structural equation modeling. Study 3 established test-retest reliability, concurrent validity, and discriminant validity. Study 4 found predictive validity with a sample of competitive swimmers. In four separate samples, a 21-item and 6-factor first-order structure of CAPS-E provided the best model fit. We provide initial evidence that supports the use of CAPS-E and CAPS-G as reliable and valid measures of the susceptibility to contagion of affective phenomena.

Co-developing 'The CyberABIlity Scale' to assess vulnerability to cyberscams for people with acquired brain injury: Delphi and cognitive interviews with clinicians and people with acquired brain injury

Background Although individuals with acquired brain injury (ABI) may be vulnerable to cyberscams, the lack of existing measures documenting cybersafety behaviours in people with ABI limits our understanding of ABI-specific risk factors, the frequency of this problem, and the ability to evaluate evidence-based interventions. The CyberABIlity Scale was developed to assess vulnerability in people with ABI via self-rated statements and practical scam-identification tasks. This study aimed to develop and refine The CyberABIlity Scale through feedback from clinicians and people with ABI. Methods Scale feedback was collected via three rounds of clinician surveys (n  = 14) using Delphi methods and two rounds of cognitive interviews with participants with ABI (n  = 8). Following each round, feedback was quantitatively and qualitatively summarised, and revisions were made accordingly. Results Key revisions included removing 12 items deemed irrelevant. Instructions and rating scales were revised to improve clarity. Cognitive interviews identified 15 comprehension errors, with further revisions made to support response clarity for participants with ABI. Clinicians and participants with ABI endorsed the content and face validities of The CyberABIlity Scale . Conclusions Following further validation, The CyberABIlity Scale has the potential to be an effective screening measure for online vulnerability for people with ABI within clinical and research settings.

The community mental health team fidelity scale: A measure of program fidelity of social networks interventions for severe mental illness

Open dialogue (OD) is a multi-component therapeutic and organizational intervention for crisis and continuing community mental health care with a therapeutic focus on clients' social networks. The development and implementation of this model of care in the United Kingdom requires considerable contextual adaptations which need to be assessed to support effective implementation. Program fidelity-the extent to which core components of an intervention are delivered as intended by an intervention protocol at all levels-is crucial for these adaptations.

Aims

To develop, pilot, and implement a program fidelity measure for community mental health services providing OD and 'treatment as usual' (TAU) or standard NHS crisis and community care.

Methods

Measure structure, content, and scoring were developed and refined through an iterative process of discussion between the research team and OD experts. Measure was piloted in the 6 OD and 6 TAU services participating in a large-scale research program.

Results

Initial data suggests that the Community Mental Health Team Fidelity Scale (COM-FIDE) is a potentially reliable and feasible measure of the fidelity of community mental health services and specific OD components of such services.

Using cognitive interviews to improve a measure of organizational readiness for implementation

BACKGROUND

Organizational readiness is a key factor for successful implementation of evidence-based interventions (EBIs), but a valid and reliable measure to assess readiness across contexts and settings is needed. The R = MC² heuristic posits that organizational readiness stems from an organization's motivation, capacity to implement a specific innovation, and its general capacity. This paper describes a process used to examine the face and content validity of items in a readiness survey developed to assess organizational readiness (based on R = MC²) among federally qualified health centers (FQHC) implementing colorectal cancer screening (CRCS) EBIs.

METHODS

We conducted 20 cognitive interviews with FQHC staff (clinical and non-clinical) in South Carolina and Texas. Participants were provided a subset of items from the readiness survey to review. A semi-structured interview guide was developed to elicit feedback from participants using "think aloud" and probing techniques. Participants were recruited using a purposive sampling approach and interviews were conducted virtually using Zoom and WebEx. Participants were asked 1) about the relevancy of items, 2) how they interpreted the meaning of items or specific terms, 3) to identify items that were difficult to understand, and 4) how items could be improved. Interviews were transcribed verbatim and coded in ATLAS.ti. Findings were used to revise the readiness survey.

RESULTS

Key recommendations included reducing the survey length and removing redundant or difficult to understand items. Additionally, participants recommended using consistent terms throughout (e.g., other units/teams vs. departments) the survey and changing pronouns (e.g., people, we) to be more specific (e.g., leadership, staff). Moreover, participants recommended specifying ambiguous terms (e.g., define what "better" means).

CONCLUSION

Use of cognitive interviews allowed for an engaged process to refine an existing measure of readiness. The improved and finalized readiness survey can be used to support and improve implementation of CRCS EBIs in the clinic setting and thus reduce the cancer burden and cancer-related health disparities.

Risky self-management behaviors in adolescents with type 1 diabetes: Measurement validation for the Diabetes-Specific Risk-Taking Inventory

OBJECTIVE

Among persons with type 1 diabetes (T1D), adolescents often experience the greatest challenge achieving optimal treatment engagement and glycemic targets. Risk-taking behaviors often increase during adolescence and may interfere with engagement in T1D care. We developed the Diabetes-Specific Risk-Taking Inventory (DSRI) to assess risky T1D self-management behaviors in adolescents with T1D. In the current study, we aimed to examine the DSRI's psychometric properties.

RESEARCH DESIGN AND METHODS

We surveyed a national sample of 224 adolescents from the T1D Exchange registry (M age = 16.9 ± 1.1, 49% female, M A1c = 8.5% ± 1.3, 76.8% on insulin pumps) in a cross-sectional design. Participants completed the DSRI and measures of engagement, general risk-taking, and executive functioning and reported on incidence of severe hypoglycemia and diabetic ketoacidosis over the past year.

RESULTS

The DSRI demonstrated reliability (internal consistency: α = 0.89; test-retest reliability: r = 0.86, p < 0.01). Concurrent validity was demonstrated through significant associations between the DSRI and T1D engagement (r = -0.75), general risk-taking (r = 0.57), executive dysfunction (r = 0.34), and report of severe hypoglycemia over the past year (r = 0.22). The DSRI accounted for unique variance in adolescents' most recent glycated hemoglobin, above and beyond other variables, indicating its incremental validity.

CONCLUSIONS

Overall, initial psychometrics suggest the DSRI is a reliable and valid measure of risks that adolescents may take with their T1D care. This innovative self-report measure has potential to be an actionable clinical tool to screen for high-risk behaviors not routinely assessed in T1D clinical care.

Valued Outcomes in the Cancer Experience (VOICE)™: Development and validation of a multidimensional measure of perceived control

Objective

Enhancing cancer patients’ sense of control can positively impact psychological well-being. We developed and assessed the psychometric properties of Valued Outcomes in the Cancer Experience (VOICE)TM, a measure of patients’ perceived control over key personal priorities within their cancer experience.

Methods

VOICE construction and testing were completed in three phases with separate participant samples: (1) item generation and initial item pool testing (N = 459), (2) scale refinement (N = 623), and (3) confirmatory validation (N = 515).

Results

A 21-item measure was developed that captures cancer patients’ sense of control in seven key domains: (1) Purpose and Meaning, (2) Functional Capacity, (3) Longevity, (4) Quality Care, (5) Illness Knowledge, (6) Social Support, and (7) Financial Capability. VOICE demonstrated adequate internal consistency (full-scale α = 0.93; factor α = 0.67–0.89) and adequate to strong convergent and discriminatory validity.

Significance of results

VOICE measures cancer patients’ perceived control across a diverse range of personal priorities, creating a platform for elevating patient perspectives and identifying pathways to enhance patient well-being. VOICE is positioned to guide understanding of the patient experience and aid the development and evaluation of supportive care interventions to enhance well-being.

Toward Better Understanding of Pediatric Feeding Disorder: A Proposed Framework for Patient Characterization

To establish a foundation for methodologically sound research on the epidemiology, assessment, and treatment of pediatric feeding disorder (PFD), a 28-member multidisciplinary panel with equal representation from medicine, nutrition, feeding skill, and psychology from seven national feeding programs convened to develop a case report form (CRF). This process relied upon recent advances in defining PFD, a review of the extant literature, expert consensus regarding best practices, and review of current patient characterization templates at participating institutions. The resultant PFD CRF involves patient characterization in four domains (ie, medical, nutrition, feeding skill, and psychosocial) and identifies the primary features of a feeding disorder based on PFD diagnostic criteria. A corresponding protocol provides guidance for completing the assessment process across the four domains. The PFD CRF promotes a standard procedure to support patient characterization, enhance methodological rigor, and provide a useful clinical tool for providers and researchers working with these disorders.

Development of Long and Short Forms of the Multilevel Resilience Resource Measure for African American/Black Adults Living with HIV

Understanding resilience in relation to HIV-related outcomes may help address racial/ethnic disparities, however, significant gaps in its measurement preclude in-depth study. Thus, this research aims to develop and evaluate the psychometric properties of long and short forms of the Multilevel Resilience Resource Measure for African American/Black Adults Living with HIV. To develop the items, we conducted a mixed methods study (N = 48) and reviewed published resilience measures. We completed content validity index analyses to ensure the items reflected the resilience construct. Next, we conducted 20 cognitive interviews and a field survey (N = 400). The long and short forms demonstrated acceptable to excellent psychometric properties based on factorial validity, internal consistency and convergent validity and on measurement invariance (conducted for the short form only). These measures provide a comprehensive framework to examine resilience and HIV-related outcomes and can inform resilience-building interventions to reduce racial and ethnic health disparities.

Development and Preliminary Validation of a Multidimensional Psychosocial Assessment Strategy for Young Adults With Cancer

OBJECTIVE

Regular psychosocial assessment is a best-practice guideline for young adult oncology care, but multipurpose, multidimensional, developmentally appropriate patient-reported outcome measurement strategies for young adults with cancer are lacking. This study reported on the development and preliminary validation of the Young Adult Psychosocial Assessment Strategy (YA-PAS), a tool designed to meet this clinical need.

METHODS

The YA-PAS was developed based on the literature and clinician feedback. 20 young adults with cancer participated in cognitive interviews to provide feedback on complexity, readability, and applicability to inform measure refinement. Following refinements, 100 young adults with a history of cancer participated in an observational study including a preliminary evaluation of YA-PAS factor structure, internal consistency, test-retest reliability, construct and criterion validity, feasibility, and acceptability.

RESULTS

Cognitive interviews and psychometric evaluation informed modifications and resulted in a measure with 9 domains (anxiety, depression, cognitive functioning, post-traumatic stress, family stressors, support, social isolation, self-efficacy for symptom management, and self-efficacy for medication management) and nonscoring items assessing substance use, life stressors, resources, educational/vocational status, and relationship status. 8 of 9 domains demonstrated acceptable internal consistency (Cronbach's α ≥ 0.70), substantial (r = 0.61-0.80) or almost perfect (r > 0.80) test-retest reliability, and evidence of domain and cut-point validity. 89% of participants were able to complete the YA-PAS within 20 min and 87% were satisfied with the measure.

CONCLUSIONS

The YA-PAS demonstrated promising psychometric properties, feasibility, and acceptability. Clinical implications and research recommendations are discussed.

Assessing resiliency in Canadians experiencing social vulnerability: Psychometric properties of the CUPS Resiliency Interview Schedule and Resiliency Questionnaire

Deficit models of care for clients experiencing social vulnerability have become increasingly unsustainable; and there is a shift towards models of care that promote and protect resiliency for lifelong health. We defined clients as socially vulnerable if they were living with poverty, mental health problems and addictions, disability, and social isolation. Scales to measure outcomes of resiliency-focused programming have limited reliability and have not been validated with vulnerable populations. The aim of this study was to develop and conduct preliminary psychometric assessment of two measures: CUPS (formerly Calgary Urban Project Society) Resiliency Interview Schedule (RIS) and Resiliency Questionnaire (RQ) for adults experiencing social vulnerability. To engage clients who were seeking integrated services at a social services agency, we developed the RIS and accessed data collected between April 2017 and December 2018. In a structured intake interview, the client and staff prioritised goals and identified resiliency in three domains: (a) economic, (b) social-emotional, and (c) health. On average, clients (N = 545) who completed the CUPS-RIS were 45.9 years old (SD = 12.62). For the CUPS-RIS, Cronbach's alphas at intake and outcome assessments were 0.80. Exploratory factor analysis demonstrated a four-factor solution with two unexpected results: executive functioning/self-regulation loaded with mental and physical health, and client education failed to load on any factor. We found significant improvements between client intake and outcome measurement points on eight of 12 sub-domains. As a brief self-report measure of resiliency, we developed the CUPS-RQ and accessed data collected between November 2018 and May 2019. Clients (N = 29) who completed the CUPS-RQ concurrently with the Resilience Research Centre-Adult Resilience Measure (RRC-ARM) were, on average, 42.46 years old (SD = 12.87). The CUPS-RQ was correlated with RRC-ARM, r = 0.819. In preliminary psychometric assessment, the CUPS-RIS and CUPS-RQ demonstrated satisfactory reliability and validity and show promise as measures of resiliency for agencies serving clients experiencing social vulnerability.

Validating the Factor Structure of the Psychosocial Assessment Tool Using Internet-Based Data

OBJECTIVE

The Psychosocial Assessment Tool (PAT) is a well-validated, brief screener of family psychosocial risk. Since 2014 a web-based version of the PAT (WebPAT) has been available for use by clinicians and researchers, but the psychometric properties have not been examined. The objective of this article was to examine the factor structure and internal consistency of the WebPAT, which was administered to caregivers of youth with cancer.

METHODS

The WebPAT was administered to 1,252 caregivers of youth with cancer across 29 institutions. Confirmatory factor analysis (CFA) was used to examine the factor structure of the WebPAT. Internal consistencies of the total and subscale scores were examined via the Kuder-Richardson 20 coefficient. The distribution of total PAT score across the three risk categories of the Pediatric Psychosocial Preventative Health Model (PPPHM) was also examined.

RESULTS

The CFA supported the original seven-factor structure of the PAT (Family Structure, Social Support, Child Problems, Sibling Problems, Family Problems, Stress Reactions, and Family Beliefs). Internal consistencies were strong for the total PAT score and four subscales (Social Support, Child Problems, Sibling Problems, and Family Problems). The distribution of total PAT scores across PPPHM risk categories was consistent with prior research.

CONCLUSIONS

The WebPAT is a psychometrically sound screener of psychosocial risk in families of youth with cancer. Healthcare providers can use the WebPAT to assess families' psychosocial risk and guide the provision of psychosocial care. Future research should evaluate the implementation of the PAT and identify barriers and facilitators to implementation.

Qualitative insights in item development for a comprehensive and inclusive measure of recovery capital

BACKGROUND

Item specification is foundational to measurement development but rarely reported in depth. We address this gap by explicating our use of qualitative methods to ground and develop items for a new recovery capital measure, the Multidimensional Inventory of Recovery Capital.

METHOD

We recruited a diverse sample of service providers (n = 9) and people in recovery from alcohol problems (n = 23) to provide feedback on an item pool assessing social, human, physical, community, and cultural capital. Using applied qualitative analysis, we coded findings from interviews and focus groups and made final decisions by consensus regarding item elimination, retention, or revision. This process yielded a 49-item draft measure.

RESULTS

Only nine items from an initial 90-item list were retained in their original form. Participant feedback guided item elimination, addition, and revision for linguistic or conceptual clarity. We detected little systematic variation in feedback based on income or race; however, there were stark divergences on particular items based on recovery pathway (i.e. 12-step versus other approaches).

CONCLUSIONS

The high degree of alteration to the item pool highlights the importance of establishing validity with respondents. Response variation based on recovery pathway suggests the need for broad heterogeneity in respondents. Measures that are sensitive, psychometrically sound, and aligned with theory are critical for advancing research on recovery capital and related disparities for diverse populations.

The Diabetes-Specific Risk-Taking Inventory: Piloting a New Measure for Adolescents With Type 1 Diabetes

OBJECTIVE

We sought to develop and pilot a new measure, the Diabetes-Specific Risk-Taking Inventory (DSRI), to assess unhealthy risk-taking behaviors among adolescents with type 1 diabetes.

METHODS

Thirteen diabetes health care providers, 30 adolescents with type 1 diabetes (aged 15-19 years, 60% female, mean A1C 8.7% [72 mmol/mol], and 33% on insulin pumps), and the adolescents' caregivers rated the perceived riskiness of each item on the DSRI. Adolescents completed the DSRI, for which they reported how often they engaged in 34 behaviors that could place them at risk for acute complications of type 1 diabetes or out-of-range blood glucose levels. Adolescents also completed the risk-taking subscale from the Risk-Taking and Self-Harm Inventory for Adolescents, and parents completed the parent-proxy Diabetes Management Questionnaire. Mean A1C during the previous year was obtained via medical chart review.

RESULTS

Results indicated good content validity and feasibility for using the DSRI in a research context, as 100% of adolescents who consented to the study completed the measure. The DSRI was positively correlated with general risk-taking and negatively correlated with diabetes management, indicating preliminary evidence of convergent validity. The DSRI also correlated with A1C.

CONCLUSION

This pilot study extends our previous work in developing a conceptual model for illness-specific risk-taking. The DSRI is a promising new measure to assess illness-specific risk-taking, including unhealthy risk-taking behaviors, for adolescents with type 1 diabetes.

Communication About Medication by Providers-Adolescent and Young Adult Version: Confirmatory Factor Analyses

OBJECTIVE

To replicate the factor structure of a patient-report measure of provider communication about key medication prescription information, the Communication about Medication by Providers-Adolescent and Young Adult (CAMP-AYA) Version. We evaluated whether the 15-item, two-factor structure identified previously could be replicated via confirmatory factor analysis, and we also examined fit of unidimensional and bifactor models. Associations of CAMP-AYA Total and Factor Scores with provider satisfaction and select patient and medication characteristics were also examined.

METHODS

Participants were 739 AYA (ages 18-25) who completed the CAMP-AYA, a provider satisfaction rating, and provided demographic and medication information.

RESULTS

The bifactor model was best fitting (χ2 [75] = 689.60, p < .0001; root mean squared error of approximation = 0.11, 90% CI [0.10, 0.11]; Comparative Fit Index = 0.98; Tucker-Lewis Index = 0.98; Standardized Root Mean Square Residual Index = 0.02). Internal consistency reliabilities for Total and Factor Scores were high (αs > .89) and Total and Factor Scores were associated with provider satisfaction (ps < .001). CAMP-AYA scores varied as a function of type of prescription (short vs. long term; new vs. refill), with higher scores reported in the context of long term (>30-day course) or refilled prescriptions (ps < .007) in most cases.

CONCLUSIONS

This study provides additional support for the reliability of the CAMP-AYA as a tool to assess AYA perceptions of provider key information coverage about medication prescriptions.

Development and Preliminary Validation of a Sport-Specific Self-Report Measure of Identity Foreclosure

A sport-specific, self-report measure of identity foreclosure was developed through a systematic process that included item pool generation, expert review, administration of items to a development sample of intercollegiate student athletes (N = 326), item evaluation, and administration of scales to validation samples of intercollegiate student athletes (N = 322, N = 54, and N = 64, respectively). The process yielded two four-item scales reflecting commitment to the occupational identity of athlete and one 4-item scale reflecting active exploration of roles other than that of athlete that (a) are internally consistent and temporally stable, (b) demonstrate preliminary factorial and convergent validity, and (c) can be used to create indices of identity foreclosure tailored to the sport context. The resulting Sport-Specific Measure of Identity Foreclosure has potential utility as an assessment tool for research and practice with athletes.

Health-related quality of life in parents and partners of people with type 1 diabetes: Development and validation of type 1 diabetes and life (T1DAL) measures

INTRODUCTION

Despite the significant impact of type 1 diabetes (T1D) on family, few instruments are available to assess health-related quality of life (HRQOL) among family members of people with T1D. This study aimed to develop and evaluate the psychometric properties of new measures of diabetes-specific HRQOL for parents and partners of people with T1D. We report on the multistep development and validation process for the self-report Type 1 Diabetes and Life (T1DAL) measures, with versions for parents of youth age <8, 8-11, 12-17, and 18-25 years, and for partners of people age ≥18 years with T1D.

METHOD

First, we conducted qualitative interviews (total parents/partners n = 38) to develop draft measures and piloted them (total n = 20). Next, we tested the measures' psychometric properties. Participants (total across versions n = 813) at six T1D Exchange Clinic Network sites completed the appropriate T1DAL measure and validated measures of related constructs. We then reduced each T1DAL measure to 20-30 items in length based on psychometric data and participant feedback. Eleven participants reviewed the final measures via cognitive debriefing.

RESULTS

The T1DAL measures for parents and partners demonstrated good internal consistency (α = .80-.88) and test-retest reliability (r = .73-.86). Correlations with measures of general quality of life, generic and diabetes-specific HRQOL, and diabetes burden demonstrated construct validity. Factor analyses identified 3-4 subscales/measure. Participants reported being satisfied with the shortened measures, which took 5-10 minutes to complete.

DISCUSSION

The new T1DAL measures for parents and partners of people with T1D are reliable, valid, and ready for use in research and clinical settings. (PsycInfo Database Record (c) 2021 APA, all rights reserved).

Design and psychometrics for new measures of health-related quality of life in adults with type 1 diabetes: Type 1 Diabetes and Life (T1DAL)

AIMS

To use a three-phase process to develop and validate new self-report measures of diabetes-specific health-related quality of life (HRQOL) for adults with type 1 diabetes. We report on four versions of the Type 1 Diabetes and Life (T1DAL) measure for people age 18-25, 26-45, 46-60, and over 60 years.

METHODS

We first conducted qualitative interviews to guide measure creation, then piloted the draft measures. We evaluated psychometric properties at six T1D Exchange Clinic Network sites via completion of T1DAL and validated measures of related constructs. Participants completed the T1DAL again in 4-6 weeks. We used psychometric data to reduce each measure to 23-27 items in length. Finally, we obtained participant feedback on the final measures.

RESULTS

The T1DAL-Adult measures demonstrated good internal consistency (α = 0.85-0.88) and test-retest reliability (r = 0.77-0.87). Significant correlations with measures of general quality of life, generic and diabetes-specific HRQOL, diabetes burden, self-management, and glycemic control demonstrated validity. Factor analyses yielded 4-5 subscales per measure. Participants were satisfied with the final measures and reported they took 5-10 min to complete.

CONCLUSIONS

The strong psychometric properties of the newly developed self-report T1DAL measures for adults with type 1 diabetes make them appropriate for use in clinical research and care.

Psychosocial Screening in Sickle Cell Disease: Validation of the Psychosocial Assessment Tool

OBJECTIVE

Families of youth with Sickle Cell Disease (SCD) can face psychosocial adversity including emotional distress, functional impairments, and sociodemographic risk factors. Systematic screening of psychosocial risk can identify families who may benefit from further assessment and evidence-based care. The Psychosocial Assessment Tool (PAT) is a brief caregiver-report screener based on the tri-level Pediatric Psychosocial Preventative Health Model (PPPHM).

METHODS

Findings are presented from the baseline assessment of a longitudinal study validating a Sickle Cell version of the PAT 2.0. Primary caregivers of 136 youth with SCD receiving care through a multidisciplinary SCD clinic in a children's hospital completed the PAT and validation measures. A subset of 25 caregivers completed the PAT a second time within 3-5 weeks.

RESULTS

Internal consistency for the total score was strong (α = .87), and for the subscales was moderate to strong (α  =  .74-.94), with the exception of the Family Structure (α  =  .38), Caregiver Beliefs (α  =  .48), and Stress Reactions (α  =  .56) subscales. Test-retest reliability was also strong (r = .86, p < .001). Moderate to strong correlations with all except two criteria measures provided validation for the total and subscale scores. Validation measures varied significantly across the three levels of the PPPHM.

CONCLUSIONS

Results provide support for the reliability and validity of the PAT in SCD. Systematic screening with the PAT can help identify families of youth with SCD at risk for psychosocial problems and potentially help connect them to appropriate services.

A psychometric investigation on the diagnostic utility of the posttrauma risky behaviors questionnaire

The Posttrauma Risky Behaviors Questionnaire (PRBQ) is a screening measure for posttrauma reckless and self-destructive behaviors (RSDBs). We examined (1) PRBQ's predictive relations with clinical (vs. not) endorsements of distinct RSDBs, and (2) PRBQ's optimal cutoff score yielding the most appropriate balance of sensitivity and specificity statistics. The sample included 354 adult trauma-exposed community participants (Mage=35.76 years; 57.90% female). Logistic regression analyses indicated that the PRBQ significantly differentiated individuals endorsing (vs. not) clinical levels of alcohol/drug misuse, disordered eating, problematic gambling, and compulsive buying. Receiver operating characteristic (ROC) curve analyses indicated that the 14-item PRBQ total score had moderate accuracy in differentiating individuals endorsing clinical vs. non-clinical levels of drug misuse, disordered eating, problematic gambling, compulsive buying, and engagement in RSDBs (PTSD's E2 Criterion); and low accuracy for alcohol misuse. ROC curve analyses indicated 3.5-6.5 as the optimal range of PRBQ cutoff scores. Thus, the PRBQ has good ability to discriminate participants endorsing (vs. not) clinical levels of alcohol/drug misuse, disordered eating, problematic gambling, and compulsive buying (lowest accuracy in identifying participants with clinical levels of alcohol misuse), and a minimum cutoff score between 3.5 and 6.5 may suggest using additional diagnostic assessments and clinical interventions.

Assessing Health-Related Quality of Life in Children and Adolescents with Diabetes: Development and Psychometrics of the Type 1 Diabetes and Life (T1DAL) Measures

OBJECTIVE

To develop and validate new measures of diabetes-specific health-related quality of life (HRQOL) for people with type 1 diabetes (T1D) that are brief, developmentally appropriate, and usable in clinical research and care. Here we report on the phases of developing and validating the self-report Type 1 Diabetes and Life (T1DAL) measures for children (age 8-11) and adolescents (age 12-17).

METHODS

Measure development included qualitative interviews with youth and parents (n = 16 dyads) followed by piloting draft measures and conducting cognitive debriefing with youth (n = 9) to refine the measures. To evaluate the psychometric properties, children (n = 194) and adolescents (n = 257) at three T1D Exchange Clinic Network sites completed the age-appropriate T1DAL measure and previously validated questionnaires measuring related constructs. Using psychometric data, the investigators reduced the length of each T1DAL measure to 21 and 23 items, respectively, and conducted a final round of cognitive debriefing with six children and adolescents.

RESULTS

The T1DAL measures for children and adolescents demonstrated good internal consistency (α = 0.84 and 0.89, respectively) and test-retest reliability (r = 0.78 and 0.80, respectively). Significant correlations between the T1DAL scores and measures of general quality of life, generic and diabetes-specific HRQOL, diabetes burden, and diabetes strengths demonstrated construct validity. Correlations with measures of self-management (child and adolescent) and glycemic control (adolescent only) demonstrated criterion validity. Factor analyses indicated four developmentally specific subscales per measure. Participants reported satisfaction with the measures.

CONCLUSIONS

The new T1DAL measures for children and adolescents with T1D are reliable, valid, and suitable for use in care settings and clinical research.

Validation of a brief scale to assess ambulatory patients' perceptions of reading visit notes: a scale development study

OBJECTIVES

To develop and evaluate the validity of a scale to assess patients' perceived benefits and risks of reading ambulatory visit notes online (open notes).

DESIGN

Four studies were used to evaluate the construct validity of a benefits and risks scale. Study 1 refined the items; study 2 evaluated underlying factor structure and identified the items; study 3 evaluated study 2 results in a separate sample; and study 4 examined factorial invariance of the developed scale across educational subsamples.

SETTING

Ambulatory care in three large health systems in the USA.

PARTICIPANTS

Participants in three US health systems who responded to one of two online surveys asking about benefits and risks of reading visit notes: a psychometrics survey of primary care patients, and a large general survey of patients across all ambulatory specialties. Sample sizes: n=439 (study 1); n=439 (study 2); n=500 (study 3); and n=250 (study 4).

PRIMARY AND SECONDARY OUTCOME MEASURES

Questionnaire items about patients' perceived benefits and risks of reading online visit notes.

RESULTS

Study 1 resulted in the selection of a 10-point importance response option format over a 4-point agreement scale. Exploratory factor analysis (EFA) in study 2 resulted in two-factor solution: a four-item benefits factor with good reliability (alpha=0.83) and a three-item risks factor with poor reliability (alpha=0.52). The factor structure was confirmed in study 3, and confirmatory factor analysis of benefit items resulted in an excellent fitting model, X²(2)=2.949; confirmatory factor index=0.998; root mean square error of approximation=0.04 (0.00, 0.142); loadings 0.68-0.86; alpha=0.88. Study 4 supported configural, measurement and structural invariance for the benefits scale across high and low-education patient groups.

CONCLUSIONS

The findings suggest that the four-item benefits scale has excellent construct validity and preliminary evidence of generalising across different patient populations. Further scale development is needed to understand perceived risks of reading open notes.

Validation of the Healthcare Transition Outcomes Inventory for Young Adults With Type 1 Diabetes

OBJECTIVE

We recently developed and content validated the Healthcare Transition Outcomes Inventory (HCTOI), a stakeholder vetted, multidimensional measure of the outcomes of the transition from pediatric to adult healthcare for young adults (YA) with type 1 diabetes (T1D). In this study, we aimed to evaluate the psychometric properties of the HCTOI.

METHODS

We collected and analyzed cross-sectional data from 128 YA (18-25 years old) with T1D to evaluate the psychometric properties of the HCTOI. We conducted confirmatory factor analysis (CFA), item analysis, and examined reliability and validity in relation to measures of quality of life, diabetes distress, regimen adherence, and glycemic control.

RESULTS

CFA supported a five-factor solution: integration of T1D into emerging adult roles, balance of parental support with T1D autonomy, establishing and maintaining continuity of care, forming a collaborative patient-provider relationship, and ownership of T1D. We reduced the HCTOI from 54 to 34 items. The HCTOI demonstrated adequate internal consistency (α's = 0.62-0.87) and significant correlations demonstrated construct (quality of life, diabetes distress) and criterion validity (adherence, glycemic control).

CONCLUSIONS

The HCTOI demonstrated promising initial psychometric properties. As the first measure of the multiple dimensions of healthcare transition outcomes, the HCTOI provides a means to examine longitudinal relations between transition readiness and outcomes and to assess the efficacy or effectiveness of interventions and programs designed to improve the transition process for YA with T1D.

Development of an Observational Parental Scaffolding Measure for Youth with Spina Bifida

OBJECTIVE

To examine the reliability and validity of a new observational measure of parental scaffolding, as well as the impact of parental scaffolding on academic and social outcomes among youth with spina bifida (SB).

METHODS

As part of a larger study, 137 families of youth with SB participated in family interaction tasks and self-report questionnaires at the baseline assessment. Teachers also reported on youth's academic independence and competence, as well as social skills. Guided by previous research and theoretical formulations, a rational approach to measure development was employed whereby maternal and paternal scaffolding composites were created using the Family Interaction Macro-coding System (Holmbeck, Zebracki, Johnson, Belvedere, & Hommeyer (2007). Parent-child interaction macro-coding manual. Unpublished coding system. Chicago: Loyola University Chicago).

RESULTS

The scaffolding measure demonstrated acceptable interrater and scale reliabilities. Additionally, both the maternal and paternal scaffolding composites were significantly associated with scores from self-report questionnaires of parenting behaviors in the expected directions. Maternal scaffolding was positively associated with IQ, academic competence, academic independence, and social self-control in youth with SB, whereas paternal scaffolding was positively associated with social cooperation and social self-control. Differences in scaffolding emerged between mothers and fathers, as well as across demographic variables.

CONCLUSION

Initial findings support the use of the scaffolding measure. Future research should continue to examine the utility of this scaffolding measure in families of youth with SB.

Psychometric Properties of the Parent and Child Problem Areas in Diabetes Measures

OBJECTIVE

Children with type 1 diabetes and their parents face daily self-care demands, leading to diabetes-specific emotional distress. A standardized measure of diabetes distress can guide clinical care and prevent negative outcomes.

METHODS

This study evaluated the psychometric properties of child- and parent-report measures of the Problem Areas in Diabetes Scale, adapted for children ages 8-12 (PAID-C) and their parents (P-PAID-C). Participants were from 42 diabetes camps in the United States. Children (N = 804; mean age = 10.3 ± 1.1) and parents (N = 968) completed measures of diabetes distress, diabetes-related strengths, and self-care skills. Half of the sample was used for exploratory factor analyses (EFA) with direct oblimin rotation and the other half for confirmatory factor analyses (CFAs).

RESULTS

For the PAID-C, EFA and CFAs supported an 11-item two-factor measure, Cronbach's α = .91, accounting for 54.6% of the variance. For the P-PAID-C, analyses resulted in a 16-item measure, Cronbach's α = .92, accounting for 51.9% of the variance. PAID-C and P-PAID-C scores were positively correlated with HbA1c (rchild = .08, p = .04; rparent = .18, p < .001), and negatively correlated with diabetes-related strengths (rchild = -.38, p < .001, rparent = -.29, p < .001) and parent report of child self-care skills (rparent = -.13, p < .001; rchild = -0.07, p = ns).

CONCLUSIONS

Initial psychometrics suggest that the PAID-C and P-PAID-C reliably and validly capture diabetes-specific emotional distress for children and their parents. Associations with glycemic control, self-care, and diabetes strengths demonstrate criterion validity. Both measures have potential applications for routine, clinic-based assessments of diabetes distress and may guide clinical decision-making.

Caregivers' Barriers to Facilitating Medication Adherence in Adolescents/Young Adults With Solid Organ Transplants: Measure Development and Validation

OBJECTIVE

To evaluate the factor structure, validity, and reliability of the Caregiver Medication Barriers to Adherence Scale (CMBAS), which assesses caregivers' barriers to facilitating medication adherence in adolescent and young adults (AYAs) with solid organ transplants.

METHODS

The sample included 93 caregivers of AYAs ages 12-22 years who received a liver, kidney, or heart transplant. Caregivers completed the CMBAS and surveys to assess its validity, including internalizing symptoms, personality traits (i.e., neuroticism, conscientiousness), and AYAs' nonadherence to immunosuppressant medications. AYA nonadherence to tacrolimus was objectively assessed via the Medication Level Variability Index (MLVI).

RESULTS

Confirmatory factor analyses of the CMBAS revealed a two-factor model: Caregiver Emotional Distress and Caregiver Cognitive Burden/Responsibility. Higher CMBAS scores were related to higher levels of caregiver internalizing symptoms (rs = .28 to .30), neuroticism (r = .27), and caregiver proxy-reported immunosuppressant nonadherence (r = .27), as well as lower levels of caregiver conscientiousness (rs = -.25 to -.26). The CMBAS was not associated with the MLVI (rs = -.13 to -.16).

CONCLUSIONS

The CMBAS demonstrated reliability and validity for caregivers of AYAs with solid organ transplants. Findings support the use of the CMBAS as a brief clinical screening tool to identify caregivers' barriers to facilitating AYA medication adherence.

Developing quality fidelity and engagement measures for complex health interventions

OBJECTIVES

To understand whether interventions are effective, we need to know whether the interventions are delivered as planned (with fidelity) and engaged with. To measure fidelity and engagement effectively, high-quality measures are needed. We outline a five-step method which can be used to develop quality measures of fidelity and engagement for complex health interventions. We provide examples from a fidelity study conducted within an evaluation of an intervention aimed to increase independence in dementia.

METHODS

We propose five steps that can be systematically used to develop fidelity checklists for researchers, providers, and participants to measure fidelity and engagement. These steps include the following: (1) reviewing previous measures, (2) analysing intervention components and developing a framework outlining the content of the intervention, (3) developing fidelity checklists and coding guidelines, (4) obtaining feedback about the content and wording of checklists and guidelines, and (5) piloting and refining checklists and coding guidelines to assess and improve reliability.

RESULTS

Three fidelity checklists that can be used reliably were developed to measure fidelity of and engagement with, the Promoting Independence in Dementia (PRIDE) intervention. As these measures were designed to be used by researchers, providers, and participants, we developed two versions of the checklists: one for participants and one for researchers and providers.

CONCLUSIONS

The five steps that we propose can be used to develop psychometrically robust and implementable measures of fidelity and engagement for complex health interventions that can be used by different target audiences. By considering quality when developing measures, we can be more confident in the interpretation of intervention outcomes drawn from fidelity and engagement studies. Statement of contribution What is already known on the subject? Fidelity and engagement can be measured using a range of methods, such as observation and self-report. Studies seldom report psychometric and implementation qualities of fidelity measures. What does this study add? A method for developing fidelity and engagement measures for complex health interventions. Guidance on how to consider quality when developing fidelity and engagement measures.

Psychometric Properties of the Assessment of Recovery Capital (ARC) Instrument in a Diverse Low-Income Sample

Background: Recovery capital is a theoretical construct elucidating the resources that support recovery from addiction. The 50-item Assessment of Recovery Capital (ARC) instrument and related brief-format versions are the predominant measures of this construct. However, some of the ARC's psychometric properties are not well-established, particularly in racially and economically diverse populations. Objectives: We aimed to determine if the ARC is a valid and reliable measure of recovery capital in a diverse sample. Methods: Paper-and-pencil survey data were collected between March 2017 and May 2018 from a low-income, racially diverse sample of adults in recovery (N = 273). Participants were recruited from nontreatment community settings throughout a mid-sized northeastern U.S. city. They completed the ARC and sociodemographic questions. To determine the ARC's reliability and factor structure, we used item-level analyses and Cronbach's alpha, followed by confirmatory and exploratory factor analyses. Results: Several items performed poorly, having means close to response extremes and problematically small variances. Cronbach's alpha for the full measure was α = .92; however, alphas for the majority of subscales were below .70. The a priori 10-factor model solution failed, preventing interpretation of the confirmatory factor analysis results. Exploratory factor analysis revealed that although the 10-factor model marginally fit the data, items did not load together as proposed. Not once did all five subscale items load highly on the same factor. Conclusions/Importance: The ARC has substantial weaknesses in its theoretical alignment, item performance, and psychometric properties with diverse populations. We recommend the development of a new multidimensional, theory-aligned measure, following a rigorous measurement development protocol.

Psychometric Evaluation of the Caregiver Burden Inventory in Children and Adolescents With PANS

Objectives

To establish the psychometric properties of the Caregiver Burden Inventory (CBI) in patients with Pediatric Acute-onset Neuropsychiatric Syndrome (PANS), which is characterized by the abrupt onset of obsessive-compulsive disorder and/or restricted eating and at least two additional psychiatric symptoms. Parents of patients with PANS have reported high caregiver burden. However, no validated instrument of burden exists for this population.

Methods

Study took place at a community-based PANS clinic where the CBI is administered as part of routine clinical care. The first CBI available during an active disease flare was analyzed (N =104). Construct validity was evaluated within a confirmatory factor analytic framework. Associations between the CBI and patient/family characteristics were explored, and preliminary normative data for this population are presented.

Results

Item-factor loadings were strong, and the overall fit of the model was good (root mean square error of approximation = .061). Strict/metric measurement invariance was demonstrated across age. The mean Total Score in this sample was 36.72 ± 19.84 (interquartile range 19-53). Total Scores on the CBI were significantly elevated for parents of children who switched schools because of their illness (Cohen's d = 0.75, 95% confidence interval [CI] 0.28-1.22) and for those who had reduced work hours to accommodate the child's illness (Cohen's d = 0.65, 95% CI 0.10-1.20). However, in this relatively high-status sample, socioeconomic variables did not predict Total Scores.

Conclusions

Parents of patients with PANS experience high caregiver burden. The CBI may be confidently used to assess caregiver burden in this population.

Application of a Discrete Choice Experiment to Assess Adherence-Related Motivation Among Adolescents and Young Adults With Cancer

Objective

To develop and pilot test a discrete choice experiment (DCE) to assess the specific factors likely to motivate a given adolescent or young adult with cancer to adhere to medications included in treatment protocols.

Methods

A multimethod and iterative approach was used. Twenty adolescents and young adults with cancer participated in DCE pilot testing and refinement. Hierarchical Bayes was used to estimate attribute and attribute-level preference scores for each participant.

Results

The final DCE included nine choice sets composed of four attributes. The resulting DCE was modified with feedback from 20 adolescents and young adults (M[SD] age = 18.66 [2.95]) with cancer. The DCE was understandable and relevant. The factors likely to motivate adolescents and young adults with cancer to be adherent differed across individuals.

Conclusions

DCEs including the measure developed in this manuscript offer a novel approach to understanding individual-level differences critical for informing adherence-promotion efforts.

Assessing Patient Motivation for Treatment: A Systematic Review of Available Tools, Their Measurement Properties, and Conceptual Definition

BACKGROUND AND PURPOSE

Motivation is often reported by clinicians and researchers as a key factor related to treatment and health outcomes. This systematic review aims to (a) Identify and critically appraise tools that measure patient motivation for treatment and (b) determine how these tools define and evaluate motivation.

METHODS

Library databases and the search engine Google Scholar were examined. Identified tools measuring patient motivation for treatment and reported measurement properties were selected.

RESULTS

14 peer-reviewed articles covering 12 different tools made the final selection. Quality was assessed using the COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN) and a new measure checklist. Reliability evidence was predominantly estimated using internal consistency; validity evidence was limited, and responsiveness was seldom examined. Overall, quality ratings were poor or inadequately reported and serious methodological limitations were identified. A lack of conceptual foundation quality ratings as tools did not apply a theory related to motivation or have a clear definition of the construct of patient motivation.

CONCLUSIONS

A significant gap exists of available tools with adequate measurement properties that use relevant theoretical frameworks.

Development and initial validation of the Support for Healthy Lifestyle (SHeL) questionnaire for adolescents

This study developed and provided initial validation for the Support for Healthy Lifestyle (SHeL), a set of scales designed to measure adolescent-perceived social support of healthy eating and physical activity. Item pool development utilized a prior focus group study of adolescents' perceptions of socially supportive behavior and a review of the literature on social support for health behavior change in adolescents. Exploratory factor analysis of the item pool completed by 220 adolescents, internal consistency estimates, and expert review of items and consensus resulted in 9 scales for the SHeL: Family Healthy Eating Support, Family Physical Activity Support, Family Hypocritical Control, Peer Health Eating Support, Peer Physical Activity Support, Peer Undermining, Professional Healthy Eating Support, Professional Physical Activity Support, and Professional General Support. Scale internal reliability estimates were α = 0.73-0.96. Supporting construct validity, the SHeL showed a pattern of stronger correlations between measures of the same source (parent/peer) and target behavior (healthy eating/physical activity) and stronger correlations with corresponding Sallis scales vis-à-vis other Sallis scales, with exceptions related to peer support for healthy eating. Divergent validity was somewhat limited, including in two instances, the SHeL scale was more strongly correlated with another SHeL scale. Supporting criterion validity, often the SHeL scales were correlated with related health behaviors. This study provided important psychometric information for a new measurement of social support for health behavior for adolescents. Further research with larger, more diverse, and treatment-seeking populations is needed to provide further validation of the SHeL and to begin to establish normative scores.

Development and Initial Validation of the Communication About Medication by Providers-Parent Scale (CAMP-P)

This study evaluated the psychometric properties of the Communication about Medication by Providers-Parent Scale (CAMP-P), a 24-item measure of communication relevant to medication adherence between parents and medical providers. Parents of youth (ages 2-7 years) who had received a prescription within the last 12 months completed online surveys regarding demographic and appointment variables, and child's recent prescription medications, and they completed the newly developed CAMP-P. Exploratory factor analysis of CAMP-P identified 20 items about provider communication corresponding to 3 distinct scales: medication administration strategies, encouraging communication, and addressing barriers to medication taking. Factor scales were related to appointment variables, such as length of time spent discussing medications. The CAMP-P demonstrated good internal consistency and convergent and divergent validity. The CAMP-P is a novel, validated measure of parent perceptions of medication communication and can be utilized to evaluate parent-provider communication on pediatric medication adherence in clinical and research settings.

PRISM: a brief screening tool to identify risk in parents of youth with chronic pain

Having a child with chronic pain impacts a parent's life. Reciprocally, parent cognitive, affective, and behavioral responses to the child's chronic pain can influence the child's pain experience. The purpose of this study is to develop a brief self-report screening tool (Parent Risk and Impact Screening Measure [PRISM]) of parent psychosocial functioning and behavioral responses to child pain. This measure assesses parents' reports of their own stress, health, psychosocial functioning, and disruption in activities due to their child's pain and related disability. In an effort to preliminarily validate this screening tool, we examined the PRISM in relation to existing measures of parent distress, parent behavior, and child functioning. An initial 30-item PRISM was administered to 229 parents of children with persistent pain. Parents also reported on distress, protectiveness, pain catastrophizing and family impact, and youth completed measures of pain, pain-related disability, and quality of life. Item refinement resulted in a final 12-item PRISM tool. The PRISM demonstrates strong internal consistency, and initial support for construct validity was shown by associations with parent distress, protectiveness, and catastrophizing. Results also revealed higher PRISM scores are associated with higher child pain intensity, greater functional disability, and poorer quality of life. Cutoff scores were determined to identify parents at differing levels of risk. The PRISM is a brief and clinically important means of screening parent distress and behaviors associated with child pain-related dysfunction. Further validation will use PRISM in longitudinal studies, particularly testing PRISM scores as a predictor of parent and child outcomes over time.

Beliefs about sharing illness experiences: Development of a scale and relationship with symptoms of fibromyalgia

OBJECTIVES

The aim of the current research was to evaluate, in people with fibromyalgia, the extent to which beliefs about sharing illness experiences are associated with functioning and distress, and to explore the mediating role of illness behaviours. A new scale was designed to address this.

DESIGN

The Beliefs about Sharing Illness Experiences (BASIE) scale was developed, and initial tests of reliability and validity were conducted. A cross-sectional design was used to determine relationships, including mediation analyses.

METHODS

Individuals with fibromyalgia (n = 147) and a comparison group of individuals without fibromyalgia (n = 47) completed questionnaires online. Construct validity was assessed by comparing these two groups. Convergent validity was assessed through correlations with the BASIE and measures of support-seeking and self-sacrifice. Correlation analyses were used to determine relationships with illness behaviours and outcome measures (distress and global impact). Mediation analyses were used to test the indirect effects of illness behaviours.

RESULTS

The BASIE was correlated with expected convergent measures and had good internal consistency (Cronbach's alpha = .939). Individuals with fibromyalgia had significantly higher scores than the comparison group. There was a direct relationship between BASIE scores and outcomes, in terms of functioning and distress. The relationship between BASIE scores and functioning was partially mediated by personal/emotional support-seeking and all-or-nothing behaviours, and not by symptom-related support-seeking or limiting behaviours.

CONCLUSION

Beliefs about sharing illness experiences may be a key factor in maintaining cycles of distress and symptoms in people with fibromyalgia, together with all-or-nothing behaviours and personal/emotional support-seeking. Statement of contribution What is already known on this subject? Maintenance of fibromyalgia is likely to be a complex autopoietic relationship including symptoms, beliefs, behaviours, and emotions. Research suggests possible roles of beliefs about unacceptability of emotions and beliefs around interpersonal situations, and behaviours in social situations as well as limiting and all-or-nothing behaviours. People with fibromyalgia may experience stigma, sometimes resulting in secrecy around their condition and symptoms. What does this study add? The BASIE is a 21-item questionnaire that measures beliefs around sharing illness experiences. Individuals with fibromyalgia hold stronger beliefs around unacceptability of sharing illness experiences. These beliefs are related to functioning and distress, partially mediated by illness behaviours.

Reducing growth and developmental problems in children: Development of an innovative postnatal risk assessment

Introduction

Globally, awareness of the relevance of both medical and non-medical risk factors influencing growth and development of children has been increasing. The aim of our study was to develop an innovative postnatal risk assessment to be used by the Preventive Child Healthcare (PCHC) to identify at an early stage children at risk for growth (catch-up growth, overweight and obesity) and developmental problems (such as motor, cognitive, psychosocial and language/ speech problems).

Methods

We used the first four steps of the Intervention Mapping process. Step 1: Review of the literature and focus group discussions. Step 2: Identification of program objectives on how to develop and implement a risk assessment in PCHC daily practice. Step 3: Application of the ASE model to initiate behavioral change in the target group. Step 4: Development of the postnatal R4U and a program plan for the implementation in PCHC organizations.

Results

Subsequently in 2015, the 41 item postnatal R4U (the postnatal Rotterdam Reproduction Risk Reduction checklist) was developed according to steps one until four of the Intervention Mapping process and was implemented in four PCHC organizations.

Conclusions

It was feasible to design and implement a postnatal risk assessment identifying both medical and non-medical risks for growth and developmental problems, using the Intervention Mapping process.

Development of the State Optimism Measure

BACKGROUND

Optimism, or positive expectations about the future, is associated with better health. It is commonly assessed as a trait, but it may change over time and circumstance. Accordingly, we developed a measure of state optimism.

METHODS

An initial 29-item pool was generated based on literature reviews and expert consultations. It was administered to three samples: sample 1 was a general healthy population (n = 136), sample 2 was people with cardiac disease (n = 96), and sample 3 was persons recovering from problematic substance use (n = 265). Exploratory factor analysis and item-level descriptive statistics were used to select items to form a unidimensional State Optimism Measure (SOM). Confirmatory factor analysis (CFA) was performed to test fit.

RESULTS

The selected seven SOM items demonstrated acceptable to high factor loadings on a single dominant factor (loadings: 0.64-0.93). There was high internal reliability across samples (Cronbach's alphas: 0.92-0.96), and strong convergent validity correlations in hypothesized directions. The SOM's correlations with other optimism measures indicate preliminary construct validity. CFA statistics indicated acceptable fit of the SOM model.

CONCLUSIONS

We developed a psychometrically-sound measure of state optimism that can be used in various settings. Predictive and criterion validity will be tested in future studies.

Psychometric Properties of the Pediatric Acute-Onset Neuropsychiatric Syndrome Global Impairment Score in Children and Adolescents with Pediatric Acute-Onset Neuropsychiatric Syndrome

OBJECTIVES

This study validates the caregiver-rated Pediatric Acute-onset Neuropsychiatric Syndrome (PANS) Global Impairment Score (GIS), a single-item, 0-100 scale, for use in PANS.

METHODS

We collected longitudinal data from community patients meeting PANS criteria. We included 128 patients with 1926 GISs, each from a unique clinic visit. To assess discriminant validity, we compared GISs from patients with PANS with scores from a population of healthy controls. To evaluate external validity, we compared global impairment with a clinician-reported global measure-the Child Global Assessment Scale (CGAS)-using the Bland-Altman plots and correlation coefficients. Then, we evaluated associations between the PANS GIS and symptom-specific disease severity variables by fitting mixed models with repeated measures.

RESULTS

The GIS shows excellent discriminant validity, distinguishing patients with PANS from healthy controls. The scores on the GIS show an acceptable level of agreement with the clinician-reported CGAS. The regression line in the Bland-Altman plot had a positive slope, indicating that parents tend to report higher disease severity than clinicians at higher levels of disease severity. Correlation was higher during disease remissions than during disease flares (r = -0.69 vs. r = -0.48). All disease severity scales predicted GIS in the expected direction.

CONCLUSION

The GIS has excellent discriminant validity and acceptable construct validity.