Development and validation of an Infertility Stigma Scale for Chinese women

OBJECTIVE

To develop and validate a scale of stigma for infertile Chinese women.

METHOD(S)

Infertile women admitted to the Xiangya Hospital, the Second Xiangya Hospital, and the Third Xiangya Hospital of Central South University for treatment were approached to participate in this study. The Infertility Stigma Scale (ISS) development involved: [1] item generation based on literature, interview (experts/patients: N=5/N=20) and related scale; [2] pre-test questionnaire formation with both experts' ratings (N=9) and infertile women's feedbacks (N=30); [3] the component structure assessed by principal components analysis with varimax rotation (N=334); [4] convergent validity assessed with Social Support Rating scale, Self-Esteem scale, Family APGAR Index (N=334); and [5] reliability identified by internal consistency Cronbach's α (N=334), split-half reliability (N=334), test-retest reliability (N=20).

RESULT(S)

This study yielded a 27-item ISS with 4 factors (self-devaluation, social withdrawal, public stigma, and family stigma). Exploratory factor analysis indicated that these 4 factors accounted for 58.17% of total variances. The Cronbach's α, split-half coefficient and test-retest correlation coefficient for the whole scale was 0.94, 0.90, and 0.91, respectively. The associations of the ISS with other measures suggested good convergent validity. The Content Validity Index (CVI) was 0.92.

CONCLUSION(S)

The ISS appears to be a reliable and valid measure to assess levels of stigma experienced by infertile Chinese women. It may be a useful tool to help identify infertile women at greater risks of distress.

Adaptation and psychometric properties of the ISPCAN Child Abuse Screening Tool for use in trials (ICAST-Trial) among South African adolescents and their primary caregivers

Child abuse prevention research has been hampered by a lack of validated multi-dimensional non-proprietary instruments, sensitive enough to measure change in abuse victimization or behavior. This study aimed to adapt the ICAST child abuse self-report measure (parent and child) for use in intervention studies and to investigate the psychometric properties of this substantially modified tool in a South African sample. First, cross-cultural and sensitivity adaptation of the original ICAST tools resulted in two preliminary measures (ICAST-Trial adolescents: 27 items, ICAST-Trial caregivers: 19 items). Second, ICAST-Trial data from a cluster randomized trial of a parenting intervention for families with adolescents (N = 1104, 552 caregiver-adolescent dyads) was analyzed. Confirmatory factor analysis established the hypothesized 6-factor (adolescents) and 4-factor (caregivers) structure. Removal of two items for adolescents and five for caregivers resulted in adequate model fit. Concurrent criterion validity analysis confirmed hypothesized relationships between child abuse and adolescent and caregiver mental health, adolescent behavior, discipline techniques and caregiver childhood abuse history. The resulting ICAST-Trial measures have 25 (adolescent) and 14 (caregiver) items respectively and measure physical, emotional and contact sexual abuse, neglect (both versions), and witnessing intimate partner violence and sexual harassment (adolescent version). The study established that both tools are sensitive to measuring change over time in response to a parenting intervention. The ICAST-Trial should have utility for evaluating the effectiveness of child abuse prevention efforts in similar socioeconomic contexts. Further research is needed to replicate these findings and examine cultural appropriateness, barriers for disclosure, and willingness to engage in child abuse research.

Development and initial validation of the Drunkorexia Motives and Behaviors scales

Drunkorexia, or restricting calorie intake on days when alcohol consumption is planned, is a trend among college students. The purpose of the present study is to develop a measure of motivations for drunkorexia before, during, and after alcohol consumption. College students (n=349, Mage=20.71years) completed an online survey including the Drinking Motives Questionnaire-Revised, the Eating Attitudes Test-26, and various drunkorexia items. A multidimensional measure of drunkorexia motives was developed through an iterative measurement development process. The first scale assesses drunkorexia motivations and behaviors through two subscales: Drunkorexia Motives and Drunkorexia Behaviors. The second scale assesses behaviors when drunkorexia is planned, but for various reasons, the individual did not restrict calories prior to alcohol consumption. The third measure examines restrictive drinking behaviors during an alcohol consumption event. The final scale measures compensatory behaviors after an alcohol consumption event. The newly developed measures relate to other established eating disorder and alcohol measures. Specifically, drunkorexia motives seem to be derived from conformity drinking motives. Male students report higher levels of drunkorexia motives and consuming alcohol when drunkorexia fails. The newly developed measures provide an additional perspective on the drunkorexia literature.

Development of the State Optimism Measure

BACKGROUND

Optimism, or positive expectations about the future, is associated with better health. It is commonly assessed as a trait, but it may change over time and circumstance. Accordingly, we developed a measure of state optimism.

METHODS

An initial 29-item pool was generated based on literature reviews and expert consultations. It was administered to three samples: sample 1 was a general healthy population (n = 136), sample 2 was people with cardiac disease (n = 96), and sample 3 was persons recovering from problematic substance use (n = 265). Exploratory factor analysis and item-level descriptive statistics were used to select items to form a unidimensional State Optimism Measure (SOM). Confirmatory factor analysis (CFA) was performed to test fit.

RESULTS

The selected seven SOM items demonstrated acceptable to high factor loadings on a single dominant factor (loadings: 0.64-0.93). There was high internal reliability across samples (Cronbach's alphas: 0.92-0.96), and strong convergent validity correlations in hypothesized directions. The SOM's correlations with other optimism measures indicate preliminary construct validity. CFA statistics indicated acceptable fit of the SOM model.

CONCLUSIONS

We developed a psychometrically-sound measure of state optimism that can be used in various settings. Predictive and criterion validity will be tested in future studies.

Reliability and Validity of a Newly Developed Measure of Citizenship Among Persons with Mental Illnesses

Following development of a 46-item of measure citizenship, a framework for supporting the full membership in society of persons with mental illness, this study tested the measure's reliability and validity. 110 persons from a mental health center completed a questionnaire packet containing the citizenship measure and other measures to assess internal consistency and validity of the citizenship instrument. Correlation matrices were examined for associations between the citizenship instrument and other measures. Stepwise regression examines demographic factors, sense of community, and social capital as predictors of citizenship, recovery, and well-being. Analyses revealed that the measure is psychometrically sound. The measure captures subjective information about the degree to which individuals experience rights, sense of belonging, and other factors associated with community membership that have been previously difficult to assess. The measure establishes a platform for interventions to support the full participation in society of persons with mental illnesses.

Use of a Pediatric Cardiovascular Nursing Consortium for Development and Evaluation of Quality Measures: The C4-MNP Experience

The evidence linking nursing care and patient outcomes has been globally demonstrated. Thus, it is time for translation and application of this evidence to robust measurement that uniquely demonstrates the value of nursing care and the characteristics of the nursing workforce that contribute to optimal patient outcomes.

OBJECTIVE

The aim of this study was to identify and develop standardized measures representative of pediatric nursing care of the cardiovascular patient for benchmarking within freestanding children's hospitals.

METHODS

Using a consensus-based approach, the Consortium of Congenital Cardiac Care- Measurement of Nursing Practice (C4-MNP) members developed quality measures within working groups and then individually critiqued all drafted measures. Final draft measures were then independently reviewed and critiqued by an external nursing quality measurement committee. The final quality measures were also made available to a national parent support group for feedback.

OUTCOMES

The development process used by C4-MNP resulted in 10 measures eligible for testing across freestanding children's hospitals. Employing a collaborative consensus-based method plus implementing the criteria of the National Quality Forum and external vetting period provided a strong framework for the development and evaluation of standardized measures.

NEXT STEPS

The Consortium will continue with implementation and testing of each measure in 9 of our 28 collaborating centers. This activity will support initial development of benchmarks and evaluation of the association of the measures with patient outcomes.

Parental Attitudes, Beliefs, and Understanding of Anxiety (PABUA): Development and psychometric properties of a measure

The Parental Attitudes, Beliefs, and Understanding of Anxiety (PABUA) was developed to assess parental beliefs about their child's anxiety, parents' perceived ability to cope with their child's anxiety and to help their child manage anxious symptoms, and to evaluate parents' understanding of various parenting strategies in response to their child's anxiety. The study evaluated the PABUA in mother-child dyads (N=192) seeking treatment for youth anxiety. Exploratory factor analysis yielded a three-factor solution and identified PABUA scales of Overprotection, Distress, and Approach (with Cronbach's alpha ranging from .67 to .83). Convergent and divergent validity of PABUA scales was supported by the pattern of associations with measures of experiential avoidance, beliefs related to children's anxiety, empathy, trait anxiety, and depressive symptoms; parent-reported family functioning; parent- and youth-reported anxiety severity; and parent-reported functional impairment (n=83). Results provide preliminary support for the PABUA as a measure of parental attitudes and beliefs about anxiety, and future studies that investigate this measure with large and diverse samples are encouraged.

Point-of-sale marketing and context of marijuana retailers: Assessing reliability and generalizability of the marijuana retail surveillance tool

As recreational marijuana expands, standardized surveillance measures examining the retail environment are critical for informing policy and enforcement. We conducted a reliability and generalizability study using a previously developed tool involving assessment of a sample of 25 randomly selected Seattle recreational marijuana retailers (20 recreational; 5 recreational/medical) in 2017. The tool assessed: 1) contextual/neighborhood features (i.e., facilities nearby); 2) compliance/security (e.g., age-of-sale signage, age verification); and 3) marketing (i.e., promotions, product availability, price). We found that retailers were commonly within two blocks of restaurants (n = 23), grocery stores (n = 17), liquor stores (n = 13), and bars/clubs (n = 11). Additionally, two were within two blocks of schools, and four were within two blocks of parks. Almost all (n = 23) had exterior signage indicating the minimum age requirement, and 23 verified age. Two retailers had exterior ads for marijuana, and 24 had interior ads. Overall, there were 76 interior ads (M = 3.04; SD = 1.84), most commonly for edibles (n = 28). At least one price promotion/discount was recorded in 17 retailers, most commonly in the form of loyalty membership programs (n = 10) or daily/weekly deals (n = 10). One retailer displayed potential health harms/warnings, while three posted some health claim. Products available across product categories were similar; we also noted instances of selling retailer-branded apparel/ paraphernalia (which is prohibited). Lowest price/unit across product categories demonstrated low variability across retailers. This study documented high inter-rater reliability of the surveillance tool (Kappas = 0.73 to 1.00). In conclusion, this tool can be used in future research and practice aimed at examining retailers marketing practices and regulatory compliance.

Validating mental health assessment in Kenya using an innovative gold standard

With the growing burden of mental health disorders worldwide, alongside efforts to expand availability of evidence-based interventions, strategies are needed to ensure accurate identification of individuals suffering from mental disorders. Efforts to locally validate mental health assessments are of particular value, yet gold-standard clinical validation is costly, time-intensive, and reliant on available professionals. This study aimed to validate assessment items for mental distress in Kenya, using an innovative gold standard and a combination of culturally adapted and locally developed items. The mixed-method study drew on surveys and semi-structured interviews, conducted by lay interviewers, with 48 caregivers. Interviews were used to designate mental health "cases" or "non-cases" based on emotional health problems, identified through a collaborative clinical rating process with local input. Individual mental health survey items were evaluated for their ability to discriminate between cases and non-cases. Discriminant survey items included 23 items adapted from existing mental health assessment tools, as well as 6 new items developed for the specific cultural context. When items were combined into a scale, results showed good psychometric properties. The use of clinically rated semi-structured interviews provides a promising alternative gold standard that can help address the challenges of conducting diagnostic clinical validation in low-resource settings.

Initial quantitative development of the Norse Feedback system: a novel clinical feedback system for routine mental healthcare

Purpose

As routine outcome monitoring has become prevalent in psychological practice, there is need for measurement tools covering diverse symptoms, treatment processes, patient strengths, and risks. Here we describe the development and initial tests of the psychometric properties of a multi-scale system for use in mental healthcare, Norse Feedback.

Methods

In Study 1, we present the item-generation process and structure of the Norse Feedback, a 17-scale digital-first measurement tool for psychopathology and treatment-relevant variables. In Study 2, we present analyses of this initial measure in a nonclinical sample of 794 healthy controls and a sample of 222 mental health patients. In Study 3, we present the analysis of a revised 20-scale system in two separate samples of patients. In each analysis, we investigate item and test information in particular, including analysis of differential item functioning on gender, age, site, and sample differences where applicable.

Results

Scales performed variably. Changes to items and scales are described. Several scales appeared to reliably discriminate individuals entering mental health treatment on severity, and others are less reliable. Marked improvements in scale internal consistency and measurement precision were observed between the first and second implemented versions.

Conclusion

This system includes some scales with reasonable structural validity, though several areas for future development are identified. The system was developed to be iteratively re-evaluated, to strengthen the validity of its scales over time. There are currently a number of limitations on inferences from these scores, which future developments should address.

Supplementary Information

The online version contains supplementary material available at 10.1007/s11136-021-02825-1.

Refining and supplementing candidate measures of psychological well-being for the NIH PROMIS®: qualitative results from a mixed cancer sample

PURPOSE

The Patient-Reported Outcomes Measurement Information System (PROMIS) is a National Institutes of Health initiative designed to improve patient-reported outcomes using state-of-the-art psychometric methods. The aim of this study is to describe qualitative efforts to identify and refine items from psychological well-being subdomains for future testing, psychometric evaluation, and inclusion within PROMIS.

METHOD

Seventy-two items from eight existing measures of positive affect, life satisfaction, meaning & purpose, and general self-efficacy were reviewed, and 48 new items were identified or written where content was lacking. Cognitive interviews were conducted in patients with cancer (n = 20; 5 interviews per item) to evaluate comprehensibility, clarity, and response options of candidate items.

RESULTS

A Lexile analysis confirmed that all items were written at the sixth grade reading level or below. A majority of patients demonstrated good understanding and logic for all items; however, nine items were identified as "moderately difficult" or "difficult" to answer. Patients reported a strong preference for confidence versus frequency response options for general self-efficacy items.

CONCLUSIONS

Altogether, 108 items were sufficiently comprehensible and clear (34 positive affect, 10 life satisfaction, 44 meaning & purpose, 20 general self-efficacy). Future research will examine the psychometric properties of the proposed item banks for further refinement and validation as PROMIS measures.

Assessing the valuing process in Acceptance and Commitment Therapy: Experts' review of the current status and recommendations for future measure development

Within Acceptance and Commitment Therapy (ACT), personal values provide the foundational framework of the therapeutic process and are considered necessary to facilitate targeted behavioral movement and a more vital, meaningful life. Considering the proposed nature of values as a core mechanism of change in this way, a thorough understanding of the therapeutic valuing process through which targeted changes occur is essential to evaluate the true efficacy of the ACT model empirically and implement it most effectively. However, to date, development of measurement tools for this purpose is limited and those that do exist are often inconsistent in their targeted constructs. The current study collected in-depth, descriptive data from ACT experts to critically examine how the valuing process in ACT is currently defined and measured and make recommendations for future measure development. 11 experts participated in semi-structured interviews and responded to topic guided questions. Thematic analyses of experts' responses were then conducted, and eight core themes were identified. Findings denoted that experts' definitions of the valuing process and its core components are largely consistent with theoretical conceptualization of ACT but that no measurement tool to date provides a complete and adequate assessment of this process. Experts expressed the need for measures capable of assessing essential contextual aspects of the valuing process and gaining a more proximal evaluation of values-consistent behaviors and experiential momentary awareness. The current study provides insight into critical areas for improvement and provides recommendations for future measure development for the empirical assessment of the valuing process in ACT which is crucial for evaluating the role of values work as a therapeutic mechanism of action.

Developing a "toolkit" to measure implementation of concurrent palliative care in rural community cancer centers

OBJECTIVE

Despite national guidelines recommending early concurrent palliative care for individuals newly diagnosed with metastatic cancer, few community cancer centers, especially those in underserved rural areas do so. We are implementing an early concurrent palliative care model, ENABLE (Educate, Nurture, Advise, Before Life Ends) in four, rural-serving community cancer centers. Our objective was to develop a "toolkit" to assist community cancer centers that wish to integrate early palliative care for patients with newly diagnosed advanced cancer and their family caregivers.

METHOD

Guided by the RE-AIM (Reach, Effectiveness-Adoption, Implementation, Maintenance) framework, we undertook an instrument-development process based on the literature, expert and site stakeholder review and feedback, and pilot testing during site visits.

RESULTS

We developed four instruments to measure ENABLE implementation: (1) the ENABLE RE-AIM Self-Assessment Tool to assess reach, adoption, implementation, and maintenance; (2) the ENABLE General Organizational Index to assess institutional implementation; (3) an Implementation Costs Tool; and (4) an Oncology Clinicians' Perceptions of Early Concurrent Oncology Palliative Care survey.

SIGNIFICANCE OF RESULTS

We developed four measures to determine early palliative care implementation. These measures have been pilot-tested, and will be integrated into a comprehensive "toolkit" to assist community cancer centers to measure implementation outcomes. We describe the lessons learned and recommend strategies for promoting long-term program sustainability.

Measuring the quality of maternal and care processes at the time of delivery in sub-Saharan Africa: development and validation of a short index

BACKGROUND

There is a growing recognition that quality of care must improve in facility-based deliveries to achieve further global reductions in maternal and newborn mortality and morbidity. Better measurement of care quality is needed, but the unpredictable length of labor and delivery hinders the feasibility of observation, the gold standard in quality assessment. This study evaluated whether a measure restricted to actions at or immediately following delivery could provide a valid assessment of the quality of the process of intrapartum and immediate postpartum care (QoPIIPC), including essential newborn care.

METHODS

The study used a comprehensive QoPIIPC index developed through a modified Delphi process and validated by delivery observation data as a starting point. A subset of items from this index assessed at or immediately following delivery was identified to create a "delivery-only" index. This delivery-only index was evaluated across content and criterion validation domains using delivery observation data from Kenya, Madagascar, and Tanzania, including Zanzibar.

RESULTS

The delivery-only index included 13 items and performed well on most validation criteria, including correct classification of poorly and well-performed deliveries. Relative to the comprehensive QoPIIPC index, the delivery-only index had reduced content validity, representing fewer dimensions of QoPIIPC. The delivery-only index was also less strongly associated with overall quality performance in observed deliveries than the comprehensive QoPIIPC index.

CONCLUSIONS

Where supervision resources are limited, a measure of the quality of labor and delivery care targeting the time of delivery may mitigate challenges in observation-based assessment. The delivery-only index may enable increased use of observation-based quality assessment within maternal and newborn care programs in low-resource settings.

Measuring Variation Across Dimensions of Integrated Care: The Maryland Medicaid Health Home Model

Despite the proliferation of initiatives to integrate services for people with serious mental illness (SMI), measures of distinct dimensions of integration, such as spatial arrangement and care team expertise, are lacking. Such measures are needed to support organizations' assessment of progress toward integrated service delivery. We developed measures characterizing integration of behavioral, somatic, and social services to operationalize the integrated care dimensions conceived by the Agency for Healthcare Research and Quality. In a survey fielded to 46 Maryland Medicaid health homes (response rate: 96%) serving adults with SMI during 2015-2016, we found that these measures provided a useful description of variation across dimensions of integration.

Where do measures of health, social care and wellbeing fit within a wider measurement framework? Implications for the measurement of quality of life and the identification of bolt-ons

BACKGROUND

There is variability across studies in the dimensionality i.e., set of latent variables to which health, social care and wellbeing measures relate. This variability may impact the development of new measures and the identification of bolt-on dimensions. We examine the dimensionality of commonly used measures and identify a set of potential bolt-ons for the EQ-5D-5L.

METHODS

We used the OMS dataset, an online survey of health, social care and wellbeing measures in patients and members of the general public. A content analysis provided a theoretical framework for results interpretation. Quantitative analyses were based on a pool of 79 items from 7 measures. Confirmatory factor analysis was used to assess health, social care and wellbeing measures dimensionality and their contribution to quality of life. The relationship between EQ-5D-5L items and the identified factors was used for bolt-ons identification.

RESULTS

The dimensionality comprised of seven factors, namely physical functioning, psychological symptoms, energy/sleep, physical pain, social functioning, needs and satisfaction. Health measures covered five of the seven factors identified, wellbeing measures three and the social care measure one. A list of candidate bolt-on items for the EQ-5D-5L was presented e.g., cognition, energy, dignity.

CONCLUSIONS

This study provides evidence on the dimensionality of health, social care and wellbeing measures and presents a list of candidate bolt-ons for the EQ-5D-5L.

Shared reading quality assessment by parental report: preliminary validation of the DialogPR

Background

The American Academy of Pediatrics (AAP) recommends shared reading beginning as soon as possible after birth to promote healthy development. Shared reading quality can strongly influence outcomes, especially in children from low-SES households. Dialogic reading is a method developed to enhance verbal interactivity and engagement through book sharing, advocated by the AAP and clinic-based programs such as Reach Out and Read. There is no brief, validated, caregiver report measure of dialogic reading or shared reading quality currently available.

Methods

This cross-sectional study involved 49 healthy mother-child dyads (mean child age 4.5 yrs., SD = 0.6 yrs.) from 2 separate MRI-based studies. The DialogPR was administered by trained research coordinators following MRI, along with the READ subscale of the validated StimQ-P measure of home cognitive environment. The DialogPR consists of eight items developed in consultation with experts in early literacy, based on the PEER/CROWD dialogic reading conceptual model. Estimated reading level is 6th grade. Descriptive statistics were computed at both the item and scale levels. Modern theory Rasch methods were used to analyze all eight DialogPR items along with preliminary estimates of reliability and validity.

Results

Our combined sample involved 15 boys and 34 girls, and was diverse in terms of age, household income, and maternal education. DialogPR administration time was less than 2 min, with no problems reported. The DialogPR demonstrated strong internal consistency and reliability (Cronbach’s alpha = 0.82), and criterion-related validity with the StimQ-P READ (Spearman’s rho coefficient = 0.53). Rasch analysis revealed strong psychometric properties in terms of reliability, variability in item difficulty, and inter-item and item-measure correlations.

Conclusions

Preliminary evidence suggests that the DialogPR may be an efficient means to assess shared reading quality and dialogic reading via caregiver report for clinical and research purposes, warranting further investigation.

Assessing Parental Anxiety in Pediatric Food Allergy: Development of the Worry About Food Allergy Questionnaire

Food allergies (FAs) in children are increasingly common, and strict allergen avoidance and safety concerns place parents at risk for anxiety (Lau et al. in Pediatr Allergy Immunol 25:236-242, 2014). Assessing parental anxiety with generic instruments may not capture the unique experience of parents managing children's FAs. This study developed and preliminarily validated the 13-item Worry About Food Allergy (WAFA) questionnaire, a measure of FA-specific parental anxiety, in an online sample of 265 parents aged 22-66 (M = 40.25) of children with FAs. The WAFA showed good internal reliability (Cronbach's α = .89) and moderate convergent validity with other anxiety measures, indicating support for a reliable measure of a discrete, specific construct. Exploratory factor analysis indicated a single factor structure. Criterion validity was established through significant, small, positive correlations with relevant allergy variables. A coherent single factor measure, the WAFA, shows promise as a screening tool for parental anxiety in pediatric practice and FA management.

Patient Satisfaction with Navigator Interpersonal Relationship (PSN-I): item-level psychometrics using IRT analysis

BACKGROUND

Patient navigation (PN) is a promising intervention to eliminate cancer health inequities. Patient navigators play a critical role in the navigation process. Patients' satisfaction with navigators is important in determining the effectiveness of PN programs. We applied item response theory (IRT) analysis to establish item-level psychometric properties for the Patient Satisfaction with Interpersonal Relationship with Navigators (PSN-I).

METHODS

We conducted a confirmatory factor analysis (CFA) to establish unidimensionality of the 9-item PSN-I in 751 cancer patients (68% female) between 18 and 86 years old. We fitted unidimensional IRT models-unconstrained graded response model (GRM) and Rasch model-to PSN-I data, and compared model fit using likelihood ratio (LR) test and information criteria. We obtained item parameter estimates (IPEs), item category/operating characteristic curves, and item/test information curves for the better fitting model.

RESULTS

CFA with diagonally weighted least squares confirmed that the one-factor model fit the data (RMSEA = 0.047, 95% CI = 0.033-0.060, and CFI ≈ 1). Responses to PSN-I items clustered into the 4th and 5th categories. We aggregated the first three response categories to provide stable parameter estimates for both IRT models. The GRM fit the data significantly better than the Rasch model (LR = 80.659, df = 8, p < 0.001). Akaike's information coefficient (6384.978 vs. 6320.319) and Bayesian information coefficient (6471.851 vs. 6443.771) were lower for the GRM. IPEs showed substantial variation in items' discriminating power (1.80-3.35) for GRM.

CONCLUSIONS

This IRT analysis confirms the latent structure of the PSN-I and supports its use as a valid and reliable measure of latent satisfaction with PN.

Development and content validation of the Healthcare Transition Outcomes Inventory for young adults with type 1 diabetes

Background

The literature on the specification and measurement of the outcomes of the healthcare transition from pediatric to adult centered-care is scarce and methodologically weak. To address these gaps, we conducted a series of studies to develop a multidimensional, multi-informant (young adults, parents, and healthcare providers) measure of healthcare transition outcomes for young adults with type 1 diabetes (T1D), the Healthcare Transition Outcomes Inventory (HCTOI). The current study describes the development and refinement of the HCTOI item pool.

Methods

Following Patient Reported Outcomes Measurement Information System (PROMIS) standards, the research team conducted qualitative interviews to define six content domains of healthcare transition outcomes from the perspectives of multiple stakeholders, developed an initial item pool of the HCTOI based on the six domains, analyzed expert item ratings and feedback for content validation, and conducted cognitive interviews with informants (patients, parents, and healthcare providers) for further item pool refinement.

Results

Qualitative findings revealed six healthcare transition outcome domains: 1) Biomedical markers of T1D control; 2) Navigation of a new health care system; 3) Possession of T1D self-management skills and knowledge; 4) Integration of T1D care into emerging adult roles; 5) Balance of parental involvement with autonomy; and 6) Attainment of T1D “ownership.” An initial pool of 88 items focused on the extent to which a young adult with T1D is successful on each of the six domains. Experts rated all content domains and all but six items as relevant. In addition to suggesting additional items, experts were concerned about the length of the measure, response burden, and whether every informant type would have sufficient knowledge to rate items in particular content domains. Cognitive interviews resulted in retaining all six content domains, but dropping some items and yielded fewer items for the healthcare provider version (47 items versus 54 items for the young adult- and parent-versions).

Conclusions

Expert review and cognitive interviews confirmed that all six domains of HCT outcomes were relevant and both procedures resulted in retaining a sufficient number of clear and representative items for each content domain. The HCTOI represents the first multi-informant, rigorously developed item pool that comprehensively measures the multiple components of the transition from pediatric to adult specialty healthcare.

Development and Psychometric Evaluation of the Father Engagement Questionnaire

While there has been increasing interest in promoting father engagement in parenting interventions for child wellbeing, both research and practice endeavors have been hindered by a lack of a measure of father engagement practices. This paper reports the development and evaluation of a comprehensive, practitioner-report measure of father engagement practices--the Father Engagement Questionnaire (FEQ). Practitioners (N = 589; 84.5% females; mean age = 38.56) involved in delivering parenting interventions in Australia completed the FEQ, along with background demographics and questions regarding their own and organization's practice. A separate sample of 28 practitioners completed the FEQ twice, with a two-week interim, to assess test-retest stability of the measure. Exploratory factor analysis revealed five factors corresponding to the measure's five intended content areas: Confidence in Working with Fathers, Competence in Using Engagement Strategies, Perceived Effectiveness of Engagement Strategies, Frequency of Strategy Use, and Organizational Practices for Father Engagement. Each of these scales demonstrated adequate internal consistency reliability and test-retest stability. As the five scales appear to be related but distinct, it is recommended that the FEQ is used as a multidimensional measure of father engagement. In terms of predictive validity, higher scores on the Confidence in Working with Fathers, Frequency of Strategy Use, and Organizational Practices for Father Engagement scales were associated with a higher likelihood of practitioner-reported father attendance. The results provide support for adequate psychometric properties of the FEQ as a research and clinical tool for assessing and monitoring father engagement practices.

Development of a Measure of Housing and Housing Services

The Housing Program Measure (HPM) was designed to document critical elements of a range of housing program types and associated services. Qualitative methods, including literature review and open-ended interviews, were used to determine pertinent HPM domains and to develop the pool of items. The measure was pre-tested, and reliability and validity analyses were applied to revise and strengthen the measure. The resulting measure furthers homelessness research by providing a tool that can be used to define housing and housing services interventions across diverse projects and disciplines, to facilitate program management by matching housing resources to the needs of homeless individuals, and to support model development by measuring progress to goals.

Development of the Functional Assessment of Cancer Therapy-Carcinoid Syndrome Symptom Index

OBJECTIVE

To develop a symptom-focused index to evaluate representative symptoms, treatment side effects, and emotional and functional well-being of patients with carcinoid syndrome (CS).

METHODS

The development of the Functional Assessment of Cancer Therapy-Carcinoid Syndrome Symptom Index (FACT-CSI) followed US Food and Drug Administration guidelines for the development of patient-reported outcome (PRO) measures and involved the following: (a) literature review; (b) interviews with 14 CS patients; (c) interviews with 9 clinicians; and (d) instrument development involving input from a range of PRO measure development and CS experts. The resulting draft instrument underwent cognitive interviews with 7 CS patients.

RESULTS

Forty-six CS sources were reviewed. Analysis of patient interviews produced 23 patient-reported symptoms. The most frequently endorsed physical symptoms were flushing, diarrhea, abdominal pain, fatigue, and food sensitivity/triggers. Seven priority CS emotional and functional themes were also identified by patients. Expert interviews revealed 12 unique priority symptoms - the most common being diarrhea, flushing, wheezing, edema, abdominal pain/cramping, fatigue, and 8 emotional and functional concerns. Through an iterative process of team and clinical collaborator meetings, data review, item reduction and measure revision, 24 items were selected for the draft symptom index representing symptoms, emotional concerns, global assessment of treatment side effects, and functional well-being. Cognitive interview results demonstrated strong content validity, including positive endorsement of item clarity (>86% across items), symptom relevance (>70% for most items), and overall measure content (86%).

CONCLUSIONS

The FACT-CSI is a content-relevant, symptom-focused index reflecting the highest priority and clinically relevant symptoms and concerns of people with CS.

Focusing the Conceptualization of Erotophilia and Erotophobia on Global Attitudes Toward Sex: Development and Validation of the Sex Positivity-Negativity Scale

Previous measures of erotophobia/erotophilia like the Sexual Opinion Survey (SOS) assessed gut-level positive-negative affective and evaluative reactions to a wide range of sexual stimuli, resulting in purposefully diverse item content. Although an effective strategy, the item content of existing erotophilia/erotophobia scales is now potentially too generalized, encompassing what have since developed as an array of more focused constructs in the current literature like attitudes toward (1) casual sex, (2) pornography, (3) non-heterosexual orientations (e.g., homophobia), and (4) masturbation. The current study therefore sought to evaluate existing scales and to develop a conceptually focused measure of sex-positivity and sex-negativity using a distinct strategy designed to obviate the need for overly generalized (and potentially imbalanced or confounding) item content. Using responses from 2205 online respondents (82% Caucasian, 66% heterosexual, and 50% female) completing an item pool of 158 items, the current study employed a combination of classic test-theory analyses (e.g., exploratory and confirmatory factor analyses) and item response theory analyses to develop a psychometrically optimized scale-the Sex Positivity-Negativity (SPN) scale. The SPN scale demonstrated: (1) a stable 2-subscale structure distinguishing sex-negativity from sex-positivity, (2) consistently high levels of internal consistency across 31 demographic subsamples, (3) more discriminant than convergent validity with existing erotophilia scales given its novel focus, (4) discriminant validity with more specific sexual attitudes, (5) greater levels of power and precision for detecting differences between individuals, (6) stronger links to individual, sexual, and relationship functioning than existing scales, and (7) incremental validity over the SOS for predicting change in relationship dynamics over 6 months. The findings therefore suggested that the SPN scale is a conceptually focused measure of sex-positivity and sex-negativity offering researchers a comparatively short and effective tool. Implications are discussed.

Initial development of the Psychopathic Processing and Personality Assessment (PAPA) across populations

Three studies describe development of the Psychopathic Processing and Personality Assessment (PAPA). Study one outlines a literature review and Expert Delphi (n=32) to develop the initial PAPA. Study two validates the PAPA with 431 participants (121 male prisoners and 310 university students: 154 men, 156 women), also using the Levenson Self Report Psychopathy scale and a measure of cognitive schema and affect. Study three refined the PAPA, employing it with 50 male students and 40 male forensic psychiatric patients using clinical (interview) assessments of psychopathy: the Psychopathy Checklist - Screening Version and the Affect, Cognitive and Lifestyle assessment. The PAPA comprised four factors; dissocial tendencies; emotional detachment; disregard for others; and lack of sensitivity to emotion. It positively correlated with existing psychopathy measures. Variations across PAPA subscales were noted across samples when associated with clinical measures of psychopathy. Support for the validity of the PAPA was indicated across samples. Directions for research and application are outlined.