Performance evaluation of the Sysmex XN-1000V in side-by-side comparison with the Siemens ADVIA 120 and manual methods for healthy CD Sprague-Dawley rats and CD-1 mice

BACKGROUND

The Sysmex XN-1000V automated hematology analyzer with multispecies software was released in June 2017 for use in research laboratories. Laser light, impedance, fluorescent staining, and fluorescent flow cytometry are used to analyze whole blood for CBC, reticulocyte counts, and WBC counts, including a 5-part differential leukocyte analysis.

OBJECTIVES

A side-by-side comparison of the Sysmex XN-1000V with the Siemens ADVIA 120 in analyzing blood from healthy mice and rats will provide insight into the performance of the new analyzer and its capabilities for use in drug development studies. Method correlation analyses on normal mouse and rat hematology data collected with both analyzers and manual reference methods will help determine the reliability of the data produced using the Sysmex XN-1000V analyzer.

METHODS

Whole blood samples collected in K2 EDTA from healthy CD-1 mice and CD Sprague-Dawley rats were analyzed in parallel with the XN-1000V and ADVIA 120 analyzers. Male and female mice, approximately 6-9 weeks old, and male and female rats, approximately 7-9 weeks old, were included in this study. Manual reference methods for WBC differential leukocyte analysis and packed cell volume (PCV) measurements were also performed. EP Evaluator version 11.2 (Data Innovations LLC, South Burlington, VT, USA) was used for method comparison statistical analysis.

RESULTS

Most hematologic parameters for naïve mice and rats achieved correlation in the fair to excellent range, with the majority showing very good to excellent correlation with low biases (<11.0%) for cohorts analyzed separately and when cohort data were combined.

CONCLUSIONS

The Sysmex XN-1000V Hematology Analyzer provided comparable results to those obtained from the Siemens ADVIA 120. We found the Sysmex XN-1000V Hematology Analyzer to be acceptable for use in drug development studies for rats and mice.

Examining concurrent validity and item selection of the Session Wants and Needs Outcome Measure (SWAN-OM) in a children and young people web-based therapy service

BACKGROUND

Single-session mental health interventions are frequently attended by children and young people (CYP) in both web-based and face-to-face therapy settings. The Session "Wants" and "Needs" Outcome Measure (SWAN-OM) is an instrument developed in a web-based therapy service to overcome the challenges of collecting outcomes and experiences of single-session therapies (SSTs). It provides pre-defined goals for the session, selected by the young person prior to the intervention, on which progress toward achievement is scored at the end of the session.

OBJECTIVE

The objective of this study was to evaluate the instrument's psychometric properties, including concurrent validity against three other frequently used outcome and experience measures, at a web-based and text-based mental health service.

METHODS

The SWAN-OM was administered for a period of 6 months to 1,401 CYP (aged 10-32 years; 79.3% white; 77.59% female) accessing SST on a web-based service. Item correlations with comparator measures and hierarchical logistic regressions to predict item selection were calculated for concurrent validity and psychometric exploration.

RESULTS

The most frequently selected items were "Feel better" (N = 431; 11.61%) and "Find ways I can help myself" (N = 411; 11.07%); unpopular items were "Feel safe in my relationships" (N = 53; 1.43%) and "Learn the steps to achieve something I want" (N = 58; 1.56%). The SWAN-OM was significantly correlated with the Experience of Service Questionnaire, particularly the item "Feel better" [rs₍₁₀₉₎ = 0.48, p < 0.001], the Youth Counseling Impact Scale, particularly the item "Learn the steps to achieve something I want" [rs₍₂₂₎ = 0.76, p < 0.001], and the Positive and Negative Affect Schedule, particularly the items "Learn how to feel better" [rs₍₂₂₎ = 0.72, p < 0.001] and "Explore how I feel" [rs₍₇₀₎ = -0.44, p < 0.001].

CONCLUSION

The SWAN-OM demonstrates good concurrent validity with common measures of outcome and experience. Analysis suggests that lesser-endorsed items may be removed in future iterations of the measure to improve functionality. Future research is required to explore SWAN-OM's potential to measure meaningful change in a range of therapeutic settings.

Online Mental Health Survey for Addressing Psychosocial Condition During the COVID-19 Pandemic in Indonesia: Instrument Evaluation

BACKGROUND

Regular monitoring of the pandemic's psychosocial impact could be conducted among the community but is limited through online media. This study aims to evaluate the self-rating questionnaire commonly used for online monitoring of the psychosocial implications of the coronavirus disease 2019 (COVID-19) pandemic.

METHODS

The data were taken from the online assessment results of two groups, with a total of 765 participants. The instruments studied were Self-Rating Questionnaire (SRQ-20), post-traumatic stress disorder (PTSD), and Center for Epidemiological Studies Depression Scale-10 (CESD-10), used in the online assessment. Data analysis used Rasch modeling and Winsteps applications. Validity and reliability were tested, and data were fit with the model, rating scale, and item fit analysis.

RESULTS

All the scales for outfit mean square (MnSq) were very close to the ideal value of 1.0, and the Chi-square test was significant. Item reliability was greater than 0.67, item separation was greater than 3, and Cronbach's alpha was greater than 0.60; all the instruments were considered very good. The raw variance explained by measures for the SRQ-20, PTSD, and CESD-10 was 30.7%, 41.6%, and 47.6%, respectively. The unexplained eigenvalue variances in the first contrast were 2.3, 1.6, and 2.0 for the SRQ-20, PTSD, and CESD-10, respectively. All items had positive point-measure correlations.

CONCLUSION

The internal consistency of all the instruments was reliable. Data were fit to the model as the items were productive for measurement and had a reasonable prediction. All the scales are functionally one-dimensional.

Missingness patterns in a comprehensive instrument identifying psychosocial and substance use risk in antenatal care

BACKGROUND

Psychosocial vulnerabilities (e.g. inadequate social support, financial insecurity, stress) and substance use elevate risks for adverse perinatal outcomes and maternal mental health morbidities. However, various barriers, including paucity of validated, simple and usable comprehensive instruments, impede execution of the recommendations to screen for such vulnerabilities in the first antenatal care visit. The current study presents findings from a newly implemented self-report tool created to overcome screening barriers in outpatient antenatal clinics.

METHODS

This was a retrospective chart-review of 904 women who completed the Profile for Maternal & Obstetric Treatment Effectiveness (PROMOTE) during their first antenatal visit between June and December 2019. The PROMOTE includes the 4-item NIDA Quick Screen and 15 additional items that each assess a different psychosocial vulnerability. Statistical analysis included evaluation of missing data, and exploration of missing data patterns using univariate correlations and hierarchical clustering.

RESULTS

Three quarters of women (70.0%) had no missing items. In the entire sample, all but four PROMOTE items (opioid use, planned pregnancy, educational level, and financial state) had < 5% missing values, suggesting good acceptability and feasibility. Several respondent-related characteristics such as lower education, less family support, and greater stress were associated with greater likelihood of missing items. Instrument-related characteristics associated with missing values were completing the PROMOTE in Spanish or question positioning at the end of the instrument.

CONCLUSIONS AND IMPLICATIONS

Conducting a comprehensive screening of theoretically and clinically meaningful vulnerabilities in an outpatient setting is feasible. Study findings will inform modifications of the PROMOTE and subsequent digitisation.

Psychometric evaluation of the Chinese version of the Person-Centred Care Assessment Tool

OBJECTIVE

This study aims to test a Chinese cross-cultural adaptation of the English version of the Person-Centred Care Assessment Tool (P-CAT) and evaluate its psychometric properties.

DESIGN

P-CAT was translated/back-translated using established procedures before the psychometric evaluation of the Chinese version was made.

SETTING

Two hospitals covering urban and suburban areas of Kunming in the Yunnan province of China.

PARTICIPANTS

152 female hospital staff completed the survey.

MAIN OUTCOME MEASURES

Construct validity and reliability, including internal consistency and test-retest reliability, were assessed among a sample of hospital staff.

RESULTS

The factor analysis resulted in a two-component solution that consisted of two subscales. The corrected item-total correlations for all of the items ranged from 0.14 to 0.44, with six items not meeting the cut-off level for item-total correlation (>0.3). The Chinese P-CAT demonstrated strong reliability, with a Cronbach's alpha of 0.91-0.94 for the scales and a test-retest reliability coefficient of 0.88 for the overall scale scores. The intraclass correlation was 0.92 (95% CI 0.90 to 0.95).

CONCLUSION

P-CAT appears to be a promising measure for evaluating staff perceptions of person-centredness in Chinese hospital environments. The results show that P-CAT can be a useful tool for improving the quality of healthcare in terms of person-centred care in the Chinese context.

Establishing the Validity and Reliability Evidence of Preceptor Assessment of Student Tool

Objective. To evaluate the validity and reliability evidence of the preceptor assessment of student tool (PAST) which was designed to assess doctor of pharmacy (PharmD) student rotation performance. Methods. Evaluation data were loaded into WINSTEPS software to conduct a Rasch rating scale analysis. Validity evidence was examined from construct and content validity perspectives, and reliability was assessed via student and item separation index and reliability coefficient. Data from 435 observations were included in the analysis. Results. All 19 items measured the same construct of interest and the five-point rating scale functioned appropriately and differentiated students' ability. However, the item/person map indicated an absence of items at the end of the measurement continuum. Conclusion. Although adding items at the end of the measurement continuum may be beneficial, PAST showed good validity and reliability evidence when used to evaluate PharmD student rotations and is suitable to assess mastery learning.

Psychometric evaluation of a questionnaire and primary healthcare nurses' attitudes towards research and use of research findings

AIM

This article investigates attitudes towards and awareness of research and use of research findings among primary healthcare nurses, determinants of attitudes and evaluation of psychometric properties of an instrument measuring nurses' attitudes.

BACKGROUND

The production of new knowledge is ongoing and the amount of research of relevance for health care has increased, but there remains a gap between what is known and what is done in practice. To enhance evidence-based practice and patient safety, the use of research findings needs to be encouraged and promoted.

METHOD

An explanatory study using a cross-sectional survey was conducted in 2005-2006. The survey included items about background data and the instrument attitudes towards and awareness of research and development in nursing. 1054 nurses participated in the study. Factor analyses and Cronbach's alpha were used to evaluate internal structure and internal consistency of the instrument.

RESULT

The nurses generally held positive attitudes towards research. Although most of the nurses reported using research in practice, 37% claimed that they never or rarely used research findings. Half of the respondents perceived they had the ability to analyse scientific reports/articles. This ability and research use were significant determinants of attitudes. Factor analysis of the scale resulted in a three-factor solution, which differs from the seven-factor structure previously identified by the originators of the instrument.

CONCLUSION

Our results support the view that implementation of research is a complex process involving several factors. The different factor structure identified suggests that further work is needed on this instrument.