Development and Psychometric Properties of the Chronic Uveitis-Specific Quality of Life Instrument for Patients with Chronic Uveitis

PURPOSE

To develop and assess psychometric properties of a disease-specific quality of life (QOL) assessment tool for patients with chronic uveitis.

METHODS

The initial 42-item chronic uveitis-related QOL questionnaire (CUQOL) was developed by literature review, semi-structured interviews, and expert consultation. Further development and assessment of the CUQOL were performed using Classic Test Theory and Rasch analysis.

RESULTS

The CUQOL version 1.0 was constructed with 28 items in five dimensions. The five subscales satisfied the requirements of unidimensionality, local independence, and threshold ordering. Cronbach's α coefficient for overall and each scale of the CUQOL 1.0 ranged from 0.75 to 0.94, with test-retest intraclass correlation ranging from 0.95 to 0.99. The CUQOL 1.0 has satisfactory convergent validity (r = 0.41-0.82), reasonable known group validity (p < .05), and good responsiveness (p < .05).

CONCLUSIONS

The CUQOL 1.0 is reliable and vaild for evaluating the QOL of patients with chronic uveitis.

Assessing psychometric properties and measurement invariance of the Sleep Quality Questionnaire among healthcare students

OBJECTIVE

The sleep of healthcare students is worth discovering. Mental health and self-rated health are thought to be associated with sleep quality. As such, valid instruments to assess sleep quality in healthcare students are crucial and irreplaceable. This study aimed to investigate the measurement properties of the Sleep Quality Questionnaire (SQQ) for Chinese healthcare students.

METHODS

Two longitudinal assessments were undertaken among healthcare students, with a total of 595, between December 2020 and January 2021. Measures include the Chinese version of the SQQ, Patient Health Questionnaire-4 (PHQ-4), Self-Rated Health Questionnaire (SRHQ), and sociodemographic questionnaire. Structural validity through confirmatory factor analysis (CFA) was conducted to examine factor structure of the SQQ. T-tests and ANOVAs were used to examine sociodemographic differences in sleep quality scores. Multi Group CFA and longitudinal CFA were respectively used to assess cross-sectional invariance and longitudinal invariance across two-time interval, i.e., cross-cultural validity. Construct validity, internal consistency, and test-retest reliability were correspondingly examined via Spearman correlation, Cronbach's alpha and McDonald's omega, and intraclass correlation coefficient. Multiple linear regression analysis was performed to examine incremental validity of the SQQ based on the PHQ-4 and SRHQ as indicators of the criterion variables.

RESULTS

CFA results suggested that the two-factor model of the SQQ-9 (item 2 excluded) had the best fit. The SQQ-9 scores differed significantly by age, grade, academic stage, hobby, stress coping strategy, anxiety, depression, and self-rated health subgroups. Measurement invariance was supported in terms of aforesaid subgroups and across two time intervals. In correlation and regression analyses, anxiety, depression, and self-rated health were moderately strong predictors of sleep quality. The SQQ-9 had good internal consistency and test-retest reliability.

CONCLUSION

Good measurement properties suggest that the SQQ is a promising and practical measurement instrument for assessing sleep quality of Chinese healthcare students.

Measuring the intensity of mental healthcare: development of the Mental Healthcare Intensity Scale (MHIS)

BACKGROUND

There are considerable differences among mental healthcare services, and especially in developed countries there are a substantial number of different services available. The intensity of mental healthcare has been an important variable in research studies (e.g. cohort studies or randomized controlled trials), yet it is difficult to measure or quantify, in part due to the fact that the intensity of mental healthcare results from a combination of several factors of a mental health service. In this article we describe the development of an instrument to measure the intensity of mental healthcare that is easy and fast to use in repeated measurements.

METHODS

The Mental Healthcare Intensity Scale was developed in four stages. First, categories of care were formulated by using focus group interviews. Second, the fit among the categories was improved, and the results were discussed with a sample of the focus group participants. Third, the categories of care were ranked using the Segmented String Relative Rankings algorithm. Finally, the Mental Healthcare Intensity Scale was validated as a coherent classification instrument.

RESULTS

15 categories of care were formulated and were ranked on each of 12 different intensities of care. The Mental Healthcare Intensity Scale is a versatile questionnaire that takes 2-to-3 min to complete and yields a single variable that can be used in statistical analysis.

CONCLUSIONS

The Mental Healthcare Intensity Scale is an instrument that can potentially be used in cohort studies and trials to measure the intensity of mental healthcare as a predictor of outcome. Further study into the psychometric characteristics of the Mental Healthcare Intensity Scale is needed.

The foundations of the working alliance in assertive community treatment teams

BACKGROUND

In this study, we aimed to identify and define the fundamental components of the working alliance in multidisciplinary (Flexible) Assertive Community Treatment teams with shared caseloads, in order to support their daily practice and further research.

METHODS

After reviewing the literature, concept mapping with professionals and clients was used to define the working alliance in (F) ACT teams. The resulting concept maps formed the basis for the working alliance assessment instrument, which was pilot tested with professionals and clients through cognitive interviews with a think-aloud procedure.

RESULTS

The study led to the development of a twenty five-item assessment instrument to evaluate working alliances in multidisciplinary teams (WAM) that was comprised of three subscales: bond, task/goal and team. Two different versions were developed for clients and professionals.

CONCLUSIONS

The WAM instrument was developed to determine the quality of the working alliance in (F) ACT teams. Future research will focus on testing its psychometric properties and predictive value.

Including the Spiritual Dimension in Multimodal Pain Therapy. Development and Validation of the Spiritual Distress and Resources Questionnaire (SDRQ)

CONTEXT

Valid instruments for assessing spiritual resources and distress in pain therapy are scarce. The Spiritual Distress and Resources Questionnaire (SDRQ) was developed to fill this gap.

GOALS

The objective of this study was to investigate the SDRQ's psychometric properties.

METHODS

We presented the SDRQ to 219 patients with chronic pain conditions and examined its measurement properties, namely reliability and structural, convergent and discriminant validity. To investigate test-retest reliability, the SDRQ was presented a second time to a subsample of 58 randomly selected participants.

RESULTS

Factor analysis required a grouping of the 22 SDRQ items into four subscales: spiritual distress, spiritual coping, immanence and transcendence, the latter two representing spiritual resources. Cronbach's alpha was high for spiritual distress (0.93), transcendence (0.85), and immanence (0.81) while it was somewhat lower but still satisfactory for spiritual coping (0.70). The construct validity of the SDRQ was shown by correlations with established measures in the field. Higher levels of spiritual distress were associated with signs of more severe illness, such as emotional distress and pain intensity.

CONCLUSION

The results from this study suggest that the SDRQ is an easy-to-use, reliable and valid screening instrument for assessing spiritual distress, spiritual resources and spiritual coping in patients with chronic pain. The SDRQ has the potential to be used with patients suffering from other chronic diseases and to disseminate the palliative approach to pain treatment to other areas of medicine.

COVID-19 Impact Battery: Development and Validation

In addition to impacting the physical health of millions of Americans, the novel-coronavirus (COVID-19) pandemic is a significant psychological stressor due to both the threat of the illness itself and the mitigation strategies used to contain the spread. To facilitate understanding of the impact of COVID-19, validated measures are needed. Using a stepwise procedure in line with best-practice measurement procedures, the current report summarizes the procedures employed to create the COVID-19 Impact Battery (CIB). Two independent samples recruited via Amazon Mechanical Turk (N = 175, N = 642) and a third community sample (N = 259) were used for reliability and validity testing. Validation procedures yielded a battery consisting of three scales assessing COVID-19 related behaviors, worry, and disability. The behaviors scale contains three subscales assessing stockpiling, cleaning, and avoidance. The worry subscale also contains three subscales assessing health, financial and catastrophic concerns. In addition, we created a short version of the battery (CIB-S) to allow for more flexibility in data collection. In summary, we have provided reliability and validity information for the CIB and CIB-S, demonstrating that these measures can facilitate evaluation of the broad impact of COVID-19 on mental health functioning.

Teachers' professional identity: validation of an assessment instrument for preservice teachers

This study aims to develop and validate an instrument to analyse future Secondary Education teachers' perceptions regarding the development of Teachers' Professional Identity (TPI). The data were collected from a sample of 733 participants who were students enrolled in the Master's Degree for Secondary Education teachers. The psychometric properties of the instrument were obtained by analysing content, and comprehension validity, construct validity and reliability. A first subsample was used for an Exploratory Factor Analysis, and a second one to verify the identified factor structure via Confirmatory Factor Analysis. The instrument is made up of 31 items in four scales namely the understanding of TPI, the development of TPI at various educational levels, the development of TPI in comparison with that of other professionals and the influencing factors. The results show that it has high levels of validity and reliability. Therefore, it provides TPI research field with an instrument to assess it during the initial teacher training period in consecutive training models where it seems to occur more identity crisis.

The IT2 Survey: contextual knowledge (XK) influences on teacher candidates' intention to integrate technology

Prior to this study, a testable model for the influence of contextual knowledge (XK) on teacher candidates' intention to integrate technology into classroom instruction had not been established. We applied the Decomposed Theory of Planned Behavior (DTPB) to aid us in this effort. Our work (a) provided a theoretical conceptualization for factors of XK through application of the DTPB, (b) represented the synergistic effects among these factors, and (c) allowed us to explore their influences on teacher candidates' intentions to teach with technology. To assess our model, which includes factors such as teacher candidates' beliefs, attitudes, and efficacy, we developed an instrument, the Intention to Teach with Technology (IT²) Survey. Results from the structural equation model of the survey data indicated our model fit the data very well and readily accounted for various XK factors, the relations among these factors, and their influence on teacher candidates' intentions to integrate technology into teaching. Given the complexity of the context in any teaching situation, its relation to and influence on technology integration, and the previously limited examination of context in research and teacher development, the results indicate the proposed model is quite plausible, accounting for 75% of the variation in intention. The study demonstrates the IT² Survey is an effective instrument to examine factors associated with XK and their influences on technology integration. Our work extends theory about technology integration by including XK and has implications for researchers as well as practitioners who seek to advance technology integration in preparation programs.

Observing cultural competence of healthcare professionals: A systematic review of observational assessment instruments

OBJECTIVE

Observational instruments are preferred for assessment of cultural competence. The aim of the current study is to identify observational instruments to assess cultural competence in healthcare providers and dieticians specifically and assess their psychometric properties.

METHODS

A systematic review was conducted in Cinahl, Cochrane, EMBASE, PsycInfo, Pubmed, and Web of Science using search terms related to cultural competency and measurement properties. Methodological quality of the selected studies of observational cultural competence instruments in dieticians, other healthcare professionals and psychological counsellors and the measurement properties of instruments were assessed using the COSMIN checklist.

RESULTS

From 11,913 articles, six articles on five instruments were selected. Instruments were targeted at health professionals and counsellors only, and designed for face-to-face communication (n = 4) or verbal responses to videotaped simulated interactions (n = 1). The instruments' content varied largely, with main focus on attitude, and little on knowledge and skills. The measurement properties were suboptimal.

CONCLUSION

No observational instrument are available to evaluate cultural competence of dieticians. Studies on psychometric properties of instruments targeted at other health professionals lack methodological rigour.

PRACTICE IMPLICATIONS

Future work should focus on developing an instrument that encompasses both 'general' cultural competences necessary for all healthcare professionals and dietetic specific competences.

Development and Pilot Validation of an Instrument Assessing Sensorimotor Skills for Percutaneous Gastral Puncture

Introduction

The acquisition of sensorimotor skills, so-called "technical skills", plays an essential part in the professional and continuing educational training of medical and nursing staff. Facilities turn to simulator training to promote the safe and accurate performance of endoscopic examinations. Thus, this study aimed to develop and pilot-test a corresponding assessment instrument to monitor necessary sensorimotor or "technical" skills of the examiner for a safe percutaneous endoscopic gastrostomy (AS-PEG).

Materials and Methods

Instrument development and pilot validation involved four stages: identification of potential items and initial draft of the AS-PEG; expert panel with 11 experts (content validity index [CVI] calculated); empirical validation using a quasi-experimental intervention on simulators; revision of the pilot AS-PEG taking expert assessment, and empirical testing into consideration.

Results

The initial instrument yielded 13 categories and 44 items describing the PEG procedure. Experts rated 30 out of 44 items (68%) extremely or very important for the safety of the puncture of the stomach. Initial item-CVIs ranged from 0.00 to 1.00; scale-CVI was 0.61. Twenty-four trainees (7 physicians, 17 nurses) participated in the pilot simulation study. On average, 8:25 min were required for PEG placement (min-max 5:59-13:38 min, SD = 1:43). The revised AS-PEG version was reduced to 14 items with a range of the item CVI from 0.8 to 1.0, and a scale-CVI of 0.90.

Conclusion

The AS-PEG instrument facilitates the evaluation of sensorimotor skills during percutaneous gastric puncture procedures within the context of PEG placement, across professions and without relating to the number of procedures previously performed. The instrument is economical and shows satisfying content validity.

Patient-physician communication in the context of diabetes care: Adaptation and assessment of psychometric properties of a Persian version of the interpersonal process of care survey (P-IPC)

AIMS

To examine the psychometric characteristics and explore the preliminary validity of the Persian version of the Interpersonal Processes of Care Survey (P-IPC) to assess patient-physician communication in the context of diabetes care.

METHODS

After adapting, translating, examining content validity, and pretesting the questionnaire, it was administered to 300 patients with diabetes. Confirmatory factor analysis identified the factor structure (scales). Variability, item-scale correlations, reliability, and construct validity of the final scales were examined.

RESULTS

Factor analysis supported the hypothesized second-order factor model with 27 of the 29 items:11 first-, and 7 second-order common factors. Scale scores were calculated for the 7 second-order factors. Internal-consistency reliability for the 7 scales ranged from 0.60 to 0.90 and 2-week test-retest correlations ranged from 0.89 to 0.96. The communication and interpersonal style domains of the P-IPC demonstrated high ceiling effects suggesting good patient-physician communication. The P-IPC scales differentiated between patients in the language-concordant and language-discordant groups, and patterns of correlations with three patient satisfaction measures corresponded to hypotheses.

CONCLUSION

The P-IPC includes all of the second-order scales identified in the original IPC. Evidence of its reliability and validity suggest it can be useful for assessing patient-physician communication in the context of diabetes care.

Health literacy knowledge and experience survey: Cross-cultural adaptation and the psychometric properties of the Iranian nurse version

BACKGROUND

Nurses' knowledge and Experience with Health Literacy can affect the treatment process, improving the quality of health care and effectively communicating with all clients. Evaluation of nurses' knowledge and experience requires a reliable instrument. This study aimed to translate cross-cultural adaptation and testing of Health Literacy Knowledge and Experience Survey (HL-KES).

MATERIALS AND METHODS

This cross-sectional methodological study was done during 2018-2019. The study was carried out in two stages: the first phase was designed to obtain a translation and cross-cultural equivalent of the (HL-KES), based on the World Health Organization (2018) and the Sousa and Rojjanasrirat (2011) Guidelines in six steps: preparation, forward translation, reconciliation, back translation, back translation review and pretesting and cognitive debriefing of the translated questionnaires. The second phase was conducted to evaluate the psychometric properties of the questionnaire.

RESULTS

The content validity index and content validity ratio values of all items were >0.62 and 0.79, respectively. Based on the Kuder-Richardson formula, the reliability of the knowledge dimension was reported as 0.7. Furthermore, split-half coefficient for inter-rather reliability and test-retest were 0.76 and 0.96, respectively. The reliability of their experiences with the HL-KES was measured using Cronbach's alpha, in which it was 0.82.

CONCLUSIONS

The Persian version of the instrument for assessing nurses' knowledge and experience with health literacy had good validity and reliability. It is recommended that it should be used in educational, clinical environments, and also in future research studies.

Measuring patient-provider communication skills in Rwanda: Selection, adaptation and assessment of psychometric properties of the Communication Assessment Tool

OBJECTIVE

To identify, adapt and validate a measure for providers' communication and interpersonal skills in Rwanda.

METHODS

After selection, translation and piloting of the measure, structural validity, test-retest reliability, and differential item functioning were assessed.

RESULTS

Identification and adaptation: The 14-item Communication Assessment Tool (CAT) was selected and adapted.

VALIDITY AND RELIABILITY TESTING

Content validation found all items highly relevant in the local context except two, which were retained upon understanding the reasoning applied by patients. Eleven providers and 291 patients were involved in the field-testing. Confirmatory factor analysis showed a good fit for the original one factor model. Test-retest reliability assessment revealed a mean quadratic weighted Kappa = 0.81 (range: 0.69-0.89, N = 57). The average proportion of excellent scores was 15.7% (SD: 24.7, range: 9.9-21.8%, N = 180). Differential item functioning was not observed except for item 1, which focuses on greetings, for age groups (p = 0.02, N = 180).

CONCLUSION

The Kinyarwanda version of CAT (K-CAT) is a reliable and valid patient-reported measure of providers' communication and interpersonal skills. K-CAT was validated on nurses and its use on other types of providers may require further validation.

PRACTICE IMPLICATION

K-CAT is expected to be a valuable feedback tool for providers in practice and in training.

A questionnaire measuring staff perceptions of Lean adoption in healthcare: development and psychometric testing

BACKGROUND

During the past decade, the concept of Lean has spread rapidly within the healthcare sector, but there is a lack of instruments that can measure staff's perceptions of Lean adoption. Thus, the aim of the present study was to develop a questionnaire measuring Lean in healthcare, based on Liker's description of Lean, by adapting an existing instrument developed for the service sector.

METHODS

A mixed-method design was used. Initially, items from the service sector instrument were categorized according to Liker's 14 principles describing Lean within four domains: philosophy, processes, people and partners and problem-solving. Items were lacking for three of Liker's principles and were therefore developed de novo. Think-aloud interviews were conducted with 12 healthcare staff from different professions to contextualize and examine the face validity of the questionnaire prototype. Thereafter, the adjusted questionnaire's psychometric properties were assessed on the basis of a cross-sectional survey among 386 staff working in primary care.

RESULTS

The think-aloud interviews led to adjustments in the questionnaire to better suit a healthcare context, and the number of items was reduced. Confirmatory factor analysis of the adjusted questionnaire showed a generally acceptable correspondence with Liker's description of Lean. Internal consistency, measured using Cronbach's alpha, for the factors in Liker's description of Lean was 0.60 for the factor people and partners, and over 0.70 for the three other factors. Test-retest reliability measured by the intra-class correlation coefficient ranged from 0.77 to 0.88 for the four factors.

CONCLUSIONS

We designed a questionnaire capturing staff's perceptions of Lean adoption in healthcare on the basis of Liker's description. This Lean in Healthcare Questionnaire (LiHcQ) showed generally acceptable psychometric properties, which supports its usability for measuring Lean adoption in healthcare. We suggest that further research focus on verifying the usability of LiHcQ in other healthcare settings, and on adjusting the instrument if needed.