The importance of content and face validity in instrument development: lessons learnt from service users when developing the Recovering Quality of Life measure (ReQoL)

Design and Psychometric Evaluation of Nurses' Mobile Health Device Acceptance Scale (NMHDA-Scale): Application of the Expectation-Confirmation Theory

BACKGROUND

The use of mobile tools in nursing care is indispensable. Given the importance of nurses' acceptance of these tools in delivering effective care, this issue requires greater attention.

OBJECTIVE

This study aims to design the Mobile Health Tool Acceptance Scale for Nurses based on the Expectation-Confirmation Theory and to evaluate it psychometrically.

METHODS

Using a Waltz-based approach grounded in existing tools and the constructs of the Expectation-Confirmation Theory, the initial version of the scale was designed and evaluated for face and content validity. Construct validity was examined through exploratory factor analysis, concurrent validity, and known-group comparison. Reliability was assessed using measures of internal consistency and stability.

RESULTS

The initial version of the scale consisted of 33 items. During the qualitative and quantitative content validity stage, 1 item was added and 1 item was removed. Exploratory factor analysis, retaining 33 items, identified 5 factors that explained 70.53% of the variance. A significant positive correlation was found between the scores of the designed tool and nurses' attitudes toward using mobile-based apps in nursing care (r=0.655, P<.001). The intraclass correlation coefficient, Cronbach α, and ω coefficient were 0.938, 0.953, and 0.907, respectively.

CONCLUSIONS

The 33-item scale developed is a valid and reliable instrument for measuring nurses' acceptance of mobile health tools.

Construction and validation of an instrument for event-related sterility of processed healthcare products

OBJECTIVE

To construct and validate an instrument to assess events related to maintaining the sterility of processed healthcare products.

METHODS

This methodological study developed the instrument through analysis by a panel of experts, focusing on the integrity of commonly used packaging: spunbond-meltblown-spunbond and medical-grade paper. The instrument was analyzed using the Content Validity Index and Content Validity Ratio (≥ 0.80) and modified Kappa (≥ 0.74). The instrument underwent pre-testing.

RESULTS

Six experienced professionals participated in the expert panel. After two rounds, the final version of the instrument contained five dimensions. In the pre-test, 30 nursing professionals participated, of whom 86.67% considered the instrument good, and 90% found it understandable.

CONCLUSION

The construction and validation followed literature recommendations. The instrument is available, aiding in the safe use of processed healthcare products.

The development of a digital intelligence quotient scale: A new measuring instrument for primary school students in China

The development of a Digital Intelligence Quotient (DQ) scale for primary school students is the basis for research on the DQ of primary school students, which helps to scientifically diagnose the level and the current average DQ among Chinese primary school students. This study developed and validated a scale applicable to the assessment of DQ in Chinese primary school students where, the initial scale was first constructed; Then 1109 valid datasets were collected through purposive sampling and divided into Sample A and Sample B; Sample A was subjected to exploratory factor analysis and Sample B was tested by confirmatory factor analysis; The final validated scale consists of 22 items in 7 dimensions: digital identity, digital use, digital safety, digital security, digital emotional intelligence, digital literacy and digital rights. The scale has high reliability and validity and thus can be used as a reliable instrument for assessing DQ in Chinese primary school students.

Multidimensional frailty assessment: Development and validation of the Tilburg Frailty Indicator-Indonesia version

The aim of this study was to develop and examine the psychometric properties of the Tilburg Frailty Indicator-Indonesian version (TFI-I). 308 community-dwelling older adults aged ≥60 years participated. The TFI-I exhibited favorable internal consistency (Cronbach's alpha = 0.775) and test-retest reliability (intraclass correlation coefficient = 0.94). The physical, psychological, and social domains of the TFI-I correlated closely with the similar constructs of other scales, including the Short Physical Performance Battery (P < .001), Fried Frailty Phenotype (P < 0.001), Geriatric Depression Scale (P < .001), and the World Health Organization Quality of Life scale (P = 0.041), indicating its favorable construct validity. Significant differences were identified between the robust and frailty groups on the Barthel Index (P = .001) and Lawton Instrumental Activity of Daily Living Scale (P < .001). Overall, the TFI-I is valid and reliable when used to evaluate frailty status in clinical and research settings.

Development and content validation of a questionnaire identifying patients' functional priorities and abilities after hip or knee arthroplasty

PURPOSE

To develop a self-report questionnaire evaluating functional priorities after hip or knee arthroplasty and evaluate patients' understanding of its items and conceptual relevance.

METHODS

A self-report questionnaire was first developed based on the International Classification of Functioning, Disability, and Health (ICF) core set for osteoarthritis (OA). In the second stage, two research physiotherapists thoroughly reviewed and refined the questionnaire, and another physiotherapist conducted cognitive think-aloud interviews with 18 patients to assess the face and content validity of the questionnaire.

RESULTS

All categories and corresponding activities of ICF core set for OA were used to develop the questionnaire. Several questionnaire issues were identified and addressed. Most challenges were related to comprehension, followed by item ordering and visual elements. Patients identified ambiguous wording which we subsequently simplified. Ten activities of the core set were excluded due to lack of face validity, two activities were added, and four activities were modified.

CONCLUSION

The findings suggest that the ICF core set for OA needs to be adjusted for patients undergoing hip or knee arthroplasty and highlight the feasibility of applying a modified core set to assess functional priorities after hip or knee arthroplasty.

Reducing anxiety and enhancing satisfaction in thyroid patients with DietLens application during radioactive iodine therapy: A quasi-experimental study

Hyperthyroidism and thyroid cancer significantly impact health, and often require Radioactive Iodine (RAI) therapy. Anxiety is common in patients undergoing RAI, particularly related to dietary compliance. This study aimed to assess the effectiveness of the mobile health application, DietLens in reducing anxiety and increasing satisfaction in patients preparing for RAI therapy, focusing on low-iodine diet (LID). A quasi-experimental study was conducted in a Singapore tertiary hospital outpatient department from March 13, 2019 to March 27, 2020, involving patients scheduled for their first RAI treatment. Participants were divided into a control group receiving standard care and an intervention group using DietLens alongside standard care. Anxiety levels were assessed using the Zung Self-Rating Anxiety Scale, and satisfaction levels were measured through self-reported questionnaires. In the study, 56 participants were initially divided into control (n = 28) and intervention (n = 28) groups. After accounting for dropouts, 50 participants finished the study, with each group comprising 25 individuals. Anxiety levels were similar between groups pre-intervention. Post-intervention, the intervention group displayed a significant decrease in anxiety levels compared to the control group (independent t-test: t (48) = 2.50, p = 0.02). The multivariate linear regression analysis indicated that being in the intervention group was significantly associated with a decrease in post-intervention anxiety score (β = -4.03, 95 % CI: -7.33 to -0.72, p = 0.02). Fisher's Exact Test revealed a borderline significant difference in satisfaction with educational materials and the overall treatment process, with 100 % of the intervention group expressing satisfaction compared to 80 % in the control group, resulting in a p-value of 0.052 in both instances. DietLens was effective in reducing anxiety and enhancing satisfaction related to RAI therapy preparation, particularly in managing a LID, highlighting a beneficial role for digital interventions in healthcare settings.

A Systematic Review and Quality Assessment of Cardiovascular Disease-Specific Health-Related Quality-of-Life Instruments Part I: Instrument Development and Content Validity

OBJECTIVES

Health-related quality-of-life (HRQoL) instruments for cardiovascular diseases (CVD) have been commonly used to measure important patient-reported outcomes (PROs) in clinical trials and practices. This study aimed at systematically identifying and assessing the content validity of CVD-specific HRQoL instruments in clinical studies.

METHODS

The research team searched Cumulative Index to Nursing and Allied Health Literature, Embase, and PubMed from inception to January 20, 2022. The research team included studies that reported the development and content validity for CVD-specific instruments. Two reviewers independently assessed the methodological quality using the Consensus-based Standards for the Selection of Health Measurement Instruments methods on evaluating content validity of PROs. Content analysis was used to categorize the items included in the instruments.

RESULTS

The research team found 69 studies reporting the content validity of 40 instruments specifically developed for CVD. Fourteen (35.0%) were rated "sufficient" with very low to moderate quality of evidence. For PRO development, all instruments were rated "doubtful" or "inadequate." Twenty-eight (70.0%) instruments cover the core concepts of HRQoL.

CONCLUSIONS

The quality of development and content validity vary among existing CVD-specific instruments. The evidence on the content validity should be considered when choosing a HRQoL instrument in CVD clinical studies and health economic evaluations.

Cadaveric Biomechanical Laboratory Research Can Be Quantitatively Scored for Quality With the Biomechanics Objective Basic Science Quality Assessment Tool: The BOBQAT Score

PURPOSE

To develop a quality appraisal tool for the assessment of cadaveric biomechanical laboratory and other basic science biomechanical studies.

METHODS

For item identification and development, a systematic review of the literature was performed. The content validity index (CVI) was used either to include or exclude items. The content validity ratio (CVR) was used to determine content validity. Weighting was performed by each panel member; the final weight was either up- or downgraded to the closest of 5% or 10%. Face validity was scored on a Likert scale ranked from 1 to 7. Test-retest reliability was determined using the Fleiss kappa coefficient. Internal consistency was assessed with Cronbach's alpha. Concurrent criterion validity was assessed against the Quality Appraisal for Cadaveric Studies scale.

RESULTS

The final Biomechanics Objective Basic science Quality Assessment Tool (BOBQAT) score included 15 items and was shown to be valid, reliable, and consistent. Five items had a CVI of 1.0; 10 items had a CVI of 0.875. For weighting, 5 items received a weight of 10%, and 10 items a weight of 5%. CVR was 1.0 for 6 items and 0.75 for 9 items. For face validity, all items achieved a score above 5. For test-retest reliability, almost-perfect test-retest reliability was observed for 10 items, substantial agreement for 4 items, and moderate agreement for 1 item. For internal consistency, Cronbach's alpha was calculated to be 0.71. For concurrent criterion validity, Pearson's product-moment correlation was 0.56 (95% confidence interval [CI] = 0.38-0.70, P = .0001).

CONCLUSIONS

Cadaveric biomechanical and laboratory research can be quantitatively scored for quality based on the inclusion of a clear and answerable purpose, demographics, specimen condition, appropriate bone density, reproducible technique, appropriate outcome measures, appropriate loading conditions, appropriate load magnitude, cyclic loading, sample size calculation, proper statistical analysis, results consistent with methods, limitations considered, conclusions based on results, and disclosure of funding and potential conflicts.

CLINICAL RELEVANCE

Study quality assessments are important to evaluate internal and external validity and reliability and to identify methodological flaws and misleading conclusions. The BOBQAT score will help not only in the critical appraisal of cadaveric biomechanical studies but also in guiding the designs of such research endeavors.

"Doctor, What Would You do if You Were Me?" - A Survey of Physician Perspectives Toward Glioblastoma Resection

OBJECTIVE

How maximal safe resection of glioblastoma (GBM) is implemented in the clinical setting remains understudied. Here, we utilized a survey-based approach to understand physician perspectives on this matter.

METHODS

Scenarios involving GBMs were presented to physicians who were asked to select from planned subtotal resection, gross total resection (GTR), medical therapy only, or palliative care. Demographic, experience, and Likert scales of value assessment were collected.

RESULTS

In the scenario involving a corpus callosum GBM, 2.33% opted for GTR. For a right frontal GBM, 91.7% opted for GTR. In contrast, only 30.8% chose GTR of a right motor strip GBM (P < 0.001). When presented with a left motor strip GBM, fewer respondents (12.7%, P < 0.001) opted for GTR. Physicians who placed a high value on preserving physical independence were more likely to forgo GTR for right motor GBMs (hazard ratio = 0.068, 95% confidence interval: 0.47-0.97, P = 0.035), and physicians who placed a high value on their faith were more likely to opt for surgical treatments that differ from the general consensus, for instance opting for GTR of the corpus callosum GBM (hazard ratio = 4.18, 95% confidence interval: 1.63-10.74, P = 0.003). No other associations were found between the choice for GTR and other variables collected.

CONCLUSIONS

Our results suggest that while maximal safe resection remains a guiding principle for GBM resection, physician preference in terms of the extent of resection varies significantly as a function of tumor location and personal values.

Baby Boomer Gay Men's Experiences with Primary Healthcare

This research explored baby boomer gay men's experiences with primary healthcare and their perspectives of future long-term care. Baby boomer gay men's perspectives about primary healthcare remain understudied in the United States. A descriptive qualitative study was conducted with 30 baby boomer men in the Southwest USA. We used semi-structured interviews to assess participants' initiation and maintenance of primary healthcare, disclosure of sexual orientation to providers, and perspectives about future healthcare needs, including long-term care. Data were analyzed with a latent thematic analysis. We found baby boomer gay men anticipate discrimination because of their sexual orientation whenever they establish healthcare with new providers. Participants identified circumstantial comfort in the new healthcare setting as a key motivator to disclose their sexual orientation. Thus, baby boomer gay men specifically sought gay or gay-friendly healthcare providers to ease the burden of managing disclosure and to permit free discussion of their sexual orientation and healthcare needs. Participants faced recurring anticipation of rejection and discrimination from healthcare providers, which extends to their perceptions of current healthcare encounters and future long-term care placement. Healthcare providers would benefit from understanding the practice implications of this dynamic. Future research on primary healthcare inclusivity is needed.

Cross-cultural validation of Malay version of perceived professionalism among dental patients

BACKGROUND

Professionalism is a dynamic construct that requires constant revision based on contemporary practices and attitudes.

OBJECTIVES

The purpose of this study was to cross-culturally adapt an already validated English questionnaire assessing patient perceptions of professionalism among dentists, into the Malay language.

METHODS

An original 24-item questionnaire was cross-cultural adapted in the Malaysian context through two phases. Phase I included content and face validity from experts' evaluation which was followed by translation into the Malay language. Phase II involved psychometric assessment including construct validity and reliability analysis.

RESULTS

Expert evaluation indicated that all items demonstrated excellent content validity for the characteristics of relevance (CVI = 0.75-1.00 Kappa = 0.72-1.00) and clarity (CVI = 0.75-1.00 and Kappa= 0.72-1.00). A total of 300 dental patients completed the questionnaire. EFA was done on the first dataset and the second dataset was subjected to CFA which showed composite reliability (CR) ranging between 0.741 and 0.897 indicating acceptable reliability among items. The final questionnaire had 20 items with 3 domains; Patient expectation of a dental care provider, Ethics and Dentist's professional responsibilities, Patient communication and confidentiality.

CONCLUSION

This study has successfully validated the questionnaire for patient perception of professionalism in the Malaysian context.

Translation, cultural adaptation and validation of the Swahili Pain Catastrophizing Scale among refugees who survived torture and/or war trauma in Kenya: An observational study

Background and Aims

Accurate assessment of any patient relies on the use of appropriate measurements which are culturally- and linguistically-applicable and valid. The following study aimed to translate, cross-culturally adapt and test the nomological validity, structural validity, internal consistency, test-retest reliability, sensitivity-to-change and feasibility of the Swahili version of the Pain Catastrophizing Scale (Swa-PCS) among refugees who survived torture/war trauma living with chronic pain in Kenya.

Methods

An observational study was conducted. Translation and cultural adaptation of the original PCS for the Swahili-speaking refugee population in Kenya, who survived torture or war trauma was undertaken. Following this process, a validation study was conducted on the newly-adapted instrument, to ascertain the psychometric properties (nomological validity, structural validity, internal consistency, test-retest reliability, sensitivity-to change, and ceiling and floor effects).

Results

Fifty participants were included in this study. Correlations between pain catastrophization and fear-avoidance behavior measures were significant (r = 0.538, p < 0.01). Ceiling effects were 42-48% with no floor effects. Standard errors of measurement values were between 0.938 and 3.38. Minimal-detectable-change values were between 2.17 and 7.82. Internal consistency was satisfactory to good, for the whole and subsections respectively (range α = 0.693-0.845). Magnification had the lowest α. Test-retest reliability was also satisfactory to good (range ICC =  0.672-0.878). Confirmatory factor analysis confirmed that the Swa-PCS had three factors which explained the majority of the variance. Root mean square error of approximation and comparative fit index were calculated for goodness-of-fit assessment, and were 0.18 and 0.83, respectively.

Conclusion

This study showed that the adapted Swa-PCS displayed overall satisfactory to good internal consistency, test-retest reliability and sensitivity-to-change. Furthermore, the Swa-PCS scores were related to fear-avoidance behavior scores as expected (nomological validity). Structural validation of the Swa-PCS requires further investigation. Further testing of the psychometric properties of the Swa-PCS is however warranted.

Assessment of patients with head and neck cancer using the MD Anderson Dysphagia Inventory: Results of a study into its comprehensiveness, comprehensibility and relevance to clinical practice

BACKGROUND

The MD Anderson Dysphagia Inventory (MDADI) is a widely used patient-reported outcome measure (PROM) which assesses dysphagia-related quality of life (QoL) in head and neck cancer (HNC). Despite its common use in HNC research and clinical practice, few of its psychometric properties have been reappraised since its inception. The aim of this study was to perform a survey-based qualitative analysis of UK HNC clinicians' perceptions of the content validity of the MDADI, evaluating it across the parameters of relevance, comprehensiveness and comprehensibility as per the COSMIN guideline for PROM assessment.

RESULTS

Four themes relating to the content validity of the MDADI were identified: (1) MDADI items lack clarity of definition of the terms 'swallowing', 'eating' and 'dysphagia'; (2) the MDADI is perceived to be overly negative in tone including items that service users may find distressing or disempowering; (3) items in the tool are exclusory to specific subgroups of patients, such as those who are nil by mouth or socially isolated; and (4) modifications to the MDADI were suggested and encouraged to make it more clinically useful and patient-centred.

CONCLUSIONS

This study indicates that MDADI's content validity is 'insufficient' when rated by COSMIN parameters. This has significant implications for its continued use in HNC research and clinical practice. Further re-evaluation of the content validity of the MDADI is warranted, with potential future amendment of items being indicated if the results of this study are corroborated in subsequent research.

WHAT THIS PAPER ADDS

What is already known on the subject The MD Anderson Dysphagia Inventory (MDADI) patient-reported outcome measure of dysphagia-related quality of life is widely used in clinical practice and international clinical trials. Content validity is considered to be the most important property of a tool when assessing its psychometric strengths and weaknesses; however, the MDADI's content validity has not been reappraised since its initial development. What this paper adds to existing knowledge This study presents UK speech and language therapists' opinions and experience of the content validity of the MDADI and this first reappraisal of its content validity since its initial development highlights several issues with this psychometric parameter of the tool. This study highlights that further re-evaluation of the content validity of the MDADI is warranted, with potential future amendment of items being indicated if the results of this study are corroborated in subsequent research. What are the potential or actual clinical implications of this work? Clinicians cannot assume that commonly used outcomes tools have strong psychometric profiles. Consideration of the content validity of outcomes tools during selection for use in clinical and research practice should be key, as this will encourage use of tools that produce relevant, valid data that can contribute meaningfully to patient-centred care.

Cross-cultural adaptation and validation of a Spanish version of the self-administered foot evaluation questionnaire (SAFE-Q)

BACKGROUND

The self-administered foot evaluation questionnaire is a comprehensive measure for assessing the perception of patients regarding their foot-related problems. However, it is currently only available in English and Japanesse. Therefore, this study aimed to cross-culturally adapt the questionnaire to Spanish and assess its psychometric properties.

METHODS

The methodology recommended by the International Society for Pharmaco Economics and Outcomes Research for translating and validating patient-reported outcome measures was followed for the Spanish translation. After a pilot study with 10 patients and 10 controls, an observational study was carried out between March and December 2021. The Spanish version of the questionnaire was filled by 100 patients with unilateral foot disorders, and the time spent to complete each questionnaire was recorded. Cronbach's alpha was calculated to analyze the internal consistency of the scale and Pearson's correlation coefficients for the degree of inter-subscale associations.

RESULTS

The maximum correlation coefficient for the Physical Functioning, Daily Living, and Social Functioning subscales was 0.768. The inter-subscale correlation coefficients were significant (p < 0.001). Additionally, the value of Cronbach's alpha for the whole scale was 0.894 (95% confidence interval, 0.858-0.924). The values of Cronbach's alpha varied between 0.863 and 0.889 when the value of one of the five subscales was suppressed, which can be considered a measure of good internal consistency.

CONCLUSION

The Spanish version of the questionnaire is valid and reliable. The method followed for its transcultural adaptation ensured its conceptual equivalence with the original questionnaire. Health practitioners can use the self-administered foot evaluation questionnaire as a complementary method to assess the interventions performed for ankle and foot disorders among native Spanish speakers; however, further research is necessary to assess its consistency for use by populations from other Spanish-speaking countries.

Psychometric evaluation of the endometriosis impact questionnaire (EIQ) in an Iranian population

BACKGROUND

Endometriosis is a benign and chronic gynecological estrogen-dependent disease. Considering the prevalence and the importance of measuring the long-term effects of endometriosis in affected women's lives t the EIQ scale was designed and psychometrically analyzed in English in Australia, in three recall periods (last 12 months, 1 to 5 years ago and more than 5 years ago). It has never been used in Iran and its validity and reliability have not been assessed either. Therefore, the present study aimed to translate and investigate the psychometric properties of the EIQ.

METHODS

In this study, 200 women were selected through random sampling in 2022. After forward and backward translation, the face validity, content validity, and construct validity of EIQ (through Corrected Item-Total Correlation) were examined. To assess the reliability of the scale, both internal consistency (Cronbach's alpha) and test-retest stability methods were employed.

RESULTS

Impact Score with a score above 1.5 was approved. CVI and CVR values of the EIQ tool were 0.97 and 0.94, respectively. The Item to total Correlation confirmed the construct validity of all seven dimensions of the tool, more than the cut-off (0.3) except lifestyle. Cronbach's alpha coefficient and Intra Correlation Coefficient (ICC) were acceptable for all dimensions.

CONCLUSION

The Persian version of EIQ is a valid and reliable scale. This tool is valid and reliable for investigating the long-term impact of endometriosis in Iranian society.

University makes me angry: Investigating stimulus-response (S-R) and cognitive-mediation (C-M) emotion beliefs in undergraduate students

Emotion regulation through cognitive reappraisal is well-studied, but less so are the predispositional and superordinate beliefs that influence reappraisal. Recently, researchers developed the cognitive mediation beliefs questionnaire (CMBQ), which measures two emotion beliefs, namely stimulus-response (S-R) generation beliefs and cognitive mediation (C-M) change beliefs. In working populations S-R generation beliefs are inversely related to cognitive reappraisal tendencies and positive mental health, and positively related to emotion reactivity. C-M change beliefs are positively related to cognitive reappraisal tendencies, and inversely related to emotion reactivity and positive mental health. As yet, there is no evidence for the validity of the CMBQ within student samples, or for the associations between its subscales and cognitive reappraisal, emotion reactivity, and positive mental health. Therefore, in the present study the CMBQ is tested for factorial, convergent (associations with cognitive reappraisal), and concurrent (associations with emotion reactivity and positive mental health) validity in a cohort of 621 undergraduate students in the United Kingdom (U.K.). Results indicate support for the factorial and convergent validity of the CMBQ, with mixed evidence for the concurrent validity of the CMBQ. A CM-SR discrepancy score appeared to provide a promising variable when associated with emotion reactivity and positive mental health. The findings are discussed in terms of practical and research implications of the findings.

Reliability and validity of the Arabic version of the modified falls efficacy scale

PURPOSE

The purpose of this study was to adapt Modified Falls Efficacy Scale (MFES) into Arabic and determine the reliability and validity of the instrument.

MATERIALS AND METHODS

The study was conducted in two phases: (i) translation and adaptation by the systematic approach of the 'forward-back' translation method and (ii) psychometric testing of the Arabic version of the Modified Falls Efficacy Scale among 207 community-dwelling older adults (≥ 60 years).

RESULTS

The Arabic version of the Modified Falls Efficacy Scale demonstrated excellent internal consistency (Cronbach's alpha = 0.98) and test-retest reliability scores (ICC = 0.96, 95% CI; 0.95-0.97). And also showed strong correlations with both the Falls Efficacy International (r = -0.82) and the activities-specific Balance Confidence Scale (r = 0.87). Sampling adequacy for factor analysis was proven by a Kaiser-Meyer-Olkin value of 0.962. Goodness-of-fit (GFI) statistics for the model were in the acceptable range (Chi-Square/Degree of Freedom (CMIN/DF) = 2.59, Goodness-of-fit index (GFI) = 0.9, Comparative Fit Index (CFI) = 0.97, Root Mean Square Error of Approximation (RMSEA) = 0.79).

CONCLUSION

The Arabic version of the Modified Falls Efficacy Scale has demonstrated excellent psychometric qualities to measure the level of fear of falling.

Item development for a patient-reported measure of compassionate healthcare in action

BACKGROUND

Compassionate care is a fundamental component of healthcare today; yet, many measures of compassionate care are subjective in focus and lack clarity around what compassionate care looks like in practice. Measures mostly relate to physical healthcare settings, neglecting mental healthcare. They also lack significant involvement of people with lived experience (PLE) of healthcare delivery in their development. This study aimed to begin the process of developing a new patient-reported measure, one that captures the observable actions of compassionate care delivery or 'compassionate healthcare in action' by any healthcare professional working in any care setting. The study involves PLE of healthcare delivery, both patients and staff, throughout.

METHODS

A multistage mixed-methods scale development process was followed. First, items were derived inductively from reflexive thematic analysis of patient and clinician interviews about what compassionate care meant to them (n = 8), with additional items derived deductively from a literature review of existing measures. Next, a panel of patient, clinician and researcher experts in compassionate care was recruited (Round 1: n = 33, Round 2: n = 29), who refined these items in a two-round modified online Delphi process.

RESULTS

Consensus was reached on 21 items of compassionate care in action relating to six facets: understanding, communication, attention, action, emotional sensitivity and connection. These items will form the basis for further scale development.

CONCLUSIONS

This item development work has laid the foundation of a potential new tool to systematically measure what compassionate healthcare in action looks like to patients. Further research is underway to produce a valid and reliable version of this proposed new measure. We have outlined these initial stages in detail in the hope of encouraging greater transparency and replicability in measure development, as well as emphasising the value of involving PLE throughout the process.

PATIENT OR PUBLIC CONTRIBUTION

This study involved PLE of both physical and mental healthcare (as staff, patients and service users) throughout the development of the new measure, including initial project conceptualisation and participation in item generation and refinement stages.

Quality of life assessment after microvascular head and neck reconstruction: a systematic review of available tools

In this study, we aimed to appraise the quality and psychometric properties of quality of life (QOL) assessment tools used after microsurgical reconstruction for head and neck cancers. A systematic review of QOL assessment tools used in head and neck cancer patients after microsurgical reconstruction was performed; emphasis was placed on psychometric properties and validity. Fifty-four studies published between January 2010 and February 2023 fulfilled the criteria; in these, twenty-three different QOL assessment tools were identified. The most commonly used instrument was the European Organisation for Research and Treatment of Cancer Quality of Life Questionnaire Head and Neck version (EORTC-H&N). No assessment tool fulfilled all the quality criteria; no single tool presented evidence from all the components of validity. Almost all reported reliability coefficients were above 0.7; most papers reported an internal consistency coefficient (Cronbach's alpha) for the global score. The array of available tools allows for the choice of the most appropriate one depending on the context faced by the clinician or researcher.

GenPup-M: A novel validated owner-reported clinical metrology instrument for detecting early mobility changes in dogs

OBJECTIVE

To use a previously validated veterinary clinical examination sheet, Liverpool Osteoarthritis in Dogs (LOAD) questionnaire, combined with kinetic and kinematic gait analysis in dogs with/without mobility problems to demonstrate the capacity of a novel clinical metrology instrument ("GenPup-M") to detect canine mobility impairments.

DESIGN

Quantitative study.

ANIMALS

62 dogs (31 with mobility impairments and 31 without mobility impairments).

PROCEDURE

The dogs' clinical history was obtained from owners and all dogs underwent a validated orthopaedic clinical examination. Mobility impairments were diagnosed in the mobility impaired group based on clinical history and orthopaedic examination. Owners were asked to complete GenPup-M along with a previously validated mobility questionnaire (Liverpool Osteoarthritis in Dogs (LOAD)) to identify construct validity. As a test of criterion validity, the correlation between instrument scores and the overall clinical examination scores, along with force-platform obtained peak vertical forces (PVF) were calculated. GenPup-M underwent internal consistency and factor analysis. Spatiotemporal parameters were calculated for dogs with/without mobility impairments to define the gait differences between these two groups.

RESULTS

Principal Component Analysis identified GenPup-M had two components with Eigenvalues >1 ("stiffness/ease of movement" and "willingness to be active/exercise"). Cronbach's α was used to test internal consistency of GenPup-M and was found to be "good" (0.87). There was a strong, positive correlation between GenPup-M and LOAD responses (r2 = 0.69, p<0.001) highlighting construct validity. Criterion validity was also shown when comparing GenPup-M to clinical examination scores (r2 = 0.74, p<0.001) and PVF (r2 = 0.43, p<0.001). Quantitative canine gait analysis showed that there were statistically significant differences between peak vertical forces (PVF) of mobility impaired and non-mobility impaired dogs (p<0.05). Analyses of PVF showed that non-mobility impaired dogs more evenly distributed their weight across all thoracic and pelvic limbs when compared to mobility impaired dogs. There were also consistent findings that mobility impaired dogs moved slower than non-mobility impaired dogs.

CONCLUSION AND CLINICAL RELEVANCE

GenPup-M is a clinical metrology instrument (CMI) that can be completed by dog owners to detect all mobility impairments, including those that are early in onset, indicating the versatility of GenPup-M to assess dogs with and without mobility impairments. Results of the study found that GenPup-M positively correlated with all three objective measures of canine mobility and consequently showed criterion and construct validity. Owner-reported CMIs such as GenPup-M allow non-invasive scoring systems which veterinary surgeons and owners can use to allow communication and longitudinal assessment of a dog's mobility. It is anticipated that GenPup-M will be used by owners at yearly vaccinations/health checks, allowing identification of any subtle mobility changes, and enabling early intervention.

Screening Children in India: Translation and Psychometric Evaluation of the Parents' Evaluation of Developmental Status and the Strength and Difficulties Questionnaire

Timely screening and surveillance of children for developmental delay and social-emotional learning difficulties are essential in Low- and Middle-Income Countries like India. Screening measures like the Parents' Evaluation of Developmental Status (PEDS) and Strength and Difficulties Questionnaire (SDQ) are considered suitable for India due to their low cost, easy accessibility, and no training requirement for administration. However, India lacks validated screening measures, and the PEDS and SDQ have yet to be validated for children in India. The study aimed to translate the PEDS and SDQ from English to Hindi and psychometrically evaluate the same measures on children aged 4-8 years in India. The original PEDS and SDQ forms and their translations were pilot tested on 55 participants and evaluated using data from 407 children with typical development (TD) and 59 children with developmental disability (DD). Parents and teachers reported no meaningful discrepancy between the original and translated (Hindi) questionnaires. Internal consistency for the PEDS was acceptable, but unacceptable for most subscales on the SDQ, for both TD and DD samples. Test-retest reliability was poor for the PEDS but adequate for the SDQ. Results from known-group validity testing showed that the PEDS scores could be used to distinguish between the TD and DD samples. The results from this study provide further support for the use of the PEDS and SDQ in developing countries like India.

Motivations and Experiences of Teaching Assistants in a First-Year Integrated Medical Course

Peer teaching is used in many medical schools and is recognized as beneficial to the student teacher and learner. We surveyed a cohort of teaching assistants (TAs) in a first-year course to determine their motivations to serve as TAs and the perceived benefits. TAs served because they wanted to help, solidify their knowledge, and have an opportunity to teach. They perceived that their experience helped them develop their communication skills and encouraged them to pursue future teaching opportunities. This information will help in recruiting students into teaching and also in developing a standardized student-as-teacher program to foster the next generation of physician educators.

Development and Psychometric Evaluation of the Clinical Nursing Cultural Competence Scale

Background and Purpose: Cultural competence in clinical nurses can lead to comprehensive care for patients from different cultures. Currently, an appropriate instrument to assess cultural competence in clinical nurses is limited. This study aimed to design and determine the psychometric properties of the clinical nursing cultural competence scale (CNCCS). Methods: This methodological study was conducted in 2018-2019 in two phases. In the first phase, a literature review and semistructured interviews with 18 clinical nurses from Isfahan and Ahvaz were conducted, and the results were used for item generation. In the second phase, the face, content, construct validity, and reliability of the questionnaire were assessed. For construct validity assessment through exploratory factor analysis (EFA), 200 clinical nurses were purposefully recruited to fill out CNCCS. Results: In the first phase, 140 items were produced. In the second phase, the item number was reduced to 40 after the face and content validity assessment. In EFA for construct validity assessment, 13 more items were deleted, and the remaining 27 items were loaded on six factors. The Cronbach's alpha and the test-retest intraclass correlation coefficient were CNCCS 0.86 and 0.93, respectively. Conclusions: The CNCCS had acceptable psychometric characteristics in Iranian nurses and can be used for assessing cultural competence among clinical nurses. The use of this scale can help nursing policymakers and managers develop their understanding of nursing cultural competence and develop strategies for its improvement.

Translation and psychometric evaluation of the reflective capacity scale in Iranian medical education

BACKGROUND

Examining the reflective capacity in medical students is a principal step for the development of effective educational strategies to improve it. Reflection scales available in Iran are inadequate due to the lack of focus on students' willingness and tendency to participate in reflection. This study aimed at translation and psychometric evaluation of "Reflective Capacity Scale" in Iranian medical education.

METHODS

This methodological research was completed in two parts: translation and psychometric evaluation. After getting permission from the main developer of the tool, the translation process was done based on Polit and Yang model in Persian language. Then, face validity and content validity of the tool were established using a qualitative method. Construct validity was surveyed with exploratory and confirmatory factor analysis via completing the questionnaire by 320 medical students, who were selected using convenience sampling. The reliability of the tool was also checked with two methods of internal consistency and stability. The gleaned data were analyzed with SPSS20 and AMOS.

RESULTS

"Reflective Capacity Scale" includes 16 items that were retained after cross-cultural translation. Face validity and content validity were acceptable. By performing exploratory factor analysis, four factors were identified that accounted for 63.79% of the total variance. In the confirmatory factor analysis, the values of the fit indices confirmed the appropriate fit of the model. The internal consistency reliability of the whole tool was equal to 0.83 and the intra-class correlation coefficient was equal to 0.98.

CONCLUSION

The translated and validated "Reflective Capacity Scale" provides a robust tool for assessing reflective capacity among Iranian medical students. Its validity and reliability underscore its potential for measuring the reflective capacity of medical students.

Content validation of a mental wellness measuring instrument for adolescents living with HIV: a modified delphi study

A growing body of evidence suggests that improving the mental wellness of adolescents living with HIV (ALHIV) will also result in improved adherence to antiretroviral therapy (ART), as well as improving their general health and wellbeing as they age into adulthood. However, to develop effective strategies and interventions aimed at improving mental wellness, we require age and culturally appropriate instruments to build an evidence base. Currently, there is a lack of mental wellness measures developed for ALHIV, especially in the African context. To address this gap, we developed a measure of mental wellness following modified guidelines set out by DeVellis [1] and Godfred et al. as a guiding framework [2]; (1) Identifying the gap, (2) Set the theoretical foundations and identify domains and (3); Instrument development and initial validation. For the first two steps, we conducted a systematic review, photovoice study and integrative review - which we briefly describe as the findings have been published. Following this we describe the processes to develop the instrument and to establish content validity through a modified Delphi Study. Through this process we were able to refine the instrument which will be subject to further testing.Implications and Contribution: This study aims to add to the body of knowledge on promoting mental health (mental wellness) among adolescents living with HIV in South Africa through developing an appropriate and valid measure of mental wellness for this population. This study reports on the results of a Delphi Study aimed at improving the content validity of the instrument Mental Wellness Measure for Adolescents Living with HIV (MWM-ALHIV).

An update on mobility assessment of dogs with musculoskeletal disease

Mobility impairments associated with musculoskeletal diseases, such as osteoarthritis and degenerative joint disease, affect approximately 200,000 dogs annually and pose a notable challenge to canine health and welfare. Osteoarthritis causes the remodelling of synovial joints, alongside inflammation and impaired mechanical function which can be extremely debilitating. Secondary osteoarthritis commonly affects dogs and can be exacerbated by previous joint abnormalities, such as patellar luxation or cranial cruciate ligament rupture. Although musculoskeletal diseases can affect dogs of any age, the early subtle signs of gait abnormalities are perhaps missed by owners, thus, dogs may be in the latter stages of osteoarthritis progression when they are presented to veterinarians. Dogs showing subtle signs of gait abnormalities must be presented to veterinary practices for acute diagnosis to prevent long-term deterioration. Musculoskeletal diseases, such as osteoarthritis and degenerative joint disease, are commonly diagnosed via visible radiographic changes. However, veterinarians can use a combination of subjective and objective clinical scoring systems, such as clinical metrology instruments and gait assessment in conjunction with radiography to aid their diagnosis and longitudinal monitoring of musculoskeletal diseases. These scoring systems may be more sensitive to earlier signs of mobility impairments in dogs, ultimately, promoting increased canine health and welfare by enabling pain reduction, improvement of muscle strength and preservation of joint function. Current canine mobility scoring systems available to veterinarians will be discussed in turn throughout this review for implementation into clinical practice.

Translation and measurement properties of the pelvic floor distress inventory-short form (PFDI-20) in Iranian reproductive age women

BACKGROUND

Every year, millions of women worldwide suffer in silence from pelvic floor disorders (PFDs) as an annoying health problem. Despite the high prevalence rate and negative effects of PFDs on the quality of life, the validity and reliability of pelvic floor distress inventory-short form (PFDI-20) has not been confirmed for Iranian women of reproductive age. Hence, this study aimed to determine measurement properties of PFDI-20 among women of reproductive age in Tabriz, Iran.

METHODS

The current study was cross-sectional research that selected 400 women of reproductive age referring to health centers in Tabriz City, by using cluster random sampling from May 2022 to September 2022. Measurement properties of the Persian version of PFDI-20 were determined and evaluated through five steps, including content and face validity within two quantitative and qualitative parts, structural validity by using exploratory factor analysis (EFA) and confirmatory factor analysis (CFA), and reliability testing through internal consistency, test-retest reliability, and measurement error. Moreover, ceiling and floor effects were investigated.

RESULTS

In this research, CVI (content validity index) and CVR (content validity ratio) of PFDI-20 equaled 0.94 and 0.97, respectively. In addition, the EFA process was applied to 20 items and derived the structure of three factors, which explained 58.15% of the total variance. In CFA phase, values of fit indicators (RMSEA = 0.07, SRMR = 0.07, TLI = 0.97, CFI = 0.99, x2/df = 3.19) confirmed the model validity. To determine reliability, Cronbach's alpha = 0.84; McDonald's omega (95% CI) = 0.84 (0.82 to 0.87) and Intraclass Correlation Coefficient (95% CI) = 0.98 (0.97 to 0.99) were obtained. Also, the SEM was 2.64, and the SDC indicating the smallest individual change was 8.91. Regarding the inventory feasibility, the ceiling effect was not observed in total value and subscales, while the floor effect in the total score of PFDI-20 equaled 24.0. The latter rate equaled 45.8, 38.3, and 50.8 for subscales POPDI-6, CRADI-8, and UDI-6, respectively.

CONCLUSIONS

Persian version of PFDI-20 is a valid and reliable scale used to evaluate PFDs in Iranian women of reproductive age. Healthcare professionals can use this scale to screen PFDs, and researchers can consider it a reliable tool for their studies.

Assessment of the general public's knowledge of atrial fibrillation through social media: a cross-sectional study

BACKGROUND

Early detection and timely treatment of atrial fibrillation (AF) remains pivotal to preventing AF-related complications. Public involvement in recognising potential AF symptoms and managing AF is vital for early detection and treatment of AF.

OBJECTIVE

The aim of the study is to assess the general public's knowledge of AF using an online survey, disseminated via social media.

METHODS

A cross-sectional online survey of the general public was conducted between November to December 2021. The survey's URL was shared on National University Heart Centre, Singapore's official Facebook page. Digital marketing strategies were employed to recruit members of the public. The 27-item survey assessed public's knowledge across five domains: basic information about AF, risk factors of AF, detection of AF, prevention of AF, and management of AF.

RESULTS

The survey involved 620 participants. Approximately two-thirds were between the ages 21 to 40 years (64.5%), female (60%) and had at least a degree (64.7%) as their highest level of education. Participants obtained a mean percentage score of 63.3 ± 26.0 for their AF knowledge. One-way ANOVA was done to examine the associations between the participants' characteristics and their knowledge of AF. There were no statistically significant differences in the AF knowledge scores across the various sociodemographic subgroups.

CONCLUSIONS

Members of the public recruited from Facebook and via digital marketing had moderately good knowledge of AF. However, public awareness pertaining to preventing AF has potential for improvement. The utility of social media in reaching the general public was illustrated through this study.

Development of the Malay Language of understanding, attitude, practice and health literacy questionnaire on COVID-19 (MUAPHQ C-19): content validity & face validity analysis

OBJECTIVE

This study aimed to assess the content and face validity index of the development of the understanding, attitude, practice and health literacy questionnaire on COVID-19 (MUAPHQ C-19) in the Malay language.

METHODS

The development of the MUAPHQ C-19 was conducted in two stages. Stage I resulted in the generation of the instrument's items (development), and stage II resulted in the performance of the instrument's items (judgement and quantification). Six-panel experts related to the study field and ten general public participated to evaluate the validity of the MUAPHQ C-19. The content validity index (CVI), content validity ratio (CVR) and face validity index (FVI) were analysed using Microsoft Excel.

RESULTS

There were 54 items and four domains, namely the understanding, attitude, practice and health literacy towards COVID-19, identified in the MUAPHQ C-19 (Version 1.0). The scale-level CVI (S-CVI/Ave) for every domain was above 0.9, which is considered acceptable. The CVR for all items was above 0.7, except for one item in the health literacy domain. Ten items were revised to improve the item's clarity, and two items were deleted due to the low CVR value and redundancy, respectively. The I-FVI exceeded the cut-off value of 0.83 except for five items from the attitude domain and four from the practice domains. Thus, seven of these items were revised to increase the clarity of items, while another two were deleted due to low I-FVI scores. Otherwise, the S-FVI/Ave for every domain exceeded the cut-off point of 0.9, which is considered acceptable. Thus, 50-item MUAPHQ C-19 (Version 3.0) was generated following the content and face validity analysis.

CONCLUSIONS

The questionnaire development, content validity, and face validity process are lengthy and iterative. The assessment of the instruments' items by the content experts and the respondents is essential to guarantee the instrument's validity. Our content and face validity study has finalised the MUAPHQ C-19 version that is ready for the next phase of questionnaire validation, using Exploratory and Confirmatory Factor Analysis.

Development of an Instrument for the Assessment of Health-Related Multi-sectoral Resource Use in Europe: The PECUNIA RUM

BACKGROUND

Measuring objective resource-use quantities is important for generating valid cost estimates in economic evaluations. In the absence of acknowledged guidelines, measurement methods are often chosen based on practicality rather than methodological evidence. Furthermore, few resource-use measurement (RUM) instruments focus on the measurement of resource use in multiple societal sectors and their development process is rarely described. Thorn and colleagues proposed a stepwise approach to the development of RUM instruments, which has been used for developing cost questionnaires for specific trials. However, it remains unclear how this approach can be translated into practice and whether it is applicable to the development of generic self-reported RUM instruments and instruments measuring resource use in multiple sectors. This study provides a detailed description of the practical application of this stepwise approach to the development of a multi-sectoral RUM instrument developed within the ProgrammE in Costing, resource use measurement and outcome valuation for Use in multi-sectoral National and International health economic evaluAtions (PECUNIA) project.

METHODS

For the development of the PECUNIA RUM, the methodological approach was based on best practice guidelines. The process included six steps, including the definition of the instrument attributes, identification of cost-driving elements in each sector, review of methodological literature and development of a harmonized cross-sectorial approach, development of questionnaire modules and their subsequent harmonization.

RESULTS

The selected development approach was, overall, applicable to the development of the PECUNIA RUM. However, due to the complexity of the development of a multi-sectoral RUM instrument, additional steps such as establishing a uniform methodological basis, harmonization of questionnaire modules and involvement of a broader range of stakeholders (healthcare professionals, sector-specific experts, health economists) were needed.

CONCLUSION

This is the first study that transparently describes the development process of a generic multi-sectoral RUM instrument in health economics and provides insights into the methodological aspects and overall validity of its development process.

The development of an instrument to measure interprofessional collaboration competency for primary care teams in the district health system of health region 2, Thailand

BACKGROUND

Evidence shows that interprofessional collaboration (IPC) practice contributes to the quality of health care. However, there are limited instruments to assess IPC in providing primary care in the district health system (DHS) in Thailand. The aim of this study is to develop a valid and reliable instrument to assess the IPC competency of primary care team members in DHSs.

METHODS

This study was designed as an exploratory mixed methods study. In the qualitative phase, 37 participants, including policymakers, practitioners, and academics with experience in primary care, were involved. Data were analysed using thematic analysis, and trustworthiness was verified by triangulation and peer debriefing. In the quantitative phase, content validity, exploratory factor analysis (EFA), confirmatory factor analysis (CFA), and reliability were conducted, and the final version of the questionnaire was evaluated with 497 participants.

RESULTS

The findings showed an I-CVI range of 0.86-1.00 and S-CVI/UA = 0.87 for 49 items with a 5-point Likert scale. EFA suggested six factors: 1) collaborative teamwork, 2) population- and community-centred care, 3) communication and mutual respect, 4) clarification of roles and responsibilities, 5) interprofessional reflection, and 6) interprofessional values and mixed skills. In the CFA results, the model fit indices were acceptable (CFI = 0.99, RMSEA = 0.049, SRMR = 0.043) or slightly less than the goodness-of-fit values (GFI = 0.84). All subscales showed acceptable Cronbach's alpha values with a range of 0.86-0.94.

CONCLUSIONS

The developed IPC competency instrument was confirmed its validity and reliability that contributes to assessing the IPC competency of primary care teams in DHSs. This information provides evidence to support tailored intervention to promote the IPC competency of primary care team work to achieve a common goal.

Quality in Psychiatric Care in the Community Mental Health Setting from the Perspective of Patients and Staff

The current paradigm of mental health care focuses on care provided in the community, increasingly moving away from hospital care models that involve considerable economic burden. Patient and staff perspectives on the quality of psychiatric care can highlight strengths and areas for improvement to ensure better care provision. The aim of this study was to describe and compare perceptions of quality of care among patients and staff in community mental health services and to determine possible relationships between these perceptions and other study variables. A comparative cross-sectional descriptive study was conducted in a sample of 200 patients and 260 staff from community psychiatric care services in the area of Barcelona (Spain). The results showed high overall levels of quality of care from patient (m = 104.35 ± 13.57) and staff (m =102.06 ± 8.80) perspectives. Patients and staff both gave high scores to Encounter and Support factors, while factors concerning patient Participation and Environment received the lowest scores. Continuous assessment of the quality of psychiatric care in the community setting is essential to ensure the highest quality of care, taking the perspectives of those involved into account.

Asking the Experts: Using Cognitive Interview Techniques to Explore the Face Validity of the Mental Wellness Measure for Adolescents Living with HIV

There has been an increased focus on the mental health of adolescents living with HIV (ALHIV), because evidence shows that poor mental health outcomes are associated with lower rates of adherence and retention in HIV care. However, the research to date has predominantly focused on addressing mental health problems and reducing symptoms of mental illness rather than strengthening mental wellness [positive mental health]. Consequently, little is known about the critical mental wellness indicators that should be targeted in services for ALHIV. There is a need for valid and appropriate measures of mental wellness to drive research and provide evidence on the mental wellness needs of ALHIV that would inform service delivery as well as the monitoring and evaluation of treatment outcomes. To this end, we developed the Mental Wellness Measure for Adolescents Living with HIV (MWM-ALHIV) for ALHIV in the South African context. In this paper, we report on the findings from a cognitive interview study with nine ALHIV aged 15-19 years receiving treatment at a public healthcare facility in the Cape Metropole, South Africa. Through interviews, participants identified key issues related to the wording, relevance and understanding of the items and provided suggestions to improve the instrument's overall face validity.

Home-Based Pilot Intervention to Improve Quality of Life and Related Outcomes among Unpaid Caregivers and Their Care-Recipients with Visual Impairments

The increasing lifespan of the United States population has led to a rise in the prevalence of age-related chronic diseases, increasing the need for unpaid caregivers. Currently, little research is known about this specific population beyond the limited formal training unpaid caregivers receive on the caregiving process. Acquiring visual impairments (VI) later in life places a large emotional toll on both the loved one and their caregivers. The objectives of this pilot study were: (1) to implement a multimodal intervention targeted towards improving the quality of life of unpaid caregivers and their care recipients with visual impairments; (2) to evaluate the efficacy of the multimodal intervention in improving the quality of life of unpaid caregivers and their care recipients with visual impairments. A 10-week virtual intervention (e.g., tai chi, yoga, music) was implemented with 12 caregivers and 8 older adults with VI. The targeted outcomes of interest included: QoL, health, stress, burden, problem-solving, and barriers. In addition to surveys to inform the choice of the intervention, focus group interviews were conducted to obtain participants' perspectives on the effectiveness of the intervention. Results revealed many positive outcomes in the quality of life and well-being of the participants following the 10-week intervention. Overall, these results represent a promising program for unpaid caregivers of older adults with VI.

From the ground up: assessing the face validity of the Quality of Life – Aged Care Consumers (QOL-ACC) measure with older Australians

Purpose

This paper aims to assess the face validity to inform content validity of the Quality of Life – Aged Care Consumers (QOL-ACC), a new measure for quality assessment and economic evaluation in aged care.

Design/methodology/approach

Semi-structured interviews were conducted with older adults (66–100 years) receiving aged care services at home (n = 31) and in residential care (n = 28). Participants provided feedback on draft items to take forward to the next stage of psychometric assessment. Items were removed according to several decision criteria: ambiguity, sensitive wording, not easy to answer and/or least preferred by participants.

Findings

The initial candidate set was reduced from 34 items to 15 items to include in the next stage of the QOL-ACC development alongside the preferred response category. The reduced set reflected the views of older adults, increasing the measure’s acceptability, reliability and relevance.

Originality/value

Quality of life is a key person-centred quality indicator recommended by the recent Royal Commission into Aged Care Quality and Safety. Responding to this policy reform objective, this study documents a key stage in the development of the QOL-ACC measure, a new measure designed to assess aged care specific quality of life.

Development and psychometric testing of a clinical reasoning rubric based on the nursing process

BACKGROUND

To facilitate the development of clinical reasoning skills in nursing students, educators must possess the ability to teach and evaluate them. This study aimed to describe the development and validation process of an analytic rubric of clinical reasoning skills based on the nursing process in undergraduate nursing students.

METHODS

A seven-step method was used for rubric development. The initial validation process of the rubric of clinical reasoning was performed with the participation of key stakeholders to assess its face and content validity as well as applicability in the classroom and bedside. An initial pilot test was performed based on scenario-based examinations in the nursing process training course so that convergent validity was used to show how closely the new scale is related to the previous measure for evaluating students' tasks. Internal consistency and inter-rater correlation coefficient measurement for reliability were assessed.

RESULTS

The rubric to assess clinical reasoning skills was developed into eight categories according to the five stages of the nursing process. Content and face validity of the rubric were done qualitatively and resulted in a clear, simple rubric relevant to clinical reasoning skills assessment. The convergent validity was confirmed by the conventional method. The reliability was approved by a high inter-rater correlation coefficient based on the assessment by two random independent raters.

CONCLUSION

The clinical reasoning meta-rubric developed in this study meets the purpose of the study. This analytical rubric can be applied to guide teaching and learning as well as evaluate clinical reasoning based on the findings. Testing the applicability confirmed its validity and reliability for assessing clinical reasoning skills in nursing process education during the undergraduate nursing program.

Translation and psychometric evaluation of the persian version of the "Nursing Profession Self-Efficacy Scale"

BACKGROUND

Self-efficacy demonstrates the general competence of nurses in providing nursing care. Evaluation of nurses' self-efficacy is of particular importance to improve nursing care. The existing self-efficacy scales in Iran are insufficient due to lack of focus on the specific issues of the nursing profession. This study was conducted with the aim of translating and psychometrically evaluating the Persian version of "Nursing Profession Self-Efficacy Scale" (NPSES).

MATERIALS AND METHOD

This cross-sectional study was conducted in two parts: translation and psychometric evaluation. After getting permission from the original developer of the scale, the process of translating the questionnaire into Persian was done based on the Polit and Yang model. Then, the face validity was explored using a qualitative method with the participation of 10 nurses. The content validity was investigated using a qualitative and quantitative method (content validity index) with the participation of 15 experts. Construct validity was surveyed with exploratory and confirmatory factor analysis via completing the questionnaire by 550 nurses worked in different wards of hospitals affiliated to Shahid Sadoughi University of Medical Sciences, Yazd/Iran, who were selected using convenience sampling. The reliability of the tool was also established with internal consistency and stability methods, with the participation of 30 nurses. SPSS20 and AMOS were used for data analysis.

RESULTS

"Nursing Profession Self-Efficacy Scale" includes 19 items for which the translation and cultural compatibility of the Persian version were confirmed. Face validity and content validity (SCVI/Ave = 0.9) were acceptable. By conducting exploratory factor analysis, three factors (professional situation, care situation, and support situation) were identified, which accounted for 62.38% of the variance of the scores. In the confirmatory factor analysis, the values of the fit indices confirmed the appropriate fit of the model. The reliability was established using Cronbach's α method (α = 0.86) and an ICC of 0.83, indicating that the scale was reliable.

CONCLUSION

The translation, validity, and reliability of the Persian version of "Nursing Profession Self-Efficacy Scale" suggested that this tool has a clear and legitimate translation. Also, this tool has good validity and reliability and can be used as one of the tools to measure the self-efficacy of Iranian nurses.

Validity and reliability of the Persian version of the Short-Form Adolescent Health Promotion scale: Methodological study

Background and Aim

Assessing health promotion among adolescents is vital to identify healthy and unhealthy behaviors and to evaluate health promotion interventions. This study aimed to determine the validity and reliability of the Persian version of the Short-Form Adolescent Health Promotion scale.

Methods

Three hundred and twenty-seven adolescents were recruited through a multistage sampling method in this methodological study. The original version of the Adolescent Health Promotion scale was translated from English to Persian using the Backward-Forward translation protocol. Then, the scale's validity and reliability, including the face, content, construct validity, and reliability indices, were evaluated. The statistical analysis was performed using SPSS software version 24.

Results

The mean CVI and CVR were 0.99. The exploratory factor analysis revealed four factors covering 42.57% of the total variance. The factor loading order of the items did not exactly correspond to the order obtained in the English version of the scale's validity and reliability analysis. The obtained factors called included: life appreciation, stress management, nutrition, and health responsibility. In the current study, both Cronbach's ɑ and the intraclass correlation coefficient were calculated at 0.84 and 0.99.

Conclusion

The Persian version of the Adolescent Health Promotion scale developed in the present study is acceptable for the validity of the content, face, and reliability. However, the construct validity of this scale should be checked in other samples.

Implementation Leadership in the Point of Care Nursing Context: A Systematic Review Comparing Two Measurement Tools

Introduction

Implementation leadership (IL) are effective point of care (POC) nursing leadership behaviors that facilitate contexts conducive to the successful implementation of evidence-based practices (EBPs). However, no systematic evaluation of IL tools validated for the nursing context existed.

Aims

The purpose of this systematic review was to compare iterations of two IL measurement tools, the Implementation Leadership Scale (ILS) and the iLEAD, for application in a nursing context; and to critically appraise and summarize the methodological quality of studies assessing their psychometric properties.

Methods

A comprehensive search was conducted in four databases. Two reviewers independently screened titles and abstracts, reviewed full-text articles, and performed extraction into data tables. Statisticians appraised the quality control aspects. Findings were narratively summarized.

Results

A total of 247 records were included, where 10 for the ILS (including different versions) and one for the iLEAD met the inclusion criteria. Three studies evaluated the psychometric properties of the ILS in nursing, and its translations into Chinese and Greek. Content validity was deemed to be doubtful for both tools, but the ILS had adequate rating for comprehensiveness; methodological quality was very good for structural validity, internal consistency, hypothesis testing, and responsiveness where applicable for both scales, with the exception of cross-cultural validity which had ratings of adequate and inadequate for versions of the scales. Several study findings met the criteria for good measurement properties. No studies for either tool formally assessed feasibility.

Conclusion

Applying validated and contextually relevant tools to evaluate the capacity of nursing leadership to engage in IL in real-world contexts are needed. The ILS shows promise but requires further validation for contexts with diverse and multiple nursing leaders at the POC. Feasibility needs to be further studied.

Applicable of teledentistry and digital platforms during the COVID-19 pandemic among dentists in Fiji: A qualitative study

Objectives

This research aims to explore the perception of dental officers (DOs) and dental managers (DMs) on the use of teledentistry and digital platforms during the COVID-19 pandemic in Fiji.

Methods

This qualitative study was conducted among 30 DOs and 17 DMs. The study was conducted in private dental clinics, government dental clinics and the School of Dentistry and Oral Health clinic (SDOH), in the Central Division, Fiji that were selected randomly. The participants were selected using the purposive sampling method using the inclusion and exclusion criteria. Data was collected through in-depth interviews via zoom using a self-developed semi-structure open-ended interview questionnaire. Manual thematic analysis of the data was conducted.

Results

Five themes emerged from data analysis: utilization of teledentistry and media during the pandemic, usefulness of teledentistry, confidence with teledentistry and digital platforms-associated risks, digital platforms for record keeping, and teledentistry promotion and training. Teledentistry was mostly utilized by private practitioners and the oral surgery department. Practitioners were not in favour of teledentistry as they thought it was putting them at risk.

Conclusion

Majority of DOs and DMs were not utilizing teledentistry except for a few private dental practitioners and the oral surgery department. Future research can be conducted in other divisions and include other healthcare professionals.

Drug Testing Practices and Policies of Labor and Delivery Units Across the Southeastern United States

OBJECTIVE

To describe drug testing practices used in labor and delivery units in seven southeastern U.S. states (Alabama, Georgia, Florida, Mississippi, North Carolina, South Carolina, and Tennessee), determine what risk factors prompt drug testing, and determine whether selective policies or factors that prompt testing differ based on hospital characteristics (type, size, or predominant payer source).

DESIGN

Cross-sectional descriptive design.

SETTING

Labor and delivery units in seven southeastern U.S. states.

PARTICIPANTS

Nurse administrators of labor and delivery units (N = 49) who responded for their units.

METHODS

We used a purposive sampling technique to construct a database of hospitals with obstetric services and e-mail addresses for nurse administrators. We created a 35-item survey to collect hospital characteristics and drug testing policy information. We distributed the survey to 291 nurse administrators.

RESULTS

We received 49 responses (response rate = 16.8%). Respondents reported that 63% (31/49) of hospitals were not-for-profit, 87% (40/46) had Medicaid as the predominant payer source, 80% (37/46) had a formal perinatal drug testing policy, and 61% (30/49) used selective drug testing protocols. Current or past history of substance use was reported as the risk factor that most often prompted drug testing. We did not find any differences in hospital characteristics (type, size, or predominant payer source) that prompted testing.

CONCLUSION

Most respondents reported that their labor and delivery units had a written drug testing policy and often used selective drug testing protocols. Drug testing protocols did not differ based on hospital type, size, or predominant payer source. Nurses have a role in implementing a best practice with unit-based drug testing.

Trust and Commitment in the Inter-Organizational Relationship Life Cycle

Purpose: The complex nature of inter-organizational relationships can be reflected in the number, level, and changes of their features. Focusing on two essential features of relationships – trust and commitment – we explore how they change in the particular phase of the relationship life cycle. Design/methodology/approach: Using the existing findings from a systematic literature review on IOR features, we aimed to qualitatively verify the changes over the time of two crucial relational characteristics – trust and commitment. Next, using a quantitative surveying, we tested the changeability of these two on a large-scale sample (786) from the software industry in Poland. Findings: With strong empirical support, we found the level of trust and commitment intensity as changing in a non-linear manner through the relationship life cycle. Logically, they both increase across the initial, development, and maintenance phases, while in the termination phase they decline. However, the results show that they can rise when the relationship is reactivated. Research limitations/implications: Due to the industry and cultural-specific limitations, comparative studies on several industries in cross-cultural conditions are recommended. We need further research on a holistic view of relationship characteristics and their changeability through the relationship life cycle. Furthermore, the validity of the cyclical treatment of relationship dynamics is worth reviewing. Originality/value: We investigate the significance of trust and commitment in inter-organizational relationship development using a mixed research approach. Additionally, as a methodological contribution, this article offers the operationalization and measurement of the above-mentioned features.

Firefighters' Health Knowledge, Cardiovascular Disease Risk Factors, and Sociodemographic Characteristics as Predictors of Firefighters Attitudes Toward Health

OBJECTIVE

The aim of the study is to determine the predictors of firefighters' attitudes toward health based on firefighters' knowledge cardiovascular disease (CVD) risk factors and sociodemographic characteristics.

METHODS

The study used a web-based cross-sectional, descriptive, and correlational research design. Convenience sampling was used to recruit 110 firefighters, males, and females, aged 18 to 65 years.

RESULTS

Firefighters' health knowledge, age group 30 to 39 years, and having CVD risk factors present were significant predictors of firefighters' attitudes toward regular aerobic exercise ( P < 0.05). Firefighters' health knowledge was a significant predictor of firefighters liking exercise to look physically fit, and health knowledge and the age group 20 to 29 and 30 to 39 years were significant predictors of firefighters liking exercise to be fit for firefighting ( P < 0.05).

CONCLUSIONS

Health knowledge, age group, years of experience, and having CVD risk factors present were significant predictors of firefighters' attitudes toward health.

An Evaluation of the Overall Utility of Measures of Functioning Suitable for School-Aged Children on the Autism Spectrum: A Scoping Review

A diagnosis of an autism spectrum condition (autism) provides limited information regarding an individual's level of functioning, information key in determining support and funding needs. Using the framework introduced by Arksey and O'Malley, this scoping review aimed to identify measures of functioning suitable for school-aged children on the autism spectrum and evaluate their overall utility, including content validity against the International Classification of Functioning, Disability and Health (ICF) and the ICF Core Sets for Autism. The overall utility of the 13 included tools was determined using the Outcome Measures Rating Form (OMRF), with the Adaptive Behavior Assessment System (ABAS-3) receiving the highest overall utility rating. Content validity of the tools in relation to the ICF and ICF Core Sets for Autism varied, with few assessment tools including any items linking to Environmental Factors of the ICF. The ABAS-3 had the greatest total number of codes linking to the Comprehensive ICF Core Set for Autism while the Vineland Adaptive Behavior Scales (Vineland-3) had the greatest number of unique codes linking to both the Comprehensive ICF Core Set for Autism and the Brief ICF Core Set for Autism (6-16 years). Measuring functioning of school-aged children on the spectrum can be challenging, however, it is important to accurately capture their abilities to ensure equitable and individualised access to funding and supports.

Improving the Physical Health of Psychiatric Hospital Residents: An Evaluation of an Obesity Education Program for Mental Health Professionals

Background: People living with mental health disorders are at increased risk for developing obesity due to poor diet, physical inactivity, and antipsychotic medications. In the United States, the obesity rate is 36% in the general population and more than 50% for people living with mental health disorders. Although mental health clinicians concentrate on managing psychiatric disorders, they seldom recognize the gradual increase in body mass index of their patients. The result is a disconnection between the clinical management of psychiatric disorders and the medical management of obesity. Purpose: This study assessed the effectiveness of an evidence-based education program for improving the obesity management practices of mental health clinicians caring for residents at a state psychiatric hospital. Methods: This was a quasi-experimental study design with a pretest and posttest evaluation. Convenience sampling was used to recruit mental health professionals, or clinicians, at a large psychiatric hospital in the Southern region of the United States. Data was collected with the Advising and Treating Overweight and Obese Patient questionnaire (17 items). Data analysis included descriptive and inferential statistics. The findings were reported in accordance with the TREND and GREET guidelines. Results: The education program was completed by 50 MHCs. The pretest indicated that 76% of MHCs were not involved in helping obese residents manage their weight, but the posttest indicated 90% were involved. There was a significant increase in MHC knowledge about obesity management and reported actions 90-days after the program. MHCs were unable to arrange follow-up visits for residents, a task not directly within their control. Conclusions: Mental health clinicians reported increased knowledge and improved clinical practice after an education program. Because the outcomes were reported at 90-days after the program, further research needs to evaluate the longitudinal impact of this type of program, where the reported behaviors are correlated to process and clinical outcome measures for obesity.

Development and psychometric properties of the hospitalized elder abuse questionnaire (HEAQ): a mixed methods study

BACKGROUND

Older patients are more vulnerable and prone to abuse and neglect in hospitals and acute care settings. The present study aimed to develop and assess the psychometric properties of a questionnaire for screening abuse in hospitalized older adults.

METHODS

This study was conducted from October 2017 to September 2019 using the exploratory sequential mixed-methods research design. The participants were selected among those admitted to various wards of six teaching hospitals affiliated with Shiraz University of Medical Sciences, Shiraz, Iran. In the qualitative phase of the study, using the inductive content analysis method, the concept of abuse in hospitalized older adults was extracted through individual in-depth semi-structured interviews with 16 older patients and 11 family caregivers. Based on qualitative findings and a review of existing literature, an initial version of the questionnaire was developed. In the quantitative phase of the study, the psychometric properties (face, content, construct, and convergent validity; internal consistency and stability) of the questionnaire were examined.

RESULTS

Based on qualitative findings and literature review, a pool of 154 candidate items was defined. These items were reduced to 37 after initial refinement, qualitative and quantitative face and content validity, and item analysis. The outcome of principal component analysis further reduced the number of items to 27, which were grouped into 5 components, namely "Shortcomings in management and care facility", "Neglect of professional commitments", "Physical and psychological abuse", "Protracted treatment process", and "Invasion of privacy". The explained variance of these 5 components was 50.09% of the overall variability of the questionnaire. The convergent validity of the questionnaire was acceptable (P < 0.00, r = - 0.44). Cronbach's alpha coefficient and intraclass correlation coefficient for the entire questionnaire were 0.89 and 0.92, respectively; indicating high reliability and stability of the questionnaire.

CONCLUSION

The hospitalized elder abuse questionnaire (HEAQ) has acceptable psychometric properties. It is recommended to use HEAQ to screen for suspected cases of abuse of hospitalized older adults.

Community Engagement and Psychometric Methods in Aboriginal and Torres Strait Islander Patient-Reported Outcome Measures and Surveys-A Scoping Review and Critical Analysis

(1) Background: In healthcare settings, patient-reported outcome measures (PROMs) and surveys are accepted, patient-centered measures that provide qualitative information on dimensions of health and wellbeing. The level of psychometric assessment and engagement with end users for their design can vary significantly. This scoping review describes the psychometric and community engagement processes for PROMs and surveys developed for Aboriginal and Torres Strait Islander communities. (2) Methods: The PRISMA ScR guidelines for scoping reviews were followed, aimed at those PROMs and surveys that underwent psychometric assessment. The Aboriginal and Torres Strait Islander Quality Appraisal Tool and a narrative synthesis approach were used. (3) Results: Of 1080 articles, 14 were eligible for review. Most articles focused on a validity assessment of PROMs and surveys, with reliability being less common. Face validity with Aboriginal and Torres Strait Islander communities was reported in most studies, with construct validity through exploratory factor analyses. Methodological design risks were identified in the majority of studies, notably the absence of explicit Indigenous knowledges. Variability existed in the development of PROMs and surveys for Aboriginal and Torres Strait Islander communities. (4) Conclusions: Improvement in inclusion of Indigenous knowledges and research approaches is needed to ensure relevance and appropriate PROM structures. We provide suggestions for research teams to assist in future design.

The Test-Retest Reliability of the Pieterse Protocol Return to Flight Assessment for Cabin Crew

INTRODUCTION: The purpose of this study was to assess test-retest reliability of the Pieterse return to flight duty protocol for cabin crew to return to flight duties.METHOD: Flight attendants between 20–50 yr old were included if they underwent rehabilitation at the musculoskeletal rehabilitation unit for a musculoskeletal injury, surgical treatment for orthopedic trauma or industrial injuries, and were assessed by the treating physical therapist and aviation medical examiner to be ready for return to work. Test-retest reliability was calculated with the Fleiss kappa coefficient.RESULTS: Included were 18 flight attendants (10 men, 34.9 ± 6.3 yr; 8 women, 34.2 ± 3.4 yr). Eight participants were rehabilitated following upper extremity injury, eight following lower extremity, and two following both upper and lower extremity injury. Perfect test-retest reliability was observed for nine items; kappa values above 0.9 were observed for three items; one item had a kappa value above 0.8 and two items had a kappa value of 0.78. The results for all 15 items were highly significant, demonstrating that the Fleiss kappa coefficients were significantly different from zero. The kappa coefficient strength of agreement was almost perfect for 13 and substantial for the remaining 3 items. Overall test-retest reliability was 0.95.DISCUSSION: This study demonstrated almost perfect test-retest reliability for 13 items and substantial reliability for two items, with an overall test-retest reliability of 0.95 for a return to flight assessment for flight attendants. The Pieterse protocol is a reliable tool to establish return to work for cabin crew.Hohmann E, Tetsworth K, Pieterse R. The test-retest reliability of the Pieterse protocol return to flight assessment for cabin crew. Aerosp Med Hum Perform. 2022; 93(7):551–556.