Evaluation of methods used for estimating content validity

King's Parkinson's Disease Pain Scale (KPPS): Cross-cultural adaptation to Brazilian Portuguese and content validity

Pain is one of the most common and troublesome non-motor symptoms of Parkinson's disease (PD). The King's Parkinson's Disease Pain Scale (KPPS) is the first scale of its kind to evaluate the burden and characterization of various phenotypes of pain in individuals with PD. The purpose of this study was to adapt the KPPS to Brazilian culture and to assess its content validity using the Delphi method. The process of adapting the original instrument to the Brazilian context occurred in six stages according to international standards. Following the pilot tests with individuals with PD, the pre-final version of the KPPS-Brazil was developed and submitted to judges to assess content validity. Three evaluation rounds were conducted, in which several corrections and changes suggested by the judges were accepted. The Content Validity Index (CVI) was calculated to determine the judges' degree of agreement. The results demonstrated that the KPPS-Brazil showed a quite satisfactory level of semantic, idiomatic, cultural, and conceptual equivalence. The judges' opinion showed adequate content validity for all of the KPPS-Brazil items and the scale. The use of the KPPS-Brazil will enable an adequate assessment of pain in individuals with PD, contributing to clinical practice and research.

Healthcare professionals' knowledge, attitudes and practices toward deprescribing: a protocol of cross-sectional study (Desmedica Study-Brazil)

BACKGROUND

Deprescribing is the planned and supervised process of dose reduction or stopping of medication that might be causing harm, or no longer be of benefit. It is an activity that should be a normal part of care/the prescribing cycle. Although now broadly recognised, there are still challenges in its effective implementation.

OBJECTIVES

To develop and validate an instrument to measure Brazilian healthcare professionals' knowledge, attitudes and practices towards deprescribing.

METHODS

This study will include the following steps: (1) development of the preliminary instrument; (2) content validation; (3) pilot study; (4) evaluation of psychometric characteristics. After the elaboration of items of the instrument through the literature review, we will use a hybrid Delphi method to develop and establish the content validity of the instrument. Further, a pilot survey will be performed with 30 healthcare professionals. Finally, for the evaluation of psychometric characteristics, a cross-sectional study will be accomplished with a representative sample of different healthcare professionals from different Brazilian states using respondent-driven sampling. Exploratory factor analysis and confirmatory factor analysis will be performed. For assessing the model fit, we will use the ratio of χ² and df (χ²/df), comparative fit index, the goodness of fit index and root mean square error of approximation. In addition, the reliability of the instrument will be estimated by test-retest reproducibility and Cronbach's alpha coefficient (α).

ETHICS AND DISSEMINATION

The Ethics Committee for Research at the University of Sorocaba (ethics approval number: 3.848.916) approved the study. Study findings will be circulated to healthcare professionals and scientists in the field through publication in peer-reviewed journals and conference presentations.

Development of an International Standardized Curriculum for Laparoscopic Sleeve Gastrectomy Teaching Utilizing Modified Delphi Methodology

BACKGROUND

The performance of laparoscopic sleeve gastrectomy has increased markedly to become the single-most performed bariatric surgical procedure globally. To date, a means of standardized trainee teaching has not been developed. The aim of this study was to design a laparoscopic curriculum for trainees of bariatric surgery utilizing modified Delphi consensus methodology.

METHODS

A panel of surgeons was assembled to devise an academic framework of technical, non-technical and cognitive skills utilized in the performance of laparoscopic sleeve gastrectomy. The panel invited 18 bariatric surgeons experienced in laparoscopic gastrectomy from 11 countries to rate the items for inclusion in the curriculum to a predefined level of agreement.

RESULTS

A consensus of experts was achieved for 24 of the 30 proposed elements for inclusion within the first round of the curriculum Delphi panel. All components pertaining to anatomical knowledge, peri-operative considerations and non-technical items were accepted. A second round further examined six statements, of which three were accepted. Agreement of the panel was reached for 27 of the cognitive, technical and non-technical components after two rounds. Three statements found no consensus.

CONCLUSIONS

Utilizing modified Delphi methodology, a curriculum outlining the most important components of teaching the procedure of laparoscopic sleeve gastrectomy, has been determined by a consensus of international experts in bariatric surgery. The curriculum is suggested as a standard in proficiency-based training of this procedure. It forms a generic template which facilitates individual jurisdictions to perform content validation, adapting the curriculum to local requirements in teaching the next generation of bariatric surgeons.

Assessing Medication Adherence Barriers to Short-Term Oral Antibiotic Treatment in Primary Care-Development and Validation of a Self-Report Questionnaire (BIOTICA)

Background: Pharmacists are increasingly involved in strategies to fight antimicrobial resistance by ensuring optimised antibiotic (AB) use, including adherence support. Successful adherence interventions should be tailored to patients’ barriers and validated instruments are needed. This study aimed to identify adherence barriers to AB treatment, develop a self-report questionnaire, and validate it in outpatients. Method: Adherence barriers were identified through a systematic literature search and focus group discussion. Unmodifiable and irrelevant barriers were excluded from further processing. A validation study assessed the questionnaire’s internal reliability and construct validity by comparing the questionnaire’s score with electronically monitored adherence data. Results: A 15-item questionnaire was created. Overall, 68 patients were included in the construct validation analysis (60.3% female). The mean consecutive taking adherence was 88% and the most frequently reported barriers were “worries about side-effects” (37%) and “having swallowing difficulties” (19%). Three items were excluded from the questionnaire, which was supported by an increase of Cronbach’s alpha (0.69 to 0.70). The 12-item version’s score correlated significantly with medication adherence rate (r = −0.34, p < 0.01). Conclusion: The self-report questionnaire is a reliable and valid tool to pre-emptively assess adherence barriers in outpatients prescribed ABs. In the future, appropriate adherence interventions can be matched to barriers and tested in a pilot intervention study.

Medication errors in homecare setting: An Italian validation study

OBJECTIVE

Medication errors are a concern in overall the world. Although there are studies that investigate what may be the main causes that lead to the genesis of the medication error in the home care setting, there is no tool that correlates knowledge, attitudes, and behavior to medication errors in the context of home care. This study aimed to psychometrically test to the questionnaire on knowledge, attitudes, and behaviors in the administration of medication in the new setting: home care setting.

DESIGN

This observational study was reported according to the STROBE checklist.

SAMPLE

Sixty two nurses working in home care setting responded to the online survey.

MEASUREMENT

The face and content validity of the items generated was assessed. An Exploratory Factorial Analysis descriptive statistical analysis was conducted. The final questionnaire is composed of 20 items.

RESULTS

The results of the statistical analyses allowed to validate the questionnaire, ensuring good internal consistency and reliability. Most of the sample pointed out that the use of electronic health record, medication reconciliation and the pharmacist's figure are all useful strategies for reducing the risk of medication errors.

CONCLUSION

The questionnaire is reliable to measure knowledge, attitude, and behavior about medication errors prevention in home care settings.

Is it Possible to Assess the Two-Domain Definition of the Broad Autism Phenotype Using the Available Measurement Tools?

Although, the operationalization of the autism spectrum disorder has been updated around two domains, the broad autism phenotype (BAP) one has not. Additionally, the items of the three common BAP measures, the Broad Autism Phenotype Questionnaire (BAPQ), the Autism Quotient, and the Social Responsiveness Scale (SRS), remain organized around a non-consensual number of factors. We explored whether the items of these measures matched with the two-domain operationalization through a parallel analysis, which has suggested two main components, and two expert judgments which have assessed item wording, relevance, and construct representativeness. A remaining pool of 48 BAP-relevant items suggested a possible under-representation of two subdomains. Despite the relevance of all the BAPQ items, only the SRS ones tapped in all subdomains.

Cross-cultural and psychometric property assessment of the Moorong Self-Efficacy Scale in Chinese patients with spinal cord injury

PURPOSE

To translate the Moorong Self-Efficacy Scale (MSES) into Chinese and to examine its reliability and validity in patients with spinal cord injury (SCI).

METHODS

A cross-sectional study design was employed. The MSES was translated into Chinese by forward- and back-translation and its psychometric properties were examined among 176 patients with SCI recruited from four rehabilitation centers in China using convenience sampling.

RESULTS

In this study, all 176 patients were aged from 18 to 90 years old with an average of 39.51 ± 14.07. The content validity index of the scale was 0.99. Principal components analysis with varimax orthogonal rotation was used. Three factors were extracted accounting for 39.083%, 11.149%, and 8.391% of the total variance and labeled as general self-efficacy (eight items), social self-efficacy (five items), and self-management self-efficacy (three items). Confirmatory factor analysis showed acceptable fit compared with previous studies. Pearson's correlation coefficient between the total scores of the MSES and the General Self-Efficacy Scale was 0.660 (p < 0.001). Cronbach's α coefficient was 0.892 for total items and 0.862, 0.817, and 0.739 for the three factors. The interclass correlation coefficients between the pretest and retest were 0.859 (0.733-0.925) for the total score.

CONCLUSIONS

The Chinese version of the MSES is reliable and valid, suggesting that it is suitable for evaluating self-efficacy of Chinese patients with SCI.Implications for rehabilitationThe satisfactory reliability and validity of the Chinese version of the Moorong Self-Efficacy Scale (MSES) confirmed its suitability as a tool to measure self-efficacy among Chinese patients with spinal cord injury (SCI).The Chinese version of the MSES could be used to reflect the important and specific aspects of self-efficacy in patients with SCI such as self-care, social interaction, and daily activities, and to help medical stuff giving more targeted intervention.

Promoting critical thinking in an online, project-based course

Education institutions are expected to contribute to the development of students' critical thinking skills. Due to COVID-19, there has been a surge in interest in online teaching. The aim of this study is therefore to design a strategy to promote critical thinking in an online setting for first year undergraduates. An intervention was carried out with 834 students at an engineering school; it comprised five activities designed to develop critical thinking. Both the control and experimental groups worked with a project-based learning strategy, while the experimental group was provided with scaffolding for a socially shared regulation process. All students answered an identical pre- and post-test so as to analyze the impact on critical thinking. Both strategies performed significantly better on the post-test, suggesting that online project-based learning improves critical thinking. However, following a socially shared regulation scaffolding led to a significantly greater improvement. In this sense, the socially shared regulation scaffolding provided to the experimental group proved to be key, while feedback was also an important element in the development of critical thinking. This study shows that online project-based learning fosters the development of critical thinking, while providing a socially shared regulation scaffolding also has a significant impact.

Adapting the determinants of implementation behavior questionnaire to evaluate implementation of a structured low back pain programme using mixed-methods

BACKGROUND AND AIMS

Best-practice low back pain (LBP) primary care programmes have been developed based on evidence-based clinical guidelines and implemented in Sweden and Denmark. The theoretical domains framework (TDF) was utilized in the design of the implementation strategy. Based on the TDF domains, the Determinants of Implementation Behavior Questionnaire (DIBQ) has been developed to evaluate implementation determinants, but its feasibility and validity need to be tested and adapted to study specific contexts. This study aimed to tailor the DIBQ for evaluation of implementation for LBP primary care programmes. The objectives were to (a) translate the DIBQ into Swedish and Danish, (b) adapt the DIBQ into DIBQ-tailored (DIBQ-t) to study content validity, (c) test the DIBQ-t for feasibility, and (d) perform validity testing of DIBQ-t.

METHODS

We used a mixed-methods design. First, forward translation of the DIBQ, then adaptation into DIBQ-t using qualitative face validity and quantitative content validity was done. Finally, to determine feasibility and construct validity using confirmatory factor analyses, we used data from DIBQ-t collected after the programmes' 2-day course.

RESULTS

The final DIBQ-t included 28 items describing 10 of the original 18 DIBQ domains and was considered feasible. A total of 598 clinicians out of 609 responded to the DIBQ-t, with only 2‰ of the items missing. The confirmatory factor analyses showed a good fit after removing two items with the lowest domain loading. The DIBQ-t maintained linkage to all domains within the Behavioral Change Wheel. The clinicians' expectations, according to the DIBQ-t, indicate facilitating determinants outweighing barriers at the initiation of implementation processes.

CONCLUSIONS

The study resulted in a feasible and valid version of a questionnaire for evaluating clinicians' expectations regarding implementation determinants of best-practice LBP primary care programmes.

French Translation, Adaptation, and Initial Validation of the Nurses' Attitudes and Perceptions of Pain Assessment in Neonatal Intensive Care Questionnaire (NAPPAQ)

PURPOSE

The purpose of this study was to translate, adapt and conduct initial psychometric validation of the French version of the Nurses' Attitudes and Perceptions of Pain Assessment in neonatal intensive care Questionnaire (NAPPAQ) developed by Polkki in 2010.

BACKGROUND

Assessing nurses' perceptions, attitudes and knowledge about pain management in preterm infants is important to improve neonatal practices.

METHODS

A sample of French-speaking nurses (n = 147) from Quebec and France working in neonatal intensive care was selected to validate the 46-item questionnaire. A French translation of the NAPPAQ, which includes Part I and II, was undertaken prior to its administration. The FIPM questionnaire was added as a Part III. Internal consistency and instrument structure were examined using Cronbach's alphas, inter-item and inter-scale correlations and exploratory factor analysis.

RESULTS

The NAPPAQ-FIPM is divided into three parts. Part I of the French version had a Cronbach's alpha of 0.64 and was composed of five factors. Part II had good total internal consistency (0.79) and adequate structure, established by inter-item correlations. Part III had good total internal consistency (0.76), and factor analysis findings suggested the presence of five factors.

CONCLUSIONS

The NAPPAQ-FIPM can be used for research purposes. Parts II and III obtained adequate psychometrics results. However, further refinement of Part I could improve its content and internal structure.

Translation of the Chinese version of the Self-Care for Aspiration Pneumonia Prevention Scale and its validation among Chinese community dwelling elderly with risk of dysphasia

Aim

To translate the Self‐Care for Aspiration Pneumonia Prevention Scale into the Chinese and validate its reliability and validity among community dwelling elderly with risk of dysphasia.

Design

A cross‐sectional survey.

Methods

A total of 430 elderly with risk of dysphasia were recruited. The reliability was measured by internal consistency, split half reliability, and test–retest reliability. The validity was evaluated by expert consultation and factor analysis.

Results

The translated scale had ideal reliability. The content validity index (S‐CVI) was 0.952. The 3‐factor structure, supported by the eigenvalues, total variance explained, and scree plot, was obtained by using exploratory factor analysis. And as a result of a confirmatory factor analysis, the model fitting indexes were all in the acceptable range. The Chinese version of the Self‐Care for Aspiration Pneumonia Prevention scale can contribute to clinical practice and education to improve self‐care for aspiration pneumonia prevention among elderly at risk of dysphasia.

Translation, cultural adaptation and validation of the Chinese version of the Carer Support Needs Assessment Tool for family caregivers of cancer patients receiving home-based hospice care

Background

Family caregivers need to be supported in caring for patients at the end of life, but practical tools to assess their support needs have been missing in China. So this study aimed to culturally adapt and validate the Carer Support Needs Assessment Tool (CSNAT).

Methods

Cross-cultural adaptation of the original CSNAT for a Chinese setting was performed according to Brislin’s translation guidelines. A pilot study was conducted with 15 Chinese family caregivers of cancer patients receiving hospice home care and 5 medical staff. A cross-sectional survey of 205 family caregivers was conducted from December 2018 to May 2019 at a home-based hospice care institute in Shenzhen, China. The validation procedure comprised the establishment of (1) content validity by a group of six experts; (2) face validity by 15 family caregivers; (3) criterion validity by calculating Spearman’s correlations between the CSNAT and caregiving burden, caregiving preparedness and quality of life scales; (4) internal consistency using Cronbach’s alpha.

Results

The CSNAT demonstrated good face validity and good content validity. CSNAT scores showed clear positive correlations with caregiving burden and negative correlations with preparedness for caregiving and quality of life. Internal consistency was high (Cronbach’s alpha = 0.899), although such reliability testing is not recommended for this tool.

Conclusions

The Chinese version of the CSNAT is a valid tool that is appropriate for identifying needs of family caregivers of cancer patients in home-based hospice care.

Development of the child's ego strength scale: an observation-based assessment of the board game behaviors in play therapy in Korea

BACKGROUND

The purpose of this study was to develop a scale for assessing children's ego strength through the observation of children playing board games in a therapeutic setting. Because ego strength is an index of psychosocial health, it is important to assess ego strength in childhood. In particular, children aged 7 to 9 exhibit their ego-strength characteristics in a situation challenged by self-competence due to their latency period. Therapists can identify such ego strength through game behaviors of children aged 7 to 9 in the play therapy setting. Thus, it is needed to develop a scale by selecting game play behaviors that grasp ego-strength.

METHOD

Data were collected from 127 play therapists and play therapist-supervisors, who observed 468 play therapy sessions and 55 children aged 7-9 who received play therapy in Korea. The scale was created through content validity verification, factor analysis and verification of criterion-related validity.

RESULTS

We generated a Child's Ego Strength Scale (CESS) consisting of five sub-factors (Coping Strategy, Cognitive Strategy, Ego Restriction, Interpersonal Functioning, Frustration Tolerance) through exploratory factor analysis. The scale met the goodness of fit criteria in a confirmatory factor analysis. The analysis of therapy sessions of children with strong and weak ego strength, as identified by play therapists, showed a significant difference between the two groups in all five sub-variables. There was a significant correlation between the CESS scores and scores of ego strength-related variables of the Rorschach scale, indicating good criterion-related validity.

CONCLUSION

The CESS appears to be a practical method for the assessment of ego strength in the field of child counseling.

Psychometric properties of the Persian version of preschool age psychiatric assessment (PAPA) for attention-deficit/hyperactivity disorder: Based on DSM-5

Childhood and adolescence psychiatric disorders affect subsequent stages; early diagnosis of these disorders, such as attention-deficit/hyperactivity disorder (ADHD), is necessary. There is no reliable and valid diagnostic interview for ADHD in Asian Persian or Farsi speaking countries. The DSM 5-based version of the interview was sent to the 14 child and adolescent and general psychiatrists to ensure the validity of the ADHD section of the PAPA interview through an online website. Out of 59 health centers, 15 centers were selected via systematic random sampling. Three hundred children participated in the study. ADHD questions of the PAPA had the power to differentiate, with a sensitivity of 0.92, a specificity of 0.01. It had positive diagnostic value = 95.83 %, negative diagnostic value = 98.91 %, negative correlation ratio = 0.12, overall diagnostic accuracy = 98.67 % and diagnostic chance ratio = 2085.35. ADHD questions of the PAPA diagnostic interview can diagnose ADHD in preschool as a reliable tool based on DSM-5.

A quasi-experimental evaluation of advance care planning improves consistency between elderly individuals and their surrogates regarding end-of-life care preferences: Development and application of a decision aid with cartoon pictures

OBJECTIVE

This study sought to develop a decision aid with cartoon pictures and evaluate its effectiveness in increasing consistency between elderly individuals and their surrogates regarding end-of-life care.

METHODS

A pre-post quasi-experimental design was adopted using the Life Support Preferences Questionnaire. The intervention had two components: (1) increasing participants' knowledge of medical treatments related to end-of-life care, and (2) sharing their end-of-life wishes. The experimental group received an intervention, whereas the control group received usual care.

RESULTS

A total of 110 participants in 55 pairs of elderly individuals with average aged 86.4 and their surrogates (27 in the experimental group, 28 in the control group) were recruited from a veterans hospital in northern Taiwan. Nearly 90 % of elderly individuals were male. The multiple linear regression showed that the inconsistent gap between elderly individuals and their surrogates in the experimental group decreased 12 points than the control group after controlling the covariances (B = -12.116, p = 0.032).

CONCLUSION

The intervention improved the consistency between elderly individuals and their surrogates regarding end-of-life care.

PRACTICE IMPLICATIONS

A decision aid with cartoon pictures may support the discussion of end-of-life care in older Asian populations.

Respiratory Distress Observation Scale Italian Version: Cultural-Linguistic Validation and Psychometric Properties

Dyspnea can be assessed using self-rating scales but, as death approaches, self-reporting becomes difficult. The validated Respiratory Distress Observation Scale measures dyspnea distress. The aim of this study was to develop the Italian version of the Respiratory Distress Observation Scale and to examine its psychometric properties. This was a cross-sectional study, analyzing cultural and linguistic validation, content validity, and psychometric properties. Eighty-nine palliative care subjects were enrolled to validate the Italian version of the Respiratory Distress Observation Scale. Patients had an average age of 74.5 (SD, 11.6) years, and 52% (n = 46) were female. Fourteen experts in palliative care evaluated the Italian Respiratory Distress Observation Scale in terms of the content validity ratio and the content validity index (CVI). The Italian Respiratory Distress Observation Scale was reported with an internal consistency (Cronbach α value) of .72 and an overall substantial interrater reliability (Cohen κ method). The Italian Respiratory Distress Observation Scale achieved a scale-level CVI of 93%, an items-level CVI of greater than 86%, and a minimum content validity ratio value of 0.71. A weak positive correlation was found between the Respiratory Distress Observation Scale and the Dyspnea Visual Analog Scale scores (0.374; P < .001). The Italian Respiratory Distress Observation Scale showed good reliability and validity for patients in palliative care. The Respiratory Distress Observation Scale measured respiratory distress in patients nearest to death.

The development of a shortened, Korean version of the Anticipated Turnover Scale for hospital nurses

This study was a psychometric validation of a Korean version of the Anticipated Turnover Scale (ATS) involving translation, transcultural adaptation, and validation. We used data from a cross-sectional online survey of 287 Korean practicing nurses in hospitals. Confirmatory factor analysis (CFA) assessed the validity of the one-factor structure that was hypothesized in the original version. We removed any items that did not enhance the scale's reliability and validity. Test and retest reliability was performed on 206 of the nurses who completed the survey again two weeks later. The mean age of the 287 nurses was 33 years, and 278 (97%) of them were female. The final 6-item Korean version of the ATS demonstrated a satisfactory model fit in the CFA (χ²  = 22.67; degree of freedom = 9; goodness-of-fit index= 0.97; comparative fit index = 0.98; Tucker-Lewis Index = 0.97; root mean square error of approximation = 0.07; and standard root mean residual = 0.03). The intraclass correlation coefficient with the test-retest reliability for the 2-week interval was 0.81, with a good internal consistency (Cronbach's alpha = 0.85; McDonald's omega coefficient reliability = 0.92). The 6-item revised ATS is a reliable and valid scale to assess the turnover intention of Korean nurses who work in hospitals. It can be used in an acute setting and predict the anticipated turnover rate for monitoring purposes.

Psychometric properties of the Turkish version of L'Insalata Shoulder Rating Questionnaire

PURPOSE

The aim of this study was to examine the psychometric properties of the culturally adapted Turkish version of the L'Insalata Shoulder Rating Questionnaire (TrLSRQ).

MATERIALS AND METHODS

Comprehensibility and content validity of the TrLSRQ were tested on 14 patients and seven physiotherapists, respectively. Subsequently, 90 volunteer patients with shoulder pain completed the TrLSRQ twice within a week for test-retest analysis. Correlations with Shoulder Pain and Disability Index (SPADI), Oxford Shoulder Score (OSS), Penn Shoulder Score (PSS), and Upper Extremity Functional Index (UEFI) were used to assess convergent validity; and pain intensity and active range of shoulder motions were measured to assess criterion validity.

RESULTS

Content validity index of the TrLSRQ was 0.99. The internal consistency was high (Cronbach's α = 0.89); and item-total correlations were 0.37-0.74. In test-retest analysis, ICC values were 0.65-0.95 for all items; and 0.86-0.94 for the subcategories. The TrLSRQ scores were positively correlated with UEFI, and negatively correlated with other scales (p < 0.05). Its correlations with the intensity of pain and shoulder range of motions (p < 0.05) indicated that the questionnaire had good criterion validity.

CONCLUSIONS

The TrLSRQ is a reliable and valid measure to assess pain, activities of daily living, sports/recreation, and work in patients with shoulder pain.Implications for RehabilitationPatient-reported outcome measures (PROMs) are important tools to assess the impact of health problems on overall well-being of the patients.The Turkish version of the L'Insalata Shoulder Rating Questionnaire (TrLSRQ) is a PROM that evaluates the impact of shoulder problems on patient's pain, daily activities, sportive/recreational activities, and work; as well as overall satisfaction with his/her shoulder, and ranking of areas in which the patient likes to see improvement.The TrLSRQ scores are well correlated with other relevant PROMs, as well as with the intensity of pain and shoulder range of motions.The TrLSRQ is a reliable and valid measure, which can be used for both clinical and research purposes to evaluate symptoms and functional status of patients with shoulder pain.

Development and Validation of a Probe Word List to Assess Speech Motor Skills in Children

Purpose The aim of the study was to develop and validate a probe word list and scoring system to assess speech motor skills in preschool and school-age children with motor speech disorders. Method This article describes the development of a probe word list and scoring system using a modified word complexity measure and principles based on the hierarchical development of speech motor control known as the Motor Speech Hierarchy (MSH). The probe word list development accounted for factors related to word (i.e., motoric) complexity, linguistic variables, and content familiarity. The probe word list and scoring system was administered to 48 preschool and school-age children with moderate-to-severe speech motor delay at clinical centers in Ontario, Canada, and then evaluated for reliability and validity. Results One-way analyses of variance revealed that the motor complexity of the probe words increased significantly for each MSH stage, while no significant differences in the linguistic complexity were found for neighborhood density, mean biphone frequency, or log word frequency. The probe word list and scoring system yielded high reliability on measures of internal consistency and intrarater reliability. Interrater reliability indicated moderate agreement across the MSH stages, with the exception of MSH Stage V, which yielded substantial agreement. The probe word list and scoring system demonstrated high content, construct (unidimensionality, convergent validity, and discriminant validity), and criterion-related (concurrent and predictive) validity. Conclusions The probe word list and scoring system described in the current study provide a standardized method that speech-language pathologists can use in the assessment of speech motor control. It can support clinicians in identifying speech motor difficulties in preschool and school-age children, set appropriate goals, and potentially measure changes in these goals across time and/or after intervention.

Development and psychometric testing of the care dependence perception questionnaire

OBJECTIVE

This multicentre study aimed to develop a measure of the perception of care dependence in patients diagnosed with cancer and to test its psychometric properties.

METHODS

The questionnaire was developed based on findings emerged from a meta-synthesis and from qualitative studies conducted in three hospitals in Italy. The draft questionnaire was tested for face and content validity and pilot-tested with patients. The questionnaire was completed by care-dependent patients with cancer. Test-retest was conducted to verify stability. Exploratory factor analysis (EFA) was performed using a Maximum Likelihood robust estimator.

RESULTS AND CONCLUSION

The Scale-Content Validity Index was 0.92. The final 15-item questionnaire was completed by 208 patients admitted to two hospitals. The EFA yielded a two-factor model including a positive and a negative perception of care dependence. Factor score determinacy coefficients, Cronbach's alpha coefficients, composite reliability coefficients and Intraclass Correlations Coefficients yielded satisfactory results confirming internal consistency and stability. The hedonic balance score is also available as a single indicator of subjective well-being. The study provides initial validation of the Care DEeP Questionnaire that can be used by cancer nurses to assess positive and negative patient experiences with care dependence and to personalise and improve their care.

Construction and validation of instrument to assess the quality of infection control programs

OBJECTIVE

To build and validate an instrument to assess hospital infection control programs.

METHOD

Methodological study that was developed in seven stages. The instrument items were categorized into the structure, process and result components. 10 expert judges participated, who evaluated the psychometric properties and validated the content using the Likert scale. The pre-test was carried out with 98 health professionals, from April to July 2018. For reliability analysis, Cronbach's alpha test was used.

RESULTS

Regarding the content validity index, the score made by expert judges ranged from 0.777 to 1.00, with mean of 0.902 (± 0.076). The Cronbach's alpha test showed good internal consistency of the items (0.82).

CONCLUSION

An instrument to assess hospital infection control programs was developed and validated, which showed good reliability and can be efficiently used at national level.

Psychometric characteristics of the of COVID Stress Scales-Arabic version (CSS-Arabic) in Egyptian and Saudi university students

Background

Mental health sufferings due to the COVID-19 pandemic were reported in many countries worldwide. However, there is a lack of a validated Arabic tool to measure stress related to this pandemic in the Arab countries. This study aims to translate into Arabic and measure the psychometric characteristics of the previously developed English COVID Stress Scales (CSS). Using a forward-backward translation, the CSS was translated into Arabic and 22 jurors assessed its content validity. An online-based survey was carried out among 1080 university students (Egyptian and Saudi) to assess internal consistency and validity of the Arabic version (CSS-Arabic) using Cronbach’s α and factor analysis.

Results

The content validity indices of the scale were 0.943 and 0.932 for both relevance and clarity. The internal consistency of the total CSS-Arabic was satisfactory (with α = 0.94) within the acceptable range for different subscales. Confirmatory factor analysis reveals 5-factor model with 36 retained items similar to the original English CSS.

Conclusions

CSS-Arabic is a reliable and valid self-reporting tool for screening of stress due to COVID-19 among the university students. Further work should be done by healthcare providers to assess the magnitude of the stress during the COVID-19 pandemic.

Supplementary Information

The online version contains supplementary material available at 10.1186/s43045-021-00095-8.

Instrument to evaluate the knowledge of patient with cirrhosis on his disease: construction and validity

Background

The application of measurement instruments is a strategy to evaluate the patient's knowledge about the disease. This study aims to build an instrument that evaluates the patient's knowledge about liver cirrhosis.

Method

This study includes three phases. The first one was the construction of the instrument based on a literature review. In the second phase, five experts were participated in the evaluation of the instrument, to check the validity of the content. Quantitative and qualitative analyzes were made. The tool used was the CVI (Content Validity Index) and it was used the semantic study of the questions. The third phase was the process of the restructuring the instrument.

Results

The final version of the instrument consisted of 36 questions. The instrument was evaluated in 91.7 by the average CVI and 94.4% by the universal CVI.

Conclusions

The questions are properly structured and clear, therefore, understandable. Thus, the final instrument presented satisfactory content validity, so that, it reached the aim of this study.

Design and behavior science in government-to-citizens cognitive-communication: a study towards an inclusive framework

Purpose

The purpose of this paper is to describe the application of design and behavior science collectively in refining the government to citizens’ (G2C) cognitive-communication by using artificial intelligence (AI) artifacts. It investigates the citizens’ behavior intention to use AI cognitive-communication channels in e-government services.

Design/methodology/approach

This study reveals the potential of unification in design and behavior science paradigms when integrated into AI artifacts in measuring the constructive outcome of proposed architecture that embraces the perceived risk and trust in citizens’ usage behavior intentions. To evaluate the practical relevance of design science paradigm, action research was incorporated by developing an app as an exemplified scenario.

Findings

The weaknesses of traditional G2C channel communication obliterated by AI virtual agents. This study proposes a five-layer architecture model created with citizens-centered design highlighting the improved relevance for G2C cognitive-communication. The behavior model supports citizens’ usage behavior intentions through trust as a positive attribute and negative attribute as a perceived risk.

Research limitations/implications

This study contributes to the knowledge of design science paradigm particularly to AI-based cognitive G2C communication. The architecture serves for deploying virtual agents to automate the public officials for decision-making processes. The authors have constructed a cognitive-communication model and have examined the relationships among the extents of cognitive-communication model. This channel has the potential to significantly transform G2C cognitive and intelligent communication.

Practical implications

This cognitive-communication channel has the potential to significantly transform the communication between government and citizens. Such a model can be an interest of developers, researchers and government policymakers in a holistic approach drawn from theory and methods of both design and behavior science to create a successful communication scenario.

Social implications

Advances in technology are not without social implications. The study results can dramatically improve the efficiencies of government workplaces and can augment the human working. It will help to reduce the government services discriminations among the citizens and contribute to society through social inclusion.

Originality/value

This study addresses the duality in information system research by first defining the theoretical framework for G2C cognitive-communication architecture and then developing a research model drawn upon a citizens’ service usage behavioral theory. It will also contribute to providing important perceptions of AI practices in the public sector.

Valuing end-of-life care: translation and content validation of the ICECAP-SCM measure

Background

The evaluation of care strategies at the end of life is particularly important due to the globally increasing proportion of very old people in need of care. The ICECAP-Supportive Care Measure is a self-complete questionnaire developed in the UK to evaluate palliative and supportive care by measuring patient’s wellbeing in terms of ‘capability’. It is a new measure with high potential for broad and international use. The aims of this study were the translation of the ICECAP-Supportive Care Measure from English into German and the content validation of this version.

Methods

A multi-step and team-based translation process based on the TRAPD model was performed. An expert survey was carried out to assess content validity. The expert panel (n = 20) consisted of four expert groups: representative seniors aged 65+, patients aged 65+ living in residential care, patients aged 65+ receiving end-of-life care, and professionals in end-of-life care.

Results

The German version of the ICECAP-Supportive Care Measure showed an excellent content validity on both item- and scale-level. In addition, a high agreement regarding the length of the single items and the total length of the questionnaire as well as the number of answer categories was reached.

Conclusions

The German ICECAP-SCM is a valid tool to assess the quality of life at the end of life that is suitable for use in different settings. The questionnaire may be utilized in multinational clinical and economic evaluations of end-of-life care.

Supplementary Information

The online version contains supplementary material available at 10.1186/s12904-021-00722-5.

Development and validation of a Fever Management Questionnaire aimed at parents and care givers

AIM

The symptoms of childhood fever are often inappropriately managed by care givers resulting in overuse of health resources and medication errors. Understanding care giver's knowledge, attitudes and beliefs about fever management using a validated questionnaire is warranted. The aim of this study was to develop and validate a comprehensive Fever Management Questionnaire.

METHODS

The questionnaire items were developed through a content analysis of the literature and current fever management guidelines. For the knowledge component, a multidisciplinary panel of 12 experts assessed content validity of items (n = 35) through a one-round Delphi process. The construct validity of the attitudes and belief items (19 items) were assessed using principal components analysis utilising response data collected from 149 Australian parents and care givers.

RESULTS

Based on the responses from the panel of experts, six items were removed, six items required substantive modification, 13 items required minor modification with the remaining eight items retained in original form. For the Attitudes and Beliefs items, a parsimonious solution with three principal components resulted after removal of six cross-loading items. The factor loadings of each item displayed a strong correlation to one of three components with scores ranging from 0.791 down to 0.541. The resulting Cronbach's α for the tool was 0.729.

CONCLUSION

Psychometric testing of this two-part Fever Management Questionnaire has resulted in a tool with acceptable validity and reliability. This tool should now be used to gather the knowledge and attitudes of care givers surrounding fever management to further understand factors that lead to inappropriate fever management.

A theoretical framework to improve the construct for chronic pain disorders using fibromyalgia as an example

Fibromyalgia (FM) is a frequent, complex condition of chronic musculoskeletal pain with no evidence for biological correlates. For this reason, despite many efforts from the medical community, its construct still appears ill defined. Promising candidate biomarkers are critically reviewed. A research agenda is proposed for developing a clearer construct of FM. The ideal theoretical framework is one of overcoming the illness–disease dichotomy and considering reciprocal interactions between biology and behaviour. This approach may foster research in other fields of pain medicine and of medicine in general.

VALIDATION OF THE KNOWLEDGE, ATTITUDE AND PRACTICE SURVEY ON NURSING ASSISTANCE DURING DELIVERY AND CHILDBIRTH

ABSTRACT Objective: to validate the Knowledge, Attitude and Practice survey on Nursing assistance during delivery and childbirth based on the concepts of Florence Nightingale's Environmental Theory and the recommendations of the National Guidelines for Assistance to Normal Delivery. Method: this is a methodological study in which the Knowledge, Attitude and Practice survey was elaborated, and validated regarding content and appearance. Data collection was carried out between the months of July and December 2017. The validations were performed by 22 nurses who work in delivery and childbirth care and the data were analyzed using the Content Validity Index and the Binomial test. Results: content and face validation evidenced that the agreement among the experts was satisfactory (Content Validity Index greater than 0.80 for all items evaluated). Conclusion: it is concluded that the survey can be used to assess the nurses' Knowledge, Attitude and Practice in relation to the Nursing assistance provided during delivery and childbirth.

Psychometric characteristics of the of COVID Stress Scales-Arabic version (CSS-Arabic) in Egyptian and Saudi university students

Background

Mental health sufferings due to the COVID-19 pandemic were reported in many countries worldwide. However, there is a lack of a validated Arabic tool to measure stress related to this pandemic in the Arab countries. This study aims to translate into Arabic and measure the psychometric characteristics of the previously developed English COVID Stress Scales (CSS). Using a forward-backward translation, the CSS was translated into Arabic and 22 jurors assessed its content validity. An online-based survey was carried out among 1080 university students (Egyptian and Saudi) to assess internal consistency and validity of the Arabic version (CSS-Arabic) using Cronbach’s α and factor analysis.

Results

The content validity indices of the scale were 0.943 and 0.932 for both relevance and clarity. The internal consistency of the total CSS-Arabic was satisfactory (with α = 0.94) within the acceptable range for different subscales. Confirmatory factor analysis reveals 5-factor model with 36 retained items similar to the original English CSS.

Conclusions

CSS-Arabic is a reliable and valid self-reporting tool for screening of stress due to COVID-19 among the university students. Further work should be done by healthcare providers to assess the magnitude of the stress during the COVID-19 pandemic.

Supplementary Information

The online version contains supplementary material available at 10.1186/s43045-021-00095-8.

The development of a behaviour questionnaire for stoma self-management for persons with bladder cancer and an ileal conduit

AIMS

To develop and preliminarily test the reliability and validity of a behaviour questionnaire for stoma self-management for patients with bladder cancer after radical cystectomy and ileal conduit.

DESIGN

A psychometric instrument validation study conducted in two phases.

METHODS

The initial version of behaviour questionnaire was developed based on guidelines for people living with a stoma. Five experts validated the content of the preliminary 29-item questionnaire. A cross-sectional survey was then conducted in Beijing for preliminary reliability and validity tests between 4 December 2017-28 April 2018. A total of 151 participants in the survey, 147 of whom completed the study and 16 completed a 2-week test-retest reliability test.

RESULTS

The content validity indices were satisfied. A principal component analysis with direct oblimin rotation was performed. Sixteen items were retained, and three factors were identified, namely, pouching system change, emotional management, and role management. The 16-item questionnaire showed acceptable internal consistency and test-retest reliability. The mediational effect of self-management behaviour on the relationship between self-efficacy and stoma quality of life was confirmed via convergent validity testing.

CONCLUSION

The behaviour questionnaire for stoma self-management appears to have adequate initial reliability and validity. More observational and interventional studies need to be conducted for further evaluation of its psychometric properties.

IMPACT

This study developed a reliable instrument to measure self-management behaviours for persons living with a stoma after radical cystectomy and ileal conduit. The questionnaire has practical value for both healthcare providers and researchers working in this field. The 16-item questionnaire can be administered quickly in clinical practice. Based on the questionnaire and the elicited mediational model, psycho-education programs tailored to improve self-management should be designed, implemented, and re-inspected regarding their effectiveness for the target population in China.

Development and Validation of Nine Deprescribing Algorithms for Patients on Hemodialysis to Decrease Polypharmacy

Background:

Polypharmacy is ubiquitous in patients on hemodialysis (HD), and increases risk of adverse events, medication interactions, nonadherence, and mortality. Appropriately applied deprescribing can potentially minimize polypharmacy risks. Existing guidelines are unsuitable for nephrology clinicians as they lack specific instructions on how to deprescribe and which safety parameters to monitor.

Objective:

To develop and validate deprescribing algorithms for nine medication classes to decrease polypharmacy in patients on HD.

Design:

Questionnaires and materials sent electronically.

Participants:

Nephrology practitioners across Canada (nephrologists, nurse practitioners, renal pharmacists).

Methods:

A literature search was performed to develop the initial algorithms via Lynn’s method for development of content-valid clinical tools. Content and face validity of the algorithms was evaluated over three interview rounds using Lynn’s method for determining content validity. Canadian nephrology clinicians each evaluated three algorithms (15 clinicians per round, 45 clinicians in total) by rating each algorithm component on a four-point Likert scale for relevance; face validity was rated on a five-point scale. After each round, content validity index of each component was calculated and revisions made based on feedback. If content validity was not achieved after three rounds, additional rounds were completed until content validity was achieved.

Results:

After three rounds of validation, six algorithms achieved content validity. After an additional round, the remaining three algorithms achieved content validity. The proportion of clinicians rating each face validity statement as “Agree” or “Strongly Agree” ranged from 84% to 95% (average of all five questions, across three rounds).

Limitations:

Algorithm development was guided by existing deprescribing protocols intended for the general population and the expert opinions of our study team, due to a lack of background literature on HD-specific deprescribing protocols. There is no universally accepted method for the validation of clinical decision-making tools.

Conclusions:

Nine medication-specific deprescribing algorithms for patients on HD were developed and validated by clinician review. Our algorithms are the first medication-specific, patient-centric deprescribing guidelines developed and validated for patients on HD.

Questionnaire to Evaluate the Competency in Evidence-Based Practice of Registered Nurses (EBP-COQ Prof©): Development and Psychometric Validation

BACKGROUND

The availability of valid and reliable instruments, based on current competency frameworks, is essential to respond to the need for accurate measurement of the competency of registered nurses in evidence-based practice (EBP).

AIMS

To develop and validate a questionnaire capable of measuring EBP competencies in registered nurses following the competency framework developed by Melynk et al. (2014).

METHODS

The study was developed in two stages: (a) creation of the questionnaire based on an operational definition of the construct, its face, and content validation by 10 experts, and cognitive piloting; (b) psychometric evaluation of the questionnaire by a cross-sectional, and multicenter study between February and November 2018. Analyses were conducted of the questionnaire's reliability and construct validity (exploratory [EFA] and confirmatory [CFA] factor analyses).

RESULTS

First phase: The initial version of EBP-COQ© Prof contained 50 items grouped into four dimensions (attitudes, knowledge, skills, and utilization). After two expert validation rounds, a 35-item version was obtained with content validity index of 0.86. Second phase: The questionnaire was completed by 579 nurses; EFA with PROMAX rotation revealed that the four-factor model had the best fit (χ²  = 311.32; p = .001, root mean square error of approximation [RMSEA] = 0.000, 90% confidence interval [CI] = 0.000 - 0.010; comparative fit index [CFI] = 1), and it showed a good CFA fit index: CFI = 0.932, and RMSEA = 0.093 (90% CI = 0.097 - 0.108). Cronbach's α for each factor ranged from 0.817 (factor III) to 0.948 (factor II).

LINKING EVIDENCE TO ACTION

EBP-COQ Prof© is a valid, reliable, and easily administered questionnaire that measures the self-perceived competency of registered nurses in EBP based on an updated and specific competency framework. It permits the independent evaluation of attitudes, knowledge, and skills related to EBP and of its utilization in hospital and primary care settings, allowing the monitoring of compliance with EBP.

Reliability and Validity of the Arabic Version of a Questionnaire Assessing Pain, Discomfort and Related Jaw Function Impairment after Extraction of Primary Teeth in Children

This study aims to translate a previously published English language questionnaire that assessed pain and discomfort after the extraction of primary teeth in children into Arabic, and evaluate its validity and reliability. All participating children (n = 120), aged 9 to 12-years-old, completed the 33-item Arabic version questionnaire after the extraction procedure had taken place. The questionnaire included three parts that were completed at three different times, namely, immediately, the first evening, and one week after the extraction procedure. Internal consistency, content validity, criterion validity, and factor analysis were performed. The results showed a good internal consistency (Cronbach's alpha = 0.83), acceptable criterion validity with a significantly strong correlation with the Visual Analog Scale (VAS), and satisfactory content validity (average content validity index (CVI = 0.90). The final factor model was comprised of four factors with an eigenvalue greater than 1, explaining 70% of the common variance. The identified factors were labeled as follows: Factor 1-analgesic consumption; Factor 2-expression of discomfort from the extraction site; Factor 3-perception of masticatory capability; and Factor 4-pain/discomfort from the dental extraction procedure. Based on the results, a shorter form of the questionnaire had satisfactory psychometric characteristics and can be used with children within the selected age group.

Translation and Psychometric Evaluation of the Mahoney Pain Scale Among Iranian Elderly With Dementia: A Methodological Study

Valid and reliable measurement tools are necessary for pain assessment among the elderly with dementia. This study aimed to translate the Mahoney Pain Scale (MPS) into Persian and evaluate its psychometric properties among Iranian elderly with dementia. In this methodological study, after translating and assessing the face and content validity of MPS, 100 elderly with dementia were selected via convenience sampling from nursing homes and clinics in Kashan in 2018-19; then, MPS was completed for them both at rest and during a movement pain protocol. MPS was assessed by exploratory factor analysis, known-group comparison, convergent validity, internal consistency, equivalence, and stability. The factor analysis revealed a one-factor structure, which explained 57.11% of the total variance. The Persian MPS differentiated patients with and without known painful conditions, as well as pain at rest and during the movement pain protocol (p < .0001). There was a significant positive correlation between the scores of MPS and PACSLAC-II (r = .87, p < .0001). The Cronbach's α, intraclass correlation coefficient and standard error of measurement of MPS were .91, .79, and ±1.37, respectively. As a valid and reliable tool, the Persian MPS can be used for pain assessment among Iranian elderly with dementia.

Validity based on content: A challenge in health measurement scales

Content-based validity can be defined as the evidence of the degree to which the items of an instrument represent the construct to be inferred. It is the initial and unavoidable step for evaluating other sources of validity. However, it is one of the least reported psychometric properties in development of health measurement scales. That is why it is considered a challenge that must be overcome with the recognition of its value. In this narrative review, the concept of content as evidence of validity is revised and methods for evaluation are synthesized with an algorithm.

Design and Validation of a Questionnaire to Measure Future Spanish Teachers’ Perceptions of Cinema in Pre-School and Primary Education: Towards Active and Technological Learning

State of the art: Cinema, because of the eclectic nature of art, technology and mass media, can be manifested as an educational tool in the classroom. In this sense, the educational possibilities detected in the cinema are numerous. The pre-service teacher education in the figure of the teacher determines their educational resources. Purpose: The general objective of this study is to design and validate an instrument to measure the perceptions of students of Pre-School Teacher Degree and Primary Teacher Degree in Spanish universities about cinema as a teaching resource in Pre-School and Primary Education. Design/methodology: For this purpose, a systematic and planned process was developed for the design and validation of the Percepciones sobre las potencialidades del cine como recurso didáctico en las aulas de Infantil y Primaria ((PECID) (perceptions about the potentialities of cinema as a didactic resource in pre-school and primary classrooms)) questionnaire. Main findings: The results obtained showed a good content validity of 25 items after an expert judgement. On the other hand, a reliability of the internal consistency of the instrument of 0.978 was obtained. Furthermore, a three-factor structure was confirmed through factor analysis. Conclusions: It is concluded that the PECID questionnaire is a valid and reliable instrument to measure the perceptions of future teachers in Spain about using cinema as a resource for future teaching.

Process Evaluation of a National Elderly Nutrition-Care Program in Iran: Perspectives of Clients and Providers

OBJECTIVE

As aging populations increase, many countries have begun implementation of policies to improve elder health and nutrition. This study evaluated key process components of nutrition sections of a national elderly integrated-care program in health-care centers in Iran.

METHODS

With stratified three-stage random cluster sampling, a total of 256 elderly subjects (clients) and 76 staff members of health-care centers (providers) participated in the study. Quantitative and qualitative data were collected using two self-administrated questionnaires to evaluate various components of process evaluation for clients and providers. Program reach was measured by the ratio of the number in the target group who underwent the program to the number of eligible individuals. Exposure rate was measured as clients' awareness of program services. Delivery and fidelity were assessed from providers' reports for each service. Satisfaction rates were assessed for the whole program and for each service of the program. All reasons behind strengths and weaknesses in each of the process-evaluation components were examined and are reported in detail.

RESULTS

The clients reported low-reach (20.0%) and moderate-exposure rates of 77.5%, with a program target of 90%. Primary training sessions were delivered to the providers as intended (100%), but most planned services for clients, especially vitamin and mineral supplementation, follow-up, and physical activity sessions, were poorly implemented, as they were delivered correctly to 24.7% (n=63, vitamin and mineral supplementation), 24% (n=62, follow-up), and 40.3% (n=103, physical activity sessions) of the clients, with a set program goal of 60%. An overall low level of implementation fidelity was observed, and 39.3% (n=30) of the providers believed that most clients did not benefit from the nutritional services. Overall, less than half (42.8%, n=101) the clients were highly satisfied with the program.

CONCLUSION

The process evaluation showed insufficient reach, exposure, and fidelity of the program, as well as imprecise delivery of some services, which resulted in low levels of client satisfaction. The findings may have implications for further reinforcement of the program, and indicate the importance of continuous monitoring and evaluation of such programs.

Qualitative Validation of the Nursing Home IT Maturity Staging Model

The goal of the current study was to qualitatively explore issues of validity, specificity, and sensitivity regarding the nursing home (NH) information technology (IT) maturity survey and staging model. Participants who completed the NH IT maturity survey were recruited during pilot testing of the survey and staging model. Cognitive interviewing was used to collect qualitative data. Findings indicate the NH IT maturity survey and staging model is a straightforward and acceptable instrument. Every participant in our study agreed with the IT maturity stage assigned to their facility, based on their total score on the IT maturity survey. However, some participants were not sure how to answer some questions on the survey because they did not have in-depth knowledge of IT processes that took place outside of their NH facility and others experienced difficulty interpreting items because their NH facility was in a time of transition. The next step in development is quantitative psychometric testing and use of the instrument in a 3-year national study. [Journal of Gerontological Nursing, 46(7), 47-54].

Psychometric evaluation of the Persian version of the Doloplus-2 (P-Doloplus-2) scale in elderly with dementia

Background/aim

A scale for behavioural pain assessment is useful for the detection and determination of pain in the elderly with dementia. This study aimed to translate and evaluate the psychometric properties of Doloplus-2 in the elderly with dementia in Iran.

Materials and methods

In this methodological study, after translation and evaluating the face and content validity of Doloplus-2, 100 elderly people were selected by the convenience sampling method in Kashan, 2018–2019. Exploratory factor analysis, convergent validity, and known-groups comparison were applied to determine construct validity. Reliability was also assessed through internal consistency, equivalence, and stability methods were used. The ceiling and floor effects were also examined. Data were analyzed using the SPSS-v16 and via Mann-Whitney U test, Cronbach’s alpha, Spearman-Brown, and intraclass correlation coefficient (ICC).

Results

The scale’s content validity index was 0.95%, and the item impact of each item was above 1.5. Factor analysis identified 2 “social- functional” and “conventional subjective-objective” factors in scale that altogether were able to explain 76% of the total variance. The results revealed that P-Doloplus-2 could discriminate between the 2 groups of elderly with and without known chronic painful diseases (P < 0.0001). There was a significant positive correlation between P-Doloplus-2 and PACSLAC-II-IR scores (r = 0.878, P < 0.0001). Cronbach’s alpha, ICC, and standard error of measurement for the scale were 0.950, 0.864, and ± 1.759, respectively. The frequency of minimum and maximum possible score of scale was less than 15%.

Conclusion

The Persian version of Doloplus-2 can be considered as a valid and reliable scale for pain assessment in the elderly with dementia.

Development and initial validation of the Psychological Need Frustration Scale for Physical Activity

Background

The frustration of basic psychological needs can be detrimental to people’s health. To date, a scale developed specifically for measuring such perceived negative experiences, derived from a need thwarting environment in the physical activity context, is lacking. The present research attempted to develop and validate the Psychological Need Frustration Scale for Physical Activity (PNFS-PA) grounded in self-determination theory via multiple studies.

Method

In Study 1, an item pool was created, and its face and content validity were established. In Study 2, the factor structure of the scale was demonstrated using exploratory structural equation modelling (ESEM). In Study 3, its factor structure was cross-validated. Also, the nomological validity, reliability and measurement invariance of the scale were established.

Result

Taken together, the research suggests the newly developed PNFS-PA is valid and reliable and can be applied to assess psychological needs frustration experiences in the physical activity context.

Evaluation of satisfaction with geospatial assistive technology (ESGAT): a methodological and usability study

Purpose: Manual wheelchair users are more vulnerable, in situations such as road crossings, hazardous sidewalks or curbs and crossing of buildings and facilities threshold. Geospatial assistive technology (GAT) can help with route planning. However, it is important to ensure the usability of such products, as well as the satisfaction of persons with reduced mobility. The study's aim was (1) to develop and validate a questionnaire on the satisfaction of GAT, in English and French, and to (2) assess satisfaction, efficacy and efficiency of a GAT with manual wheelchair users following a filmed trial in a dense urban area.Method: A methodological study was conducted (development of the questionnaire, assessment of its content validity, feasibility and practicability) followed by a trial and post-observations with the videos. Two questionnaires (English, French) were concurrently validated by two groups of experts (n = 8), and then field-tested by wheelchair users (n = 8), using Google Maps Pedestrian routeing tool.Results: The Evaluation of satisfaction with geospatial assistive technology (ESGAT) consists in a user profile and their experience with the technology, followed by 12 satisfaction criteria rated from 1-not satisfied to 5-very satisfied. Both questionnaires were rated as feasible and practicable to complete. The usability of Google Maps Pedestrian routeing tool was measured as "moderate" by manual wheelchairs since the total satisfaction score at the ESGAT was 3.9/5 (quite satisfied). The items with the lowest score were navigation assistance, hands-free function and security. The GAT was effective (87.5% have completed their destination) but not efficient (37.5% needed help).IMPLICATIONS FOR REHABILITATIONFor manual wheelchair users paired with geospatial assistive technology:• A 10 minutes questionnaire was developed and validated to assess their satisfaction after testing aid in an urban area.• Satisfaction criteria to address are ease of access (service), learnability, hands-free function, ease of use for planning as well for navigating, transportability/ appearance, content, geographic information, effectiveness, efficiency, navigation assistance and security• A field test is necessary to ensure the effectiveness of the technology in avoiding or announcing potential obstacles such as sidewalk crossing ramp, damaged and congested sidewalk; sidewalk tilt (side slopes); thresholds at destination; verbal indication too soon or too late; incorrect indication; the arrow does not indicate the right direction; readjustment of the route needed; a lack of indication; and human intervention needed.

Validation issues of a performance management system for design: three case studies

Purpose

This study aimed to discuss issues related to the process for validating a performance management system for design (PMSD) in three product development companies.

Design/methodology/approach

The use of multifunctional groups becomes important because it favors viewing the organization as a whole, thereby reducing existing gaps between segments of the company. To support this study, focus group research was used.

Findings

Viewing design as a resource that contributes to increased competitiveness offers companies benefits, such as improved performance measurement. This measurement is based on indicators and, to be useful, an indicator system should stimulate the company's interest. In addition, the present study made it possible to conclude that the validation process is essential in preimplementation stages because validation allows the PMSD to be adapted to bring it closer to the reality of companies, thus increasing the chances of success during the implementation stage.

Originality/value

Validation of the metrics from the perspective of senior management enabled critical analyses of the applicability of the PMSD, as well as its suitability and approximation to the reality of businesses, by selecting the most relevant data.

How to measure a latent construct: Psychometric principles for the development and validation of measurement instruments

Measurement instruments are used to collect data about respondents. In social pharmacy, measurement instruments are often used to measure latent constructs, such as attitudes, among healthcare professionals and patients. This paper aims to describe the fundamental aspects of designing and validating instruments, which aim to measure latent constructs. The main focus of this manuscript is to describe the considerations and processes relating to exploratory and confirmatory factor analyses, when used to develop measures of latent psychosocial constructs. However, it also presents a detailed summary of the current evidence and suggestions for item generation and sample selection, as well as, an in-depth description of approaches to content and face validation. Suggestions for further reading are also provided.

Comparison of drug-related problem risk assessment tools for older adults: a systematic review

PURPOSE

This study aims to systematically review studies describing screening tools that assess the risk for drug-related problems (DRPs) in older adults (≥ 60 years). The focus of the review is to compare DRP risks listed in different tools and describe their development methods and validation.

METHODS

The systematic search was conducted using evidence-based medicine, Medline Ovid, Scopus, and Web of Science databases from January 1, 1985, to April 7, 2016. Publications describing general DRP risk assessment tools for older adults written in English were included. Disease, therapy, and drug-specific tools were excluded. Outcome measures included an assessment tool's content, development methods, and validation assessment.

RESULTS

The search produced 15 publications describing 11 DRP risk assessment tools. Three major categories of risks for DRPs included (1) patient or caregiver related risks; (2) pharmacotherapy-related risks; and (3) medication use process-related risks. Of all the risks included in the tools only 8 criteria appeared in at least 4 of the tools, problems remembering to take the medication being the most common (n=7). Validation assessments varied and content validation was the most commonly conducted (n = 9). Reliability assessment was conducted for 6 tools, most commonly by calculating internal consistency (n = 3) and inter-rater reliability (n = 2).

CONCLUSIONS

The considerable variety between the contents of the tools indicates that there is no consensus on the risk factors for DRPs that should be screened in older adults taking multiple medicines. Further research is needed to improve the accuracy and timeliness of the DRP risk assessment tools.

Development and Testing of a Clinical Practice Framework for Pharmacists to Assess Patients' Travel-Related Risks: The 5W Approach to Travel Risk Identification

Objective: To assist with identifying patients who may be managed by pharmacists without additional travel medicine training, versus those who may benefit from referral, we developed and validated a clinical practice framework. This framework was then piloted in eight pharmacies in Ontario, Canada, from March to August 2019. Methods: A panel of experts, comprised of physicians and pharmacists from Ontario, Canada, holding a Certificate in Travel Health^TM from the International Society of Travel Medicine was recruited. This panel participated electronically in the development of the framework in three stages: (1) Sharing their current approach when performing information gathering and assessing risk in a traveling patient; (2) judging of items collated from all panellists on the basis of how essential they are to a risk assessment; and (3) validation of items deemed essential by the panel using the Item and Average Content Validity Index. The framework was then released to community pharmacies, where pharmacists that self-identified as beginners to travel medicine completed pre- and post-test phase surveys to determine the utility of the framework. Key Findings: A total of 64 items for consideration were deemed essential enough to proceed to content validation, organized into 5 ‘W’ domains: Who, What, Where, When, and Why. Each item was ranked by the experts according to its relevancy, resulting in an Average-Content Validity Index of 0.91. The resulting framework was titled “The 5W Approach to Travel Risk Identification.” This clinical practice framework is the first published assessment tool for travel medicine tailored for pharmacy’s scope of practice that has been content validated. Pharmacists reported that the framework is simple to use and provides structure for interactions with travelling patients. However, it may not be as beneficial for those with a higher level of travel medicine expertise than the average pharmacist. Conclusion: The 5W Approach tool allows pharmacists inexperienced in travel medicine to collect information when required to use their professional judgement when assessing traveling patients as either high-risk (requiring a referral to a travel medicine specialist) or low-risk. With the aim of supporting pharmacists to be more confident in caring for traveling patients and increasing their involvement in travel medicine, future research will test this framework for feasibility in Canadian community pharmacy practice.

Exerting Explanatory Accounts of Safety Behavior of Older Construction Workers within the Theory of Planned Behavior

Older construction workers are vulnerable to accident risks at work. Work behavior affects the occurrence of accidents at construction sites. This study aims to investigate the organizational and personal factors that underlie the safety behaviors of older construction workers considering their age-related characteristics. A cross-sectional questionnaire survey, which involves 260 older construction workers (aged 50 and over), was conducted, and an integrative old-construction-worker safety behavior model (OSBM) was established on the basis of the theory of planned behavior (TPB). Results showed that the OSBM provides a considerably good explanation of the safety behaviors of older construction workers. The explained variances for safety participation and compliance are 74.2% and 63.1%, respectively. Subjective norms and perceived behavioral control are two critical psychological drivers that proximally affect the safety behaviors of workers. Moreover, safety knowledge, management commitment, and aging expectation are the distal antecedents that significantly influence psychological drivers. This study proves the mediating role of psychological factors on predicting safety behaviors among older construction workers, thereby promoting an understanding of "how" and "why" their safety behaviors occur. Furthermore, the identified effects of several critical organizational and personal factors, particularly age-related factors, provide new insights into the safety behaviors of older construction workers.