The Standardized Pressure Injury Prevention Protocol (SPIPP) Checklist 2.0: Content validation

BACKGROUND

Pressure injury prevention is complex, and rates continue to rise. Checklists reduce human error, improve adherence and standardization with complex processes, focus attention on evidence-based practices derived from clinical practice guidelines and are arranged in a systematic manner to manage the entirety of a patient's risk for preventable outcomes. The original Standardized Pressure Injury Prevention Protocol was created to provide a checklist of pressure injury prevention measures but needed revision and validation.

PURPOSE

This article describes the revision and content validity testing of the Standardized Pressure Injury Prevention Protocol Checklist 2.0 that took place in 2022.

METHODS

Using the International 2019 Clinical Practice Guideline as a foundation, items were identified/revised, and expert review of the items was obtained. The Standardized Pressure Injury Prevention Protocol 2.0 underwent three rounds of revision by experts from the National Pressure Injury Advisory Panel. A panel of eight national experts completed the content validity survey. Individual item content validity index and total scale content validity index were used to summarize the content validity survey scores.

RESULTS

The individual item content validity index scores ranged from 0.5 to 1.0. One item (using a mirror to look at heels) was rated as 0.5, three items were 0.75, 20 items were 0.875 and 23 items were 1.0. The item scoring 0.5 was deleted. Those items scoring 0.75 were revised using the content experts' recommendations. The total scale content validity index was 0.93.

CONCLUSION

The Standardized Pressure Injury Prevention Protocol 2.0 provides a standardized checklist of evidence-based items that operationalize a rigorous clinical practice guideline for the prevention of pressure injuries. Early intervention using a standardized approach and evidence-based checklist that can be integrated into the workflow of the direct-care nurse and provider provides the best opportunity for successful and sustainable pressure injury prevention.

Content Validity and Psychometric Properties of the German Version of the Holm and Cordoba Urinary Tract Infection Score for Uncomplicated Urinary Tract Infections in Women: Protocol for a Validation Study

BACKGROUND

Uncomplicated urinary tract infections (UTIs) in women are among the most common bacterial infections in primary care. Given the health threats related to the overuse of antibiotics, alternative options are of increasing importance. Patient-reported outcome measures are valuable tools for including the patients' perspective when evaluating the efficacy of these strategies. Aiming to identify a suitable instrument to measure the severity and bothersomeness of UTI symptoms in women, we performed a systematic review of the literature and identified the Holm and Cordoba Urinary Tract Infection Score (HCUTI), which measures the severity, bothersomeness, and impact of uncomplicated UTIs on daily activities. This instrument showed sufficient content validity but needs translation and further validation before it can be used in German research.

OBJECTIVE

For use in the German setting, we aim (1) to perform translation and linguistic validation of the HCUTI and (2) to evaluate content validity and psychometric properties of the German version of the HCUTI in a population of women with uncomplicated UTIs.

METHODS

The HCUTI will be translated and linguistically validated using the dual-panel method. This process involves a bilingual translation panel and a lay panel to check the comprehensibility of the translation. Content validity of the translated questionnaire will be assessed using cognitive interviews according to the criteria for good content validity as recommended by the COSMIN (Consensus-based Standards for the selection of health Measurement Instruments) group involving women with uncomplicated UTIs and health care professionals. Subsequent psychometric validation of the German version of the HCUTI in a population of women with uncomplicated UTIs will include the assessment of structural validity, internal consistency, test-retest reliability, construct validity, responsiveness, and interpretability.

RESULTS

Results of the translation and linguistic validation process and the results of the content validity study were obtained in September 2023 and will be published separately. Data on the psychometric properties of the German version of the HCUTI are anticipated in mid-2024.

CONCLUSIONS

We expect that data from the content validity study will provide important suggestions for potential modifications of the HCUTI for use in the German setting. The final version of the questionnaire will be used for the assessment of its psychometric properties in a large population of women with uncomplicated UTIs.

INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID)

PRR1-10.2196/49903.

A Systematic Review and Quality Assessment of Cardiovascular Disease-Specific Health-Related Quality-of-Life Instruments Part I: Instrument Development and Content Validity

OBJECTIVES

Health-related quality-of-life (HRQoL) instruments for cardiovascular diseases (CVD) have been commonly used to measure important patient-reported outcomes (PROs) in clinical trials and practices. This study aimed at systematically identifying and assessing the content validity of CVD-specific HRQoL instruments in clinical studies.

METHODS

The research team searched Cumulative Index to Nursing and Allied Health Literature, Embase, and PubMed from inception to January 20, 2022. The research team included studies that reported the development and content validity for CVD-specific instruments. Two reviewers independently assessed the methodological quality using the Consensus-based Standards for the Selection of Health Measurement Instruments methods on evaluating content validity of PROs. Content analysis was used to categorize the items included in the instruments.

RESULTS

The research team found 69 studies reporting the content validity of 40 instruments specifically developed for CVD. Fourteen (35.0%) were rated "sufficient" with very low to moderate quality of evidence. For PRO development, all instruments were rated "doubtful" or "inadequate." Twenty-eight (70.0%) instruments cover the core concepts of HRQoL.

CONCLUSIONS

The quality of development and content validity vary among existing CVD-specific instruments. The evidence on the content validity should be considered when choosing a HRQoL instrument in CVD clinical studies and health economic evaluations.

Patient-reported outcome measures for dysphagia in head and neck cancer: A systematic review and appraisal of content validity and internal structure

Dysphagia is a major head and neck cancer (HNC) issue. Dysphagia-related patient-reported outcome measures (PROMs) are critical for patient-centred assessment and intervention tailoring. This systematic review aimed to derive a comprehensive inventory of HNC dysphagia PROMs and appraise their content validity and internal structure. Six electronic databases were searched to February 2023 for studies detailing PROM content validity or internal structure. Eligible PROMs were those developed or validated for HNC, with ≥20% of items related to swallowing. Two independent raters screened citations and full-text articles. Critical appraisal followed COSMIN guidelines. Overall, 114 studies were included, yielding 39 PROMs (17 dysphagia-specific and 22 generic). Of included studies, 33 addressed PROM content validity and 78 internal structure. Of all PROMs, only the SOAL met COSMIN standards for both sufficient content validity and internal structure. Notably, the development of 18 PROMs predated the publication of COSMIN standards. In conclusion, this review identified 39 PROMs addressing dysphagia in HNC, of which only one met COSMIN quality criteria. Given that half of PROMs were developed prior to COSMIN guidelines, future application of current standards is needed to establish their psychometric quality.

Cross-Cultural Adaptation and Validation of the Malay-Translated Version of the Food Neophobia Scale for Malaysian Young Adults

The Food Neophobia Scale (FNS) is a research instrument, originally developed in English, to assess an individual's level of food neophobia. However, it has not yet been translated and validated for Malaysians. Therefore, we aimed to translate and validate a Malay-translated version of the FNS. Respondents were 200 young adults (mostly females, 73%; and students, 82.0%; M age = 22.3 years, SD = 2.3). We first translated the FNS into Malay using the forward-backward translation method, and a panel of nutrition and dietetics experts then reviewed it for item relevance, clarity, simplicity, and ambiguity. The translated FNS suggested good content validity with an item-level content validity index (I-CVI) > .8, a scale-level content validity index (S-CVI)/average = .8 and a S-CVI/universal agreement = .96. Principal component analysis revealed a two-factor model: (i) willingness and trust; and (ii) rejection and fear. Cronbach's alpha for the Malay-translated FNS was .808, demonstrating high internal consistency and reliability among young Malaysian adults. Future investigators can now use this Malay-translated FNS instrument to determine levels of food neophobia among Malaysians.

Assessment of patients with head and neck cancer using the MD Anderson Dysphagia Inventory: Results of a study into its comprehensiveness, comprehensibility and relevance to clinical practice

BACKGROUND

The MD Anderson Dysphagia Inventory (MDADI) is a widely used patient-reported outcome measure (PROM) which assesses dysphagia-related quality of life (QoL) in head and neck cancer (HNC). Despite its common use in HNC research and clinical practice, few of its psychometric properties have been reappraised since its inception. The aim of this study was to perform a survey-based qualitative analysis of UK HNC clinicians' perceptions of the content validity of the MDADI, evaluating it across the parameters of relevance, comprehensiveness and comprehensibility as per the COSMIN guideline for PROM assessment.

RESULTS

Four themes relating to the content validity of the MDADI were identified: (1) MDADI items lack clarity of definition of the terms 'swallowing', 'eating' and 'dysphagia'; (2) the MDADI is perceived to be overly negative in tone including items that service users may find distressing or disempowering; (3) items in the tool are exclusory to specific subgroups of patients, such as those who are nil by mouth or socially isolated; and (4) modifications to the MDADI were suggested and encouraged to make it more clinically useful and patient-centred.

CONCLUSIONS

This study indicates that MDADI's content validity is 'insufficient' when rated by COSMIN parameters. This has significant implications for its continued use in HNC research and clinical practice. Further re-evaluation of the content validity of the MDADI is warranted, with potential future amendment of items being indicated if the results of this study are corroborated in subsequent research.

WHAT THIS PAPER ADDS

What is already known on the subject The MD Anderson Dysphagia Inventory (MDADI) patient-reported outcome measure of dysphagia-related quality of life is widely used in clinical practice and international clinical trials. Content validity is considered to be the most important property of a tool when assessing its psychometric strengths and weaknesses; however, the MDADI's content validity has not been reappraised since its initial development. What this paper adds to existing knowledge This study presents UK speech and language therapists' opinions and experience of the content validity of the MDADI and this first reappraisal of its content validity since its initial development highlights several issues with this psychometric parameter of the tool. This study highlights that further re-evaluation of the content validity of the MDADI is warranted, with potential future amendment of items being indicated if the results of this study are corroborated in subsequent research. What are the potential or actual clinical implications of this work? Clinicians cannot assume that commonly used outcomes tools have strong psychometric profiles. Consideration of the content validity of outcomes tools during selection for use in clinical and research practice should be key, as this will encourage use of tools that produce relevant, valid data that can contribute meaningfully to patient-centred care.

Consensus on the definition and assessment of external validity of randomized controlled trials: A Delphi study

External validity is an important parameter that needs to be considered for decision making in health research, but no widely accepted measurement tool for the assessment of external validity of randomized controlled trials (RCTs) exists. One of the most limiting factors for creating such a tool is probably the substantial heterogeneity and lack of consensus in this field. The objective of this study was to reach consensus on a definition of external validity and on criteria to assess the external validity of RCTs included in systematic reviews. A three-round online Delphi study was conducted. The development of the Delphi survey was based on findings from a previous systematic review. Potential panelists were identified through a comprehensive web search. Consensus was reached when at least 67% of the panelists agreed to a proposal. Eighty-four panelists from different countries and various disciplines participated in at least one round of this study. Consensus was reached on the definition of external validity ("External validity is the extent to which results of trials provide an acceptable basis for generalization to other circumstances such as variations in populations, settings, interventions, outcomes, or other relevant contextual factors"), and on 14 criteria to assess the external validity of RCTs in systematic reviews. The results of this Delphi study provide a consensus-based reference standard for future tool development. Future research should focus on adapting, pilot testing, and validating these criteria to develop measurement tools for the assessment of external validity.

Knowledge, Awareness, and Practice of Safety and Emergency Response Among Scuba Divers in Malaysia: Questionnaire Development and Validation

INTRODUCTION

Safety has become paramount to ensure that scuba diving continues to expand into new markets, with minimal risks, and that scuba diving translates into a safe and relaxed adventure in response to growing market demands. Research focusing on assessing the knowledge, awareness, and practices (KAP) regarding safety and emergency response among scuba divers has been limited, and there is a need for validated assessment tools in this area.

METHODS

This study involved 555 scuba divers in Malaysia, and the questionnaire underwent a thorough development and validation process, including content and face validity assessments, as well as exploratory factor analysis. The validation of the knowledge domain was conducted using Item Response Theory (IRT) analysis, while awareness and practice were validated through exploratory and confirmatory factor analyses (EFA and CFA).

RESULTS

The content validity of the instrument was confirmed, with all items scoring over 80% for Item Content Validity Index (I-CVI), Scale Content Validity Index (S-CVI), and Scale Content Validity Index/Average (S-CVI/AVE). The initial draft comprises three domains: knowledge, awareness, and practice. Knowledge items were analyzed using IRT and demonstrated acceptable difficulty and discrimination levels. For the awareness and practice domains, EFA showed a Kaiser-Meyer-Olkin measure (KMO) of 0.83 and 0.79, respectively, with a significant Bartlett's test of Sphericity (P < 0.001). EFA yielded three factors for both awareness and practice domains with a total of 12 items for awareness and 13 items for practice, with satisfactory factor loadings (≥0.3). The final model of CFA showed good fits for both awareness and practice domains in terms of absolute, parsimonious, and comparative measures. The composite reliability of awareness was acceptable with Raykov's rho of 0.71, whereas the practice domain fell slightly below the acceptable threshold at 0.55. This was attributed to low factor loading and a limited number of items within each factor. The final questionnaire now consists of 20 items for knowledge, 10 items for awareness, and 12 items for the practice domain.

CONCLUSION

The results of this validation and reliability study indicate that the newly developed questionnaire possesses favorable psychometric properties for assessing KAP related to safety and emergency response in the scuba diving context. This research is essential for harmonizing the perspectives of crucial stakeholders within the recreational scuba diving industry.

How Well Does the EQ-5D-Y-5L Describe Children With Intellectual Disability?: "There's a Lot More to My Child Than That She Can't Wash or Dress Herself."

OBJECTIVES

The EQ-5D-5L is a generic health utility instrument for measuring health-related quality of life (HRQoL), with self-report and proxy report versions for children (EQ-5D-Y-5L). Children with intellectual disability (ID) are a heterogeneous population whose impairments and comorbidities place them at risk of poor HRQoL. This study aimed to describe the content validity and suitability for children with ID of a proxy report version of the EQ-5D-Y-5L as seen by their caregivers.

METHODS

A proxy report EQ-5D-Y-5L was administered to caregivers of children with ID. Using cognitive think-aloud interviewing, participants were encouraged to provide the reasoning for their choices, assess the questions' relevance, comprehensibility, and comprehensiveness, and comment on the tool's strengths and weaknesses. Qualitative content analysis used both directed (deductive) and conventional (inductive) methods.

RESULTS

There were 28 interviews with 30 caregivers of children with ID (aged 8-22 years, 17 boys, with autism spectrum disorder, cerebral palsy, Down syndrome, and rare genetic disorders). The EQ-5D-Y-5L was considered clear, concise, and largely relevant, but insufficiently comprehensive for this population. Interviewees sought clarification of the definition of HRQoL, whether it included unchanging impairments (vs fluctuating health states), and what basis of comparison to use (child or peer). Many interviewees suggested inclusion of questions for other domains, including communication and social engagement, equipment and human supports required, and a wider range of mental health questions.

CONCLUSIONS

The study suggests that further work is required to ensure accurate responses to the EQ-5D-Y-5L from caregivers of children with ID and to describe these children adequately.

Development and Validation of an Auricular Acupuncture Protocol for the Management of Chemotherapy-Induced Nausea and Vomiting in Cancer Patients

Auricular acupuncture (AA) has been used to manage chemotherapy-induced nausea and vomiting (CINV). However, the application of the technique varies widely among the clinical trials that test its effectiveness. The aim of the present study was to develop and clinically validate an AA protocol for the management of CINV in cancer patients. This study was carried out in two stages: (1) development of the AA protocol for the management of CINV and (2) clinical validation of the protocol. The content validity of the protocol was determined by a panel of specialists, with an agreement rate ranging from 85.7% to 100%. In the clinical validation, when administered to cancer patients, the protocol developed has been shown to reduce the incidence, frequency, severity, and length of nausea and vomiting following chemotherapy, as well as the severity of nausea and anticipatory nausea following chemotherapy. This protocol needs to be tested in future studies, including a pilot study with a sham group and a randomized clinical trial, in order to further evaluate its feasibility, acceptability, safety, and clinical usefulness for the management of CINV.

Content validity of the International Classification of Functioning, Disability and Health core set for knee dysfunction: a Delphi study

OBJECTIVE

To assess the content validity of the preliminary core set for knee dysfunction based on the opinion of experts.

DESIGN

A panel of 180 experts in knee disorders or on the use of the International Classification of Functioning, Disability, and Health for musculoskeletal conditions was invited for this Delphi study. The experts gave their opinion on whether to include the categories of the preliminary core set for knee dysfunction in a more comprehensive core set, using a six-item Likert scale. Kappa coefficient was used to analyze the agreement between the experts, and a consensus of 75% among responses was considered acceptable.

RESULTS

Nineteen experts participated in all rounds. Of the 24 categories from the preliminary core set for knee dysfunction, 15 remained in the comprehensive core set and one category was further detailed into three new categories. Seven new categories were included. Thus, the comprehensive core set for knee dysfunction was composed of 25 categories with an agreement of 81.5% among responses and a Kappa value of 0.63.

CONCLUSION

After validation by experts, the comprehensive core set for knee dysfunction was composed of 25 categories that can be used to assess the functioning of patients with knee dysfunction.

Assessing the Content Validity of Preference-Based Measures in Cancer

OBJECTIVES

This study assessed the content validity of generic and condition-specific preference-based measures (PBMs) with patients treated for cancer, evaluated against 10 Consensus-Based Standards for the Selection of Health Measurement Instruments criteria for good content validity, to best inform measurement strategies regarding the use of PBMs in oncology development programs and real-world applications.

METHODS

Individual, semistructured interviews were conducted with patients who received drug treatment for cancer in the United Kingdom (n = 47) and the United States (n = 49). During the interview, patients completed 3 generic PBMs (EQ-5D-5L, EuroQol Health and Wellbeing measure-Short Form, Château Santé Base) and 2 condition-specific PBMs (Quality of Life Utility-Core 10 Dimension, Functional Assessment of Cancer Therapy Eight Dimension [FACT-8D]). Interviews were conducted via teleconference, audio recorded, and transcribed verbatim. Transcripts were coded using thematic and content analysis methods.

RESULTS

Condition-specific measures were evaluated as having better relevancy than generic PBMs. Overall, the FACT-8D was evaluated as holding the best content validity in terms of relevancy, and the EuroQol Health and Wellbeing measure-Short Form received the most favorable evaluation of relevancy for generic PBMs. All measures demonstrated comparable comprehensiveness, with all suggested by patients to be missing concepts. The EQ-5D-5L was evaluated best in terms of comprehensibility. This was followed by the Quality of Life Utility-Core 10 Dimension and FACT-8D; both received similar evaluations.

CONCLUSIONS

All measures were generally seen by patients as adequate in capturing appropriate aspects of health-related quality of life for measuring cancer outcomes, although together condition-specific measures were evaluated as having better relevancy than generic PBMs. Further health-related quality of life instrument development is encouraged, particularly with regard to the longer-term detrimental impacts of cancer and treatment side effects. Other developments could include new cancer-specific tools inclusive of conventional health items, treatment impacts, and psychological items.

Exploring the contributions of expert review and cognitive interviewing to evaluating the content validity of items for anew measure of adolescent social communication, the Transition Pragmatics Interview

Interventions to facilitate improvement in adolescent social communication are more effective when they are tailored to adolescents' individual profiles of ability. Current social communication assessments for adolescents are not designed to identify their profiles of ability for settings beyond compulsory education. To address this gap, we developed the Transition Pragmatics Interview (TPI). The purpose of these studies was to evaluate the content validity of items developed for the TPI using expert review and cognitive interviewing. Cognitive interviewing is recommended in health-related measurement standards but is not widely reported for assessments of developmental language disorders. Six speech-language pathologists participated in the expert review, rating how well TPI items represented facets of social communication ability. All questions were rated as representative of their intended construct. Eight adolescents (age 14-21) of varied social communication abilities participated in the cognitive interview study to explore whether items were understood as intended by the developers. Participants responded to each item while aresearcher observed their response process and asked questions to identify the respondents' thinking about the items. Transcribed responses were classified based on whether they indicated aconstruct-irrelevant difficulty with the item. Nine of 52 items were identified with recall difficulties, ambiguous wording or potential sources of bias. Cognitive interviewing complemented expert review by identifying issues with content validity not identified by expert review. Items with construct-irrelevant barriers to response will be modified and re-evaluated prior to field testing.

Development of the Canadian Eating Practices Screener to assess eating practices based on 2019 Canada's Food Guide recommendations

In 2019, Health Canada released a new iteration of Canada's Food Guide (2019-CFG), which, for the first time, highlighted recommendations regarding eating practices, i.e., guidance on where, when, why, and how to eat. The objective of this study was to develop a brief self-administered screener to assess eating practices recommended in the 2019-CFG among adults aged 18-65 years. Development of the screener items was informed by a review of existing tools and mapping of items onto 2019-CFG recommendations. Face and content validity were assessed with experts in public health nutrition and/or dietary assessment (n = 16) and individuals from Government of Canada (n = 14). Cognitive interviews were conducted with English-speaking (n = 16) and French-speaking (n = 16) adults living in Canada to assess face validity and understanding of the screener items. While some modifications were identified to improve relevance or clarity, overall, the screener items were found to be relevant, well-constructed, and clearly worded. This comprehensive process resulted in the Canadian Eating Practices Screener/Questionnaire court canadien sur les pratiques alimentaires, which includes 21 items that assess eating practices recommended in the 2019-CFG. This screener can facilitate monitoring and surveillance efforts of the 2019-CFG eating practices as well as research exploring how these practices are associated with various health outcomes.

Preference-based patient participation in intermediate care: Translation, validation and piloting of the 4Ps in Norway

INTRODUCTION

The implementation and evaluation of patient participation to obtain high-quality transitional care for older people is an international priority. Intermediate care (IC) services are regarded as an important part of the patient's pathway from the specialist to the primary care levels, bridging the gap between the hospital and the home. Patients may experience varying capacities and conditions for patient participation. Yet, few tools for evaluating patients' preferences for patient participation within IC services are at hand. Accordingly, further knowledge is needed to understand and scaffold processes for patient participation in IC. Therefore, the aim of this project was to translate, validate and pilot test the Patient Preferences for Patient Participation (the 4Ps) with patients in IC services in Norway.

METHODS

This project comprised two phases: (1) a careful translation and cultural adaptation process, followed by a content validity trial among 15 patients and staff in Norwegian IC and (2) a cross-sectional survey of the instrument with 60 patients admitted to IC.

RESULTS

The translation between Swedish and Norwegian required no conceptual or contextual adaptations. The subsequent cross-sectional study, designed as a dialogue between the patients and staff, revealed that only 50% of the participants received a sufficient level of patient participation based on their preferences, mostly indicating that patients were receiving less-than-preferred conditions for engaging in their health and healthcare issues.

CONCLUSION

The 4Ps instrument was deemed suitable for measuring patient participation based on patient preferences in the IC context and was feasible for both healthcare professionals and patients to complete in an interview when arriving at and leaving services. This may support person-centred communication and collaboration, calling for further research on what facilitates patient participation and the implementation of person-centred services for patients in IC.

PATIENT OR PUBLIC CONTRIBUTION

First, the current paper is part of the IPIC study (i.e., the implementation of patient participation in IC). Influenced by a James Lind Alliance process, the study addresses research uncertainties identified by patients, next of kin, staff and researchers in the cocreation process. Second, cognitive interviewing was conducted with 15 representatives of the target population: seven patients receiving IC services, one home-dwelling previous IC patient (altogether four women and four men, most of them 80 years or older) and seven healthcare staff working in IC services. The interviews determined the relevance, comprehensiveness and clarity of the 4Ps. Finally, 60 patients admitted to IC took part in the cross-sectional study.

Application of the Delphi Method for Content Validity Analysis of a Questionnaire to Determine the Risk Factors of the Chemsex

Chemsex is understood as "the intentional use of stimulant drugs to have sex for an extended time among gay, bisexual, and other men who have sex with men". It is a public health problem because of the increased incidence of cases and because of the consequences on the physical and mental health of those who practice it.

AIM

This study aimed to analyze, with the help of the Delphi method, the content validity of a new instrument to assess the risk of behaviors associated with the chemsex phenomenon.

METHOD

First, a bank of items identified from the literature was elaborated. Secondly, 50 experts with knowledge of the chemsex phenomenon at the national level were contacted. A Delphi group was formed with them to carry out two rounds of item evaluation. The linguistic evaluation (comprehension and appropriateness) was assessed using a Likert scale from 1 to 5 for each item. Items that did not reach a mean score of 4 were eliminated. Content assessment was calculated using each item's content validity index (CVI) and Aiken's V (VdA). A minimum CVI and VdA value of 0.6 was established to include the items in the questionnaire.

RESULTS

A total of 114 items were identified in the literature. In the first round of Delphi evaluation, 36 experts evaluated the items. A total of 58 items were eliminated for obtaining a CVI or VdA of less than 0.6, leaving 56 items. In a second Delphi round, 30 experts re-evaluated the 56 selected items, where 4 items were eliminated for being similar, and 10 items were also eliminated for not being relevant to the topic even though they had values higher than 0.6, leaving the scale finally composed of 52 items.

CONCLUSION

A questionnaire has been designed to assess the risk of behaviors associated with the chemsex phenomenon. The items that make up the questionnaire have shown adequate content and linguistic validity. The Delphi method proved to be a helpful technique for the proposed objective.

The Feasibility and Validity of Preference-Based Quality of Life Measures With Informal Carers: A Think-Aloud Study

OBJECTIVES

A range of preference-based quality of life (QoL) measures have been proposed for use with informal carers. Qualitative evaluation of validity and feasibility of the measures is an important step in understanding whether measures will work as intended. At present, little is known about the performance of different types of preference-based QoL measures with informal carers. The objective of this study was to qualitatively assess the feasibility, content validity (including face validity), and acceptability of 5 QoL measures (the Carer Experience Scale, CarerQoL-7D, ASCOT-C, ICECAP-A, and EQ-5D-5L) with informal carers.

METHODS

A total of 24 "think-aloud" interviews were conducted with a cross-section of carers of adults in the United Kingdom. This think-aloud process was followed by semistructured discussion to probe issues of validity and feasibility in more detail. The interview data were transcribed, coded to identify the frequency of errors in completing the QoL measures and thematically analyzed to study the validity, feasibility, and acceptability of the measures.

RESULTS

Few errors (3%-7% per item) were identified in completing each of the measures with little distinct pattern. Most participants found the measures to be concise, clear, and relevant. Challenges included relevance, context, time period, missing items, multiple questions, and response options. Informal carers generally expressed a preference for using a care-related QoL measure.

CONCLUSIONS

Existing preference-based QoL measures have encouraging validity and feasibility within a mixed sample of informal carers, with minor challenges raised. These challenges ought to be considered, alongside the decision context, when administering QoL measures in this context.

Development of the item pool for the 'WHO-ageism scale': conceptualisation, item generation and content validity assessment

OBJECTIVES

ageism harms individuals' health and wellbeing and can be costly to societies. Reliable and valid measures that can quantify ageism are critical for achieving accurate data on its global prevalence, determinants and impacts, and to evaluate the effectiveness of interventions to reduce it. Ageism scales exist; however, none have been demonstrated to validly measure ageism in a manner consistent with consensus definitions of the concept (i.e. as manifested in all of stereotypes, prejudices and discrimination), whilst also quantifying ageism against all groups, from a target and perpetrator perspective, and across diverse country settings. Our objective was to develop an item pool to meet this need.

METHODS

we completed the conceptualisation, item generation and content validity assessment phases of a new World Health Organisation (WHO) WHO-ageism item pool that aims to measure the multi-dimensional nature of ageism. These phases drew on a review of available evidence, an experts' workshop and structured content validity reviews conducted by experts in scale development and ageism drawn from every world region defined by WHO.

RESULTS

our resulting item pool is designed to provide a multi-dimensional measure of ageism against all ages measured from both a perpetration and experienced perspective and that can produce valid and reliable scores within diverse country contexts and comparable scores across these contexts.

CONCLUSIONS

our item pool is the first major step in providing a global and comprehensive measure of ageism. Future phases of research will refine the item pool and establish the statistical psychometric properties of the final tool.

Assessing the Content Validity, Acceptability, and Feasibility of the Hypo-METRICS App: Survey and Interview Study

BACKGROUND

The Hypoglycaemia - MEasurement, ThResholds and ImpaCtS (Hypo-METRICS) smartphone app was developed to investigate the impact of hypoglycemia on daily functioning in adults with type 1 diabetes mellitus or insulin-treated type 2 diabetes mellitus. The app uses ecological momentary assessments, thereby minimizing recall bias and maximizing ecological validity. It was used in the Hypo-METRICS study, a European multicenter observational study wherein participants wore a blinded continuous glucose monitoring device and completed the app assessments 3 times daily for 70 days.

OBJECTIVE

The 3 aims of the study were to explore the content validity of the app, the acceptability and feasibility of using the app for the duration of the Hypo-METRICS study, and suggestions for future versions of the app.

METHODS

Participants who had completed the 70-day Hypo-METRICS study in the United Kingdom were invited to participate in a brief web-based survey and an interview (approximately 1h) to explore their experiences with the app during the Hypo-METRICS study. Thematic analysis of the qualitative data was conducted using both deductive and inductive methods.

RESULTS

A total of 18 adults with diabetes (type 1 diabetes: n=10, 56%; 5/10, 50% female; mean age 47, SD 16 years; type 2 diabetes: n=8, 44%; 2/8, 25% female; mean age 61, SD 9 years) filled out the survey and were interviewed. In exploring content validity, participants overall described the Hypo-METRICS app as relevant, understandable, and comprehensive. In total, 3 themes were derived: hypoglycemia symptoms and experiences are idiosyncratic; it was easy to select ratings on the app, but day-to-day changes were perceived as minimal; and instructions could be improved. Participants offered suggestions for changes or additional questions and functions that could increase engagement and improve content (such as providing more examples with the questions). In exploring acceptability and feasibility, 5 themes were derived: helping science and people with diabetes; easy to fit in, but more flexibility wanted; hypoglycemia delaying responses and increasing completion time; design, functionality, and customizability of the app; and limited change in awareness of symptoms and impact. Participants described using the app as a positive experience overall and as having a possible, although limited, intervention effect in terms of both hypoglycemia awareness and personal impact.

CONCLUSIONS

The Hypo-METRICS app shows promise as a new research tool to assess the impact of hypoglycemia on an individual's daily functioning. Despite suggested improvements, participants' responses indicated that the app has satisfactory content validity, overall fits in with everyday life, and is suitable for a 10-week research study. Although developed for research purposes, real-time assessments may have clinical value for monitoring and reviewing hypoglycemia symptom awareness and personal impact.

Validity and reliability of the orthodontic experience questionnaire in Malayalam, an Indian language

AIM

To translate the orthodontic experience questionnaire into Malayalam, an Indian language, and assess its validity and reliability in the Kerala population.

MATERIALS AND METHODS

The original questionnaire, which was developed in English, was translated into Malayalam. Face validity was assessed, and minor changes were made, followed by a content validity assessment by an expert panel. The final version was given to 324 patients who marked their responses on a Likert scale. Internal consistency reliability was tested using Cronbach's alpha, and test-retest reliability was tested using the intraclass correlation coefficient. Principal component factor analysis was performed to regroup the valid items.

RESULTS

The principal component factor analysis revealed three domains. Reliability assessed by Cronbach's alpha of the whole questionnaire was 0.799, and that of the three domains was 0.73, 0.71, and 0.71, respectively. The test-retest reliability was found to be good (0.798).

CONCLUSION

The Malayalam version of the orthodontic experience questionnaire was found to be content valid with good reliability. To obtain a successful treatment result, an orthodontist must be aware of these and this questionnaire, with adequate validity and reliability, has been designed to achieve this in the Malayalam-speaking population.

Intersectoral Development of an Evaluation Tool for the Socio-Professional Rehabilitation Process Adapted to People with Autism

Since there was no French tool adapted to the reality of people with autism enrolled in a work integration program in Quebec, we have modified the Profile of Rehabilitation and Adaptation in a Work Context for People with Intellectual Disabilities according to the scientific literature on autism. Content validity (n=17) and applicability (n=5) were done with success. Result is an Excel compiler containing 3 informative tabs, 10 tabs on the dimensions of work rehabilitation (59 items) and 4 tabs used to compile the results. Socio-professional practicians are welcomed to use this new tool to pursue construct and internal validity.

Adaptation and content validation of a patient-reported measure of treatment burden for use in stroke survivors: the patient experience with treatment and self-management in stroke (PETS-stroke) measure

PURPOSE

Stroke survivors often live with significant treatment burden yet our ability to examine this is limited by a lack of validated measurement instruments. We aimed to adapt the 60-item, 12-domain Patient Experience with Treatment and Self-Management (PETS) (version 2.0, English) patient-reported measure to create a stroke-specific measure (PETS-stroke) and to conduct content validity testing with stroke survivors.

MATERIALS AND METHODS

Step 1 - Adaptation of PETS to create PETS-stroke: a conceptual model of treatment burden in stroke was utilised to amend, remove or add items. Step 2 - Content validation: Fifteen stroke survivors in Scotland were recruited through stroke groups and primary care. Three rounds of five cognitive interviews were audio recorded and transcribed. Framework analysis was used to explore importance/relevance/clarity of PETS-stroke content. COSMIN reporting guidelines were followed.

RESULTS

The adapted PETS-stroke had 34 items, spanning 13 domains; 10 items unchanged from PETS, 6 new and 18 amended. Interviews (n = 15) resulted in further changes to 19 items, including: instructions; wording; item location; answer options; and recall period.

CONCLUSIONS

PETS-stroke has content that is relevant, meaningful and comprehensible to stroke survivors. Content validity and reliability testing are now required. The validated tool will aid testing of tailored interventions to lessen treatment burden.IMPLICATIONS FOR REHABILITATIONTreatment burden is reported by stroke survivors but no stroke-specific measure of treatment burden exists.We adapted an existing measure of treatment burden for use in multimorbid patients (PETS) to create a stroke specific version (PETS-stroke).The items in PETS-stroke are relevant and meaningful to people with stroke.Further testing will examine construct validity, reliability, and useability.This measure will be useful in future RCTs to measure treatment burden and to identify stroke patients who are at high risk of treatment burden.

Development of the Canadian Food Intake Screener to assess alignment of adults' dietary intake with the 2019 Canada's Food Guide healthy food choices recommendations

NOVELTY

The Canadian Food Intake Screener was developed to rapidly assess alignment of adults' dietary intake over the past month with the Food Guide's healthy food choices recommendations. The screener was developed and evaluated through an iterative process that included three rounds of cognitive interviews in each of English and French, along with ongoing feedback from external advisors and face and content validity testing with a separate panel of content experts. The 16-question screener is intended for use with adults, aged 18-65 years, with marginal and higher health literacy in research and surveillance contexts in which comprehensive dietary assessment is not possible.

Using Patient Blogs on Social Media to Assess the Content Validity of Patient-Reported Outcome Measures: Qualitative Analysis of Patient-Written Blogs

BACKGROUND

Patient-reported outcome measures (PROMs) are questionnaires that measure patient outcomes related to quality of life, health, and functioning, and are increasingly used to assess important outcomes from the patient's perspective. For PROMs to contribute to better health and better care, it is vital that their content validity be adequate. This requires patient involvement in various steps of PROM development. PROM developers not only recognize the benefits of patient involvement but also report difficulties in recruiting patients and experience patient involvement as time-consuming, logistically challenging, and expensive.

OBJECTIVE

This study seeks to explore different strategies for disclosing the experiential knowledge of patients, namely through analyzing patient stories on the web and social media. The research questions are as follows: (1) how do bloggers living with a disease experience their health-related quality of life? (2) How are these experiences reflected in the domains and items of PROMs related to their disease?

METHODS

First, a qualitative analysis of blogs written by patients was performed. Second, subthemes and underlying codes resulting from this qualitative analysis were systematically compared with the domains and items in PROMs for the respective diseases that the bloggers write about. Blogs were identified via the Google search engine between December 2019 and May 2021.

RESULTS

Bloggers describe a wide range of experiences regarding their physical functioning and health; mental well-being; social network and support; daily life, education, work, and leisure; coping; and self-management. Bloggers also write about their positive and negative experiences with health care delivery, the organization of health care, and health care professionals. In general, patients' experiences as described in blogs were reflected in the domains and items of the PROMs related to their disease. However, except for diabetes mellitus, in all the sets of PROMs, potentially missing topics could be identified. Similarly, with the exception of Parkinson disease, all PROMs address issues that patients did not write about in their blogs and that might therefore be redundant.

CONCLUSIONS

Web-based patient stories in the form of blogs reveal how people living with a certain disease experience their health-related quality of life. These stories enable analyses of patients' experiences that can be used to assess the content validity of PROMs. This can be a useful step for researchers who are looking for sets of measuring instruments that match their purposes.

The Transthyretin Amyloidosis - Quality of Life (ATTR-QOL) Questionnaire: Development of a Conceptual Model and Disease-Specific Patient-Reported Outcome Measure

Purpose

Patients with transthyretin amyloidosis (ATTR) experience a wide variety of symptoms and impacts on health-related quality of life (HRQoL). However, the lack of an ATTR-specific patient-reported outcome (PRO) measure has made consistent measurement of HRQoL in ATTR challenging. This paper describes the development of a conceptual model and subsequent content for the Transthyretin Amyloidosis - Quality of Life Questionnaire (ATTR-QOL), an ATTR-specific PRO measure.

Methods

This was a cross-sectional, non-interventional, US-based study. The study design included three stages: 1) a targeted literature review followed by qualitative data collection with patients and experts; 2) development of a conceptual model and PRO measure; and 3) review of the PRO measure using a modified Delphi method, translatability assessment, and interviews with patients and experts. Revisions were made to the measure after each round of review.

Results

Forty-four patients and 29 experts participated in this study. The conceptual model included two primary concepts of interest: symptoms (cardiac, neuropathic-peripheral, neuropathic-autonomic, and other) and impacts (eg, physical, role, and mental/emotional functioning). Seventy-two items were created (32 symptoms; 40 impacts) to align with the model. A recall period of one month was selected based on participant input.

Conclusion

The ATTR-QOL was created with significant patient involvement and guidance from a multidisciplinary group of experts. The mix of patient and clinical perspectives helped to ensure a balanced representation of all relevant disease experiences and clinical specialties. With further refinement from psychometric testing, the ATTR-QOL will provide a standard, comprehensive measure for all ATTR-specific research including both clinical trials and clinical practice.

Evaluating the content validity of the Single Assessment Numeric Evaluation (SANE) in shoulder pathologies

BACKGROUND

The Single Assessment Numeric Evaluation (SANE) is a single item patient reported outcome measure (PROM) of function, in where patients rate how normal they feel in relation to a specific joint or problem. Although validated for some orthopedic conditions, it is not yet validated for a population with shoulder pathologies; nor have other studies explored the content validity. This study aims to understand how 1) patients with shoulder conditions interpret and calibrate responses to the SANE and 2) how they define normal.

METHODS

This study uses cognitive interviewing, a qualitative methodology that focuses on the interpretation of questionnaire items. Patients with rotator cuff disorders (n = 10), clinicians (n = 6) and measurement researchers (n = 10) were interviewed using a talk aloud structured interview that evaluated the SANE. All interviews were recorded and transcribed verbatim by one researcher (R.F). Analysis was done through an open coding scheme using a previously established framework for classification of interpretation variances.

RESULTS

Overall, the single-item SANE was well received by all participants. Through the interviews, the themes of: Comprehension (20% of participants), Reference Point (20% of participants), Relevance (10% of participants), and Perspective Modifiers (50% of participants) emerged as potential sources of interpretation variances. Clinicians indicated this tool facilitates discussion when trying to create realistic recovery expectations for patients post-operatively. The word "normal" was defined by the themes of: 1) levels of current pain compared to pre-injury, 2) personal expectations of recovery and 3) pre-injury activity levels.

CONCLUSIONS

Overall, respondents found the SANE to be cognitively simple, but it was clear that the interpretation of the question and what factors calibrated their responses were highly variable between respondents. The SANE is perceived favorable by patients and clinicians, while providing a low response burden. However, the construct being measured may vary between patients.

AO Spine Adult Spinal Deformity Patient Profile: A Paradigm Shift in Comprehensive Patient Evaluation in Order to Optimize Treatment and Improve Patient Care

STUDY DESIGN

Modified Delphi study.

OBJECTIVE

Adult spinal deformity (ASD) is an increasingly recognized condition, comprising a spectrum of pathologies considerably impacting patients' health and functional status. Patients present with a combination of pain, disability, comorbidities and radiological deformity. The study aims to propose a systematic approach of gathering information on the factors that drive decision-making by developing a patient profile.

METHODS

The present study comprises of 3 parts. Part 1: Development of prototype of patient profile: The data from the Core Outcome Study on SCOlisis (COSSCO) by Scoliosis Research Society (SRS) was categorized into a conceptual framework. Part 2: Modified Delphi study: Items reaching >70% agreement were included in a 4 round iterative process with 51 panellists across the globe. Part 3: Pilot testing-feasibility: Content validity and usability were evaluated quantitatively.

RESULTS

The profile consisted of 4 domains. 1. General health with demographics and comorbidities, 2.Spine-specific health with spine related health and neurological status, 3. Imaging with radiographic and MRI parameters and 4. Deformity type. Each domain consisted of 1 or 2 components with various factors and their measuring instruments. Profile was found to have an excellent content validity (I-CVIr 0.78-1.00; Ave-CVI 0.92) appropriateness, relevance and usefulness.

CONCLUSIONS

The present study, is first to provide a universally applicable multimodal ASD patient profile to methodically describe patients. Physicians are encouraged to assess ASD patients holistically using this profile and not just based on radiographic findings.

Face Validity, Content Validity, and Psychometric Testing of the Hospital Survey on Patient Safety Culture Among Undergraduate Nursing Students

Background and Purpose: Nursing students have an essential role in patient safety. The purpose of this study was to evaluate the face validity, content validity, and psychometric properties of the Hospital Survey on Patient Safety Culture for Nursing Students (HSOPS-NS). Methods: The cross-sectional study was carried out between January and October 2021. The participants were undergraduate nursing students (N = 482) from 16 Czech nursing faculties. Results: Exploratory factor analysis revealed an eight-factor structure, which was verified by confirmatory factor analysis using the optimization process that results in adequate goodness-of-fit indices (root mean squared error approximation = .037; standardized root mean squared residuals = .056; comparative fit index = .935; Tucker-Lewis index = .926; incremental fit index = .936). The internal consistency of a new model was excellent (α = .914). Conclusion: The results indicate that the HSOPS-NS shows evidence of reliability and validity and is a valuable measure of safety culture as perceived by nursing students.

The assessment of qualitative olfactory dysfunction in COVID-19 patients: a systematic review of tools and their content validity

Background

There is a lack of overview of the tools used to assess qualitative olfactory dysfunction, including parosmia and phantosmia, following COVID-19 illness. This could have an impact on the diagnosis and treatment offered to patients. Additionally, the formulations of symptoms are inconsistent and often unclear, and consensus around the wording of questions and responses is needed.

Aim of study

The aim of this systematic review is to provide an overview of tools used to assess qualitative olfactory dysfunction after COVID-19, in addition to addressing the content validity (i.e., item and response formulations) of these tools.

Methods

MEDLINE, Web of Science, and EMBASE were searched 5th of August 2022 and updated on the 25th of April 2023 to identify studies that assess qualitative olfactory dysfunction in COVID-19 patients. Primary outcomes were the tool used (i.e., questionnaire or objective test) and item and response formulations. Secondary outcomes included psychometric properties, study design, and demographic variables.

Results

The assessment of qualitative olfactory dysfunction is characterized by heterogeneity, inconsistency, and lack of validated tools to determine the presence and degree of symptoms. Several tools with overlapping and distinct features were identified in this review, of which some were thorough and detailed, while others were merely assessing the presence of symptoms as a binary measure. Item and response formulations are also inconsistent and often used interchangeably, which may lead to confusion, incorrect diagnoses, and inappropriate methods for solving the problem.

Conclusions

There is an unmet need for a reliable and validated tool for assessing qualitative olfactory dysfunction, preferably one that also captures quantitative olfactory issues (i.e., loss of smell), to ensure time-effective and specific assessment of the ability to smell. A consensus around the formulation of items and response options is also important to increase the understanding of the problem, both for clinicians, researchers, and the patient, and ultimately to provide the appropriate diagnosis and treatment.

Registration and protocol

The URL is https://www.crd.york.ac.uk/PROSPERO/display_record.php?RecordID=351621. A preregistered protocol was submitted and accepted (12.09.22) in the International prospective register of systematic reviews (PROSPERO) with the registration number CRD42022351621.

Development of a Visuoperceptual Measure for Fiberoptic Endoscopic Evaluation of Swallowing (V-FEES) in Adults with Oropharyngeal Dysphagia: An International Delphi Study

Visuoperceptual evaluation of fiberoptic endoscopic evaluation of swallowing (FEES) is a commonly used assessment in dysphagia or swallowing disorders. Currently, no international consensus exists regarding which visuoperceptual measures to use for the analysis of FEES recordings. Moreover, existing visuoperceptual FEES measures are limited by poor and incomplete psychometric data, identifying an urgent need for developing a visuoperceptual measure to interpret FEES recordings. Following the COSMIN group's (COnsensus-based Standards for the selection of health Measurement INstruments) psychometric taxonomy and guidelines, this study aimed to establish the content validity of a new visuoperceptual FEES (V-FEES) measure in adults with oropharyngeal dysphagia. Using the Delphi technique, international consensus was achieved among dysphagia experts across 21 countries, resulting in a new prototype measure for V-FEES, comprising 30 items, 8 function testing items (i.e., specific tasks performed by patients while observing and rating items), and 36 unique operationalisations (i.e., defining items into measurable factors that could be measured empirically using visuoperceptual observation). This study supports good content validity for V-FEES, including participants' feedback on the relevance, comprehensiveness, and comprehensibility of the included items. Future studies will continue the instrument development process and determine the remaining psychometric properties using both the classic test theory (CTT) and item response theory (IRT) models.

Providing evidence for content validity of the most frequently used hip specific recovery outcome measures in hip fracture studies: an International Classification of Functioning approach

PURPOSE

We established the most commonly used clinician and patient-reported hip fracture outcome measures as of 2022, assessed their content validity using an International Classification of Functioning, Disability and Health (ICF) framework, and operationalized these results to contribute to an updated hip fracture core set.

MATERIALS AND METHODS

A literature search was conducted to identify articles utilizing outcome measures related to hip fracture. A total of five outcome measures were identified, linked to the ICF, and assessed for content validity via bandwidth percent, content density, and content diversity.

RESULTS

Outcome measures were linked to 191 ICF codes, most of which were associated with Activities and Participation. Notably, no outcome measure contained concepts linked to Personal Factors and Environmental Factors were underrepresented across all outcome measures. The modified Harris Hip Score had the highest content diversity (0.67), the Hip Disability and Osteoarthritis Outcome Score had the highest bandwidth of ICF content coverage (2.48), and the Oxford Hip Score had the highest content density (2.92).

CONCLUSIONS

These results clarify the clinical applicability of outcome measures and guide development of hip fracture outcomes that allow providers to assess the complex role of social, environmental, and personal factors in patient rehabilitation.IMPLICATIONS FOR REHABILITATIONHip fracture is a complex and disabling pathology predominantly affecting older adults and represents a public health problem.There are a variety of outcome measures used to assess a patient's recovery following a hip fracture, each with distinctive objectives and modes of administration.Content validity metrics associated with the Harris Hip Score suggest it would be a suitable outcome measure during early-stage recovery, whereas the modified Harris Hip Score may be more suitable for tracking long-term recovery tracking.Choosing an outcome measure most appropriate for a hip fracture patient is an individualized decision that must consider aspects such as age, activity level, needs, and environmental factors.

Development of the self-regulation assessment and content validation using cognitive interviews in a multicultural post-rehabilitation population

Aim

Self-regulation is one of the main goals of medical rehabilitation. Four themes of self-regulation were identified by former patients and rehabilitation physicians in a previous study. Based on these themes, a measure for self-regulation, the self-regulation assessment (SeRA), was developed. This study aimed to establish the content validity of the SeRA in a multicultural and multi-diagnostic post-rehabilitation population.

Methods

The Consensus-based Standards for the selection of health Measurement Instruments (COSMIN) methodology was applied. First, cognitive interviews were held with eight former rehabilitation patients. Feedback was obtained on relevance, comprehensibility, and comprehensiveness of the items. Items with problems were revised. Then, a second series of cognitive interviews was held with 16 former rehabilitation patients with non-Western migration backgrounds. Again, feedback was obtained on relevance, comprehensibility, and comprehensiveness of the items.

Results

The first series of cognitive interviews revealed good comprehensiveness, and also comprehensibility or relevance problems with 12 of the 25 items. These items were revised or deleted. Two missing concepts were identified and these were added. There was no need to revise the items based on the results of the second series of cognitive interviews.

Conclusion

The final version of the SeRA demonstrated content validity for the studied population. The measure is ready for psychometric analyses in subsequent validation studies.

Psychometric properties of a clinical assessment tool in the postgraduate midwifery programme, Botswana

BACKGROUND

 The psychometric properties of a clinical assessment tool used in the postgraduate midwifery programme in Botswana have not been evaluated. A lack of reliable and valid clinical assessment tools contributes to inconsistencies in clinical assessment in midwifery programmes.

OBJECTIVES

 This study aimed to evaluate the internal consistency and content validity of a clinical assessment tool used in the postgraduate midwifery programme in Botswana.

METHOD

 For internal consistency, we calculated the total-item correlation and Cronbach's alpha coefficient. For content validity, subject matter experts completed a checklist to evaluate the relevance and clarity of each competency in the clinical assessment tool. The checklist included questions with Likert-scale responses, indicating the level of agreement.

RESULTS

 The clinical assessment tool had a good reliability, with a Cronbach's alpha of 0.837. The corrected item total correlation values ranged from -0.043 to 0.880 and the Cronbach's alpha (if item deleted) ranged from 0.079 to 0.865. Overall content validity ratio was 0.95, and content validity index was 0.97. Item content validity indices ranged from 0.8 to 1.0. The overall scale content validity index was 0.97 and the scale content validity index using universal agreement was 0.75.

CONCLUSION

 The clinical assessment tool used in the postgraduate midwifery programme in Botswana has acceptable reliability. Most of the competencies included in the clinical assessment tool were relevant and clear. Certain competencies need to be reviewed to improve the reliability and validity of the clinical assessment tool.Contribution: The clinical assessment tool currently used in the postgraduate midwifery programme in Botswana had acceptable internal consistency reliability and validity.

Implementation of a Canine Ergonomic Abdominal Simulator for Training Basic Laparoscopic Skills in Veterinarians

The validity of the CALMA Veterinary Lap-trainer simulator (CVLTS) for training basic veterinary laparoscopic skills was assessed and compared to a simple collapsible mobile box trainer. Ten veterinarian surgeons with no experience in laparoscopic surgery and four experts with at least two years of experience in minimally invasive surgery (MIS) were included. The training curriculum included object transfer, non-woven gauze cutting with curved scissors, and interrupted and continuous intracorporeal sutures, which were practiced on the CVLTS. The initial and final assessments were carried out in both the CVLTS and in a collapsible mobile simulator. These were video-recorded and evaluated by external experts using the Objective Structured Assessment of Technical Skills (OSATS) and a specific scale evaluation in a double-blinded schedule. The time, angular displacement, number, and movement smoothness were recorded using a hands movement assessment system (HMAS). Through a survey, the face validity and content were evaluated. The data were analyzed by a Pearson's proportions comparison or Mann Whitney U test and a bilateral Student's t-test. The experimental group OSATS, specific scores, and HMAS values, with the exception of the smoothness of movements, significantly improved after training, with no statistically significant differences compared to the expert group. No differences were found between the two simulators. The experts' and experimental participants' CVLTS mean score was 4.8. Our data support the CVLTS validations for laparoscopic surgery basic skills training.

Development and Validation of Nutrition and Food Safety Educational Material for Fish Processors in Nigeria

INTRODUCTION

fish can be an affordable and accessible animal-source food in many Low- and Middle-Income Countries (LMIC).

BACKGROUND

Traditional fish processing methods pose a risk of exposing fish to various contaminants that may reduce their nutritional benefit. In addition, a lack of literacy may increase women fish processors' vulnerability to malnutrition and foodborne diseases.

OBJECTIVE

The overall aim of the project was to educate women and youth fish processors in Delta State, Nigeria about the benefit of fish in the human diet and to develop low literacy tools to help them better market their products. The objective of this study was to describe the development and validation of a low-literacy flipbook designed to teach women fish processors about nutrition and food safety.

METHOD

developing and validating instructional material requires understanding the population, high-quality and relevant graphics, and the involvement of relevant experts to conduct the content validation using the Content Validity Index (CVI) and the index value translated with the Modified Kappa Index (k).

RESULT

The Item-level Content Validity Index (I-CVI) value of all domains evaluated at the initial stage was 0.83 and the Scale-level Content Validity Index (S-CVI) was 0.90. At the final stage, the material was validated with CVI 0.983 by four experts and satisfied the expected minimum CVI value for this study (CVI ≥ 0.83, p-value = 0.05). The overall evaluation of the newly developed and validated flipbook was "excellent".

CONCLUSIONS

the developed material was found to be appropriate for training fish processors in Nigeria in nutrition and food safety and could be modified for a population of fish processors in other LMICs.

The Four Factors of Mind Wandering Questionnaire: Content, Construct, and Clinical Validity

Despite great interest in Mind Wandering, a fully validated questionnaire has been lacking. The Four Factors of Mind Wandering (4FMW) Questionnaire, presented here, meets this demand. First, 80 items were judged for content validity by two panels of experts. Those items that survived this content validity assessment were then tested using exploratory and confirmatory factor analyses on two independent samples of young adults. The 16 resulting items were shown to cluster into four factors (i.e., Failure in social interaction, Failure in interaction with objects, Unawareness, and Inattention). The 4FMW questionnaire showed good reliability, robust structure, and acceptable goodness-of-fit indices, as well as good convergent validity with another Mind Wandering questionnaire. Importantly, the 4FMW questionnaire was able to discriminate between attention-deficit/hyperactivity disorder and obsessive-compulsive disorder symptoms. The 4FMW Questionnaire is a reliable and valid instrument for assessing mind wandering in the young adult population.

Measuring Internet Gaming Disorder and Gaming Disorder: A Qualitative Content Validity Analysis of Validated Scales

Numerous instruments have been developed to measure gaming-related health problems based on "internet gaming disorder" (IGD) in the third section of the Diagnostic and Statistical Manual of Mental Disorders (5th ed.) and "gaming disorder" (GD) in the International Classification of Diseases (11th rev.). However, the criteria in the manuals tend to be operationalized in numerous diverse ways, which can make screening outcomes incomparable. A content validity analysis is needed to reassess the relationships between the diagnostic criteria and the items that operationalize them. The IGD and GD criteria were divided into sematic components. A qualitative content validity analysis was carried out for all items employed by the 17 instruments that claim to measure either construct by their criteria in English. In all but one instrument, the operationalizations did not include all criterion components. There were two main reasons found for this: the components had simply been left out or had been alternatively modified into other components. Criteria that were vaguely described in the manuals were sources of lower content validity items. The study implies that many of the problems in IGD and GD measurement derive from criteria operationalization and original manual descriptions. The conclusion provides practical recommendations that researchers can apply to improve the content validity of their measurement.

Development of a Personalized Tobacco Cessation Intervention Package (PTCIP) for Persons with Schizophrenia in India

Background

Among persons with schizophrenia (PwS), tobacco use is higher in comparison to the general population, contributing to greater morbidity and mortality. Pharmacological interventions combined with psychosocial interventions are effective in tobacco cessation. While the effectiveness of extant psychosocial interventions-when used in isolation-seems limited, developing better combinations of interventions could help treatment providers deliver tobacco cessation services to PwS at different stages of motivation to quit. We aimed to develop a personalized tobacco cessation intervention package (PTCIP) for PwS.

Methods

The stage-based intervention package was developed through a systematic review of interventions for tobacco cessation, the authors' clinical experience, and expert validation. The components of the intervention package, developed for PwS visiting the outpatient psychiatric department, were retained, removed, or added based on the content validity ratio (CVR).

Results

The final components included brief advice, principles of motivational interviewing, psychoeducation, decisional balance matrix, positive reinforcement, offering various treatment options, personalized feedback using a smoking-risk calculator, and prediction of cardiovascular risk using the WHO package of essential noncommunicable disease (PEN). The delivery of the intervention package was refined based on pilot testing in eight participants.

Conclusion

The tailored package was designed to be delivered by a mental health professional as a single comprehensive 40 min to 45 min face-to-face session, integrated with routine follow-up visits, followed by two telephonic conversations in the second and third week of the initial session. The package needs to be tested in a randomized controlled trial for its effectiveness.

Reliability and Validity of Non-Instrumental Clinical Assessments for Adults with Oropharyngeal Dysphagia: A Systematic Review

This systematic review on non-instrumental clinical assessment in adult oropharyngeal dysphagia (OD) provides an overview of published measures with reported reliability and validity. In alignment with PRISMA, four databases (CINAHL, Embase, PsycINFO, and PubMed) were searched, resulting in a total of 16 measures and 32 psychometric studies included. The included measures assessed any aspect of swallowing, consisted of at least one specific subscale relating to swallowing, were developed by clinical observation, targeted adults, and were developed in English. The included psychometric studies focused on adults, reported on measures for OD-related conditions, described non-instrumental clinical assessments, reported on validity or reliability, and were published in English. Methodological quality was assessed using the standard quality assessment QualSyst. Most measures targeted only restricted subdomains within the conceptual framework of non-instrumental clinical assessments. Across the 16 measures, hypothesis testing and reliability were the most reported psychometrics, whilst structural validity and content validity were the least reported. Overall, data on the reliability and validity of the included measures proved incomplete and frequently did not meet current psychometric standards. Future research should focus on the development of comprehensive non-instrumental clinical assessments for adults with OD using contemporary psychometric research methods.

[JAPANESE TRANSLATION AND LINGUISTIC VALIDATION OF THE RECAP OF ATOPIC ECZEMA (RECAP)]

BACKGROUND

The Recap of atopic eczema (RECAP), a new core outcome of the atopic dermatitis trial, was translated into Japanese and linguistically validated.

METHODS

Translation into Japanese was accomplished according to the ISPOR (International Society for Pharmacoeconomics and Outcome Research) guidelines and the basic guidelines for scale translation. The translation process included two forward translations, reconciliation with native English speakers, third-party back translation, cognitive debriefing, review and harmonization by the original authors. Twenty-seven atopic dermatitis and pediatric specialists from 21 centers in Japan participated in the translation process. Cognitive debriefing was conducted through face-to-face interviews using a think-aloud method with the interview guide including questions about comprehensibility, relevance, comprehensiveness, recall period and suggested improvements, based on the COSMIN methodology.

RESULTS

No linguistic or cultural problems were encountered in the translation into Japanese. Cognitive debriefings were conducted with 10 adult patients and 10 parents of pediatric patients. Some minor modifications were made following discussion and approval by the research team and the original authors. The Japanese version of RECAP was considered to be understandable, comprehensive and relevant for adult patients and families of pediatric patients.

CONCLUSION

The Japanese version of the RECAP, which has been validated as linguistically equivalent to the original version, is now available. Further evaluation of the measurement properties is needed in the future.

Exploring Disease Remission and Bowel Urgency Severity Among Adults with Moderate to Severe Ulcerative Colitis: A Qualitative Study

Purpose

Achieving and maintaining symptom control is a key treatment goal in ulcerative colitis (UC). Bowel urgency is an important symptom of UC, thus measurement of urgency is critical. This research explored the patient experience of UC and "remission" in UC, with a focus on urgency, and cognitively debriefed the Urgency Numeric Rating Scale (NRS), including score interpretation and examination of meaningful improvement.

Patients and Methods

Semi-structured hybrid concept elicitation and cognitive debriefing interviews with adults with moderately-severely active UC were conducted to explore experiences of UC and urgency, as well as examine meaningful improvement and score interpretation of the Urgency NRS. Purposive sampling was used to identify 20 eligible adult participants with UC. Concept elicitation data were analyzed using thematic analysis, and a deductive approach was used to analyze cognitive debriefing data. Thematic analysis was also applied to meaningful change-related data.

Results

Twenty participants were interviewed (average age = 42.6 years old, 50% male); 14 with moderately active (70.0%) and 6 with severely active UC (30.0%). Disease remission was not consistently defined by participants and description varied in terms of definition (absence vs not complete absence of symptoms), duration (months vs days) and key symptoms to consider. Urgency was a prominent symptom for all participants, with 8 (40.0%) identifying it as the most bothersome aspect of UC. No issues were identified with the Urgency NRS. Participants were able to define different levels of urgency severity, describe how they relate to daily life impacts, and score them differently on the Urgency NRS. Participants were also able to reflect urgency improvement on the NRS and discuss how small changes in numeric ratings of urgency can reflect meaningful change in the symptom burden of their UC.

Conclusion

The Urgency NRS is a content valid and interpretable measure to assess bowel urgency severity.

Psychometric properties of patient-reported outcomes measures used to assess upper limb pathology: a systematic review

BACKGROUND

With the continued development of patient-centred healthcare models, patient-reported outcome measures (PROMs) are increasingly used to evaluate outcomes in patients with upper limb pathology. The aim was to identify valid, reliable and responsive PROMs used to assess outcomes following upper limb pathology, and ascertain how their psychometric properties had been established. A secondary aim was to identify PROMs that have been validated to assess upper limb pathology in the paediatric population.

METHODS

A review of the Medline and EMBASE database was performed. Articles that analysed the validity of an established PROM used for upper limb pathology were included. Extracted study data included: author, country, PROM(s) investigated, year of publication, study type, sample size, demographics and duration of follow-up.

RESULTS

Twenty-five articles were included, which together investigated the psychometric properties of 23 different PROMs that have been used to assess outcomes in adults following upper limb pathology. No study evaluated the psychometric properties of PROMs used in the paediatric population. Among PROMs that have been used in adults, the Quick-Disabilities of the Arm, Shoulder and Hand (QuickDASH) had strong content- and construct-validity, reliability and responsiveness in comparison to others.

CONCLUSION

There are currently no studies that have analysed the content validity of PROMs used to assess upper limb pathology in the paediatric population. Prospective studies are required for the development of PROMs that can be utilized in children to assess upper limb pathology.

A Qualitative Investigation of Older Adults' Conceptualization of Quality of Life and a Think-Aloud Content Validation of the EQ-5D-5L, SF-12v2, Warwick Edinburgh Mental Wellbeing Scale, and Office of National Statistics-4

OBJECTIVES

Old age is characterized by declining health, comorbidities, and increasing health and social care service use. Traditionally, patient-reported outcome measures (PROMs) including the EQ-5D-5L and SF-12v2 have focused on health. Nevertheless, aged care often aims to improve broader elements of quality of life (QoL), captured by well-being measures, such as the Warwick Edinburgh Mental Wellbeing Scale (WEMWBS) and Office of National Statistics-4 (ONS-4). This study investigates older adults' conceptualization of QoL and the content validity of the EQ-5D-5L, SF-12v2, WEMWBS, and ONS-4 in measuring their QoL.

METHODS

Qualitative cognitive think-aloud interviews were undertaken with older adults aged 75+, exploring their views on what was important to QoL and, for each measure, the relevance, acceptability, and interpretation of items; suitability of response options; and the comprehensiveness of the measure. Conceptualization of QoL was analyzed thematically and content validity using framework analysis.

RESULTS

Twenty interviews were undertaken. Older adults' conceptualization of QoL centered on health, ability to perform usual activities, social contact, and emotional functioning. Possible response shift was observed, as older adults assessed their health relative to lower health expectations at their age or to people in worse states. Participants questioned the relevance of negatively phrased mental items and often preferred the functioning-focused EQ-5D-5L to more subjective ONS-4 and WEMWBS items. Domains suggested to improve comprehensiveness included social contact, coping, security, dignity, and control.

CONCLUSIONS

These findings are useful to researchers developing new PROMs for older adults or for the developers of included PROMs considering permanently adapting or bolting-on domains to improve content validity in older adults.

The Chinese Mandarin Version of the Esophageal-Atresia-Quality-of-Life Questionnaires for Children and Adolescents: Evaluation of Linguistic and Content Validity

BACKGROUND

After repair of esophageal atresia (EA), children risk digestive and respiratory morbidity, but knowledge of their health-related quality of life (HRQOL) in China is lacking. The EA-QOL questionnaires were developed in Sweden and Germany to evaluate condition-specific HRQOL in children with EA aged 2-7 and 8-17. This study aimed to evaluate the linguistic and content validity of the Chinese Mandarin version of the EA-QOL questionnaires.

METHODS

The procedure was conducted in compliance with international standards, including a forward-backward translation procedure, expert reviews, and cognitive debriefing interviews with 14 Chinese families of children with EA (parents of 8 children aged 2-7/6 children aged 8-17 and their parents).

RESULTS

Following forward-backward translation, minor issues were identified and solved. In interviews, all participants rated all EA-QOL items easy to understand, none expressed negative emotions about them and most described them comprehensive and relevant for EA. Leading from cognitive debriefing, three EA-QOL items in the questionnaire version for children aged 2-7 and three EA-QOL items in the questionnaire version for children aged 8-17 were modified in the Chinese language to improve cultural appropriateness and/or clarity.

CONCLUSION

The Chinese Mandarin version of the EA-QOL questionnaires achieved satisfactory linguistic and content validity. This can help increase focus of HRQOL in research and clinical practice of children with EA in China.

Interventions Employed By Licensed Nurses in Nursing Homes: Refinement and Validation of an Existing Omaha System Nursing Intervention Set

Background and Purpose: Demands on long-term services and supports for older adults are growing, although geriatric workforce shortages have persisted for decades. Methods to define and quantify practice of licensed nurses in nursing homes are needed for work optimization within limited nurse resources available in nursing homes. This study aimed to refine and validate observable nursing interventions for nursing homes, using the Omaha System. Methods: Based on the existing corpus of Omaha System interventions for acute care nursing, this multi-phase, multi-method study included a mapping procedure of interviews from licensed nurses in nursing homes, the evaluation of content validity and coding of the interventions using a survey, and inter-observer reliability assessment using TimeCaT. Results: This study validated 57 observable interventions for nursing homes. Of the previously identified acute care nursing interventions, eight interventions were deemed out of scope. One additional intervention was identified. Refined intervention definitions were related to procedures common in acute care settings such as tracheal intubations/extubations and nasogastric tube insertion that were not performed in nursing homes. Expert agreement for content validity and coding of the interventions was high (S-CVI = 0.97), and inter-observer reliability levels (Cohen's κ value >0.4; proportion agreement >60%) were acceptable for all case studies. Implications for Practice: The validated observable Omaha System nursing interventions for nursing home practice have potential for use in future studies of nursing home practice to understand evidence-based practice, and gaps in care provided. The methodology may be extended to define observable interventions for other roles and settings.

Communication support needs assessment in dementia (CoSNAT-D): An international content validation study

The decline of language and communication abilities is common among people living with dementia and impacts on many areas of everyday life, including active participation in social activities and decision-making. Despite a growing body of supporting evidence for approaches that address language and communication decline in dementia, the concept of communication rehabilitation is largely neglected in this population. This paper reports on the content validation of a novel tool, the Communication Support Needs Assessment Tool for Dementia (CoSNAT-D). The tool has been developed to assist in the initial identification of communication difficulties and related support needs of people living with dementia. Importantly, the CoSNAT-D is the only available tool that takes a three-way informed approach, considering the view of the person living with dementia, their carer and an administering healthcare professional. Content validity was established between September and December 2018 using a modified Delphi approach. An international expert panel rated 32 items of a face-validated item pool regarding their importance and relevance through an iterative feedback process. Consensus was pre-determined at 70% of agreement for both importance and relevance of an item. Data were analysed using descriptive statistics and qualitative content analysis of comments provided in each round. Twenty-eight experts working in dementia, language and communication participated in the Delphi survey. Qualitative analysis resulted in the addition of five items, of which three reached the required consensus in Round 3. Consensus was established for 35/37 items in three rounds. The pilot version of the CoSNAT-D demonstrates adequate content validity and face validity. The use of the CoSNAT-D may assist a range of healthcare professionals in the decision-making process about appropriate next management steps, and thereby improve the care path for people with dementia and language and communication impairment. The establishment of further psychometric properties is warranted.

Content validity of the nursing diagnosis low self-efficacy in health

PURPOSE

The purpose of this study was to verify the validity of the content of the proposal for the nursing diagnosis of low self-efficacy in health.

METHODS

Content validation study using the approach proposed by Lopes, a panel of 47 experts on the phenomenon of interest analyzed the content of the diagnosis using a Likert-type scale to evaluate the relevance of 16 clinical indicators and 18 etiological factors of the nursing diagnosis under investigation. These components were previously identified and defined through a middle-range theory. Based on the predictive diversity model, the experts' verifications were weighted according to their level of expertise. The pseudomedian and 95% confidence intervals were calculated. A content validity index above 0.9 was considered valid, and the Wilcoxon test was used to validate each pseudomedian with a p-value above 0.05.

FINDINGS

Thirteen clinical indicators were considered relevant, demonstrating the importance of these elements for the clinical identification of low self-efficacy in health. Three clinical indicators were excluded because they were not representative for this diagnosis. The eighteen etiological factors analyzed were considered relevant.

CONCLUSION

The findings of the present study may help nurses to identify low self-efficacy in health early and direct effective interventions to increase people's confidence in their abilities to promote their health.

IMPLICATIONS FOR NURSING PRACTICE

A new diagnostic framework is presented with peer-reviewed content, representing a phenomenon frequently reported by clinicians. This new diagnosis can guide nursing care and produce better health outcomes that depend on patients' confidence in their ability to take care of their own health.

Content Validity and Inter-rater Reliability of the Music Interventions in Pediatric DoC Behavior Observation Record

Aligned with best practice guidelines for patients presenting with a disorder of consciousness (DoC), music therapy interventions with this population aim to increase arousal and awareness to support emergence to consciousness. There is a significant evidence base supporting music therapy for adults with a DoC; however, there are currently no published tools that systematically capture behavioral responses of this population during rehabilitative music therapy interventions. Further, the developmentally specific response to severe brain injury in the pediatric population means pediatric-specific research is required. The Music Interventions in Pediatric DoC Behavior Observation Record (Music Behavior Record [MBR]) was developed to objectively record responses during music therapy interventions for children presenting with a DoC. To establish content validity and inter-rater reliability, a pragmatic pilot study was undertaken. Results established that the MBR has content validity with 100% agreement among participants. Overall fair-substantial inter-rater reliability in >70% of the behavioral responses recorded in the MBR indicate the MBR is an early but promising tool to objectively capture responses during music therapy interventions. The use of the MBR may ultimately support clinical advancement and intervention research to optimize consciousness recovery for the pediatric DoC population.

Content validity of a psychological e-health program of self-control and motivation for adults with excess weight

Excess weight requires multidisciplinary treatment, including psychology in face-to-face and e-health interventions. The need to analyse interventions' content validity has become evident. The objective is to assess content validity of a psychological e-health program of self-control and motivation for adults with excess weight. Six health professionals (a nutritionist, a personal trainer, physician and three psychologists) evaluated the content validity of the program. The results showed that the item-level content validity index (I-CVI) was 1 (the maximum value) for 11 of the 22 activities that comprise the program. This index fluctuated between 0.83 and 0.85 for the other activities, and the scale-level content validity index was greater than 0.90 for the four modules. In terms of relevance, effectiveness and appropriateness, 90%, 65% and 60% of the activities, respectively, obtained the maximum possible I-CVI, while the index was acceptable for the remainder of the activities. This is the first study about content validity of a psychological program for adults with excess weight in Mexico and it supported that the content program was suitable, and it may be used as a part of multidisciplinary treatments. This study also highlights the importance of involving an expert review in the development of intervention programs. This intervention program may be useful in the context of a multidisciplinary intervention; however, it is important to conduct studies to evaluate its efficacy.

An Evidence-Based Somatic Acupressure Intervention Protocol for Managing the Breast Cancer Fatigue-Sleep Disturbance-Depression Symptom Cluster: Development and Validation following the Medical Research Council Framework

BACKGROUND

Somatic acupoint stimulation (SAS) has been frequently utilised as a promising intervention for individual cancer-related symptom management, such as fatigue, sleep disturbance and depression. However, research evidence regarding the role of SAS in mitigating the fatigue-sleep disturbance-depression symptom cluster (FSDSC) has been scant. This study was conducted to develop an evidence-based SAS intervention protocol that can be further implemented in a Phase II randomized controlled trial (RCT) to manage the FSDSC in breast cancer survivors.

METHODS

The Medical Research Council Framework for Developing and Evaluating Complex Intervention (MRC framework) was employed to guide the development procedures of the SAS intervention protocol, including the identification of an existing evidence base, the identification of theories and practice standards, and the validation of the SAS intervention protocol. A content validity study was performed through an expert panel to assess the scientific and practical appropriateness of the SAS intervention protocol. The content validity index (CVI), including item-level CVI and protocol-level CVI, were calculated to evaluate the consensus level of the expert panel.

RESULTS

Key components of the SAS protocol, including the acupoint formula, the SAS modality, technique, intensity and frequency were identified for both a true and placebo SAS intervention based on the best available research evidence retrieved from systematic reviews, clinical trials, and relevant theories, particularly regarding the inflammatory process, yin-yang theory, zang-fu organs and meridians theory, and acupressure practical standards. The true SAS intervention was determined as daily self-administered acupressure on specific acupoints for seven weeks. The placebo SAS was designed as light acupressure on non-acupoints with the same frequency and duration as the true SAS. Excellent content validity was achieved after one round of expert panel assessment, with all the key components of the true and placebo SAS protocols rated as content valid (CVI ranged from 0.86 to 1.00).

CONCLUSIONS

A research-informed, theory-driven and practically feasible SAS intervention protocol for the FSDSC management in breast cancer survivors was developed following the MRC framework. The feasibility and acceptability of the SAS intervention will be further tested in breast cancer survivors through a Phase II RCT.