Development of the Canadian Food Intake Screener to assess alignment of adults' dietary intake with the 2019 Canada's Food Guide healthy food choices recommendations

NOVELTY

The Canadian Food Intake Screener was developed to rapidly assess alignment of adults' dietary intake over the past month with the Food Guide's healthy food choices recommendations. The screener was developed and evaluated through an iterative process that included three rounds of cognitive interviews in each of English and French, along with ongoing feedback from external advisors and face and content validity testing with a separate panel of content experts. The 16-question screener is intended for use with adults, aged 18-65 years, with marginal and higher health literacy in research and surveillance contexts in which comprehensive dietary assessment is not possible.

Using Patient Blogs on Social Media to Assess the Content Validity of Patient-Reported Outcome Measures: Qualitative Analysis of Patient-Written Blogs

BACKGROUND

Patient-reported outcome measures (PROMs) are questionnaires that measure patient outcomes related to quality of life, health, and functioning, and are increasingly used to assess important outcomes from the patient's perspective. For PROMs to contribute to better health and better care, it is vital that their content validity be adequate. This requires patient involvement in various steps of PROM development. PROM developers not only recognize the benefits of patient involvement but also report difficulties in recruiting patients and experience patient involvement as time-consuming, logistically challenging, and expensive.

OBJECTIVE

This study seeks to explore different strategies for disclosing the experiential knowledge of patients, namely through analyzing patient stories on the web and social media. The research questions are as follows: (1) how do bloggers living with a disease experience their health-related quality of life? (2) How are these experiences reflected in the domains and items of PROMs related to their disease?

METHODS

First, a qualitative analysis of blogs written by patients was performed. Second, subthemes and underlying codes resulting from this qualitative analysis were systematically compared with the domains and items in PROMs for the respective diseases that the bloggers write about. Blogs were identified via the Google search engine between December 2019 and May 2021.

RESULTS

Bloggers describe a wide range of experiences regarding their physical functioning and health; mental well-being; social network and support; daily life, education, work, and leisure; coping; and self-management. Bloggers also write about their positive and negative experiences with health care delivery, the organization of health care, and health care professionals. In general, patients' experiences as described in blogs were reflected in the domains and items of the PROMs related to their disease. However, except for diabetes mellitus, in all the sets of PROMs, potentially missing topics could be identified. Similarly, with the exception of Parkinson disease, all PROMs address issues that patients did not write about in their blogs and that might therefore be redundant.

CONCLUSIONS

Web-based patient stories in the form of blogs reveal how people living with a certain disease experience their health-related quality of life. These stories enable analyses of patients' experiences that can be used to assess the content validity of PROMs. This can be a useful step for researchers who are looking for sets of measuring instruments that match their purposes.

The Transthyretin Amyloidosis - Quality of Life (ATTR-QOL) Questionnaire: Development of a Conceptual Model and Disease-Specific Patient-Reported Outcome Measure

Purpose

Patients with transthyretin amyloidosis (ATTR) experience a wide variety of symptoms and impacts on health-related quality of life (HRQoL). However, the lack of an ATTR-specific patient-reported outcome (PRO) measure has made consistent measurement of HRQoL in ATTR challenging. This paper describes the development of a conceptual model and subsequent content for the Transthyretin Amyloidosis - Quality of Life Questionnaire (ATTR-QOL), an ATTR-specific PRO measure.

Methods

This was a cross-sectional, non-interventional, US-based study. The study design included three stages: 1) a targeted literature review followed by qualitative data collection with patients and experts; 2) development of a conceptual model and PRO measure; and 3) review of the PRO measure using a modified Delphi method, translatability assessment, and interviews with patients and experts. Revisions were made to the measure after each round of review.

Results

Forty-four patients and 29 experts participated in this study. The conceptual model included two primary concepts of interest: symptoms (cardiac, neuropathic-peripheral, neuropathic-autonomic, and other) and impacts (eg, physical, role, and mental/emotional functioning). Seventy-two items were created (32 symptoms; 40 impacts) to align with the model. A recall period of one month was selected based on participant input.

Conclusion

The ATTR-QOL was created with significant patient involvement and guidance from a multidisciplinary group of experts. The mix of patient and clinical perspectives helped to ensure a balanced representation of all relevant disease experiences and clinical specialties. With further refinement from psychometric testing, the ATTR-QOL will provide a standard, comprehensive measure for all ATTR-specific research including both clinical trials and clinical practice.

Evaluating the content validity of the Single Assessment Numeric Evaluation (SANE) in shoulder pathologies

BACKGROUND

The Single Assessment Numeric Evaluation (SANE) is a single item patient reported outcome measure (PROM) of function, in where patients rate how normal they feel in relation to a specific joint or problem. Although validated for some orthopedic conditions, it is not yet validated for a population with shoulder pathologies; nor have other studies explored the content validity. This study aims to understand how 1) patients with shoulder conditions interpret and calibrate responses to the SANE and 2) how they define normal.

METHODS

This study uses cognitive interviewing, a qualitative methodology that focuses on the interpretation of questionnaire items. Patients with rotator cuff disorders (n = 10), clinicians (n = 6) and measurement researchers (n = 10) were interviewed using a talk aloud structured interview that evaluated the SANE. All interviews were recorded and transcribed verbatim by one researcher (R.F). Analysis was done through an open coding scheme using a previously established framework for classification of interpretation variances.

RESULTS

Overall, the single-item SANE was well received by all participants. Through the interviews, the themes of: Comprehension (20% of participants), Reference Point (20% of participants), Relevance (10% of participants), and Perspective Modifiers (50% of participants) emerged as potential sources of interpretation variances. Clinicians indicated this tool facilitates discussion when trying to create realistic recovery expectations for patients post-operatively. The word "normal" was defined by the themes of: 1) levels of current pain compared to pre-injury, 2) personal expectations of recovery and 3) pre-injury activity levels.

CONCLUSIONS

Overall, respondents found the SANE to be cognitively simple, but it was clear that the interpretation of the question and what factors calibrated their responses were highly variable between respondents. The SANE is perceived favorable by patients and clinicians, while providing a low response burden. However, the construct being measured may vary between patients.

AO Spine Adult Spinal Deformity Patient Profile: A Paradigm Shift in Comprehensive Patient Evaluation in Order to Optimize Treatment and Improve Patient Care

STUDY DESIGN

Modified Delphi study.

OBJECTIVE

Adult spinal deformity (ASD) is an increasingly recognized condition, comprising a spectrum of pathologies considerably impacting patients' health and functional status. Patients present with a combination of pain, disability, comorbidities and radiological deformity. The study aims to propose a systematic approach of gathering information on the factors that drive decision-making by developing a patient profile.

METHODS

The present study comprises of 3 parts. Part 1: Development of prototype of patient profile: The data from the Core Outcome Study on SCOlisis (COSSCO) by Scoliosis Research Society (SRS) was categorized into a conceptual framework. Part 2: Modified Delphi study: Items reaching >70% agreement were included in a 4 round iterative process with 51 panellists across the globe. Part 3: Pilot testing-feasibility: Content validity and usability were evaluated quantitatively.

RESULTS

The profile consisted of 4 domains. 1. General health with demographics and comorbidities, 2.Spine-specific health with spine related health and neurological status, 3. Imaging with radiographic and MRI parameters and 4. Deformity type. Each domain consisted of 1 or 2 components with various factors and their measuring instruments. Profile was found to have an excellent content validity (I-CVIr 0.78-1.00; Ave-CVI 0.92) appropriateness, relevance and usefulness.

CONCLUSIONS

The present study, is first to provide a universally applicable multimodal ASD patient profile to methodically describe patients. Physicians are encouraged to assess ASD patients holistically using this profile and not just based on radiographic findings.

Face Validity, Content Validity, and Psychometric Testing of the Hospital Survey on Patient Safety Culture Among Undergraduate Nursing Students

Background and Purpose: Nursing students have an essential role in patient safety. The purpose of this study was to evaluate the face validity, content validity, and psychometric properties of the Hospital Survey on Patient Safety Culture for Nursing Students (HSOPS-NS). Methods: The cross-sectional study was carried out between January and October 2021. The participants were undergraduate nursing students (N = 482) from 16 Czech nursing faculties. Results: Exploratory factor analysis revealed an eight-factor structure, which was verified by confirmatory factor analysis using the optimization process that results in adequate goodness-of-fit indices (root mean squared error approximation = .037; standardized root mean squared residuals = .056; comparative fit index = .935; Tucker-Lewis index = .926; incremental fit index = .936). The internal consistency of a new model was excellent (α = .914). Conclusion: The results indicate that the HSOPS-NS shows evidence of reliability and validity and is a valuable measure of safety culture as perceived by nursing students.

The assessment of qualitative olfactory dysfunction in COVID-19 patients: a systematic review of tools and their content validity

Background

There is a lack of overview of the tools used to assess qualitative olfactory dysfunction, including parosmia and phantosmia, following COVID-19 illness. This could have an impact on the diagnosis and treatment offered to patients. Additionally, the formulations of symptoms are inconsistent and often unclear, and consensus around the wording of questions and responses is needed.

Aim of study

The aim of this systematic review is to provide an overview of tools used to assess qualitative olfactory dysfunction after COVID-19, in addition to addressing the content validity (i.e., item and response formulations) of these tools.

Methods

MEDLINE, Web of Science, and EMBASE were searched 5th of August 2022 and updated on the 25th of April 2023 to identify studies that assess qualitative olfactory dysfunction in COVID-19 patients. Primary outcomes were the tool used (i.e., questionnaire or objective test) and item and response formulations. Secondary outcomes included psychometric properties, study design, and demographic variables.

Results

The assessment of qualitative olfactory dysfunction is characterized by heterogeneity, inconsistency, and lack of validated tools to determine the presence and degree of symptoms. Several tools with overlapping and distinct features were identified in this review, of which some were thorough and detailed, while others were merely assessing the presence of symptoms as a binary measure. Item and response formulations are also inconsistent and often used interchangeably, which may lead to confusion, incorrect diagnoses, and inappropriate methods for solving the problem.

Conclusions

There is an unmet need for a reliable and validated tool for assessing qualitative olfactory dysfunction, preferably one that also captures quantitative olfactory issues (i.e., loss of smell), to ensure time-effective and specific assessment of the ability to smell. A consensus around the formulation of items and response options is also important to increase the understanding of the problem, both for clinicians, researchers, and the patient, and ultimately to provide the appropriate diagnosis and treatment.

Registration and protocol

The URL is https://www.crd.york.ac.uk/PROSPERO/display_record.php?RecordID=351621. A preregistered protocol was submitted and accepted (12.09.22) in the International prospective register of systematic reviews (PROSPERO) with the registration number CRD42022351621.

Development of a Visuoperceptual Measure for Fiberoptic Endoscopic Evaluation of Swallowing (V-FEES) in Adults with Oropharyngeal Dysphagia: An International Delphi Study

Visuoperceptual evaluation of fiberoptic endoscopic evaluation of swallowing (FEES) is a commonly used assessment in dysphagia or swallowing disorders. Currently, no international consensus exists regarding which visuoperceptual measures to use for the analysis of FEES recordings. Moreover, existing visuoperceptual FEES measures are limited by poor and incomplete psychometric data, identifying an urgent need for developing a visuoperceptual measure to interpret FEES recordings. Following the COSMIN group's (COnsensus-based Standards for the selection of health Measurement INstruments) psychometric taxonomy and guidelines, this study aimed to establish the content validity of a new visuoperceptual FEES (V-FEES) measure in adults with oropharyngeal dysphagia. Using the Delphi technique, international consensus was achieved among dysphagia experts across 21 countries, resulting in a new prototype measure for V-FEES, comprising 30 items, 8 function testing items (i.e., specific tasks performed by patients while observing and rating items), and 36 unique operationalisations (i.e., defining items into measurable factors that could be measured empirically using visuoperceptual observation). This study supports good content validity for V-FEES, including participants' feedback on the relevance, comprehensiveness, and comprehensibility of the included items. Future studies will continue the instrument development process and determine the remaining psychometric properties using both the classic test theory (CTT) and item response theory (IRT) models.

Development of the self-regulation assessment and content validation using cognitive interviews in a multicultural post-rehabilitation population

Aim

Self-regulation is one of the main goals of medical rehabilitation. Four themes of self-regulation were identified by former patients and rehabilitation physicians in a previous study. Based on these themes, a measure for self-regulation, the self-regulation assessment (SeRA), was developed. This study aimed to establish the content validity of the SeRA in a multicultural and multi-diagnostic post-rehabilitation population.

Methods

The Consensus-based Standards for the selection of health Measurement Instruments (COSMIN) methodology was applied. First, cognitive interviews were held with eight former rehabilitation patients. Feedback was obtained on relevance, comprehensibility, and comprehensiveness of the items. Items with problems were revised. Then, a second series of cognitive interviews was held with 16 former rehabilitation patients with non-Western migration backgrounds. Again, feedback was obtained on relevance, comprehensibility, and comprehensiveness of the items.

Results

The first series of cognitive interviews revealed good comprehensiveness, and also comprehensibility or relevance problems with 12 of the 25 items. These items were revised or deleted. Two missing concepts were identified and these were added. There was no need to revise the items based on the results of the second series of cognitive interviews.

Conclusion

The final version of the SeRA demonstrated content validity for the studied population. The measure is ready for psychometric analyses in subsequent validation studies.

Psychometric properties of a clinical assessment tool in the postgraduate midwifery programme, Botswana

BACKGROUND

 The psychometric properties of a clinical assessment tool used in the postgraduate midwifery programme in Botswana have not been evaluated. A lack of reliable and valid clinical assessment tools contributes to inconsistencies in clinical assessment in midwifery programmes.

OBJECTIVES

 This study aimed to evaluate the internal consistency and content validity of a clinical assessment tool used in the postgraduate midwifery programme in Botswana.

METHOD

 For internal consistency, we calculated the total-item correlation and Cronbach's alpha coefficient. For content validity, subject matter experts completed a checklist to evaluate the relevance and clarity of each competency in the clinical assessment tool. The checklist included questions with Likert-scale responses, indicating the level of agreement.

RESULTS

 The clinical assessment tool had a good reliability, with a Cronbach's alpha of 0.837. The corrected item total correlation values ranged from -0.043 to 0.880 and the Cronbach's alpha (if item deleted) ranged from 0.079 to 0.865. Overall content validity ratio was 0.95, and content validity index was 0.97. Item content validity indices ranged from 0.8 to 1.0. The overall scale content validity index was 0.97 and the scale content validity index using universal agreement was 0.75.

CONCLUSION

 The clinical assessment tool used in the postgraduate midwifery programme in Botswana has acceptable reliability. Most of the competencies included in the clinical assessment tool were relevant and clear. Certain competencies need to be reviewed to improve the reliability and validity of the clinical assessment tool.Contribution: The clinical assessment tool currently used in the postgraduate midwifery programme in Botswana had acceptable internal consistency reliability and validity.

Implementation of a Canine Ergonomic Abdominal Simulator for Training Basic Laparoscopic Skills in Veterinarians

The validity of the CALMA Veterinary Lap-trainer simulator (CVLTS) for training basic veterinary laparoscopic skills was assessed and compared to a simple collapsible mobile box trainer. Ten veterinarian surgeons with no experience in laparoscopic surgery and four experts with at least two years of experience in minimally invasive surgery (MIS) were included. The training curriculum included object transfer, non-woven gauze cutting with curved scissors, and interrupted and continuous intracorporeal sutures, which were practiced on the CVLTS. The initial and final assessments were carried out in both the CVLTS and in a collapsible mobile simulator. These were video-recorded and evaluated by external experts using the Objective Structured Assessment of Technical Skills (OSATS) and a specific scale evaluation in a double-blinded schedule. The time, angular displacement, number, and movement smoothness were recorded using a hands movement assessment system (HMAS). Through a survey, the face validity and content were evaluated. The data were analyzed by a Pearson's proportions comparison or Mann Whitney U test and a bilateral Student's t-test. The experimental group OSATS, specific scores, and HMAS values, with the exception of the smoothness of movements, significantly improved after training, with no statistically significant differences compared to the expert group. No differences were found between the two simulators. The experts' and experimental participants' CVLTS mean score was 4.8. Our data support the CVLTS validations for laparoscopic surgery basic skills training.

Development and Validation of Nutrition and Food Safety Educational Material for Fish Processors in Nigeria

INTRODUCTION

fish can be an affordable and accessible animal-source food in many Low- and Middle-Income Countries (LMIC).

BACKGROUND

Traditional fish processing methods pose a risk of exposing fish to various contaminants that may reduce their nutritional benefit. In addition, a lack of literacy may increase women fish processors' vulnerability to malnutrition and foodborne diseases.

OBJECTIVE

The overall aim of the project was to educate women and youth fish processors in Delta State, Nigeria about the benefit of fish in the human diet and to develop low literacy tools to help them better market their products. The objective of this study was to describe the development and validation of a low-literacy flipbook designed to teach women fish processors about nutrition and food safety.

METHOD

developing and validating instructional material requires understanding the population, high-quality and relevant graphics, and the involvement of relevant experts to conduct the content validation using the Content Validity Index (CVI) and the index value translated with the Modified Kappa Index (k).

RESULT

The Item-level Content Validity Index (I-CVI) value of all domains evaluated at the initial stage was 0.83 and the Scale-level Content Validity Index (S-CVI) was 0.90. At the final stage, the material was validated with CVI 0.983 by four experts and satisfied the expected minimum CVI value for this study (CVI ≥ 0.83, p-value = 0.05). The overall evaluation of the newly developed and validated flipbook was "excellent".

CONCLUSIONS

the developed material was found to be appropriate for training fish processors in Nigeria in nutrition and food safety and could be modified for a population of fish processors in other LMICs.

The Four Factors of Mind Wandering Questionnaire: Content, Construct, and Clinical Validity

Despite great interest in Mind Wandering, a fully validated questionnaire has been lacking. The Four Factors of Mind Wandering (4FMW) Questionnaire, presented here, meets this demand. First, 80 items were judged for content validity by two panels of experts. Those items that survived this content validity assessment were then tested using exploratory and confirmatory factor analyses on two independent samples of young adults. The 16 resulting items were shown to cluster into four factors (i.e., Failure in social interaction, Failure in interaction with objects, Unawareness, and Inattention). The 4FMW questionnaire showed good reliability, robust structure, and acceptable goodness-of-fit indices, as well as good convergent validity with another Mind Wandering questionnaire. Importantly, the 4FMW questionnaire was able to discriminate between attention-deficit/hyperactivity disorder and obsessive-compulsive disorder symptoms. The 4FMW Questionnaire is a reliable and valid instrument for assessing mind wandering in the young adult population.

Measuring Internet Gaming Disorder and Gaming Disorder: A Qualitative Content Validity Analysis of Validated Scales

Numerous instruments have been developed to measure gaming-related health problems based on "internet gaming disorder" (IGD) in the third section of the Diagnostic and Statistical Manual of Mental Disorders (5th ed.) and "gaming disorder" (GD) in the International Classification of Diseases (11th rev.). However, the criteria in the manuals tend to be operationalized in numerous diverse ways, which can make screening outcomes incomparable. A content validity analysis is needed to reassess the relationships between the diagnostic criteria and the items that operationalize them. The IGD and GD criteria were divided into sematic components. A qualitative content validity analysis was carried out for all items employed by the 17 instruments that claim to measure either construct by their criteria in English. In all but one instrument, the operationalizations did not include all criterion components. There were two main reasons found for this: the components had simply been left out or had been alternatively modified into other components. Criteria that were vaguely described in the manuals were sources of lower content validity items. The study implies that many of the problems in IGD and GD measurement derive from criteria operationalization and original manual descriptions. The conclusion provides practical recommendations that researchers can apply to improve the content validity of their measurement.

Development of a Personalized Tobacco Cessation Intervention Package (PTCIP) for Persons with Schizophrenia in India

Background

Among persons with schizophrenia (PwS), tobacco use is higher in comparison to the general population, contributing to greater morbidity and mortality. Pharmacological interventions combined with psychosocial interventions are effective in tobacco cessation. While the effectiveness of extant psychosocial interventions-when used in isolation-seems limited, developing better combinations of interventions could help treatment providers deliver tobacco cessation services to PwS at different stages of motivation to quit. We aimed to develop a personalized tobacco cessation intervention package (PTCIP) for PwS.

Methods

The stage-based intervention package was developed through a systematic review of interventions for tobacco cessation, the authors' clinical experience, and expert validation. The components of the intervention package, developed for PwS visiting the outpatient psychiatric department, were retained, removed, or added based on the content validity ratio (CVR).

Results

The final components included brief advice, principles of motivational interviewing, psychoeducation, decisional balance matrix, positive reinforcement, offering various treatment options, personalized feedback using a smoking-risk calculator, and prediction of cardiovascular risk using the WHO package of essential noncommunicable disease (PEN). The delivery of the intervention package was refined based on pilot testing in eight participants.

Conclusion

The tailored package was designed to be delivered by a mental health professional as a single comprehensive 40 min to 45 min face-to-face session, integrated with routine follow-up visits, followed by two telephonic conversations in the second and third week of the initial session. The package needs to be tested in a randomized controlled trial for its effectiveness.

Reliability and Validity of Non-Instrumental Clinical Assessments for Adults with Oropharyngeal Dysphagia: A Systematic Review

This systematic review on non-instrumental clinical assessment in adult oropharyngeal dysphagia (OD) provides an overview of published measures with reported reliability and validity. In alignment with PRISMA, four databases (CINAHL, Embase, PsycINFO, and PubMed) were searched, resulting in a total of 16 measures and 32 psychometric studies included. The included measures assessed any aspect of swallowing, consisted of at least one specific subscale relating to swallowing, were developed by clinical observation, targeted adults, and were developed in English. The included psychometric studies focused on adults, reported on measures for OD-related conditions, described non-instrumental clinical assessments, reported on validity or reliability, and were published in English. Methodological quality was assessed using the standard quality assessment QualSyst. Most measures targeted only restricted subdomains within the conceptual framework of non-instrumental clinical assessments. Across the 16 measures, hypothesis testing and reliability were the most reported psychometrics, whilst structural validity and content validity were the least reported. Overall, data on the reliability and validity of the included measures proved incomplete and frequently did not meet current psychometric standards. Future research should focus on the development of comprehensive non-instrumental clinical assessments for adults with OD using contemporary psychometric research methods.

[JAPANESE TRANSLATION AND LINGUISTIC VALIDATION OF THE RECAP OF ATOPIC ECZEMA (RECAP)]

BACKGROUND

The Recap of atopic eczema (RECAP), a new core outcome of the atopic dermatitis trial, was translated into Japanese and linguistically validated.

METHODS

Translation into Japanese was accomplished according to the ISPOR (International Society for Pharmacoeconomics and Outcome Research) guidelines and the basic guidelines for scale translation. The translation process included two forward translations, reconciliation with native English speakers, third-party back translation, cognitive debriefing, review and harmonization by the original authors. Twenty-seven atopic dermatitis and pediatric specialists from 21 centers in Japan participated in the translation process. Cognitive debriefing was conducted through face-to-face interviews using a think-aloud method with the interview guide including questions about comprehensibility, relevance, comprehensiveness, recall period and suggested improvements, based on the COSMIN methodology.

RESULTS

No linguistic or cultural problems were encountered in the translation into Japanese. Cognitive debriefings were conducted with 10 adult patients and 10 parents of pediatric patients. Some minor modifications were made following discussion and approval by the research team and the original authors. The Japanese version of RECAP was considered to be understandable, comprehensive and relevant for adult patients and families of pediatric patients.

CONCLUSION

The Japanese version of the RECAP, which has been validated as linguistically equivalent to the original version, is now available. Further evaluation of the measurement properties is needed in the future.

Exploring Disease Remission and Bowel Urgency Severity Among Adults with Moderate to Severe Ulcerative Colitis: A Qualitative Study

Purpose

Achieving and maintaining symptom control is a key treatment goal in ulcerative colitis (UC). Bowel urgency is an important symptom of UC, thus measurement of urgency is critical. This research explored the patient experience of UC and "remission" in UC, with a focus on urgency, and cognitively debriefed the Urgency Numeric Rating Scale (NRS), including score interpretation and examination of meaningful improvement.

Patients and Methods

Semi-structured hybrid concept elicitation and cognitive debriefing interviews with adults with moderately-severely active UC were conducted to explore experiences of UC and urgency, as well as examine meaningful improvement and score interpretation of the Urgency NRS. Purposive sampling was used to identify 20 eligible adult participants with UC. Concept elicitation data were analyzed using thematic analysis, and a deductive approach was used to analyze cognitive debriefing data. Thematic analysis was also applied to meaningful change-related data.

Results

Twenty participants were interviewed (average age = 42.6 years old, 50% male); 14 with moderately active (70.0%) and 6 with severely active UC (30.0%). Disease remission was not consistently defined by participants and description varied in terms of definition (absence vs not complete absence of symptoms), duration (months vs days) and key symptoms to consider. Urgency was a prominent symptom for all participants, with 8 (40.0%) identifying it as the most bothersome aspect of UC. No issues were identified with the Urgency NRS. Participants were able to define different levels of urgency severity, describe how they relate to daily life impacts, and score them differently on the Urgency NRS. Participants were also able to reflect urgency improvement on the NRS and discuss how small changes in numeric ratings of urgency can reflect meaningful change in the symptom burden of their UC.

Conclusion

The Urgency NRS is a content valid and interpretable measure to assess bowel urgency severity.

Psychometric properties of patient-reported outcomes measures used to assess upper limb pathology: a systematic review

BACKGROUND

With the continued development of patient-centred healthcare models, patient-reported outcome measures (PROMs) are increasingly used to evaluate outcomes in patients with upper limb pathology. The aim was to identify valid, reliable and responsive PROMs used to assess outcomes following upper limb pathology, and ascertain how their psychometric properties had been established. A secondary aim was to identify PROMs that have been validated to assess upper limb pathology in the paediatric population.

METHODS

A review of the Medline and EMBASE database was performed. Articles that analysed the validity of an established PROM used for upper limb pathology were included. Extracted study data included: author, country, PROM(s) investigated, year of publication, study type, sample size, demographics and duration of follow-up.

RESULTS

Twenty-five articles were included, which together investigated the psychometric properties of 23 different PROMs that have been used to assess outcomes in adults following upper limb pathology. No study evaluated the psychometric properties of PROMs used in the paediatric population. Among PROMs that have been used in adults, the Quick-Disabilities of the Arm, Shoulder and Hand (QuickDASH) had strong content- and construct-validity, reliability and responsiveness in comparison to others.

CONCLUSION

There are currently no studies that have analysed the content validity of PROMs used to assess upper limb pathology in the paediatric population. Prospective studies are required for the development of PROMs that can be utilized in children to assess upper limb pathology.

A Qualitative Investigation of Older Adults' Conceptualization of Quality of Life and a Think-Aloud Content Validation of the EQ-5D-5L, SF-12v2, Warwick Edinburgh Mental Wellbeing Scale, and Office of National Statistics-4

OBJECTIVES

Old age is characterized by declining health, comorbidities, and increasing health and social care service use. Traditionally, patient-reported outcome measures (PROMs) including the EQ-5D-5L and SF-12v2 have focused on health. Nevertheless, aged care often aims to improve broader elements of quality of life (QoL), captured by well-being measures, such as the Warwick Edinburgh Mental Wellbeing Scale (WEMWBS) and Office of National Statistics-4 (ONS-4). This study investigates older adults' conceptualization of QoL and the content validity of the EQ-5D-5L, SF-12v2, WEMWBS, and ONS-4 in measuring their QoL.

METHODS

Qualitative cognitive think-aloud interviews were undertaken with older adults aged 75+, exploring their views on what was important to QoL and, for each measure, the relevance, acceptability, and interpretation of items; suitability of response options; and the comprehensiveness of the measure. Conceptualization of QoL was analyzed thematically and content validity using framework analysis.

RESULTS

Twenty interviews were undertaken. Older adults' conceptualization of QoL centered on health, ability to perform usual activities, social contact, and emotional functioning. Possible response shift was observed, as older adults assessed their health relative to lower health expectations at their age or to people in worse states. Participants questioned the relevance of negatively phrased mental items and often preferred the functioning-focused EQ-5D-5L to more subjective ONS-4 and WEMWBS items. Domains suggested to improve comprehensiveness included social contact, coping, security, dignity, and control.

CONCLUSIONS

These findings are useful to researchers developing new PROMs for older adults or for the developers of included PROMs considering permanently adapting or bolting-on domains to improve content validity in older adults.

The Chinese Mandarin Version of the Esophageal-Atresia-Quality-of-Life Questionnaires for Children and Adolescents: Evaluation of Linguistic and Content Validity

BACKGROUND

After repair of esophageal atresia (EA), children risk digestive and respiratory morbidity, but knowledge of their health-related quality of life (HRQOL) in China is lacking. The EA-QOL questionnaires were developed in Sweden and Germany to evaluate condition-specific HRQOL in children with EA aged 2-7 and 8-17. This study aimed to evaluate the linguistic and content validity of the Chinese Mandarin version of the EA-QOL questionnaires.

METHODS

The procedure was conducted in compliance with international standards, including a forward-backward translation procedure, expert reviews, and cognitive debriefing interviews with 14 Chinese families of children with EA (parents of 8 children aged 2-7/6 children aged 8-17 and their parents).

RESULTS

Following forward-backward translation, minor issues were identified and solved. In interviews, all participants rated all EA-QOL items easy to understand, none expressed negative emotions about them and most described them comprehensive and relevant for EA. Leading from cognitive debriefing, three EA-QOL items in the questionnaire version for children aged 2-7 and three EA-QOL items in the questionnaire version for children aged 8-17 were modified in the Chinese language to improve cultural appropriateness and/or clarity.

CONCLUSION

The Chinese Mandarin version of the EA-QOL questionnaires achieved satisfactory linguistic and content validity. This can help increase focus of HRQOL in research and clinical practice of children with EA in China.

Interventions Employed By Licensed Nurses in Nursing Homes: Refinement and Validation of an Existing Omaha System Nursing Intervention Set

Background and Purpose: Demands on long-term services and supports for older adults are growing, although geriatric workforce shortages have persisted for decades. Methods to define and quantify practice of licensed nurses in nursing homes are needed for work optimization within limited nurse resources available in nursing homes. This study aimed to refine and validate observable nursing interventions for nursing homes, using the Omaha System. Methods: Based on the existing corpus of Omaha System interventions for acute care nursing, this multi-phase, multi-method study included a mapping procedure of interviews from licensed nurses in nursing homes, the evaluation of content validity and coding of the interventions using a survey, and inter-observer reliability assessment using TimeCaT. Results: This study validated 57 observable interventions for nursing homes. Of the previously identified acute care nursing interventions, eight interventions were deemed out of scope. One additional intervention was identified. Refined intervention definitions were related to procedures common in acute care settings such as tracheal intubations/extubations and nasogastric tube insertion that were not performed in nursing homes. Expert agreement for content validity and coding of the interventions was high (S-CVI = 0.97), and inter-observer reliability levels (Cohen's κ value >0.4; proportion agreement >60%) were acceptable for all case studies. Implications for Practice: The validated observable Omaha System nursing interventions for nursing home practice have potential for use in future studies of nursing home practice to understand evidence-based practice, and gaps in care provided. The methodology may be extended to define observable interventions for other roles and settings.

Communication support needs assessment in dementia (CoSNAT-D): An international content validation study

The decline of language and communication abilities is common among people living with dementia and impacts on many areas of everyday life, including active participation in social activities and decision-making. Despite a growing body of supporting evidence for approaches that address language and communication decline in dementia, the concept of communication rehabilitation is largely neglected in this population. This paper reports on the content validation of a novel tool, the Communication Support Needs Assessment Tool for Dementia (CoSNAT-D). The tool has been developed to assist in the initial identification of communication difficulties and related support needs of people living with dementia. Importantly, the CoSNAT-D is the only available tool that takes a three-way informed approach, considering the view of the person living with dementia, their carer and an administering healthcare professional. Content validity was established between September and December 2018 using a modified Delphi approach. An international expert panel rated 32 items of a face-validated item pool regarding their importance and relevance through an iterative feedback process. Consensus was pre-determined at 70% of agreement for both importance and relevance of an item. Data were analysed using descriptive statistics and qualitative content analysis of comments provided in each round. Twenty-eight experts working in dementia, language and communication participated in the Delphi survey. Qualitative analysis resulted in the addition of five items, of which three reached the required consensus in Round 3. Consensus was established for 35/37 items in three rounds. The pilot version of the CoSNAT-D demonstrates adequate content validity and face validity. The use of the CoSNAT-D may assist a range of healthcare professionals in the decision-making process about appropriate next management steps, and thereby improve the care path for people with dementia and language and communication impairment. The establishment of further psychometric properties is warranted.

Content validity of the nursing diagnosis low self-efficacy in health

PURPOSE

The purpose of this study was to verify the validity of the content of the proposal for the nursing diagnosis of low self-efficacy in health.

METHODS

Content validation study using the approach proposed by Lopes, a panel of 47 experts on the phenomenon of interest analyzed the content of the diagnosis using a Likert-type scale to evaluate the relevance of 16 clinical indicators and 18 etiological factors of the nursing diagnosis under investigation. These components were previously identified and defined through a middle-range theory. Based on the predictive diversity model, the experts' verifications were weighted according to their level of expertise. The pseudomedian and 95% confidence intervals were calculated. A content validity index above 0.9 was considered valid, and the Wilcoxon test was used to validate each pseudomedian with a p-value above 0.05.

FINDINGS

Thirteen clinical indicators were considered relevant, demonstrating the importance of these elements for the clinical identification of low self-efficacy in health. Three clinical indicators were excluded because they were not representative for this diagnosis. The eighteen etiological factors analyzed were considered relevant.

CONCLUSION

The findings of the present study may help nurses to identify low self-efficacy in health early and direct effective interventions to increase people's confidence in their abilities to promote their health.

IMPLICATIONS FOR NURSING PRACTICE

A new diagnostic framework is presented with peer-reviewed content, representing a phenomenon frequently reported by clinicians. This new diagnosis can guide nursing care and produce better health outcomes that depend on patients' confidence in their ability to take care of their own health.

Content Validity and Inter-rater Reliability of the Music Interventions in Pediatric DoC Behavior Observation Record

Aligned with best practice guidelines for patients presenting with a disorder of consciousness (DoC), music therapy interventions with this population aim to increase arousal and awareness to support emergence to consciousness. There is a significant evidence base supporting music therapy for adults with a DoC; however, there are currently no published tools that systematically capture behavioral responses of this population during rehabilitative music therapy interventions. Further, the developmentally specific response to severe brain injury in the pediatric population means pediatric-specific research is required. The Music Interventions in Pediatric DoC Behavior Observation Record (Music Behavior Record [MBR]) was developed to objectively record responses during music therapy interventions for children presenting with a DoC. To establish content validity and inter-rater reliability, a pragmatic pilot study was undertaken. Results established that the MBR has content validity with 100% agreement among participants. Overall fair-substantial inter-rater reliability in >70% of the behavioral responses recorded in the MBR indicate the MBR is an early but promising tool to objectively capture responses during music therapy interventions. The use of the MBR may ultimately support clinical advancement and intervention research to optimize consciousness recovery for the pediatric DoC population.