Developing and Establishing Content Validity of Vignettes for Health Care Education and Research

Assessing Heart Failure Self-management Knowledge Through Vignettes

BACKGROUND

Heart failure (HF) self-care is key to managing symptoms, but current HF knowledge instruments are at risk for social desirability bias (ie, tendency to respond in a way that is viewed favorably). Vignettes may be a useful method to mitigate this bias by measuring knowledge via scenarios in which individuals with HF are invited to respond to fictional characters' self-management problems rather than disclosing their own practices.

OBJECTIVE

The aims of the study were to develop and test the content validity of vignettes measuring individuals' knowledge of HF symptom self-management.

METHODS

The study had 3 phases. In phase 1, two vignettes were developed. One focused on psychological symptom self-management (ie, anxiety, depression), and the other focused on physical symptom self-management (ie, edema, fatigue). In phase 2, the research team and lay experts made improvements to the vignettes' readability. In phase 3, five HF self-care nurse experts evaluated the vignettes' clarity and importance with a 3-point Likert-type scale using Delphi methods. We calculated the vignettes' content validity using the scale-level content validity index.

RESULTS

The final content validation encompassed 2 Delphi rounds (phase 3), yielding a scale-level content validity index of 0.92 and 0.94 for the psychological and physical symptom vignettes, respectively. These results indicate excellent initial content validity.

CONCLUSIONS

The content of vignettes measuring individuals' knowledge of HF symptom self-management is valid based on the opinions of nurse experts. The vignettes offer a promising method to assess knowledge about HF self-care management without the pressure of disclosing individual patient practices.

Vignettes as a novel research tool in spiritual care: A methods paper

AIMS

To discuss the construction and use of vignettes as a novel approach in spiritual care research and education.

DESIGN

Methods paper.

METHODS

In this methods paper, the authors introduce the use of vignettes in spiritual care research and provide insight into the construction of vignettes. The vignette presented was part of a study of neurosurgical nurses' attitudes and responses to the spiritual needs of neuro-oncology patients. The development process, consisting of four steps, is explained in this paper.

RESULTS

Using a vignette to explore nurses' attitudes towards spiritual care is an innovative way to understand what behaviours nurses consider appropriate in situations where the patient is seeking meaning and connection. Transparent description of the development process is crucial to ensure reproducibility.

CONCLUSION

The use of theoretically constructed and validated vignettes in spiritual care research is new. Vignettes used in surveys have the potential to elicit nurses' responses to patients' search for meaning and connectedness.

IMPLICATIONS

In order to investigate nurses' attitudes and behaviours towards patients' spiritual needs, carefully constructed and validated vignettes are valuable research tools.

IMPACT

Vignettes have proven to be a valuable research tool in the social and health sciences. So far, their use as a survey instrument in spiritual care research has not been investigated. Therefore, this method paper introduces vignettes as a novel approach to spiritual care research. Our findings contribute to the further development of vignettes in nursing science, as there are similarities with case development and simulation training in nursing education.

REPORTING METHOD

Reporting guideline is not applicable.

PATIENT OR PUBLIC CONTRIBUTION

No patient or public contribution.

Development and Validation of an ICU Delirium Playbook for Provider Education

Although delirium detection and prevention practices are recommended in critical care guidelines, there remains a persistent lack of effective delirium education for ICU providers. To address this knowledge-practice gap, we developed an "ICU Delirium Playbook" to educate providers on delirium detection (using the Confusion Assessment Method for the ICU) and prevention.

DESIGN

Building on our previous ICU Delirium Video Series, our interdisciplinary team developed a corresponding quiz to form a digital "ICU Delirium Playbook." Playbook content validity was evaluated by delirium experts, and face validity by an ICU nurse focus group. Additionally, focus group participants completed the quiz before and after video viewing. Remaining focus group concerns were evaluated in semi-structured follow-up interviews.

SETTING

Online validation survey, virtual focus group, and virtual interviews.

SUBJECTS

The validation group included six delirium experts in the fields of critical care, geriatrics, nursing, and ICU education. The face validation group included nine ICU nurses, three of whom participated in the semi-structured feedback interviews.

INTERVENTIONS

None.

MEASUREMENTS AND MAIN RESULTS

The 44-question quiz had excellent content validity (average scale-level content validity index [S-CVI] of individual items = 0.99, universal agreement S-CVI = 0.93, agreement κ ≥ 0.75, and clarity p ≥ 0.8). The focus group participants completed the Playbook in an average (sd) time of 53 (14) minutes, demonstrating significant improvements in pre-post quiz scores (74% vs 86%; p = 0.0009). Verbal feedback highlighted the conciseness, utility, and relevance of the Playbook, with all participants agreeing to deploy the digital education module in their ICUs.

CONCLUSIONS

The ICU Delirium Playbook is a novel, first-of-its-kind asynchronous digital education tool aimed to standardize delirium detection and prevention practices. After a rigorous content and face validation process, the Playbook is now available for widespread use.

Development and psychometric testing of the Diagnostic Competency During Simulation-based (DCDS) learning tool

BACKGROUND

Despite diagnostic errors impacting an estimated 12 million people yearly in the United States, educational strategies that foster diagnostic performance among nurse practitioner (NP) students remain elusive. One possible solution is to focus explicitly on competencies fundamental for diagnostic excellence. Currently, no educational tools were found that comprehensively address individual diagnostic reasoning competencies during simulated-based learning experiences.

PURPOSE

Our research team developed and explored psychometric properties of the "Diagnostic Competency During Simulation-based (DCDS) Learning Tool."

METHOD

Items and domains were developed based on existing frameworks. Content validity was determined by a convenience sample of eight experts. Inter-rater reliability was determined by four faculty rating eight simulation scenarios.

RESULTS

Final individual competency domain scale content validity index (CVI) scores ranged between 0.9175 and 1.0; total scale CVI score was 0.98. The intra-class correlation coefficient (ICC) for the tool was 0.548 (p < 0.0001, 95 % confidence interval CI [0.482-0.612]).

CONCLUSIONS

Results suggest that the DCDS Learning Tool is relevant to diagnostic reasoning competencies and may be implemented with moderate reliability across varied simulation scenarios and performance levels. The DCDS tool expands the landscape of diagnostic reasoning assessment by providing NP educators with granular, actionable, competency-specific assessment measures to foster improvement.

Towards precision pain medicine for pain after cancer: the Cancer Pain Phenotyping Network multidisciplinary international guidelines for pain phenotyping using nociplastic pain criteria

Pain after cancer remains underestimated and undertreated. Precision medicine is a recent concept that refers to the ability to classify patients into subgroups that differ in their susceptibility to, biology, or prognosis of a particular disease, or in their response to a specific treatment, and thus to tailor treatment to the individual patient characteristics. Applying this to pain after cancer, the ability to classify post-cancer pain into the three major pain phenotypes (i.e. nociceptive, neuropathic, and nociplastic pain) and tailor pain treatment accordingly, is an emerging issue. This is especially relevant because available evidence suggests that nociplastic pain is present in an important subgroup of those patients experiencing post-cancer pain. The 2021 International Association for the Study of Pain (IASP) clinical criteria and grading system for nociplastic pain account for the need to identify and correctly classify patients according to the pain phenotype early in their treatment. These criteria are an important step towards precision pain medicine with great potential for the field of clinical oncology. Within this framework, the Cancer Pain Phenotyping (CANPPHE) Network, an international and interdisciplinary group of oncology clinicians and researchers from seven countries, applied the 2021 IASP clinical criteria for nociplastic pain to the growing population of those experiencing post-cancer pain. A manual is provided to allow clinicians to differentiate between predominant nociceptive, neuropathic, or nociplastic pain after cancer. A seven-step diagnostic approach is presented and illustrated using cases to enhance understanding and encourage effective implementation of this approach in clinical practice.

Testing the Decision Support Tool for Responsible Pain Management for Headache and Facial Pain Diagnosis with Opioid-Risk-Stratified Treatment

In primary and urgent care, headache and facial pain are common and challenging to diagnose and manage, especially with using opioids appropriately. We therefore developed the Decision Support Tool for Responsible Pain Management (DS-RPM) to assist healthcare providers in diagnosis (including multiple simultaneous diagnoses), workup (including triage), and opioid-risk-informed treatment. A primary goal was to supply sufficient explanations of DS-RPM's functions allowing critique. We describe the process of iteratively designing DS-RPM adding clinical content and testing/defect discovery. We tested DS-RPM remotely with 21 clinician-participants using three vignettes-cluster headache, migraine, and temporal arteritis-after first training to use DS-RPM with a trigeminal-neuralgia vignette. Their evaluation was both quantitative (usability/acceptability) and qualitative using semi-structured interviews. The quantitative evaluation used 12 Likert-type questions on a 1-5 scale, where 5 represented the highest rating. The mean ratings ranged from 4.48 to 4.95 (SDs ranging 0.22-1.03). Participants initially found structured data entry intimidating but adapted and appreciated its comprehensiveness and speed of data capture. They perceived DS-RPM as useful for teaching and clinical practice, making several enhancement suggestions. The DS-RPM was designed, created, and tested to facilitate best practice in management of patients with headaches and facial pain. Testing the DS-RPM with vignettes showed strong functionality and high usability/acceptability ratings from healthcare providers. Risk stratifying for opioid use disorder to develop a treatment plan for headache and facial pain is possible using vignettes. During testing, we considered the need to adapt usability/acceptability evaluation tools for clinical decision support, and future directions.

Development of a specific supportive care needs scale for radical cystectomy patients and its reliability and validity test

OBJECTIVE

To develop a specific supportive care needs scale for patients who have undergone radical cystectomy, and to assess its reliability and validity.

METHODS

The clinical test version of the scale was developed based on literature review, qualitative interviews, Delphi method, and a pretest. The reliability and validity of the scale were assessed in a cohort of 603 patients who had undergone radical cystectomy at 5 Grade A hospitals in Chongqing, China.

RESULTS

The final scale included 26 items across the following 7 dimensions: health information needs, social needs, family support needs, physiological needs, sexual needs, daily activities needs, and psychological needs. The content validity index was 0.991 and the content validity indices of each item ranged from 0.889 to 1.00. Seven factors were extracted by exploratory factor analysis and the cumulative contribution of variance accounted for 70.762%. Confirmatory factor analysis revealed a good fit of the model (X²/df = 1.595, GFI = 0.904, IFI = 0.943, TLI = 0.932, CFI = 0.942, RMSEA = 0.044, and RMR = 0.026). The Cronbach's ɑ coefficient and retest reliability were 0.807 and 0.810, respectively.

CONCLUSION

The specific supportive care needs scale for radical cystectomy patients developed in this study showed the good reliability and validity. The tool can be invaluable for comprehensive assessment of the specific supportive care needs of these patients.

Nociplastic Pain Criteria or Recognition of Central Sensitization? Pain Phenotyping in the Past, Present and Future

Recently, the International Association for the Study of Pain (IASP) released clinical criteria and a grading system for nociplastic pain affecting the musculoskeletal system. These criteria replaced the 2014 clinical criteria for predominant central sensitization (CS) pain and accounted for clinicians' need to identify (early) and correctly classify patients having chronic pain according to the pain phenotype. Still, clinicians and researchers can become confused by the multitude of terms and the variety of clinical criteria available. Therefore, this paper aims at (1) providing an overview of what preceded the IASP criteria for nociplastic pain ('the past'); (2) explaining the new IASP criteria for nociplastic pain in comparison with the 2014 clinical criteria for predominant CS pain ('the present'); and (3) highlighting key areas for future implementation and research work in this area ('the future'). It is explained that the 2021 IASP clinical criteria for nociplastic pain are in line with the 2014 clinical criteria for predominant CS pain but are more robust, comprehensive, better developed and hold more potential. Therefore, the 2021 IASP clinical criteria for nociplastic pain are important steps towards precision pain medicine, yet studies examining the clinimetric and psychometric properties of the criteria are urgently needed.