A Practical Guide for Item Generation in Measure Development: Insights From the Development of a Patient-Reported Experience Measure of Compassion

BACKGROUND AND PURPOSE

Although various measure development guidelines exist, practical guidance on how to systematically generate items is nascent. This article provides practical guidance on item generation in measure development and the use of a Table of Specifications (TOS) in this process.

METHODS

In addition to a review of the literature, the item generation process within an ongoing study to develop a valid and reliable patient-reported measure of compassion is provided.

RESULTS

Consensus on an initial pool of 109 items and their response scale was achieved with the aid of a TOS.

CONCLUSIONS

Dynamic, experiential, and relational care constructs such as compassion lie at the heart of nursing. Practical guidance on item generation is needed to allow nurses to identify, measure, and improve compassion in research and practice.

Development and psychometric properties of the public attitude towards vaccination scale - Health belief model

AIM

The aim of this study was to develop and psychometrically evaluate the Public Attitude Towards Vaccination Scale - Health Belief Model.

DESIGN

A methodological and prospective psychometric study.

METHOD

A three-phase construct was used to develop the Public Attitude Towards Vaccination Scale - Health Belief Model and to determine its psychometric properties: (1) creation of the item pool/conceptualization; (2) evaluation of the items; and (3) psychometric evaluation. This scale was tested using the construct validity (exploratory and confirmatory factor analyses) and the reliability analysis. A psychometric assessment of the scale was conducted with 586 individuals. Data were collected between January - April 2018.

RESULTS

Items of the scale were obtained by appraising the literature concerning vaccination and the other Health Belief Model scale and conducting interviews with mothers. The content validity ratio of this scale calculated according to experts' opinions ranged between 0.769 and 1.00. According to the exploratory factor analysis, there were five factors with an eigenvalue higher than 1 in the scale. These five factors accounted for 68.9% of the total variance. In confirmatory factor analysis, values of fit indices were excellent or acceptable. This scale had high internal consistency and test-retest reliability.

CONCLUSION

This study successfully developed the Public Attitude Towards Vaccination Scale - Health Belief Model. In addition to researchers, this scale can be used by nurses while providing counselling for people with vaccine hesitancy/refusal.

IMPACT

This measurement tool can be used to understand and address 'vaccine hesitancy' by researchers. The results of the research using this measurement tool will provide valuable information to policymakers for preventing vaccine hesitancy. The validity and reliability of this scale can easily be conducted in different languages.

Development of a Novel Hematological Malignancy Specific Patient-Reported Outcome Measure (HM-PRO): Content Validity

BACKGROUND

The quality of life of patients at all stages of hematological malignancy is greatly affected by the disease and its treatment. There is a wide range of health-related quality of life (HRQoL) issues important to these patients. Any new instrument developed to measure HRQoL of such patients should be content valid, i.e., the items should be comprehensively relevant to the patients and their health condition. The aim of the present study was to examine content validity of a hematological malignancy specific patient reported outcome measure (HM-PRO) developed for use in routine clinical practice.

METHODS

Following literature review and semi-structured interviews, the generated themes and sub-themes were discussed to develop the prototype version of the HM-PRO. A 4-step approach was used for content validation: initial testing and cognitive interviewing; item rating; content validity panel meeting; final field testing and cognitive interviewing. Additional questions related to patients' perception of recall period and preferred sentence structure (i.e., question or statement) of the items were also asked during cognitive interviews.

RESULTS

The content analysis of 129 transcribed semi-structured interviews resulted in the prototype version of the instrument consisting of 58 items grouped into two parts: Part A (impact/HRQoL - 34 items) and Part B (signs and symptoms - 24 items). The initial testing showed intra-class correlation coefficient (ICC) of >0.8 for both Part A and Part B. Item rating for language clarity, completeness, relevance, and response scale by experts and patients showed content validity index for scales average >0.8 for both Part A and Part B, except 0.64 for relevance for Part A by the patient panel. The final testing of the revised version of the instrument showed the Cronbach's alpha value of 0.91 for Part A and 0.76 for Part B, suggesting high internal consistency, and ICC of 0.91 for Part A and 0.76 for Part B. The recall period of "today" for Part-A and "last 3 days" for Part-B were the patients' preferred "recall period." Furthermore, the patients expressed preference to the HM-PRO items as statements.

CONCLUSION

The findings of this study confirm that the HM-PRO possesses a strong content validity, includes all the issues important to patients and is easy to read, understand and respond to spontaneously.

A novel patient-reported outcome for paediatric localized scleroderma: a qualitative assessment of content validity

BACKGROUND

According to current standards, no existing patient-reported outcome (PRO) measures have high-quality validity evidence for use with individuals diagnosed with paediatric localized scleroderma (LS). This severely hinders patient-centred LS-focused research, including much needed clinical trials.

OBJECTIVES

To develop a valid health-related quality of life measure for individuals with paediatric LS and to qualitatively evaluate its content validity using a patient-centred approach.

METHODS

Previously collected qualitative data from youth with LS and their caregivers was used to develop items. The resulting item set was administered in a clinical setting to participants aged 8-18 years old. Cognitive interviews were used to evaluate time to survey completion, readability/understanding of the items, appropriateness of the recall period and construct representation.

RESULTS

Seventeen children and adolescents with LS participated in the study. Interviews supported readability, understanding of the items and appropriateness of the recall period in individuals > 10 years old. Revisions were made to simplify the instructions and to be more inclusive of different subtypes of LS. Three items were added to improve content representation.

CONCLUSIONS

Content validity was supported by the patient-centred development process of the outcome measure and via direct feedback from individuals with LS and their families. Although an important first step, the resulting PRO, termed the Localized Scleroderma Quality of Life Instrument, should be further evaluated in a larger sample before being implemented. What's already known about this topic? No current health-related quality of life (HRQoL) measures have been created using direct input from children and adolescents with localized scleroderma (LS). When compared with qualitative reports of HRQoL impact in youth with all LS subtypes, no existing patient-reported outcome (PRO) measures have appropriate content validity for individuals with paediatric LS. What does this study add? This study proposes a novel LS-specific PRO and is the first qualitative assessment of content validity for any PRO measure in this population. Results from cognitive interviews with children and adolescents support the content validity of the newly developed item set and its ability to capture HRQoL impact in a clinical context. What are the clinical implications of this work? Incorporating a content-valid PRO of HRQoL impact into clinical practice would allow for the valid, ongoing capture of patient experience in LS. Although content validity is an important and necessary step in the process of evaluating validity, items within this novel measure will undergo additional psychometric evaluation before implementation in research and clinical settings.

Measuring shared decision making in oncology: Development and first testing of the iSHAREpatient and iSHAREphysician questionnaires

BACKGROUND

Existing measures to assess shared decision making (SDM) have often been developed based on an ill-defined underlying construct, and many assess physician behaviours only or focus on a single patient-physician encounter.

OBJECTIVE

To (a) develop a patient and a physician questionnaire to measure SDM in oncology and (b) determine their content validity and comprehensibility.

METHODS

A systematic review of SDM models and an oncology-specific SDM model informed the domains of the SDM construct. We formulated items for each SDM domain. Cancer patients and physicians rated content validity in an online questionnaire. We assumed a formative measurement model and performed online field-testing in cancer patients to inform further item reduction. We tested item comprehension in cognitive interviews with cancer patients and physicians.

RESULTS

We identified 17 domains and formulated 132 items. Twelve cancer patients rated content validity at item level, and 11 physicians rated content validity at domain level. We field-tested the items among 131 cancer patients and conducted cognitive interviews with eight patients and five physicians. These phases resulted in the 15-item iSHAREpatient and 15-item iSHAREphysician questionnaires, covering 13 domains.

CONCLUSIONS

We thoroughly developed the iSHARE questionnaires. They both assess patient and physician behaviours and cover the entire SDM process rather than a single consultation.

Identifying and Prioritizing Effective Factors on Outsourcing in Public Hospitals Using Fuzzy BWM

The outsourcing of health services has gained prominence over the past decades. Because numerous factors affect outsourcing in the field of health services, identifying and prioritizing these factors is specifically important. This study sought to identify and prioritize the factors affecting outsourcing, and to propose a model for the effective outsourcing of hospital services in Shiraz, Iran. The study drew on an exploratory mixed research method. In the first stage, all the criteria affecting the outsourcing of activities in hospitals were identified through the theoretical framework, a literature review, and interviews with hospital experts. Next, the criteria were finalized and prioritized using the fuzzy best-worst method (BWM). Following the literature review, 34 criteria for outsourcing were identified based on the studies explored and the interviews with the experts; the criteria were categorized into seven dimensions including "strategy", "management", "economy", "quality", "security and keeping patients' records", "service", and "agility." These dimensions formed the final outsourcing model of hospitals in Shiraz. Finally, the fuzzy BWM analysis revealed that "security and keeping patient's records" had the highest priority in outsourcing-related decision-making. The findings can help hospital managers make the right decision concerning the outsourcing of hospital services. The dimensions found in this research might also have been identified in other models, although this study was different in that it concentrated on the criteria in the specialized area of hospital management, while identifying the importance and weights of all the criteria involved.

Development and validation of a quality of relationship intervention for stroke survivor-family caregiver dyads

Background: The relationship between stroke survivors and family caregivers is critical for the well-being of both dyad members. Currently, there are few interventions targeted at dyads and focused on strengthening the relationship between survivors and family caregivers.Objectives: This study reports on the development of a customizable, strengths-based, relationship-focused intervention driven by the real-world experience and advice of stroke dyads. It also describes the "tips" that survivors and family caregivers offered for dealing with relationship challenges after stroke.Methods: Content of the intervention, including relationship tips, was derived from semi-structured interviews with N= 19 stroke dyads. A modified Delphi process with a national panel of 10 subject matter experts was used to evaluate and refine the content of the intervention and the associated screening tool.Results: Seventeen domains of relationship challenges and tips were identified. Consensus was reached among experts that the intervention content was relevant to the goal of helping survivors and family caregivers maintain a strong relationship after stroke; (2) clear from the perspective of stroke survivors and family caregivers who would be using it; (3) accurate with respect to the advice being offered, and; (4) useful for helping stroke survivors and family caregivers improve the quality of their relationship.Conclusions: This study extends the limited body of research about dyadic interventions after stroke. The next steps in this line of research include feasibility testing the intervention and evaluating its efficacy in a larger trial.

Development and Validation of an Evaluation Tool to Measure the Effectiveness of a Smoking Cessation Training among Healthcare Providers in Malaysia: The Providers' Smoking Cessation Training Evaluation (ProSCiTE)

Background: In line with Article 14 of the Framework Convention for Tobacco Control, we have witnessed vast developments in smoking cessation training for healthcare providers, offering help for smokers. However, there is no specific evaluation tool to monitor and evaluate the effectiveness of these programs for future enhancement and sustainability. Objective: To develop and validate a new tool for evaluating smoking cessation training programs for healthcare providers called the Providers' Smoking Cessation Training Evaluation (ProSCiTE). Methods: The 74-item ProSCiTE tool was developed based on a review of the literature and an expert panel review. The tool was validated in a sample of 403 healthcare providers using a cross-sectional study design from July to December 2016. Content validity was assessed by the Scale-Content Validity Index (S-CVI). The construct validity of the ProSCiTE was analyzed using exploratory factor analysis (EFA) to confirm psychometric properties. Internal consistency reliability was determined using Cronbach's alpha. Results: The content validity showed that the S-CVI ranged from 0.82 to 1.00 for consistency, representativeness, relevancy, and the clarity of each construct, resulting in 67 items for the questionnaire. The construct validity of the ProSCiTE (based on eigenvalues and factor loadings to confirm the four-factor structure (attitude, self-efficacy, behavior, and barriers) with 54.74% total variance) was acceptable (Kaiser-Mayer-Olkin = 0.923; Bartlett's test of sphericity was significant, p < 0.001). The internal consistency reliability of the four-factor structure was very good, with Cronbach's alpha values at 0.89, 0.94, 0.95, and 0.90, respectively. Conclusions: This study showed that 67 items of the ProSCiTE demonstrated good content and construct validity, as well as a high internal consistency reliability for the measurement of knowledge, attitudes, self-efficacy, behavior, and barriers to smoking cessation interventions among healthcare providers. Therefore, the ProSCiTE is a valid and reliable research tool with which to evaluate the effectiveness of smoking cessation training programs.

Development and content validation of the Telenursing Interaction and Satisfaction Questionnaire (TISQ)

Background

Caller satisfaction with telephone advice nursing (TAN) is generally high, and the interaction is essential. However, a valid questionnaire exploring caller satisfaction in TAN with focus on perceived interaction is lacking.

Objective

To develop and assess content validity and test‐retest reliability of a theoretically anchored questionnaire, the Telenursing Interaction and Satisfaction Questionnaire (TISQ), that explores caller satisfaction in TAN by focusing on perceived interaction between the caller and the telenurse.

Methods

The study was performed in three stages. First, variables relevant for patient satisfaction in health care were identified through a literature search. Variables were then structured according to the Interaction Model of Client Health Behavior (IMCHB), which provided theoretical guidance. Items relevant for a TAN context were developed through consensus discussions. Then, evaluation and refinement were performed through cognitive interviews with callers and expert ratings of the Content Validity Index (CVI). Finally, test‐retest reliability of items was evaluated in a sample of 109 individuals using intraclass correlation coefficients (ICC).

Results

The TISQ consists of 60 items. Twenty items cover perceived interaction in terms of health information, affective support, decisional control and professional/technical competence. Five items cover satisfaction with interaction and five items overall satisfaction. Remaining items reflect singularity of the caller and descriptive items of the call. The TISQ was found to exhibit good content validity, and test‐retest reliability was moderate to good (ICC = 0.39‐0.84).

Conclusions

The items in the TISQ form a comprehensive and theoretically anchored questionnaire with satisfactory content validity and test‐retest reliability.

Development of a 'universal-reporter' outcome measure (UROM) for patient and healthcare professional completion: a mixed methods study demonstrating a novel concept for optimal questionnaire design

OBJECTIVES

To describe the novel concept of, and methods for developing, a 'universal-reporter' outcome measure (UROM); a single questionnaire for completion by patients and/or healthcare professionals (HCPs) when views on the same subject are required.

DESIGN

A mixed methods study with three phases-phase I: identification of relevant content domains from existing clinical tools, patient questionnaires and in-depth interviews with multistakeholders; phase II: item development using a novel approach that considered plain language in conjunction with medical terminology; and phase III: pretesting with multistakeholders using cognitive interviews.

SETTING

A case study in surgical wound assessment undertaken in two UK hospital trusts and one university setting.

PARTICIPANTS

Patients who had recently undergone general abdominal surgery and healthcare professionals involved in post-surgical wound care.

RESULTS

Phase I: In the example case study, 19 relevant content domains were identified from two clinical tools, two patient questionnaires and 19 multistakeholder interviews (nine patients, 10 HCPs). Phase II: Domains were operationalised into items and subitems (secondary components to collect further information, if relevant). The version after pretesting had 16 items, five of which included further subitems. Plain language in conjunction with medical terminology was applicable in nine (27%) items/subitems. Phase III: Pretesting with 28 patients and 14 HCPs found that the UROM was acceptable to both respondent groups. An unanticipated secondary finding of the study was that the combined use of plain language and medical terminology during questionnaire development may be a useful, novel technique for evaluating item interpretation and thereby identifying items with inadequate content validity.

CONCLUSION

UROMs are a novel approach to outcome assessment that are acceptable to both patients and HCPs. Combining plain language and medical terminology during item development is a recommended technique to improve accuracy of item interpretation and content validity during questionnaire design. More work is needed to further validate this novel approach and explore the application of UROMs to other settings.

Validity and reliability of the Neuropsychological Assessment Battery - Screening Module (S-NAB) in a subset of Malaysian population with mild traumatic brain injury (mTBI)

This study assessed the validity (construct validity) and reliability (internal consistency) of the Neuropsychological Assessment Battery Screening Module (S-NAB) in detecting mild cognitive deficit/alteration in multicultural, multilingual, and multiethnic mild traumatic brain injury (mTBI) population of Malaysia. S-NAB and Montreal Cognitive Assessment (MoCA) data from 114 patients with mTBI (93 males; 21 females) aged 18 to 60 years old were obtained at University Malaya Medical Center, Malaysia. The mean age was 28.17 ± 8.57 years and mean education years was 12.40 ± 2.01. Convergent validity was assessed between S-NAB domain scores and MoCA total scores by using Pearson's correlation and internal consistency was assessed using Cronbach's alpha. Acceptable internal consistency (α ≥ .70) was found for Attention, Language, and Memory domains but weak internal consistencies (α < .50) were found for Spatial and Executive Function domains. There were positive but weak correlations between S-NAB and MoCA. These findings provide some support for the application of S-NAB in assessing mild cognitive deficits of mTBI population in a Malaysian setting.

Symptoms of Major Depressive Disorder Scale: Performance of a Novel Patient-Reported Symptom Measure

BACKGROUND

The Symptoms of Major Depressive Disorder Scale (SMDDS) was expressly developed on the basis of qualitative data to directly incorporate patients' voices into evaluation of treatment benefit in major depressive disorder (MDD) clinical trials.

OBJECTIVES

To collect quantitative data necessary to refine/optimize the SMDDS and document its psychometric properties.

METHODS

In this multicenter, observational study, participants with clinically diagnosed MDD completed questionnaires in 2 waves. Wave 1 was designed to refine the SMDDS using Rasch measurement evaluations and item reduction analyses. On a subset of wave 1 subjects, 7 to 12 months later, wave 2 further examined item performance and measurement properties. Exploratory factor analyses and assessments of construct validity and reliability (internal consistency and reproducibility) were completed.

RESULTS

Using wave 1 data (N = 315; females = 71%, white = 81%, mean age = 44 years), the SMDDS was revised from 36 to 16 items. The Rasch item threshold map indicated that all but 1 item (suicidal ideation) were appropriately ordered. The 207 wave 2 participants were 74% females, 82% white, with a mean age of 45 years. The exploratory factor analyses resulted in a single component (all standardized factor loadings >0.46). Cronbach α was 0.93 and the 7-day test-retest intraclass correlation coefficient (n = 93) was 0.84 (95% confidence interval 0.77-0.89). SMDDS scores discriminated between MDD severity levels.

CONCLUSIONS

The 16-item SMDDS generated highly reliable scores with substantial evidence of construct validity. On the basis of the evidence of appropriate content validity and sound psychometric performance, the Food and Drug Administration qualified the SMDDS as an outcome measure to support exploratory efficacy endpoints in MDD clinical trials.

Validation of a Short-Form Version of the Danish Need for Recovery Scale against the Full Scale

Introduction: The Need for Recovery (NFR) Scale facilitates the understanding of the factors that can lead to sustainable working and employability. Short-form scales can reduce the burden on researchers and respondents. Our aim was to create and validate a short-form Danish version of the NFR Scale. Methods: Two datasets were used to conduct the exploratory and confirmatory analyses. This was done using qualitative and quantitative methods. The exploratory phase identified several short-form versions of the Danish NFR Scale and evaluated the quality of each through the assessment of content, construct and criterion validity, and responsiveness. These evaluations were then verified through the confirmatory analysis, using the second dataset. Results: A short-form NFR scale consisting of three items (exhausted at the end of a work day, hard to find interest in other people after a work day, it takes over an hour to fully recover from a work day) showed excellent validity and responsiveness compared to the nine-item scale. Furthermore, a short-form consisting of just two items also showed excellent validity and good responsiveness. Conclusion: A short-form NFR scale, consisting of three items from the Danish NFR Scale, seems to be an appropriate substitute for the full nine-item scale.

The Pictorial Fit-Frail Scale: Developing a Visual Scale to Assess Frailty

Background

Standardized frailty assessments are needed for early identification and treatment. We aimed to develop a frailty scale using visual images, the Pictorial Fit-Frail Scale (PFFS), and to examine its feasibility and content validity.

Methods

In Phase 1, a multidisciplinary team identified domains for measurement, operationalized impairment levels, and reviewed visual languages for the scale. In Phase 2, feedback was sought from health professionals and the general public. In Phase 3, 366 participants completed preliminary testing on the revised draft, including 162 UK paramedics, and rated the scale on feasibility and usability. In Phase 4, following translation into Malay, the final prototype was tested in 95 participants in Peninsular Malaysia and Borneo.

Results

The final scale incorporated 14 domains, each conceptualized with 3–6 response levels. All domains were rated as “understood well” by most participants (range 64–94%). Percentage agreement with positive statements regarding appearance, feasibility, and usefulness ranged from 66% to 95%. Overall feedback from health-care professionals supported its content validity.

Conclusions

The PFFS is comprehensive, feasible, and appears generalizable across countries, and has face and content validity. Investigation into the reliability and predictive validity of the scale is currently underway.

A content validity evaluation of the PEDI-CAT Speedy Mobility domain

Objective: To evaluate the content validity of the PEDI-CAT Speedy Mobility domain through analysis of item and content area exposure, score range and scoring precision.Methods: Retrospective analysis of 3,364 items from assessments (n = 301) completed from 2013 to 2017. Content validity was appraised through analysis of item and content area exposure (item, content area, response frequency), score range (floor and ceiling effect) and scoring precision (person fit, score reliability, item information function).Results: Sixty-five of the 75 general mobility items from the PEDI-CAT Mobility domain item bank were exposed. "Stands up from the middle of the floor" (68%) was the most frequently exposed non-mandatory item. Almost half (49%) of all items were from the Basic Mobility and Transfers content area. Scaled scores ranged from 26.77 to 69.40 with a floor (scores ≤27; n = 51, 17%) but no ceiling effect. Person fit statistics were acceptable for 238 (79%), suggesting limited outliers. Score reliability was sufficient with 68% of scores above threshold (>0.9). Item information function plot indicated less discriminating items at the lower end of the score range.Conclusion: Content is adequately and reliably measuring the intended construct, but additional items at the lower end of the scale could improve score precision.

Patient-reported outcome measures in community-acquired pneumonia: a systematic review of application and content validity

Introduction

Patient-reported outcome measures (PROMs) are a vital component of patient-centred care. Community-acquired pneumonia (CAP) is a significant contributor to morbidity, mortality and health service costs globally, but there is a lack of consensus regarding PROMs for this condition.

Methods

We searched MEDLINE, EMBASE and Cochrane Collaboration for studies, both interventional and observational, of adult recovery from CAP that applied at least one validated PROM instrument and were published before 31 December 2017. The full text of included studies was examined and data collected on study design, PROM instruments applied, constructs examined and the demographic characteristics of the populations measured. For all CAP-specific PROM instruments identified, content validity was assessed using the COnsensus based Standards for selection of health Measurement INstruments guidelines (COSMIN).

Results

Forty-two articles met the inclusion criteria and applied a total of 17 different PROM instruments including five (30%) classified as CAP specific, six (35%) as generic and six (35%) that measured functional performance or were specific to another disease. The 36-Item Short Form Survey (SF-36) was the most commonly used instrument (15 articles). Only one of 11 (9%) patient cohorts assessed using a CAP-specific instrument had a mean age ≥70 years. The CAP-Sym and CAP-BIQ questionnaires had sufficient content validity, though the quality of evidence for all CAP-specific instruments was rated as very low to low.

Discussion

PROM instruments used to measure recovery from CAP are inconsistent in constructs measured and have frequently been developed and validated in highly selective patient samples that are not fully representative of the hospitalised CAP population. The overall content validity of all available CAP-specific instruments is unclear, particularly in the context of elderly hospitalised populations. Based on current evidence, generic health instruments are likely to be of greater value for measuring recovery from CAP in this group.

Development and Validation of "Caregiver Burden Scale-Indian Population"

Background:

Caregiver burden is always a neglected domain, and assessment of burden with available instruments developed in one country is neither reliable nor valid because of different cultural, ethical, religious, and other personal values. This study is an attempt to develop an appropriate instrument which can assess the burden on caregivers from the Indian subcontinent and other Asian countries. This work is an attempt to develop and standardization of CBS-IP using content and construct validity.

Methods:

The study was conducted with a total of 125 (55 – initial interview + 25 – pilot study + 45 – construct validity) caregivers of individual with chronic neurologically ill patients. Content and construct validation was performed as follows: (1) search of relevant electronic databanks and use of experts and caregivers’ opinions to prepare appropriate content, review, and correction of the content through discussions with experts. (2) Content validity has been established by computing content validity index (CVI). (3) Construct validity has been established by correlating (Pearson’s-r) with another standardized instrument (Eysenck Personality Questionnaire-Revised) using multitrait procedure.

Results:

Using CVI procedure, scale-level CVI (S-CVI) universal agreement is 0.889; S-CVI average is 0.898. The item-level CVI is 0.90. The Pearson product-moment correlation coefficient (r) was obtained by comparing caregiver burden scale-Indian population (CBS-IP) total with extraversion, r = −0.440, n = 45, P = 0.002; CBS-IP total with neuroticism, r = 0.228, n = 45, P = 0.132; and CBS-IP total with psychoticism, r = −0.011, n = 45, P = 0.942.

Conclusions:

We believe that the new tool CBS-IP is a good empirical instrument for evaluating stressors on informal caregivers in India and possibly in some other countries in Asia.

Development and Validation of the Tele-Pulmonary Rehabilitation Acceptance Scale

BACKGROUND

Using telehealth in pulmonary rehabilitation (telerehabilitation) is a new field of health-care practice. To successfully implement a telerehabilitation program, measures of acceptance of this new type of program need to be assessed among potential users. The purpose of this study was to develop a scale to measure acceptance of using telerehabilitation by health-care practitioners and patients.

METHODS

Three objectives were met (a) constructing a modified scale of the technology acceptance model, (b) judging the items for content validity, and (c) judging the scale for face validity. Nine experts agreed to participate and evaluate item relevance to theoretical definitions of domains. To establish face validity, 7 health-care practitioners and 5 patients were interviewed to provide feedback about the scale's clarity and ease of reading.

RESULTS

The final items were divided into 2 scales that reflected the health-care practitioner and patient responses. Each scale included 3 subscales: perceived usefulness, perceived ease of use, and behavioral intention.

CONCLUSIONS

The 2 scales, each with 3 subscales, exhibited evidence of content validity and face validity. The 17-item telerehabilitation acceptance scale for health-care practitioners and the 13-item telerehabilitation acceptance scale among patients warrant further psychometric testing as valuable measures for pulmonary rehabilitation programs.

Reporting of Protocol Rationale and Content Validity in Randomized Clinical Trials of T'ai Chi: A Systematic Evaluation

BACKGROUND

Mind-body exercise interventions are typically multimodal, complex, and pluralistic, and few have been developed with the goal of therapeutically targeting a specific medical population. It is thus important that clinical trials evaluating mind-body interventions provide some justification for the use of the specific protocol being evaluated.

OBJECTIVES

This article reports the results of a systematic review of the quality of reporting of protocol rationale and content validity for using a specific t'ai chi protocol in a randomized controlled trial (RCT).

METHODS

Electronic literature searches were conducted using PubMed/MEDLINE, EBSCOhost, and the Cochrane Library from inception through June 2015. Search terms were Tai Chi, Taiji, Tai Chi Chuan; searches were limited to English-language RCTs. Inclusion and exclusion of trials were reported in accordance with the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines. The authors assessed the level of reporting with respect to t'ai chi protocol validation using a 5-point grading system based on whether (1) a specific protocol was mentioned, (2) rationale for the specific protocol was stated and supported, and (3) formal evaluation for content validity was conducted.

RESULTS

There was significant heterogeneity in the quality of reporting related to protocol rationale and content validity. A total of 171 publications were identified. Studies met between 0 and 4 validity criteria (of possible 5, more indicating better quality), with a mean of 2.52 (±SD 1.2) and median of 3. Twenty (12%) trials did not mention a specific t'ai chi protocol, 10 (6%) trials met 0 of 5 criteria, and 47 (31%) studies met 4 of 5 criteria. Formal validity assessments were employed in only one trial.

CONCLUSIONS

The poor quality of protocol rationale and content validity reporting limits our ability to accurately evaluate the evidence of t'ai chi as a therapeutic intervention. The development of formal guidelines for developing and reporting intervention validity for multimodal mind-body exercises like t'ai chi may improve the quality and interpretability of research.

Development of a Questionnaire to Determine Incidence and Attitudes to "Voluntary Stopping of Eating and Drinking"

Background

“Voluntary stopping of eating and drinking” (VSED) is an option to hasten death at the end of life. There are no data available about incidence of either the explicit VSED or implicit (V)SED nor information about experiences and attitudes of health professionals about VSED in Switzerland.

Aims

To develop, test, and translate a standardized questionnaire that measures the incidence of VSED, and physicians’ and nurses’ experiences about explicit VSED and implicit (V)SED.

Methods

The development of the questionnaire was based on a systematic search, which were updated in 2016. The questionnaire was tested by palliative care specialists using standard pretest and content validity index (CVI). Subsequently, a forward/backward translation was made.

Results

The questionnaire includes 38 items. Feedback of 15 participants in the standard pretest were positive in terms of intelligibility with an average time of 28 minutes. After adjustment, 27 experts validated the items in two rounds. The questionnaire achieves excellent item-CVI values between 0.91 and 1.00 and scale-CVI values of 0.97. The forward/backward translations were each carried out by two independent translators with subsequent building of a consensus through a consultant.

Conclusion

A mulitlingual questionnaire has been developed, which measures the incidence of explicit VSED and implicit (V)SED. This questionnaire is the basis for a Swiss-wide census of all physicians and nurses of outpatient and long-term care.

The Puzzle of Emotion Regulation: Development and Evaluation of the Tangram Emotion Coding Manual for Children

The ability to regulate one's emotions is crucial to engaging successfully in social contexts. Difficulties in emotion regulation are seen in multiple psychiatric disorders, prompting an increased interest in the concept. Suitable methods for assessing emotion regulation, however, are lacking. In this study, we investigated the interrater and intrarater reliability, construct validity, and content validity of a new observational method for evaluating children's emotion regulation abilities (a complex puzzle task) in a sample of 62 children without psychiatric disorders and 23 children with attention-deficit/hyperactivity disorder (ADHD) aged 7-12, using intra-class correlation coefficients for the reliability analyses and Spearman's rank-order correlations for analyses of convergent and discriminant validity. A panel of experts examined the content validity of the test, and Mann-Whitney U-tests were used to investigate the ability of the test to differentiate the non-clinical group from the ADHD group. Results showed a high level of interrater and intrarater reliability of the test. There was mixed evidence for convergent and discriminant validity as expected due to the novelty and experimental nature of the test, making it difficult to compare with questionnaire-based measures. Content validity analysis was satisfactory, and the group comparison showed that the test differentiated the groups on the primary outcome measure. Overall, the measure demonstrated high feasibility and satisfactory psychometric properties. The generic nature of the test makes it suitable for use across psychiatric disorders and age groups with potential relevance in both research and clinical settings.

Qualitative Methods Used to Generate Questionnaire Items: A Systematic Review

A systematic review of articles using qualitative methods to generate questionnaire items identified in MEDLINE and PsycINFO from 2000 to 2014 was carried out. Articles were analyzed for (a) year of publication and journal domain, (b) qualitative data collection methods, (c) method of data content analysis, (d) professional experts' input in item generation, and (e) debriefing of the newly developed items. In total, 371 articles were included and results showed (a) an acceleration of published articles, (b) individual interviews and focus groups were common ways of generating items and no emergent approach was identified, (c) the content analysis was usually not described (43% of articles), (d) experts were involved in eliciting concepts in less than a third of articles, (e) 61% of articles involved a step of further submission of newly developed items to the population of interest. This review showed an insufficient reporting of qualitative methods used to generate new questionnaires despite previous recommendations.

Perspectives of parents and nurses on the content validity of the Family Empowerment Scale for parents of children with a chronic condition: A mixed-methods study

BACKGROUND

Insight into parental empowerment is important to understanding the impact of health care policy and to supporting and strengthening parents in the care of their child. The Family Empowerment Scale (FES) is a valid 24-item instrument that measures parental empowerment. It was originally developed for parents of children with emotional disabilities. It has been translated from English into Dutch. Before using the translated FES in another context, the aim of this study was to assess the content validity of the Dutch FES in the context of children with a chronic condition in a children's hospital, according to parents and nurses.

METHOD

This content validity study has a convergent, mixed-methods design. The content validity index was used to examine the relevance, according to 22 parents and 12 nurses quantitatively, on a scale and item level. The qualitative part assessed the comprehensiveness and comprehension of the FES through cognitive interviewing with eight parents and four nurses. The results of both analyses were converged to determine content validity.

RESULTS

The scale-content validity index was 0.88; three items scored < 0.78 on the item level. For 10 (of 24) items, issues were noticed about the tone and clarity of wording. Participants considered the FES to be not only an instrument of research but also an instrument that could be used to give insight into the personal degree of parental empowerment.

CONCLUSION

The content validity of the Dutch FES for parents of children with a chronic condition can be considered sufficient. Resolving some minor translation issues in some of the items is advised. The FES can be used in further research to examine the value of the FES in health care services, aiming to support the needs of parents and to increase their empowerment.

The requirement for a disease-specific patient-reported outcome measure of dysphagia in oculopharyngeal muscular dystrophy

INTRODUCTION

There is no patient-reported outcome (PRO) questionnaire specifically designed to assess oropharyngeal dysphagia in oculopharyngeal muscular dystrophy (OPMD). To select a suitable questionnaire, content validity of the existing questionnaires must be assessed. This study sought (1) to identify dysphagia-related symptoms in OPMD and (2) to assess content validity of currently available PRO for the assessment of dysphagia severity in OPMD.

METHODS

A two-step literature review was conducted of dysphagia-related symptom identification and oropharyngeal dysphagia-related PRO. Symptoms were validated with an expert panel by using a Delphi survey. Content validity of PRO questionnaires was documented through content analysis.

RESULTS

Ten PRO questionnaires were identified. None of the questionnaires cover the entire symptom spectrum in OPMD and thus lack content validity.

DISCUSSION

The development and validation of a new PRO questionnaire to assess dysphagia in OPMD is required to establish the importance of symptomatic relief from new treatments. Muscle Nerve 59:445-450, 2019.

Development of a New Tool for Evaluating the Benefit of Preventive Treatments for Migraine on Functional Outcomes - The Migraine Functional Impact Questionnaire (MFIQ)

OBJECTIVE

The objective of this study was to develop a method for evaluating patient-relevant outcomes of interventions for preventing migraine attacks, followed by an assessment of the content validity of a new patient-reported outcome (PRO) instrument: the Migraine Functional Impact Questionnaire (MFIQ).

BACKGROUND

The aim of preventive treatments for migraine is not only to reduce migraine frequency, but also to restore patients' ability to function and improve quality of life.

METHODS

A multi-stage process based on best practice methods and regulatory guidelines for ensuring content validity of PRO instruments for evaluating treatment benefit was followed. Qualitative concept elicitation interviews conducted to understand the experiences of adults with migraine underpinned the development of the instrument. The initial stage included the development of a conceptual disease model (CDM) based on information from these interviews. This CDM was used to identify the concepts of interests (COI) to evaluate outcomes of preventive treatments. The results of the interviews were also used in stage 2, to develop a measurement framework for collecting data about these COI. In the third stage, existing instruments were reviewed for coverage of the concepts in the framework and evidence of concept elicitation to the point of saturation, to support content validity. In the fourth stage, an instrument was drafted to evaluate concepts in the framework, based on the qualitative data collected from the interviews. Following a review by clinical and translation experts, the new instrument was tested in adults with migraine in the fifth stage using 2 rounds of cognitive interviews, and was modified based on interview feedback. In the last stage, the instrument was linguistically adapted, using methods recommended for PRO instruments, to ensure conceptual equivalence of language versions for use in international studies. Each language version was tested in at least 5 native speakers using cognitive interviews.

RESULTS

Results from the concept elicitation interviews suggested that migraine had an impact on various aspects of functioning. A conceptual framework for evaluating functional outcomes was developed for the concept selected based on a review of the CDM - physical and emotional functioning, every day activities, and social/leisure activities. Existing PROs lacked coverage of some concepts in the conceptual framework, had recall periods that were inappropriate for capturing the experience of COI or did not have evidence of content validity. A novel PRO instrument, the MFIQ, was developed to address these gaps. Cognitive interviews with 9 adults with migraine resulted in minor changes to the items of the MFIQ, and a final round of 8 interviews confirmed the changes were acceptable and supported its validity. The interviews conducted to test linguistic adaptations confirmed conceptual equivalence in the 25 countries evaluated.

CONCLUSIONS

Development of the MFIQ followed best measurement practices to ensure content validity and followed regulatory guidelines for PRO instruments to evaluate benefits of treatments. The MFIQ was developed for use in clinical trials or clinical practice settings to track outcomes of preventive treatments that are most relevant to adults with migraine.