A note on contemporary psychometrics

Validity and reliability of the agentive steadfastness index

Agentive steadfastness is a hitherto unarticulated and unmeasured construct, although clinicians may have drawn intuitively on it in anticipating clients' prognosis and anticipated responsiveness to adverse events. Following the conceptualisation and articulation of the agentive steadfastness construct and a measure thereof, the current study examined the validity and reliability of the agentive steadfastness index (ASI) among responding adult social media users (n = 511). Results confirmed convergent validity between agentive steadfastness and closest related psychological constructs, which were resilience (r = .715) and character strength (r = .704). Its discriminant validity was observed with other related but notably distinct psychological constructs, which were anxiety (r = -.599) and ego-strength (r = -.244). Temporal stability was confirmed over a period of 6 months (r = .763). The ASI showed good internal (Cronbach alpha = .937) and split-half reliability (r = .838) and a low standard error of measurement of 7.57 points within a theoretical range of 190 points. These results suggest that the ASI is a valid and a reliable measure of agentive steadfastness. Equipped with the ASI, further research is enabled on agentive steadfastness as a psychotherapeutic target and its relations with various aspects of personality, prognosis and adversity.

Measuring psychological, cognitive, and social domains of physical literacy in school-aged children with neurodevelopmental disabilities: a systematic review and decision tree

PURPOSE

To identify and assess the clinimetric properties of psychological, cognitive, and social competence assessment tools relevant to physical activity for school-aged children (5-17 years) with neurodevelopmental disabilities.

METHODS

Seven electronic databases were searched. Study findings and methodologies were evaluated using the COnsensus-based Standards for the selection of health Measurement Instruments (COSMIN) checklist. Psychometric strength of assessment tools was determined using Grading of Recommendations Assessment, Development and Evaluation principles (GRADE) (Trial registration: CRD42020180616).

RESULTS

Study criteria were met by eight subscales from the BRIEF2, DMQ17, QI-Disability, SAID, and SDQ. Most subscales examined psychological competence (n = 5), with fewer addressing social competence (n = 2), or cognitive competence (n = 1). Validity was moderate to high strength for most subscales. Reliability was of moderate and unclear strength for two subscales. A five-level decision tree was devised to summarise: (1) physical literacy domains/elements, (2) populations, (3) assessment focus, (4) required resources, and (5) psychometric evidence.

CONCLUSIONS

Subscales are available to assess psychological, cognitive, or social competence. For school-aged children with neurodevelopmental disabilities, these have moderate to high strength psychometric support. A decision tree will assist practitioners in subscale selection. Future studies are needed to establish gold standard assessment of physical literacy for this population.IMPLICATIONS FOR REHABILITATIONPsychological Activity Competence can be measured for children with neurodevelopmental disabilities, subscales from The Behaviour Rating Inventory of Executive Function, Second Edition (BRIEF2; The Dimensions of Mastery Questionnaire 17.0 (DMQ17); and The Quality of Life Inventory-Disability (QI-Disability).Cognitive Activity Competence can be measured using a subscale from The Scale of Attention in Intellectual Disability (SAID).Social Activity Competence can be measured using subscales from the BRIEF2, and The Strengths and Difficulties Questionnaire (SDQ).Clinicians can use the Physical Literacy decision tree to guide selection of these tools.

Psychometric properties of a clinical assessment tool in the postgraduate midwifery programme, Botswana

BACKGROUND

 The psychometric properties of a clinical assessment tool used in the postgraduate midwifery programme in Botswana have not been evaluated. A lack of reliable and valid clinical assessment tools contributes to inconsistencies in clinical assessment in midwifery programmes.

OBJECTIVES

 This study aimed to evaluate the internal consistency and content validity of a clinical assessment tool used in the postgraduate midwifery programme in Botswana.

METHOD

 For internal consistency, we calculated the total-item correlation and Cronbach's alpha coefficient. For content validity, subject matter experts completed a checklist to evaluate the relevance and clarity of each competency in the clinical assessment tool. The checklist included questions with Likert-scale responses, indicating the level of agreement.

RESULTS

 The clinical assessment tool had a good reliability, with a Cronbach's alpha of 0.837. The corrected item total correlation values ranged from -0.043 to 0.880 and the Cronbach's alpha (if item deleted) ranged from 0.079 to 0.865. Overall content validity ratio was 0.95, and content validity index was 0.97. Item content validity indices ranged from 0.8 to 1.0. The overall scale content validity index was 0.97 and the scale content validity index using universal agreement was 0.75.

CONCLUSION

 The clinical assessment tool used in the postgraduate midwifery programme in Botswana has acceptable reliability. Most of the competencies included in the clinical assessment tool were relevant and clear. Certain competencies need to be reviewed to improve the reliability and validity of the clinical assessment tool.Contribution: The clinical assessment tool currently used in the postgraduate midwifery programme in Botswana had acceptable internal consistency reliability and validity.

Cancer-related fatigue: an overview

A diagnosis of cancer is a major life stressor that can affect the physiological, psychological and physical state of the person concerned. Fatigue is a particularly common and troubling symptom that has a negative impact on quality of life throughout all phases of treatment and stages of the illness. The aim of this review is to provide background information on cancer-related fatigue. This review discusses cancer-related fatigue (CRF) in terms of the definition, prevalence, risk factors, aetiology, and the measurement scales used. The differences between definitions of symptoms and relevant theories will be explored and discussed to help explain the variety of instruments used in its measurement. The prevalence of fatigue will be assessed by looking critically at the evidence of fatigue and the factors that affect it. Potential treatment and management strategies for CRF will also be discussed. Finally, there will be an overview of the instruments used to measure fatigue. This review also provides important evidence for measuring and managing CRF that can help nurses to understand fatigue among patients with cancer. Assessing CRF should be routinely undertaken in clinical settings to help identify the proper interventions, treatments and management to reduce fatigue among cancer patients.

How to measure a latent construct: Psychometric principles for the development and validation of measurement instruments

Measurement instruments are used to collect data about respondents. In social pharmacy, measurement instruments are often used to measure latent constructs, such as attitudes, among healthcare professionals and patients. This paper aims to describe the fundamental aspects of designing and validating instruments, which aim to measure latent constructs. The main focus of this manuscript is to describe the considerations and processes relating to exploratory and confirmatory factor analyses, when used to develop measures of latent psychosocial constructs. However, it also presents a detailed summary of the current evidence and suggestions for item generation and sample selection, as well as, an in-depth description of approaches to content and face validation. Suggestions for further reading are also provided.

Quality assessment criteria: psychometric properties of measurement tools for cancer related fatigue

Background: Fatigue is a common and distressing cancer symptom that negatively affects the quality of life. Many scales have been developed to assess cancer-related fatigue. The properties of the scales vary in terms of dimensionality, reliability, validity, length and method of administration. Insufficient of psychometric properties may affect the accuracy of scales findings, that may lead result obtained questionable. The main objective of this review was to conduct a quality assessment of the psychometric properties of cancer-related fatigue scales to identify appropriate scales that could be used in research and clinical practice. Method: A systematic search was carried out to identify validated scales that measure cancer-related fatigue. Five databases were searched: CINAHL, MEDLINE, EMBASE, PsycINFO, Cochrane Library. This review was conducted following the PRISMA and Terwee et al.'s quality assessment guidelines to evaluate the psychometric properties of the studies. Result: Seventy-one different studies published between 1970 and 2018 met the inclusion criteria. Twenty-five scales were identified. Of these, eighteen were multidimensional and seven were uni-dimensional, containing between 4 and 72 items. Reliability and/or validity information was missing for many scales. Four scales met the quality assessment criteria and were reported as the most appropriate for measuring fatigue in cancer patients. Conclusion: Further psychometric testing is required for other scales. Developing a universally-defined tool kit for the assessment of cancer-related fatigue may help clarify the concept of fatigue and promote a systematic approach to fatigue measurement.