Test-Retest Reliability and Reliable Change Estimates for Four Mobile Cognitive Tests Administered Virtually in Community-Dwelling Adults

Pupillometry as a new window to player fatigue? A glimpse inside the eyes of a Euro Cup Women's Basketball team

A rapidly emerging area of interest in high-pressure environments is that of pupillometry, where handheld quantitative infrared pupillometers (HQIPs) are able to track psycho-physiological fatigue in a fast, objective, valid, reliable, and non-invasive manner. However, the application of HQIPs in the context of athlete monitoring is yet to be determined. Therefore, the main aim of this pilot study was to examine the potential usefulness of a HQIP to monitor game-induced fatigue inside a professional female basketball setting by determining its (1) test-retest repeatability, (2) relationship with other biomarkers of game-induced fatigue, and (3) time-course from rested to fatigued states. A non-ophthalmologic practitioner performed a standardized Pupil Light Reflex (PLR) test using a medically graded HQIP among 9 professional female basketball players (2020-2021 Euro Cup) at baseline, 24-h pre-game (GD-1), 24-h post-game (GD+1) and 48-h post-game (GD+2). This was repeated over four subsequent games, equalling a total of 351 observations per eye. Two out of seven pupillometrics displayed good ICCs (0.95-0.99) (MinD and MaxD). Strong significant relationships were found between MaxD, MinD, and all registered biomarkers of game-induced fatigue (r = 0.69-0.82, p < 0.05), as well as between CV, MCV, and cognitive, lower-extremity muscle, and physiological fatigue markers (r = 0.74-0.76, p < 0.05). Three pupillometrics were able to detect a significant difference between rested and fatigued states. In particular, PC (right) (F = 5.173, η2 = 0.115 p = 0.028) and MCV (right) (F = 3.976, η2 = 0.090 p = 0.049) significantly decreased from baseline to GD+2, and LAT (left) (F = 4.023, η2 = 0.109 p = 0.009) significantly increased from GD-1 to GD+2. HQIPs have opened a new window of opportunity for monitoring game-induced fatigue in professional female basketball players. However, future research initiatives across larger and heterogenous samples, and longer investigation periods, are required to expand upon these preliminary findings.

Detecting Change in Needs-Supplies Fit Through Reliable Change Methodology

Studying change is a critical part of psychology and science in general. Studies often treat fit as static and use between-person designs to assess change. Accordingly, potentially insightful within-person information is frequently overlooked. The current study aimed to establish the utility of reliable change methodology within the domain of organizational psychology, using needs-supplies fit as a guiding framework. When employee needs can be tracked with a fair degree of clarity, organizations can devise better strategies to routinely address discrepancies between desired employee needs and organizational offerings. This longitudinal study used secondary data from 258 secondary school teachers. The Needs-Supplies Fit Scale was administered. The study's hypothesis was assessed through reliable change methodology. When considering all the participants that experienced at least some change across time intervals (n = 148), 23.65% (n = 35) of this change was meaningful. This declined to 17.33% meaningful change when factoring in the entire sample, including those who did not experience any change. When organizations are aware of the ever-evolving needs of employees, quicker action can be taken to avoid impending person-environment misfit. This study contributes to existing within-person studies that showcased the malleability of needs-supplies fit and emphasize the value of placing a more prominent focus on the individual.

Test-Retest reliability and preliminary reliable change estimates for Sway Balance tests administered remotely in community-dwelling adults

OBJECTIVE

Impaired balance and postural stability can occur with advanced age, following traumatic brain injury, in association with neurological disorders and diseases, and as the result of acute or chronic orthopedic problems. The remote assessment of balance and postural stability could be of value in clinical practice and research. We examined the test-retest reliability and reliable change estimates for Sway Balance Mobile Application tests (Sway Medical, Tulsa OK, USA) administered remotely from the participant's home.

METHOD

Primarily young, healthy community-dwelling adults completed Sway Balance Mobile Application tests remotely on their personal mobile devices once per week for three consecutive weeks while being supervised with a video-based virtual connection. Sway Balance tests include five stances (i.e., feet together, tandem right foot forward, tandem left foot forward, single leg right foot, single leg left foot), which are averaged to compute a Sway Balance composite score from 0 to 100, with higher scores indicating better postural stability. We examined test-retest reliability (measured with intraclass correlation coefficients, ICCs) and preliminary reliable change estimates for 70%, 80%, and 90% confidence intervals.

RESULTS

Participants included 55 healthy adults (ages = 26.7 ± 9.9 years, interquartile range = 20-30, range = 18-58; 38 [69%] women). Test-retest reliability for the Sway Balance composite score across three weeks was.88. Test-retest reliability for individual stances ranged from 62 to 83 (all ps < 0.001). At the 80% confidence interval, preliminary reliable changes estimates were 9 points for the Sway Balance composite score.

CONCLUSIONS

For a remote administration, test-retest reliability was moderate-to-good for all Sway Balance stances, as well as for the Sway Balance composite score. Reliable change estimates may allow clinicians to determine whether an improvement or decline in performance is greater than the expected improvement or decline due to measurement error in young adults.

The ambulatory battery of creativity: Additional evidence for reliability and validity

Psychometrically sound instruments that assess temporal dynamics of creative abilities are limited. The Ambulatory Battery of Creativity (ABC) is designed to assess creative ideation performance multiple times in everyday life and was proven to capture the intra-individual dynamic of creative abilities reliably and validly. The present ambulatory study aimed to replicate and extend the psychometric evidence of the novel ABC. Sixty-nine participants worked on the ABC during a 5-day ambulatory assessment protocol. Each day, participants completed six randomly presented items of the verbal and the figural ABC. Matching previous psychometric analyses, the results indicated good between-person (≥0.80) and good within-person (≥0.72) reliability. Furthermore, evidence for between-person and within-person validity of the ABC was obtained. Performance in the verbal and the figural ABC were interrelated and correlated with an independent measure of creative potential. The verbal ABC was further associated with openness, self-reported creative behavior, creative activities, and creative achievements, thus providing additional evidence of construct validity, especially for the verbal ABC. Finally, the verbal and the figural ABC yielded convincing within-person validity: Longer response times and higher subjective originality ratings were associated with more original ideas. This replication and extension of the ABC's psychometric properties indicates that it enables a reliable and valid assessment of moment-to-moment fluctuations of creative ideation abilities in everyday life, which may facilitate the investigation of exciting new research questions related to dynamic aspects of creative ability.