Validation methods for global and local positioning-based athlete monitoring systems in team sports: a scoping review

Testing in Intermittent Sports-Importance for Training and Performance Optimization in Adult Athletes

ABSTRACT

Performance in intermittent sports relies on the interplay between multiple physiological systems determining the capacity to perform short explosive efforts as well as repeated intense actions with limited recovery over the course of an entire game. Testing should reflect these demands to allow for sport- and position-specific capacity analyses that eventually may translate into optimized training and improved performance. This may include individual load management and optimized training prescription, intensity targeting for specific positions or individual athletes, as well as benchmarking for monitoring of training progression and enhanced engagement of athletes. This review provides an overview of available tests in different exercise domains identified as relevant (from assessment of single explosive actions to intermittent endurance capacity), forming the basis for recommendations on how to compose a comprehensive yet feasible test battery that may be integrated into the seasonal competition and training plan. The test procedures should cover the performance spectrum of relevance for the individual athlete-also in team sports to account for positional differences. We emphasize the benefits of sport-specific tests, highlight parameters of importance for test standardization, and discuss how the applied test battery may be supplemented with secondary tests directed toward specific energy systems to allow for more in-depth analyses when required (e.g., in terms of an underperforming athlete). The synergy between testing and tracking of match performance (utilizing time-motion or global positioning systems) is highlighted, and although tracking cannot substitute for testing, combining the tools may provide a comprehensive overview of the physiological demands and performance during competition contextualized to the athletes' maximal exercise capacity.

Wearable Sensors and the Evaluation of Physiological Performance in Elite Field Hockey Players

Sports performance tracking has gained a lot of interest and widespread use in recent years, especially in elite and sub-elite sports. This makes it possible to improve the effectiveness of training, to calibrate and balance workloads according to real energy expenditure, and to reduce the likelihood of injuries due to excessive physical stress. In this context, the aim of this review was to map the scientific literature on wearable devices used in field hockey, evaluating their characteristics and the available evidence on their validity in measuring physiological and movement parameters. A systematic investigation was carried out by employing five electronic databases and search terms that incorporated field hockey, wearables, and performance analysis. Two independent reviewers conducted assessments of the 3401 titles and abstracts for inclusion, and at the end of the screening process, 102 full texts were analyzed. Lastly, a total of 23 research articles that specifically concentrated on field hockey were incorporated. The selected papers dealt with performance monitoring (6 papers), technical analysis and strategy game (6), injury prevention (1), and physiological measurements (10). To appraise the quality of the evaluations, the Oxford quality scoring system scale was employed. The extraction of information was carried out through the utilization of the participants, intervention, comparison, and outcomes (PICOS) format. The analysis encompassed research studies that implemented wearable devices during training and competitive events. Among elite field hockey competitions, GPS units were identified as the predominant wearable, followed by heart rate monitors. The intraclass correlation coefficient (ICC) related to wearable devices showed reasonably high between-trial ICCs ranging from 0.77 to 0.99. The utilization of wearable devices in field hockey primarily centers around the measurement of player activity profiles and physiological demands. The presence of discrepancies in sampling rates and performance bands makes it arduous to draw comparisons between studies. Nevertheless, this analysis attested to the fact that wearable devices are being employed for diverse applications in the realm of field hockey.

Reliability of phase-specific outcome measurements in change-of-direction tests using a motorized resistance device

This study aims to determine test-retest reliability of phase-specific information during initial acceleration, deceleration, and re-acceleration phases of different change-of-direction (CoD) tests using a motorized resistance device (MRD). A total of 21 participants (16 males and five females, with mean age of 22.3 ± 3.9 years, body mass of 75.2 ± 6.9 kg, height of 177.9 ± 6.8 cm) completed the modified 505 (m505), 10-0-5, and 15-0-5 CoD tests on four different test sessions while exposed to an external load (3 kg) provided by the MRD. Outcome variables included overall and phase-specific kinetic (force, power, and impulse) and kinematic (time, distance, velocity, and acceleration/deceleration) data during the initial acceleration, deceleration, and re-acceleration phases. The deceleration and re-acceleration phases were further divided into two subphases, namely, early and late subphases, using 50% of maximum velocity. Reliability was assessed using an intraclass correlation coefficient (ICC), coefficient of variation (CV), typical error (TE), and minimal detectable change (MDC). Good to excellent ICC values (>0.75) and acceptable (<10%) to good (<5%) CV values were observed for most outcome measurements. Specifically, 80.1% (822 out of 1,026) of all variables showed good or better relative reliability (i.e., ICC ≥ 0.75), while 97.0% (995 out of 1,026) of all variables showed acceptable or better absolute reliability (i.e., CV < 10%). In conclusion, the present study demonstrates that the MRD can obtain reliable phase-specific outcome measurements across different CoD tests, providing coaches and researchers with new opportunities to advance our understanding of CoD ability and inform more advanced CoD training prescriptions.

The science and art of testing in ice hockey: a systematic review of twenty years of research

Introduction

Ice hockey is a complex sport requiring multiple athletic and technical attributes. Considering the variety of tests developed, on-ice testing protocols have been created to measure the physiological and mechanical attributes associated with performance. To our knowledge, a lack of technical resources exists to help stakeholders opt for on-ice protocols from among those developed. It becomes crucial for researchers and practitioners to select relevant and context-specific procedures. This systematic review of the literature outlines an inventory of the on-ice tests that have been used in the domain of ice hockey research over the last twenty years, and summarize protocols mostly used in major athletic components.

Methods

A search was performed on three databases (PubMed, SPORTDiscus and Scopus) by following the PRISMA guidelines. Specific keywords were selected to find publications using on-ice testing protocols in the methodology. Four aspects of athletic attributes were used to categorize the protocols: aerobic capacity, acceleration-speed, agility-change of direction and ability to repeat skating sprints. Analyses were conducted regarding four categories of observations: population under study, on-ice reported test(s), outcomes measures and main findings.

Results

A total of 107 articles were included, resulting in 55 on-ice tests related to the on-ice assessments of four major athletic components: aerobic capacity (n = 7), acceleration-speed (n = 6), agility and change of direction (n = 23) and repeated skating sprint ability (n = 19). Testing in male and older cohorts (≥16 years old) predominates, with a primary focus on the competitive amateur level. The selected tests were mainly designed for assessing on-ice physiological responses and fitness (n = 38), talent identification-team selection (n = 19), efficiency of interventions (n = 17) and validation purposes (n = 16).

Conclusion

A prevalence of on-ice skating tests to assess the ability to repeat intense efforts, agility, acceleration and speed components exists, which are relevant and linked to match requirement. The wealth of on-ice tests used in the literature reflects the need to adapt the on-ice evaluation process to the population, constraints, and goals. This review is a valid toolbox and can benefit for researchers and practitioners interested in testing hockey players from different levels, with a variety of aims and needs, by helping them to select the relevant procedures to their environment and practice context.

Methods to assess validity of positioning systems in team sports: can we do better?

Objectives

There is previously reported a large variety of criterion measures and reference systems applied to validate position tracking systems in sports. This study aims to investigate the effect of different criterion measures and reference systems on the outcome of accuracy assessments of tracking systems in sports.

Methods

Data from a commercially available standalone global navigation satellite system (GNSS) were compared with two different reference systems: a high-end differential GNSS and a tape measure. Differences in accuracy outcomes of position (static and dynamic), distance and speed (mean and instantaneous) were investigated in team sport imitation courses.

Results

The mean horizontal position error was larger when athletes were in motion (dynamic position; 1.53±0.82 m) compared with static measurements (1.10±0.60 m). Measured distances of the courses were markedly different (+6% to -17%) between the two reference systems, causing differences in error. Differences in error were also found between mean speed and instantaneous speed (0.10 vs 0.28 m). Errors in mean speed were highly affected by the time over which speed was averaged.

Conclusion

Choice of criterion measure and reference system has a substantial impact on the accuracy assessments of tracking systems. Specifically, assessing static position is not a substitute for dynamic position, and mean speed is not a substitute for instantaneous speed. Therefore, the outcomes of validation studies should always be interpreted in light of the reference methods that were used.

Accuracy of a local positioning system for time-series speed and acceleration and performance indicators in game sports

The objective was to determine the reliability and validity of a local positioning system (LPS) promising high accuracy at reduced product costs. Fifty-five random static positions in a gym (54.8  × 26.0 m) were obtained 10 times via LPS (50 Hz) and measuring tape. An athlete's LPS-derived peak and time-series speed and acceleration during dynamic movements (n = 80) were compared with Vicon (100 Hz). Reliability and validity were assessed via Intraclass and Concordance Correlation Coefficients (ICC/CCC), root mean square errors, Bland-Altman plots, and analysis of variance. ICC3,1 (≥0.999) and CCC (0.387-0.999) were calculated for static positions (errors <0.22 m). CCC for time-series speed and acceleration, and peak speed, acceleration, and deceleration were 0.884-0.902, 0.777-0.854, 0.923, 0.486, and 0.731, respectively. Errors were larger in time-series acceleration (14.37 ± 3.77%) than in speed (11.99 ± 5.78%) (η p 2  = 0.472, p < 0.001) and in peak acceleration (28.04 ± 14.34%) and deceleration (25.07 ± 14.90%) than in speed (7.34 ± 6.07%) (η p 2  = 0.091, p < 0.01). LPS achieved excellent reliability and moderate-to-excellent validity of time-series speed and acceleration. The system accurately measured peak speed but not peak acceleration and deceleration. The system is suitable for analyses based on instantaneous speed and acceleration in game sports (e.g., energy estimations).

Drone-Based Position Detection in Sports-Validation and Applications

Radio and video-based electronic performance and tracking systems (EPTS) for position detection are widely used in a variety of sports. In this paper, the authors introduce an innovative approach to video-based tracking that uses a single camera attached to a drone to capture an area of interest from a bird’s eye view. This pilot validation study showcases several applications of this novel approach for the analysis of game and racket sports. To this end, the authors compared positional data retrieved from video footage recorded using a drone with positional data obtained from established radio-based systems in three different setups: a tennis match during training with the drone hovering at a height of 27 m, a small-sided soccer game with the drone at a height of 50 m, and an Ultimate Frisbee match with the drone at a height of 85 m. For each type of playing surface, clay (tennis) and grass (soccer and Ultimate), the drone-based system demonstrated acceptable static accuracy with root mean square errors of 0.02 m (clay) and 0.15 m (grass). The total distance measured using the drone-based system showed an absolute difference of 2.78% in Ultimate and 2.36% in soccer, when compared to an established GPS system and an absolute difference of 2.68% in tennis, when compared to a state-of-the-art LPS. The overall ICC value for consistency was 0.998. Further applications of a drone-based EPTS and the collected positional data in the context of performance analysis are discussed. Based on the findings of this pilot validation study, we conclude that drone-based position detection could serve as a promising alternative to existing EPTS but would benefit from further comparisons in dynamic settings and across different sports.

Validity of Velocity Measurements of a Motorized Resistance Device During Change of Direction

The aim of this study was to determine validity of velocity measurements of a motorized resistance device (MRD) during change of direction (CoD). Eight male (age: 22.1 ± 4.2 yrs; weight: 83.3 ± 17.1 kg; height: 181.6 ± 12.6 cm) and three female participants (age: 21.7 ± 1.5 yrs; mass: 69.7 ± 2.4 kg; height: 167.0 ± 3.6 cm) completed the modified 505 CoD test (m505) with turning off the left and right foot while exposed to external loads (3, 6, and 9 kg) provided by the MRD. Three-dimensional kinematic data were measured (200 Hz) for all tests using a full-body marker set with an additional marker placed on the pulley used to attach the carabiner (CAR) at the end of the line from the MRD to the participant. Average velocity of overall center of mass (COM_vel), pelvis (COM_{pelvis_vel}), and pulley (CAR_vel) was then calculated and compared to the velocity measured by MRD (MRD_vel) in 0.5 s intervals 1.5 s before and after CoD. Average velocities from these intervals were then compared using correlational, Bland–Altman analysis, coefficient of variation (CV), and statistical parametric mapping (SPM). Mostly, excellent correlations were observed and ranged from 0.93 to 1.00, 0.53 to 1.00 and 0.93 to 1.00 for the 3, 6, and 9 kg load conditions, respectively. CV values ranged from 0.3 to 3.2%, 0.8 to 4.3%, and 1.5 to 7.7% for the CAR_vel, COM_{pelvis_vel}, and COM_vel comparisons, respectively. The biases for CAR_vel comparisons ranged from −0.027 to 0.05 m/s, −0.246 to 0.128 m/s and −0.486 to 0.082 m/s across all load conditions and time intervals for the CAR_vel, COM_{pelvis_vel}, and COM_vel comparisons, respectively. SPM analysis indicated significant differences between MRD_vel and COM_vel and COM_{pelvis_vel} over short time periods during the CoD, but no difference between MRD_vel and CAR_vel. The velocity measurements obtained by a MRD during a m505 test are valid as low biases, low CV’s, and high correlations are observed for the MRD_vel to CAR_vel comparison. As single points of measurement (i.e., laser) has been proven useful to assess other athletic tasks (i.e., sprint running), the single point CAR_vel comparison is an appropriate comparison for validating MRD_vel measurements during the m505 test.

Validation of Player and Ball Tracking with a Local Positioning System

The aim of this study was the validation of player and ball position measurements of Kinexon's local positioning system (LPS) in handball and football. Eight athletes conducted a sport-specific course (SSC) and small sided football games (SSG), simultaneously tracked by the LPS and an infrared camera-based motion capture system as reference system. Furthermore, football shots and handball throws were performed to evaluate ball tracking. The position root mean square error (RMSE) for player tracking was 9 cm for SSCs, the instantaneous peak speed showed a percentage deviation from the reference system of 0.7-1.7% for different exercises. The RMSE for SSGs was 8 cm. Covered distance was overestimated by 0.6% in SSCs and 1.0% in SSGs. The 2D RMSE of ball tracking was 15 cm in SSGs, 3D position errors of shot and throw impact locations were 17 cm and 21 cm. The methodology for the validation of a system's accuracy in sports tracking requires extensive attention, especially in settings covering both, player and ball measurements. Most tracking errors for player tracking were smaller or in line with errors found for comparable systems in the literature. Ball tracking showed a larger error than player tracking. Here, the influence of the positioning of the sensor must be further reviewed. In total, the accuracy of Kinexon's LPS has proven to represent the current state of the art for player and ball position detection in team sports.