Expert performance in sport and the dynamics of talent development

Tests examining skill outcomes in sport: a systematic review of measurement properties and feasibility

BACKGROUND

A high level of participant skill is influential in determining the outcome of many sports. Thus, tests assessing skill outcomes in sport are commonly used by coaches and researchers to estimate an athlete's ability level, to evaluate the effectiveness of interventions or for the purpose of talent identification.

OBJECTIVE

The objective of this systematic review was to examine the methodological quality, measurement properties and feasibility characteristics of sporting skill outcome tests reported in the peer-reviewed literature.

DATA SOURCES

A search of both SPORTDiscus and MEDLINE databases was undertaken.

STUDY SELECTION

Studies that examined tests of sporting skill outcomes were reviewed. Only studies that investigated measurement properties of the test (reliability or validity) were included. A total of 22 studies met the inclusion/exclusion criteria.

STUDY APPRAISAL AND SYNTHESIS METHODS

A customised checklist of assessment criteria, based on previous research, was utilised for the purpose of this review.

RESULTS

A range of sports were the subject of the 22 studies included in this review, with considerations relating to methodological quality being generally well addressed by authors. A range of methods and statistical procedures were used by researchers to determine the measurement properties of their skill outcome tests. The majority (95%) of the reviewed studies investigated test-retest reliability, and where relevant, inter and intra-rater reliability was also determined. Content validity was examined in 68% of the studies, with most tests investigating multiple skill domains relevant to the sport. Only 18% of studies assessed all three reviewed forms of validity (content, construct and criterion), with just 14% investigating the predictive validity of the test. Test responsiveness was reported in only 9% of studies, whilst feasibility received varying levels of attention.

LIMITATIONS

In organised sport, further tests may exist which have not been investigated in this review. This could be due to such tests firstly not being published in the peer-review literature and secondly, not having their measurement properties (i.e., reliability or validity) examined formally.

CONCLUSIONS

Of the 22 studies included in this review, items relating to test methodological quality were, on the whole, well addressed. Test-retest reliability was determined in all but one of the reviewed studies, whilst most studies investigated at least two aspects of validity (i.e., content, construct or criterion-related validity). Few studies examined predictive validity or responsiveness. While feasibility was addressed in over half of the studies, practicality and test limitations were rarely addressed. Consideration of study quality, measurement properties and feasibility components assessed in this review can assist future researchers when developing or modifying tests of sporting skill outcomes.

The advent of canine performance science: offering a sustainable future for working dogs

Working and sporting dogs provide an essential contribution to many industries worldwide. The common development, maintenance and disposal of working and sporting dogs can be considered in the same way as other animal production systems. The process of 'production' involves genetic selection, puppy rearing, recruitment and assessment, training, housing and handling, handler education, health and working life end-point management. At present, inefficiencies throughout the production process result in a high failure rate of dogs attaining operational status. This level of wastage would be condemned in other animal production industries for economic reasons and has significant implications for dog welfare, as well as public perceptions of dog-based industries. Standards of acceptable animal use are changing and some historically common uses of animals are no longer publicly acceptable, especially where harm is caused for purposes deemed trivial, or where alternatives exist. Public scrutiny of animal use appears likely to increase and extend to all roles of animals, including working and sporting dogs. Production system processes therefore need to be transparent, traceable and ethically acceptable for animal use to be sustainable into the future. Evidence-based approaches already inform best practice in fields as diverse as agriculture and human athletic performance. This article introduces the nascent discipline of canine performance science, which aims to facilitate optimal product quality and production efficiency, while also assuring evidence-based increments in dog welfare through a process of research and development. Our thesis is that the model of canine performance science offers an objective, transparent and traceable opportunity for industry development in line with community expectations and underpins a sustainable future for working dogs. This article is part of a Special Issue entitled: Canine Behavior.

Longitudinal intra- and inter-individual variability in young swimmers' performance and determinant competition factors

The main purpose of this study was to follow-up the intra- and inter-individual variability of young swimmers' performance and determinant factors over two competitive seasons. Thirty young swimmers (14 boys: 12.33±0.65 years-old; 16 girls: 11.15±0.55 years-old) were followed-up throughout two consecutive seasons (seven evaluation moments). Performance (100m freestyle), anthropometric, kinematic, hydrodynamic and efficiency features were evaluated. A gender and skill-level effect was observed. Boys improved in a higher amount (%) comparing to girls. Overall, swimmers in skill-level 2 (both genders) presented a higher intra-individual variability. Performance and anthropometrics showed a significant inter-individual variability in most moments, but hydrodynamics, kinematics and efficiency did not. Within each skill-level hydrodynamics, kinematics and efficiency were the variables that showed a high inter-individual variability. As a gender and skill-level effect was noticed in an age-group of young swimmers, coaches and practitioners should put the focus in specific and customized training plans for each skill-level of swimmers.

Growth influences biomechanical profile of talented swimmers during the summer break

This study aimed to analyse the effect of growth during a summer break on biomechanical profile of talented swimmers. Twenty-five young swimmers (12 boys and 13 girls) undertook several anthropometric and biomechanical tests at the end of the 2011-2012 season (pre-test) and 10 weeks later at the beginning of the 2012-2013 season (post-test). Height, arm span, hand surface area, and foot surface area were collected as anthropometric parameters, while stroke frequency, stroke length, stroke index, propelling efficiency, active drag, and active drag coefficient were considered as biomechanical variables. The mean swimming velocity during an all-out 25 m front crawl effort was used as the performance outcome. After the 10-week break, the swimmers were taller with an increased arm span, hand, and foot areas. Increases in stroke length, stroke index, propelling efficiency, and performance were also observed. Conversely, the stroke frequency, active drag, and drag coefficient remained unchanged. When controlling the effect of growth, no significant variation was determined on the biomechanical variables. The performance presented high associations with biomechanical and anthropometric parameters at pre-test and post-test, respectively. The results show that young talented swimmers still present biomechanical improvements after a 10-week break, which are mainly explained by their normal growth.

Change of plans: an evaluation of the effectiveness and underlying mechanisms of successful talent transfer

Talent transfer (TT) is a recently formalised process used to identify and develop talented athletes by selecting individuals who have already succeeded in one sport and transferring them to another. Despite the increasing popularity of TT amongst national organisations and sport governing body professionals, however, there is little empirical evidence as to its efficacy or how it may be most efficiently employed. Accordingly, this investigation was designed to gain a deeper understanding of the effectiveness and underlying mechanisms of TT, achieved through a two-part study. Stage 1 provided a quantitative analysis of the incidence and distribution or, in this respect, epidemiology of TT, finding the most popular transfer to be sprinting to bobsleigh, with an average transfer age of 19 years. Stage 2 scrutinised the TT process and explored the specific cases revealed in stage 1 by examining the perceptions of four sport science support specialists who had worked in TT settings, finding several emergent themes which, they felt, could explain the TT processes. The most prominent theme was the psychosocial mechanism of TT, an aspect currently missing from TT initiatives, suggesting that current TT systems are poorly structured and should redress their approach to develop a more integrated scheme that encompasses all potential mechanisms of transfer.

Young Swimmers’ Classification Based on Kinematics, Hydrodynamics, and Anthropometrics

The aim of this article has been to classify swimmers based on kinematics, hydrodynamics, and anthropometrics. Sixty-seven young swimmers made a maximal 25 m front-crawl to measure with a speedometer the swimming velocity (v), speed-fluctuation (dv) anddvnormalized tov(dv/v). Another two 25 m bouts with and without carrying a perturbation device were made to estimate active drag coefficient (CDa). Trunk transverse surface area (S) was measured with photogrammetric technique on land and in the hydrodynamic position. Cluster 1 was related to swimmers with a high speed fluctuation (ie,dvanddv/v), cluster 2 with anthropometrics (ie,S) and cluster 3 with a high hydrodynamic profile (ie,CDa). The variable that seems to discriminate better the clusters was thedv/v(F= 53.680;P< .001), followed by thedv(F= 28.506;P< .001),CDa(F= 21.025;P< .001),S(F= 6.297;P< .01) andv(F= 5.375;P= .01). Stepwise discriminant analysis extracted 2 functions: Function 1 was mainly defined bydv/vandS(74.3% of variance), whereas function 2 was mainly defined byCDa(25.7% of variance). It can be concluded that kinematics, hydrodynamics and anthropometrics are determinant domains in which to classify and characterize young swimmers’ profiles.

Technical, perceptual and motor skills in novice-expert water polo players: an individual discriminant analysis for talent development

The 4 tasks (A, B, C, and Y) have the characteristic of containing one more element than the task performed before it. In fact, task B introduces the slalom which is not present in task A. Task C introduces the ball control that are not present in tasks A and B, whereas task Y introduces the slalom and ball control in a visual dual task situation developed in horizontal swimming over a distance of 20 m at maximum speed. This exercise not included in task C. These tasks were performed by a group of pre-adolescent players and national under 18 water polo players. The novice players showed that tasks B and C are predictors of task Y. Such characteristics were not present in the expert players. The novice players also had difficulty in performing task Y because of the visual-attention overload, a difficulty that was not present in the expert players. To improve the 4 skills, the coach of the novice players developed a technical-didactic program, which was checked 6 months after the pretest. The posttest was not significantly different from the pretest while the individual discriminant analysis identified the improvements in some novice players, which on elaboration proved significant, enabling us to distinguish 2 subgroups, one with higher learning rates and the other with lower learning rates. In the practical applications, we describe the didactic tools (task analysis) and the different levels of development of technical skills in water polo. Improvements in these skills are explained through computational models like the HMOSAIC (Hierarchical, Modular, Selection and Identification for Control) while the individual discriminant analysis enables us to do a longitudinal analysis that is not possible with cross-sectional models.

Effective learning among elite football players: the development of a football-specific self-regulated learning questionnaire

The present study aimed to develop a football-specific self-report instrument measuring self-regulated learning in the context of daily practice, which can be used to monitor the extent to which players take responsibility for their own learning. Development of the instrument involved six steps: 1. Literature review based on Zimmerman's (2006) theory of self-regulated learning, 2. Item generation, 3. Item validation, 4. Pilot studies, 5. Exploratory factor analysis (EFA), and 6. Confirmatory factor analysis (CFA). The instrument was tested for reliability and validity among 204 elite youth football players aged 13-16 years (Mage = 14.6; s = 0.60; 123 boys, 81 girls). The EFA indicated that a five-factor model fitted the observed data best (reflection, evaluation, planning, speaking up, and coaching). However, the CFA showed that a three-factor structure including 22 items produced a satisfactory model fit (reflection, evaluation, and planning; non-normed fit index [NNFI] = 0.96, comparative fit index [CFI] = 0.95, root mean square error of approximation [RMSEA] = 0.067). While the self-regulation processes of reflection, evaluation, and planning are strongly related and fit well into one model, other self-regulated learning processes seem to be more individually determined. In conclusion, the questionnaire developed in this study is considered a reliable and valid instrument to measure self-regulated learning among elite football players.

Acquisition of expertise in cricket fast bowling: perceptions of expert players and coaches

OBJECTIVES

Experiential knowledge of elite athletes and coaches was investigated to reveal insights on expertise acquisition in cricket fast bowling.

DESIGN

Twenty-one past or present elite cricket fast bowlers and coaches of national or international level were interviewed using an in-depth, open-ended, semi-structured approach.

METHODS

Participants were asked about specific factors which they believed were markers of fast bowling expertise potential. Of specific interest was the relative importance of each potential component of fast bowling expertise and how components interacted or developed over time.

RESULTS

The importance of intrinsic motivation early in development was highlighted, along with physical, psychological and technical attributes. Results supported a multiplicative and interactive complex systems model of talent development in fast bowling, in which component weightings were varied due to individual differences in potential experts. Dropout rates in potential experts were attributed to misconceived current talent identification programmes and coaching practices, early maturation and physical attributes, injuries and lack of key psychological attributes and skills.

CONCLUSIONS

Data are consistent with a dynamical systems model of expertise acquisition in fast bowling, with numerous trajectories available for talent development. Further work is needed to relate experiential and theoretical knowledge on expertise in other sports.

Accuracy of pattern detection methods in the performance of golf putting

The authors present a comparison of the classification accuracy of 5 pattern detection methods in the performance of golf putting. The detection of the position of the golf club was performed using a computer vision technique followed by the estimation algorithm Darwinian particle swarm optimization to obtain a kinematical model of each trial. The estimated parameters of the models were subsequently used as sample of five classification algorithms: (a) linear discriminant analysis, (b) quadratic discriminant analysis, (c) naive Bayes with normal distribution, (d) naive Bayes with kernel smoothing density estimate, and (e) least squares support vector machines. Beyond testing the performance of each classification method, it was also possible to identify a putting signature that characterized each golf player. It may be concluded that these methods can be applied to the study of coordination and motor control on the putting performance, allowing for the analysis of the intra- and interpersonal variability of motor behavior in performance contexts.

Movement variability in the golf swing

Traditionally, golf biomechanics has focused upon achieving consistency in swing kinematics and kinetics, whilst variability was considered to be noise and dysfunctional. There has been a growing argument that variability is an intrinsic aspect of skilled motor performance and plays a functional role. Two types of variability are described: 'strategic shot selection' and 'movement variability'. In 'strategic shot selection', the outcome remains consistent, but the swing kinematics/kinetics (resulting in the desired ball flight) are free to vary; 'movement variability' is the changes in swing kinematics and kinetics from trial to trial when the golfer attempts to hit the same shot. These changes will emerge due to constraints of the golfer's body, the environment, and the task. Biomechanical research has focused upon aspects of technique such as elite versus non-elite kinematics, kinetics, kinematic sequencing, peak angular velocities of body segments, wrist function, ground reaction forces, and electromyography, mainly in the search for greater distance and clubhead velocity. To date very little is known about the impact of variability on this complex motor skill, and it has yet to be fully researched to determine where the trade-off between functional and detrimental variability lies when in pursuit of enhanced performance outcomes.

Biomechanics and visual-motor control: how it has, is, and will be used to reveal the secrets of hitting a cricket ball

Cricket batting is an incredibly complex task which requires the coordination of full-body movements to successfully hit a fast moving ball. Biomechanical studies on batting have helped to shed light on how this intricate skill may be performed, yet the many different techniques exhibited by batters make the systematic examination of batting difficult. This review seeks to critically evaluate the existing literature examining cricket batting, but doing so by exploring the strong but often neglected relationship between biomechanics and visual-motor control. In three separate sections, the paper seeks to address (i) the different theories of motor control which may help to explain how skilled batters can hit a ball, (ii) strategies used by batters to overcome the (at times excessive) temporal constraints, and (iii) an interpretation from a visual-motor perspective of the prevailing biomechanical data on batting.

Biological maturation, morphology, fitness, and motor coordination as part of a selection strategy in the search for international youth soccer players (age 15-16 years)

We report the morphology (height, weight, body fat, body mass index), fitness (strength, speed, agility, flexibility), and soccer-specific (dribbling) and non-specific motor coordination skills (Körper KoordinationsTest für Kinder; KTK) of 78 Belgian international youth soccer players aged 15-16 years with varying biological maturity status. The more mature players (U16 and U17) possessed higher morphological measures and outperformed their later maturing peers (U16 Futures and U17 Futures) on almost all fitness tests. However, soccer-specific and non-specific motor coordination tests did not distinguish the more mature players from the later maturing players in both age groups. When adjusted for the confounder (age at peak height velocity), multivariate analysis of covariance revealed that several morphology- and fitness-related parameters did not differ between selection groups, again in both age groups. These findings indicate that biological maturation affects morphology and fitness more so than motor coordination skills. In conclusion, to prevent the dropout of promising late maturing players, we suggest avoiding one-dimensional approaches and to include measures of biological maturity status as well as maturity independent performance tests during the talent identification and selection process.

Performance accuracy and functional variability in elite and developing fast bowlers

OBJECTIVES

The relationship between performance variability and accuracy in cricket fast bowlers of different skill levels under three different task conditions was investigated. Bowlers of different skill levels were examined to observe if they could adapt movement patterns to maintain performance accuracy on a bowling skills test.

DESIGN

8 national, 12 emerging and 12 junior pace bowlers completed an adapted version of the Cricket Australia bowling skills test, in which they performed 30 trials involving short (n=10), good (n=10), and full (n=10) length deliveries.

METHODS

Bowling accuracy was recorded by digitising ball position relative to the centre of a target. Performance measures were mean radial error (accuracy), variable error (consistency), centroid error (bias), bowling score and ball speed. Radial error changes across the duration of the skills test were used to record accuracy adjustment in subsequent deliveries.

RESULTS

Elite fast bowlers performed better in speed, accuracy, and test scores than developing athletes. Bowlers who were less variable were also more accurate across all delivery lengths. National and emerging bowlers were able to adapt subsequent performance trials within the same bowling session for short length deliveries.

CONCLUSIONS

Accuracy and adaptive variability were key components of elite performance in fast bowling which improved with skill level. In this study, only national elite bowlers showed requisite levels of adaptive variability to bowl a range of lengths to different pitch locations.