Examining the validity, reliability and feasibility of capturing children's physical literacy through games-based assessment in physical education

Background

Observational tools can help refine practice design and guide the creation of effective learning environments. The intention of this study was to design and validate an observational instrument for assessing physical literacy that remains more faithful to the philosophically complex and holistic nature of the concept.

Methods

Framed by concepts of ecological dynamics, the emergent games-based assessment tool enables capture of children's interactions with their environment, providing insight on the manifestation of physical literacy within physical education games. The design and validation of the instrument consisted of a multistage process: (1) design of the observational instrument and establishing face validity; (2) pilot observation study; (3) expert qualitative and quantitative review to establish content validity; (4) observation training; and (5), establishing observer reliability.

Results

Following expert qualitative and quantitative evaluation, Aiken's V coefficient was used to determine content validity. Results achieved demanding levels of validity (V ≥ 0.78) for all retained measurement variables. Cohen's κ values for inter- and intra-observer reliability ranged from 0.331 to 1.00 and 0.552 to 1.00, generally reporting "substantial" agreement during inter-observer analysis and "substantial" to "almost perfect" agreement during intra-observer analysis.

Conclusions

The final model of the emergent games-based assessment tool, with 9 ecological conceptualisations of behaviour, 15 measurement variables, and 44 categorical observational items was found to be valid and reliable, providing both educators and researchers with a useful mechanism to assess physical literacy during gameplay.

Analysis of the Actions of Net Zone Approach in Padel: Validation of the NAPOA Instrument

To carry out research that analyzes performance indicators through observational methodology, it is necessary to have validated tools. The purpose of this study was to design and validate a tool to ascertain the characteristics of the strokes that padel pairs use to reach the net and their consequences in the two subsequent shots of the game. Eleven experts, who had to meet four of the five inclusion criteria established by the researchers, participated in the process. Aiken’s V coefficient and confidence intervals were used to analyze content validity and Cronbach’s α coefficient to calculate reliability. The adequacy and wording of the sixteen variables initially designed were evaluated. Four variables were eliminated due to obtaining values <0.90 in Aiken’s V coefficient in adequacy. The rest of the variables were modified in their wording, according to the qualitative evaluations of the experts, or were considered correct. The reliability of the instrument was acceptable (α = 0.89). The NAPOA instrument is novel, as it is of interest to analyze the characteristics of the strokes that padel players use to achieve the offensive position.

Data Mining to Select Relevant Variables Influencing External and Internal Workload of Elite Blind 5-a-Side Soccer

(1) Background: Data mining has turned essential when exploring a large amount of information in performance analysis in sports. This study aimed to select the most relevant variables influencing the external and internal load in top-elite 5-a-side soccer (Sa5) using a data mining model considering some contextual indicators as match result, body mass index (BMI), scoring rate and age. (2) Methods: A total of 50 top-elite visually impaired soccer players (age 30.86 ± 11.2 years, weight 77.64 ± 9.78 kg, height 178.48 ± 7.9 cm) were monitored using magnetic, angular and rate gyroscope (MARG) sensors during an international Sa5 congested fixture tournament.; (3) Results: Fifteen external and internal load variables were extracted from a total of 49 time-related and peak variables derived from the MARG sensors using a principal component analysis as the most used data mining technique. The principal component analysis (PCA) model explained 80% of total variance using seven principal components. In contrast, the first principal component of the match was defined by jumps, take off by 24.8% of the total variance. Blind players usually performed a higher number of accelerations per min when losing a match. Scoring players execute higher DistanceExplosive and Distance21-24 km/h. And the younger players presented higher HRAVG and AccMax. (4) Conclusions: The influence of some contextual variables on external and internal load during top elite Sa5 official matches should be addressed by coaches, athletes, and medical staff. The PCA seems to be a useful statistical technique to select those relevant variables representing the team's external and internal load. Besides, as a data reduction method, PCA allows administrating individualized training loads considering those relevant variables defining team load behavior.

Design, Validation, and Reliability of an Observational Instrument for Technical and Tactical Actions in Singles Badminton

Technical and tactical actions are decisive in terms of badminton player competitive performance. The main objective of this research was to design, validate, and estimate the reliability of an observational instrument for the analysis of the tactical and technical actions in individual badminton. The process was carried out in four different steps: first, there was a review of the scientific literature and a preliminary list of variables was made; second, a qualitative and quantitative assessment was completed by 10 badminton expert judges; in the third step, the content validity was estimated using Aiken’s V coefficient; finally, intra-observer reliability and interobserver reliability were tested by two observers specialized in badminton using the Cohen’s Kappa coefficient and the intraclass correlation coefficient. Strokes were used as the unit of measure by our observational instrument; every time badminton players hit the shuttlecock, 22 variables (eight contextual variables, seven variables related to the result of the match, and seven variables related to the game) are observed. The minimum Aiken’s value was 0.58, and reliability was 0.63. In spite of these values, none of the variables had to be removed, but there were modifications in terms of drafting in some of them. The main findings confirmed the validity and the usefulness of this instrument.

Design and Validation of the Instrument for the Measurement of Learning and Performance in Football

The assessment of tactical-technical knowledge of football is essential to develop optimal and integral teaching processes for students. Therefore, the aim of this study was to design and validate an instrument so that teachers, coaches, and researchers can observe and codify both the tactical behaviors and technical skills performed by the students in the game of football. The design and validation of the instrument were carried out in four phases: a) review of the literature and previous instruments; b) design of the Instrument for the Measurement of Learning and Performance in Football (IMLPFoot). It assesses all the offensive and defensive play actions, with and without the ball, as well as their three components (decision-making, technical execution, and final result); c) sample selection of experts (N = 12); and d) quantitative (Likert-type scale from 1 to 10) and qualitative assessment of degree the pertinence, unambiguity, and importance of each of the 33 items included in the IMLPFoot. Aiken’s V coefficient was used to determine content validity. Likewise, internal consistency was calculated using Cronbach’s α coefficient. The results showed demanding levels of validity (V ≥ 0.77), internal consistency (α = 0.983), inter-rater, and intra-rater reliability. Therefore, it is a valid and reliable instrument that makes possible a complete assessment of football in physical education classes and/or in the sports context (out-of-school football).

I. VALIDACIÓN DE DOS PROGRAMAS DE INTERVENCIÓN PARA LA ENSEÑANZA DEL FÚTBOL ESCOLAR

El propósito del estudio fue validar dos programas de intervención, correspondientes a dos unidades didácticas realizadas cada una en base a dos metodologías diferentes: Direct Instruction (ID) y Tactical Games Approach (TGA), para la enseñanza del fútbol escolar. Se diseñaron dos programas de intervención semejantes con el mismo número de tareas, sesiones, fases de juego, contenidos y objetivos. En el proceso de validación participaron 13 jueces expertos. La validez de contenido se calculó mediante el coeficiente de V de Aiken y sus intervalos de confianza. Para la consistencia interna se empleó el coeficiente de ? de Cronbach. Ninguna de las tareas que componen los programas de intervención fue eliminada al superar el valor crítico exacto (V ? .69). La consistencia interna de las tareas fue excelente (? = .97). Por tanto, ambos programas de intervención son válidos y fiables para la enseñanza del fútbol escolar, así como para comparar los efectos de ambas metodologías.

Systematic Observation of the Verbal Behavior of Families of Youth Athletes in Grassroots and Team Sports

Some of the more protective and favorable factors for the development and health in children and teenagers are family and sport, so family involvement in the children’s sports activities is vital in their sports process. The purpose of this study was to analyze the verbal behavior (positive, negative, and neutral comments) of family spectators of school-age athletes regarding sociodemographic and sporting variables. The sample consisted of 190 family spectators of 215 male and female (M_age = 11.66; SD = 1.60) football, basketball, and volleyball players. The Parents’ Observation Instrument at Sport Events (POISE) was used for the observation and LINCE was used to codify the verbal comments made. After registering 38,829 comments, the results showed statistically significant differences in relation to the comments made and the gender of athletes, geographical area, kind of sport, and the sporting category. The findings highlight that in a competitive environment, the comments made by spectators related to athletes do not seem to be initiators of potentially violent situations but rather are dependent on the atmosphere in question. Further research is required in this area to foster positive conduct relating to grassroots sports.

Design and Validation of an Observational Instrument for the Technical-Tactical Actions in Singles Tennis

The competitive performance in tennis practice is determined by the effectiveness of technical tactical action. The main objective of the present study was to design and validate an observational instrument with the aim of analysing the technical-tactical in singles tennis. The instrument uses the stroke as a unit of measure, so that each time a player hits a ball, a total of 23 variables are analyzed. The variables collect information about: (a) matching context; (b) result; and (c) technical-tactical information of the stroke (five variables: sequences of the stroke of the point, kind of technical and tactical stroke, bounce area, hitting, and effectiveness area). The design and validation of the instrument consisted on five different stages: (a) review of the scientific literature and variables definition by experts, (b) pilot observation study, (c) qualitative and quantitative assessment of the instrument by experts, (d) review and confirmation of the instrument by experts (content validity), and (e) observation training and reliability evaluation. From 23 expert judges, divided into three panels, and four observers the instrument went from being composed of 38 variables (eight contextual, seven related to the result and 23 related to the game) to 23 (eight contextual variables, 10 of result and five of game), with minimum Aikens's V values of 0.94 and reliability of 0.81. The results show that the designed instrument allows obtaining valid and objective information about the technical-tactical actions of the players and their performance in singles tennis.