Systematic Observation: Relevance of This Approach in Preschool Executive Function Assessment and Association with Later Academic Skills

Do Performance-Based Measures and Behavioral Ratings of Executive Functioning Complement Each Other in Predicting Reading and Mathematics in Chinese?

We examined what executive functioning (EF) components predict reading and mathematics within the same study and whether the effects of behavioral ratings of EF overlap or complement those of performance-based measures. One hundred and nine Grade 2 Mandarin-speaking Chinese students from Chengdu, China (55 girls, 54 boys, Mage = 8.15 years), were assessed on measures of EF (planning, inhibition, shifting, and working memory), speed of processing, reading and mathematics. Parents also rated their children's EF skills using the Childhood Executive Functioning Inventory. Results of hierarchical regression analyses showed that only working memory among the performance-based EF measures predicted reading and mathematics. In addition, none of the behavioral ratings of EF made a significant contribution to reading and mathematics after controlling for mother's education and speed of processing. Taken together, these findings suggest that working memory is a domain general predictor of academic achievement, but only when measured with cognitive tasks.

New insights into the behavioral structure of Pikler educators: An application of T-pattern detection and analysis with THEME

Introduction

The recent generalization of early childhood schooling has given rise to a need for the development of rigorous, specific training programs aimed at early education professionals (0-3 years of age). This work emanates from the unique nature of Pikler-Lóczy education as a reference for early childhood education centers, and its expertise in providing quality care in an everyday classroom situation. The aim of the study is to use T-pattern detection and analysis, within the framework of observational methodology, to identify relevant aspects of the choreography followed by Pikler educators during breakfast, and thus provide substantial material with a view to creating a training plan.

Methods

Two expert educators in Pikler-Lóczy education were directly and systematically observed in their own classrooms, following a nomothetic, follow-up and multidimensional design. The observation instrument underwent a molarization process so that the detected elements would be more significant and understandable for novice educators.

Results

Using THEME, the invariant aspects of the educators' behavior were analyzed. The significance level for the critical interval was the THEME default (α = 0.005). The results show: on the one hand, changes expected in T-patterns in accordance with the observation instrument molarity; and on the other hand, stability in terms of the comparison between the two educators.

Discussion

These results help us to identify the complex structure of the breakfast choreography, and how educators establish interaction with children. In addition to specific issues pertaining to Pikler-Lóczy education, the conclusions highlight the advantages of using T-pattern analysis within the framework of observational methodology, in order to dissect a mealtime routine in its natural context, and explain components of early childhood education intervention that satisfy basic childhood needs. This constitutes a starting point from which to generate instructive material for the training of professionals working in early education.

Teacher-Rated Executive Functions, Gender and Relative Age: Independent and Interactive Effects on Observed Fundamental Motor Skills in Kindergarteners

Fundamental motor skills (FMS) of children can be affected by different variables, such as executive functions (EF), gender and relative age. However, the effects of these variables on FMS have been scarce studied, especially in early childhood, and show inconsistent results. To clarify these relationships, this study was carried out. Its aim was to analyze whether EF, gender and relative age influenced FMS in 43 Spanish kindergarteners. A multimethod and mixed methods approach was used. Kindergarteners' teachers completed the Childhood Executive Functioning Inventory to know the children level of EF (working memory and inhibition control). Kindergarteners' parents complimented ad hoc questionnaire reporting the children gender and birth data (to know their relative age). A Nomothetic/Punctual/Multidimensional observational design was used to observe children FMS in their habitual motor sessions at school. Two-way ANOVAs were performed to know the independent and interactive effects of working memory level (lower/higher), inhibition control level (lower/higher), gender (boys/girls) and relative age (according to the birth semester in the year) on FMS. Results showed these variables have independent and interactive effects on some FMS, but not on others. FMS influenced by these variables vary depending what independent variable(s) is/are considered. Therefore, it can be concluded that the influences of teacher-rated EF, gender and relative age on observed FMS in kindergarteners are complex and specific. Results obtained must be taken into to design and implement instructional and intervention strategies, as well as educational and sport policy changes, especially in early childhood, when FMS are more malleable.

Assessment of Preschool-age Executive Functions: A Systematic Review

Executive functions (EF) are higher-order cognitive processes present in the prefrontal cortex, and are fundamental in planning, executing, and monitoring goal-oriented behaviors. Evaluating EF in early stages of child development is essential for identifying any cognitive alterations in young children, given that it allows for early intervention and minimizes future complications. Additionally, it contributes to a better understanding of this construct in this age bracket, as well as its operational model. Study of EF has recently been the focus of multiple researcher; however, there is still a serious lack of instruments and measurements validated towards children's age bracket. This systematic review's main goal is to evaluate instruments and/or tasks that serve to evaluate and analyze EF and/or their components between the ages of 36 and 72 months. Forty-nine studies were analyzed, containing multiple tasks and tools oriented towards EF and their constituent components. Results indicate the existence of various tasks that grade the different components independently from one another; nevertheless, they also confirm the lack of any global measurement instrument or method. Therefore, this systematic review presents itself as an important contribution in the study of EF, not only stressing the importance of further investing into constructing and validating new and better tools for evaluating the construct, but also the study of operating models of executive functioning, especially in an age bracket where comprehending it is notoriously difficult.

Early Environmental and Biological Influences on Preschool Motor Skills: Implications for Early Childhood Care and Education

Early motor skills underpin the more complex and specialized movements required for physical activity. Therefore, the design of interventions that enhance higher levels of early motor skills may encourage subsequent participation in physical activity. To do so, it is necessary to determine the influence of certain factors (some of which appear very early) on early motor skills. The objective of this study was to examine the influence of some very early environmental variables (delivery mode, feeding type during the first 4 months of life) and some biological variables (sex and age in months) on preschool motor skills, considered both globally and specifically. The sample was composed by 43 preschool students aged 5-6 years. The participant's parents completed an ad hoc questionnaire, reporting on delivery mode, feeding type, sex, and age in months. The children's motor skills were assessed using observational methodology in the school setting, while the children participated in their regular motor skills sessions. A Nomothetic/Punctual/Multidimensional observational design was used. Results revealed that certain preschool motor skills were specifically influenced by delivery mode, feeding type, sex, and age. Children born by vaginal delivery showed higher scores than children born via C-section in throwing (p = 0.000; d = 0.63); total control of objects (p = 0.004; d = 0.97); total gross motor skills (p = 0.005; d = 0.95); and total motor skills (p = 0.002; d = 1.04). Children who were exclusively breastfed outperformed those who were formula-fed in throwing (p = 0.016; d = 0.75); visual-motor integration (p = 0.005; d = 0.94); total control of objects (p = 0.002; d = 1.02); total gross motor skills (p = 0.023; d = 0.82); and total motor skills (p = 0.042; d = 0.74). Boys outperformed girls in throwing (p = 0.041; d = 0.74) and total control of objects (p = 0.024; d = 0.63); while the opposite occurred in static balance (p = 0.000; d = 1.2); visual-motor coordination (p = 0.020; d = 0.79); and total fine motor skills (p = 0.032; d = 0.72). Older children (aged 69-74 months) obtained higher scores than younger ones (aged 63-68 months) in dynamic balance (p = 0.030; d = 0.66); visual-motor integration (p = 0.034; d = 0.63); and total balance (p = 0.013; d = 0.75). Implications for early childhood care and education are discussed since this is a critical period for motor skill development and learning.

Association Between Preschoolers' Specific Fine (But Not Gross) Motor Skills and Later Academic Competencies: Educational Implications

Motor development is an inseparable component of cognitive development. So, to develop the mind, it is necessary to work the body. Therefore, Early Childhood Education curricula and the scientific literature emphasize the need to promote the development of motor skills during the 1st years of life. These skills are necessary for learning and subsequent academic performance. However, studies frequently offer only a partial view of these relationships. Few works have analyzed the specific relationships between different components of preschool gross and fine motor skills and subsequent performance on different academic competencies. Further, they present discrepant results. The aim of this study was to determinate which specific components of gross and fine motor skills assessed in Spanish students during the final year of Early Childhood Education (5 to 6-year-olds) were associated with different academic competencies assessed in the following academic year, when the students were in their 1st year of Primary Education. The final sample consisted of 38 Spanish students, aged 5. A mixed methods approach was used. It consisted of systematic observation to assess specific components of gross and fine motor skills when children were in the Early Childhood Education period, and selective methodology to evaluate their academic competencies (specifically in literacy and mathematics and overall), 1 year later, once in Primary Education. Multiple linear regression models were constructed using the computing language R to examine the association between motor skills and academic competencies. The results indicated that only the components of fine motor skills showed associations with academic competencies. The pattern of association varied when literacy and mathematics competencies were specifically and individually assessed and when overall academic competency was considered. The two assessed fine motor skills (Coordination and Integration) were associated with literacy competency (β = 0.344, p = 0.025; β = 0.349, p = 0.024, respectively) and overall academic competency (β = 0.267, p = 0.065; β = 0.493, p = 0.001, respectively). However, only Integration was associated with mathematics competency (β = 0.476, p = 0.002). The "Discussion" section focuses on the educational implications of these results and future research. It highlights the importance of early assessment of fine motor skills to identify students likely to present inadequate subsequent academic performance and the need to apply instruction and interventions tailored to the specific needs of each child.

Improvement of Planning Skills in Children With Autism Spectrum Disorder After an Educational Intervention: A Study From a Mixed Methods Approach

The literature confirms that individuals with autism spectrum disorder (ASD) have planning deficits. However, few interventions have targeted these deficits. The aims of this study were to: (1) show that the mixed methods approach can be useful in studying planning skills of children with ASD during and after an educational intervention; (2) assess whether the planning skills of two groups of children with ASD improved during the intervention and if this progress was maintained 1 month after completing the intervention. The groups were formed depending on each child’s severity level (SL) of ASD according to DSM-5: SL1 (requiring support) and SL2 (requiring substantial support). Each group was composed of four children. In the framework of mixed methods, we used observational methodology, which is considered as mixed methods in itself because it integrates qualitative and quantitative elements. A nomothetic/follow-up/multidimensional observational design was used. Planning skills manifested by children during the intervention were codified, as well as the scaffolding behaviors provided by the educational specialist. These skills and behaviors were also coded in one session, which took place 1 month after the intervention. Coded data of each group were submitted to prospective and retrospective lag sequential analysis. This informed of the sequential structure of planning skills performed by children in interaction with the educational specialist at the beginning and at the end of the intervention, as well as 1 month later after the intervention. The comparison of the patterns obtained in these three temporal moments allowed us to know the improvement of the two groups in the use of planning skills. Results showed that both groups improved their autonomous use of planning skills. However, SL1 group used successfully and autonomously complex planning skills, while SL2 group were unable to achieve this gain. SL2 group progressed in autonomy, but only using basic planning skills. Both groups can further improve their use of planning skills; therefore, the intervention should be adjusted to their characteristics and temporarily extended. These findings contribute to the, as yet, little studied field of intervention and assessment of planning skills in children with ASD using a mixed methods approach.

Preschool Metacognitive Skill Assessment in Order to Promote Educational Sensitive Response From Mixed-Methods Approach: Complementarity of Data Analysis

A child's metacognitive skills contribute significantly to their learning and success. However, very few studies are focused on these skills at early education and most of them are carried out from inappropriate methodological perspectives for the characteristics of the youngest students. To overcome such limitations, it is essential to carry out observational studies that analyze children's metacognitive behaviors in the natural and habitual context of children's learning, as well as appropriate tasks for their level of development. The aim of this study was to analyze the sequential and associative structure of the metacognitive skills used by 5-year-old children throughout the resolution of a playful task (a puzzle). It was interesting to know if there were different hidden structures in the use of metacognitive skills in the children who solved the puzzle and those who did not. From the methodological approach, this work was located in the perspective of mixed methods which is characterized by the integration of qualitative and quantitative elements. This integration was carried out from the “connect” option. The integration involved developing quantitizing, as one of its possibilities. Recent scientific literature has considered systematic observation, in which the QUAL-QUAN-QUAL macro stages take place, as a mixed method itself. Consequently, systematic observation was applied, because it was suitable for our aim. A Nomothetic/Punctual/Multidimensional observational design was used. The playful activity of 44 preschool children solving the puzzle individually was coded. It allowed us to obtain data matrices that respond to the QUAL stage. Regarding the QUAN stage, once the quality of data was controlled, the records were further analyzed by differentiating two groups of participants (those who had solved the puzzle and those who did not) using three quantitative techniques of observational analysis (T-pattern detection, lag sequential analysis, polar coordinate analysis). Finally data was returned to a QUAL stage to interpret the results. The use of these three techniques allowed a detailed and in-depth analysis of the children's activity. Results reveal differences in the metacognitive abilities of the children that solved and didn't solve the puzzle. These results have important implications for educational practice.

Support System for the Assessment and Intervention During the Manual Material Handling Training at the Workplace: Contributions From the Systematic Observation

Efficacy of classical manual material handling (MMH) training interventions on back pain prevention at the workplace has been called into question. The way that observation (self-observation or hetero-observation) is used in other areas to create feedback addressed to modify motor activities can justify innovative components for these interventions. However, their implementation and evaluation cannot be done without tackling the methodological challenge of developing a reliable observational instrument to measure manual handling practice during the training process. The aims of this study were: (1) justify and develop an hetero-observation (H-O) instrument to assess changes in the worker behavioral patterns with a level of analysis convenient to derive a parallel version for the systematic self-observation (S-O) during training on MMH; (2) provide evidence on the inter-rater reliability of the H-O instrument; (3) provide evidence on the usability of the S-O instrument and its perceived usefulness; and (4) provide evidence on the benefits that can be derived with the use of the H-O instrument to create feedback based on T-pattern and polar coordinate analysis. A mixed method approach mainly grounded on systematic observation was used. A convenience sample composed by blue-collar workers participated in the study. Based on literature review and expert opinion, the H-O instrument proposed was composed by six dimensions (feet, knee joints, back, elbow joints, load position, and interaction between back tilt and displacement) plus a structural dimension which defined MMH phases. The inter-rater reliability of this instrument was almost perfect for all dimensions using a tolerance level of 2 s (the range of time-unit kappa was from 0.93 to 0.97 and the range of event-based kappa was from 0.82 to 0.9). The usability and usefulness of the S-O instrument was highly valued by workers. Regarding the way to use hetero-observations to create feedback, the paper shows the great potential of T-pattern and polar coordinate analysis. The observational instruments developed combined with these techniques make it possible to characterize the body positions adopted during manual handling performance, and this is crucial to create feedback on performance instead of only feedback on results.

Giok the Alien: An AR-Based Integrated System for the Empowerment of Problem-Solving, Pragmatic, and Social Skills in Pre-School Children

The use of technology for educational purposes is a consolidated reality, and many new tools are constantly being devised and offered for use with both normally developing children and children with special needs. Nonetheless, a detailed analysis of the processes being stimulated and of the goals being pursued is often lacking or absent. In this work we describe the design, development and preliminary testing of an integrated system which combines the use of smart devices, a physical cube, augmented reality (AR) technology, a smart TV, and a software application especially designed to stimulate cognitive and social functions in pre-school children. The system was tested with three groups of children (25 children in total) during kindergarten activities. The results show that the system is easy to understand, elicits high levels of participation and social interaction, favors strategic behaviors, and can be used by the children with limited need of instruction and support by the adult. The implications for empowerment in typically developing children and the possibilities for use with children who have specific impairments in social communication are discussed.

Indirect Observation in Everyday Contexts: Concepts and Methodological Guidelines within a Mixed Methods Framework

Indirect observation is a recent concept in systematic observation. It largely involves analyzing textual material generated either indirectly from transcriptions of audio recordings of verbal behavior in natural settings (e.g., conversation, group discussions) or directly from narratives (e.g., letters of complaint, tweets, forum posts). It may also feature seemingly unobtrusive objects that can provide relevant insights into daily routines. All these materials constitute an extremely rich source of information for studying everyday life, and they are continuously growing with the burgeoning of new technologies for data recording, dissemination, and storage. Narratives are an excellent vehicle for studying everyday life, and quantitization is proposed as a means of integrating qualitative and quantitative elements. However, this analysis requires a structured system that enables researchers to analyze varying forms and sources of information objectively. In this paper, we present a methodological framework detailing the steps and decisions required to quantitatively analyze a set of data that was originally qualitative. We provide guidelines on study dimensions, text segmentation criteria, ad hoc observation instruments, data quality controls, and coding and preparation of text for quantitative analysis. The quality control stage is essential to ensure that the code matrices generated from the qualitative data are reliable. We provide examples of how an indirect observation study can produce data for quantitative analysis and also describe the different software tools available for the various stages of the process. The proposed method is framed within a specific mixed methods approach that involves collecting qualitative data and subsequently transforming these into matrices of codes (not frequencies) for quantitative analysis to detect underlying structures and behavioral patterns. The data collection and quality control procedures fully meet the requirement of flexibility and provide new perspectives on data integration in the study of biopsychosocial aspects in everyday contexts.