A review of key issues in the measurement of children’s social and emotional skills

How Distributed Leadership Affects Social and Emotional Competence in Adolescents: The Chain Mediating Role of Student-Centered Instructional Practices and Teacher Self-Efficacy

The social and emotional competence of adolescents serves as the cornerstone for their success and future development. This study aims to explore the impact of distributed leadership on the social and emotional competence of adolescents, examining the mediating roles of student-centered teaching practices and teacher self-efficacy. Utilizing survey data from 7246 Chinese adolescents in the SESS project, the study employs a multi-level structural equation modeling approach for data analysis. The results indicate that distributed leadership positively predicts the social and emotional competence of adolescents. Furthermore, distributed leadership exerts indirect effects on adolescents' social and emotional competence through the independent mediating roles of student-centered teaching practices and teacher self-efficacy, as well as a sequential mediation process involving student-centered teaching practices leading to teacher self-efficacy. This study elucidates how distributed leadership facilitates the development of adolescents' social and emotional competence, confirming the supportive factors influencing these crucial capacities. Simultaneously, it provides valuable insights into the daily practices of teachers, principals, and administrators.

Soziale Kompetenzen im Selbstbericht bei Kindern der Primarstufe

Zusammenfassung: Die Relevanz sozialer Kompetenzen bei Kindern für schulischen Erfolg und psychische Gesundheit ist vielfach belegt worden. Trotz fehlender einheitlicher Definition des Begriffs herrscht Einigkeit über die mehrdimensionale Struktur sozialer Kompetenzen. Einige Teilkompetenzen wie z. B. Empathie lassen sich aufgrund fehlender sichtbarer Ausprägung unzureichend beobachten. Eine Erfassung sozialer Kompetenzen aus der Fremdperspektive sollte dementsprechend um eine differenzierte Selbstperspektive ergänzt werden. Insbesondere für den Primarbereich fehlen Inventare, die die Selbstperspektive des Individuums berücksichtigen. Die Social Skill Improvement System Rating Scales (SSIS-RS) bietet als englischsprachiges Inventar diese Möglichkeit. Mithilfe von n = 525 Schülerinnen und Schülern wird in einer ersten Studie die Konstruktvalidität einer deutschen Übersetzung der SSIS-RS untersucht. In einer zweiten Studie wird die Retestreliabilität nach vier Wochen und die Kriteriumsvalidität mithilfe von n = 289 Schülerinnen und Schülern überprüft. Für die deutsche Version zeigt sich eine mit dem Original vergleichbare siebenfaktorielle Struktur sozialer Kompetenzen sowie vergleichbare Skaleneigenschaften und Zusammenhänge zu Fremdurteilen. Dies legt nahe, dass die SSIS-RS sich auch im deutschen Sprachraum für den Selbstbericht im Primarbereich gewinnbringend einsetzen lässt.

Children's social emotional competence in Pakistan and Sweden: Factor structure and measurement invariance of the Social Competence Scale (teacher edition)

Introduction

Social emotional competence is fundamental to the positive development of children and youth. Accurately understanding and assessing children's social emotional competencies, using psychometrically sound instruments, are essential to global efforts to support children's social emotional learning, academic achievements, and health. This study examined the psychometric properties of a teacher-reported measure of young children's social emotional competence, the Social Competence Scale - Teacher edition (SCS-T), in two samples of children growing up with varied economic resources/conditions, cultural norms, and educational experiences, namely Pakistan (N = 396) and Sweden (N = 309).

Methods

Participants were aged 4-6 years old. The study design was cross-sectional.

Results and Discussion

Using structural equation modelling, bi-factor confirmatory factor analysis models implying shared variance, among all items and domain-specific shared variance, among the prosocial items, emotion regulation items, and academic skills items resulted in good fitting models in each respective sample. Invariance testing across samples revealed a subset of items from each factor structure with partial scalar invariance, whereby five items had equal thresholds and could be comparable across the two samples. Thus, results provided partial support for hypotheses 1, 2, and 3, in that the posited three factor model (H1) was not clearly supported and a bi-factor model evidenced the best fit, among tested models, for both samples. Further, partial scalar invariance (H3) was found for five items out of 25 items, concerning social competence and academic skills. In regards, to the posited research question, the results of Z-tests showed significant (p < 0.001) latent mean differences between the samples. Compared to the Swedish sample, the Pakistani sample was 1.80 units lower on social competence (z = -6.41, p < 0.001) and 1.86 units lower on academic skills (z = -7.87, p < 0.001). The implications of these findings in light of efforts to promote positive child development in diverse parts of the world are considered.

Social Emotional Learning Competencies in Belize Children: Psychometric Validation Through Exploratory Structural Equation Modeling

In the nation of Belize, and in particular the south side of Belize City, the main metropolitan area of the nation, significant economic disparities have led to child and adolescent exposure to high rates of violent crime, gang activity, unsafe neighborhoods, sexual, and physical violence. Problems associated with poor Social-Emotional Character Development are especially prevalent among boys. Consequently, valid culture-relevant measures are required that identify problematic behavior for policy-based intervention and evaluation of educational programs designed to ameliorate this problem. The present study demonstrates the application of Exploratory Structural Equation Modeling to existing measures through the investigation of structural validity and generalizability of the Social-Emotional and Character Development Scale with a large sample of children from schools in Belize (N = 1,877, Ages 10-13). Exploratory structural equation modeling results demonstrate the original factor correlations were reduced, providing less biased estimates than confirmatory factor analysis (CFA). Moreover, a multi-group Exploratory Structural Equation Modeling analysis illuminates significant differences between latent factor scores of males and females for most factors. Using this newer factor analytic procedure, original factors are reconceptualized to better situate the Social Emotional Character Development Scales into the larger body of Social-Emotional Learning (SEL) competencies literature.

Without Assumptions: Development of a Socio-Emotional Learning Framework That Reflects Community Values in Cameroon

Socioemotional learning (SEL) skills are the competencies that children need to be successful and accepted members of society. In this study, we built a SEL framework and a SEL measurement tool from the ground up that assess children's development of skills with communities of the Baka ethnic group in Cameroon. We conducted a participatory and interactive study to develop a SEL framework and measurement tool that is specific to the context of indigenous Baka communities in Cameroon. Using a quick ethnography methodology and an emic approach, a researcher team comprised mainly of Baka community members engaged parents, teachers, and others in iterative cycles of data collection, analysis, and reflection to develop the framework and assessments. The resulting Baka SEL framework includes skills and domains distinct from predominant SEL frameworks, underscoring the importance of drawing SEL priorities from communities themselves. Shared foundational constructs underlying the Baka SEL framework and other frameworks indicate possible universal human expectations for emotional and relational skills. Two SEL measurement tools were produced: a caregiver tool and a teacher tool, each using storytelling to elicit specific, honest, and detailed information about child behavior. These tools allow us to capture child behavior in the school and the home, and to collect data on all participating children within a specific time period. The described approach is a simple, practical, and culturally appropriate strategy for collaborating with rural communities to articulate their understanding of SEL. The resulting framework and tools illustrate the importance of rooting SEL in local culture, while the approach to developing them serves as a model for other early childhood care and education organizations and programs.

Exploring the Dimensionality of the Social Skills Improvement System Using Exploratory Graph Analysis and Bifactor-(S - 1) Modeling

Since its development over a decade ago, the Social Skills Improvement System (SSIS) has been one of the most widely used measures of social skills in children. However, evidence of its structural validity has been scant. The current study examined the original seven-factor and more recent five-factor structure (SSIS-SEL) of the self-report SSIS in a sample of English elementary school students (N = 3,331) aged 8 to 10 years (M = 8.66, SD = 0.59). A problematic fit was found for both structures with poor discriminant validity. Using exploratory graph analysis and bifactor-(S − 1) modeling, we found support for a four-factor structure, the variation of which was captured by a general factor defined by “empathy and prosocial skills.” Future researchers, particularly those interested in using specific domains of the SSIS, are urged to assess its structure in their studies, if their findings are to be theoretically meaningful.

The PATHS curriculum for promoting social and emotional well-being among children aged 7–9 years: a cluster RCT

Background

Universal social and emotional learning interventions can produce significant practical improvements in children’s social skills and other outcomes. However, the UK evidence base remains limited.

Objectives

To investigate the implementation, impact and cost-effectiveness of the Promoting Alternative THinking Strategies (PATHS) curriculum.

Design

Cluster randomised controlled trial. Primary schools (n = 45) were randomly assigned to implement PATHS or to continue with their usual provision for 2 years.

Setting

Primary schools in seven local authorities in Greater Manchester.

Participants

Children (n = 5218) in Years 3–5 (aged 7–9 years) attending participating schools.

Intervention

PATHS aims to promote children’s social skills via a taught curriculum, which is delivered by the class teacher, generalisation activities and techniques, and supplementary materials for parents. Schools in the usual provision group delivered the Social and Emotional Aspects of Learning programme and related interventions.

Main outcome measures

Children’s social skills (primary outcome, assessed by the Social Skills Improvement System); pro-social behaviour and mental health difficulties (Strengths and Difficulties Questionnaire); psychological well-being, perceptions of peer and social support, and school environment (Kidscreen-27); exclusions, attendance and attainment (National Pupil Database records); and quality-adjusted life-years (QALYs) (Child Health Utility 9 Dimensions). A comprehensive implementation and process evaluation was undertaken, involving usual provision surveys, structured observations of PATHS lessons, interviews with school staff and parents, and focus groups with children.

Results

There was tentative evidence (at ap-value of  < 0.10) that PATHS led to very small improvements in children’s social skills, perceptions of peer and social support, and reductions in exclusions immediately following implementation. A very small but statistically significant improvement in children’s psychological well-being [d = 0.12, 95% confidence interval (CI) –0.02 to 0.25;p < 0.05) was also found. No lasting improvements in any outcomes were observed at 12- or 24-month post-intervention follow-up. PATHS was implemented well, but not at the recommended frequency; our qualitative analysis revealed that this was primarily due to competing priorities and pressure to focus on the core academic curriculum. Higher levels of implementation quality and participant responsiveness were associated with significant improvements in psychological well-being. Finally, the mean incremental cost of PATHS compared with usual provision was determined to be £29.93 per child. Mean incremental QALYs were positive and statistically significant (adjusted mean 0.0019, 95% CI 0.0009 to 0.0029;p < 0.05), and the incremental net benefit of introducing PATHS was determined to be £7.64. The probability of cost-effectiveness in our base-case scenario was 88%.

Limitations

Moderate attrition through the course of the main trial, and significant attrition thereafter (although this was mitigated by the use of multiple imputation of missing data); suboptimal frequency of delivery of PATHS lessons.

Conclusions

The impact of PATHS was modest and limited, although that which was observed may still represent value for money. Future work should examine the possibility of further modifications to the intervention to improve goodness of fit with the English school context without compromising its efficacy, and identify whether or not particular subgroups benefit differentially from PATHS.

Trial registration

Current Controlled Trials ISRCTN85087674 (the study protocol can be found at:www.journalslibrary.nihr.ac.uk/programmes/phr/10300601/#/).

Funding

This project was funded by the National Institute for Health Research (NIHR) Public Health Research programme and will be published in full inPublic Health Research; Vol 6, No. 10. See the NIHR Journals Library website for further project information.

Differential Effectiveness of a Middle School Social and Emotional Learning Program: Does Setting Matter?

There is a lack of studies in the literature addressing the differential effectiveness of Social and Emotional Learning according to their implementation setting. This study compared the effectiveness of an upper middle school Social and Emotional Learning program applied in two different settings: within school and after-school hours, while controlling for individual and class-level variables. There were 837 students (M_age =12.70; SD = 0.98; 47.6% were female): 246 in the control group, 319 in the after-school intervention group and 272 in the within school schedule intervention group, assessed at pretest, post-test and follow-up seven months later. Multilevel analyses identified more positive intervention results in on self-esteem, self-control, and social awareness for students in the within school schedule groups. Girls gained more in social awareness in both program settings. This study highlights the importance of analyzing Social and Emotional Learning program´s differential effectiveness in order to optimize it.

The Children’s Social Comprehension Scale (CSCS): Construct validity of a new social intelligence measure for elementary school children

The abilities comprising social intelligence are critical to children’s development and interpersonal functioning, and there is a need for reliable and valid tools for measuring them. This paper describes the Children’s Social Comprehension Scale (CSCS), which is a performance-based test of the cognitive component of social intelligence for young schoolchildren. The CSCS was developed as an easy-to-use and rapid screening tool for diagnosing deficits in social information processing, such as understanding and evaluation of social situations. The final version of the instrument exhibits satisfactory score reliability as measured by Cronbach’s alpha and acceptable factorial validity of results as determined by confirmatory factor analysis for each of the studied age groups (6–7, 8–9, and 10–11 years; N = 358). The validity of the CSCS results is also corroborated by its positive correlations with other measures of social intelligence (stronger), intellectual potential (weaker), and an indicator of effective social functioning. The scores on the test show age differences in the expected direction. All these findings suggest that the CSCS is valid and reliable measure of cognitive social intelligence in children.

Psychometric Properties of the Chinese Version of the Children's Resourcefulness Scale in Taiwanese Children

This study reports the psychometric properties of a Chinese version of the Children's Resourcefulness Scale (C-CRS) for Taiwanese children. An instrument for assessing resourcefulness skills in children and adolescents, the CRS was translated into Mandarin Chinese, and a cross-sectional investigation was conducted with a convenience sample of 368 fifth and sixth graders recruited from three geographically diverse locations in Taiwan. Internal consistency statistics from the total sample and subgroups were between .57 and .71 with lower alphas for subgroups with disadvantaged socioeconomic status. Findings suggest that the C-CRS has the potential to assess children's resourcefulness skills in the Taiwanese population.

The Effectiveness of a Portuguese Elementary School Social and Emotional Learning Program

We examined the effects of a social and emotional learning program, Program Positive Attitude, on the social and emotional competencies and self-esteem of Portuguese elementary school students, from the twin perspectives of students and their teachers. Participants were 1237 fourth grade students from 37 schools in a Portuguese municipality, with a mean age of 9.2 years, of which 970 students (in 86 classes) participated in the program and 267 students (in 21 classes) served as a comparison group. Students and their teachers completed questionnaires prior to and following the intervention. We used multilevel linear modeling with a repeated measures design to evaluate the effectiveness of the program. Both students and their teachers reported significant intervention gains in self-control and social awareness. Students' in the intervention group also identified reductions in social isolation and improvements in self-esteem, and their teachers reported decreases in their students' social anxiety. An analysis by gender revealed that only girls showed increases in self-esteem, and only boys reported reduced social isolation. These findings support the effectiveness of the program.

Emotional development among early school-age children: gender differences in the role of problem behaviours

There has been an increasing focus on social and emotional development in educational programmes in early childhood as both variables are believed to influence behavioural outcomes in the classroom. However, relationships between social and emotional development and behaviour in early childhood have rarely been explored. This article sets out to investigate the conceptualisation of these variables and their interrelationships. Structural equation models were used to assess whether differences exist between boys and girls in relation to social and emotional competences, which could affect the relative success of such programmes. This article is based on cross-sectional data collected from 749 four- to six-year-olds and their teachers. The findings generally supported the hypothesised relationships between social and emotional development variables and prosocial behaviour (including internalising behaviour) for boys and girls. However, some gender differences were noted in externalising behaviour, which teachers often consider to be most significant due to its potentially disruptive nature in the classroom.

Social and Emotional Competencies Evaluation Questionnaire-Teacher's Version: Validation of a Short Form

The Social and Emotional Competencies Evaluation Questionnaire-Teacher's version, Short Form (QACSE-P-SF) allows teachers to assess their students' social and emotional competencies, having been designed for program evaluation. Thirty-nine teachers completed the QACSE-P-SF, regarding 657 students (fourth to ninth grades). Factor analyses supported a six-factor structure with acceptable internal consistency. Sex differences were found with teachers reporting girls as having higher scores on Self-Control, Social Awareness, Relationship Skills, and Responsible Decision Making. Developmental differences were also found with fourth-grade students presenting higher levels of Social Awareness and Relationship Skills than older students. The final version of the QACSE-P-SF is composed by 30 items, organized into six scales and less time consuming than the previous version for teachers who need to assess full classes.

Development of the Preschool Developmental Assessment Scale (PDAS) on children's social development

This paper aimed to describe the design and development of the social domain of the Preschool Developmental Assessment Scale (PDAS), which would be used for assessment of preschool children with different developmental disabilities. The original version of the social domain consisted of 30 items. Children were asked questions about their social development such as their relationship with others, understanding of social norms and rules, empathy and perspective taking. The test was administered to 324 children, including 240 children from preschools and 84 children with developmental disabilities. Rasch analysis was conducted, and all except one item were within the acceptable range of infit statistics. The revised 29-item version could well differentiate between children with typical development and children with developmental disabilities. It could also differentiate between children from different age groups. The revised version was estimated to take around 15 min to administer. The social domain of the PDAS was found to be a direct, quick yet reliable assessment tool for assessing the social development of preschool children.