[Evaluative designs in public health: methodological considerations]

[An evaluation of teacher training to promote healthy and equitable relationships: transforming or reproducing?]

OBJECTIVE

To evaluate the impact of the training on teacher capacity to implement Posem el Focus, a socio-educational intervention adapted from Lights4Violence to prevent the gender-based violence during adolescence.

METHOD

Evaluation study of a training using qualitative methodology in Terrassa, 2019-2021. The socio-constructionist perspective was used to understand the impact of teacher training and its translation into educational practice. A purposive sampling of teachers (n=32) was carried out. A descriptive-interpretative analysis of the discourses was carried out based on the written productions of the participants in the training and their answers to some open questions. An explanatory theoretical framework was developed.

RESULTS

Teachers reported acquiring concepts, developing new skills and modifying some attitudes. Teachers stated theoretical understanding of the sex-gender system, intersectionality and explicit and implicit violence. However, they reproduced gender stereotypes, did not understand the inclusive approach and pointed out not identifying implicit violence. Teachers perceived the training as useful and felt empowered to implement the intervention. No differences were identified in discursive production with respect to gender or age.

CONCLUSIONS

Teacher training ensures minimum knowledge and facilitates the acquisition of some skills, although it does not achieve in-depth changes in attitudes. It is concluded that the training enables teachers to implement Posem el Focus, although it is recommended that it be reformulated.

Positive Masculinities and Gender-Based Violence Educational Interventions Among Young People: A Systematic Review

BACKGROUND

Hegemonic masculinity has been recognized as contributing to the perpetration of different forms of gender-based violence (GBV). Abandoning hegemonic masculinities and promoting positive masculinities are both strategies used by interventions that foreground a "gender-transformative approach." Preventing GBV among young people could be strengthened by engaging young men. In this article, we aim to systematically review the primary characteristics, methodological quality, and results of published evaluation studies of educational interventions that aim to prevent different forms of GBV through addressing hegemonic masculinities among young people.

MAIN BODY

We conducted a systematic review of available literature (2008-2019) using Medline (PubMed), Scopus, Web of Science, PsycInfo, the CINAHL Complete Database, and ERIC as well as Google scholar. The Template for Intervention Description and Replication was used for data extraction, and the quality of the selected studies was analyzed using the Mixed Method Appraisal Tool. More than half of the studies were conducted in Africa (n = 10/15) and many were randomized controlled trials (n = 8/15). Most of the studies with quantitative and qualitative methodologies (n = 12/15) reported a decrease in physical GBV and/or sexual violence perpetration/victimization (n = 6/15). Longitudinal studies reported consistent results over time.

CONCLUSIONS

Our results highlight the importance of using a gender-transformative approach in educational interventions to engage young people in critical thinking about hegemonic masculinity and to prevent GBV.

Effectiveness of a preschool emotional education programme administered over 3 grades: a cluster randomised controlled trial

INTRODUCTION

Emotional education programmes are universal preventive strategies for health promotion, especially mental health. The aim of this study is to evaluate the effectiveness and implementation of '1,2,3, emoció!': a preschool-based programme designed to improve emotional competence and targeted to 3-5-year-old children in Barcelona during three academic years.

STUDY DESIGN

Cluster randomised trial, using schools as clusters.

METHODS

The study's population included preschoolers 3-5 years old from Barcelona. Teachers offered the programme during one or three academic years in the intervention groups. We evaluated the emotional competence of each child at the beginning and the end of the academic year with the Emotional Competence Assessment Questionnaire (30-180 scale). We studied the implementation process and analysed the outcomes with nested linear regression models. Considering sociodemographic variables and implementation outcomes, we obtained the individual differences in emotional competence at the end of the school year-segregated by sex-for intervention and comparison groups.

RESULTS

1586 children participated in the study. The emotional competence level increased significantly after one year (4.1 in boys; 5.6 in girls; P < 0.05) and after three years of intervention (5.5 in boys; 8.0 in girls; P < 0.01), compared to comparison group. The level of emotional competence was the highest for the 3-year intervention group: we obtained an average ECAQ score of 131.1 (95% CI 126.9-135.2) for boys and 141 (95% CI 137.2-144.9) for girls. We observed that an accurate implementation improved its results.

CONCLUSIONS

The programme '1,2,3, emoció!' effectively increases preschool children's emotional competence, especially when the programme is rigorously implemented for three years.

The Emotional Competence Assessment Questionnaire (ECAQ) for Children Aged from 3 to 5 Years: Validity and Reliability Evidence

In order to assess emotional competence in children, it is necessary to have psychometrically sound measures. To the best of our knowledge, there is no available tool to assess emotional competence in children from 3 to 5 years old that assesses the five emotional competences of the Bisquerra model and can be easily and quickly answered in the school environment. The objective of this study is to develop a measure, the Emotional Competence Assessment Questionnaire (ECAQ), and to provide evidence of its psychometric quality. Qualitative evidence was obtained from a systematic review, from two expert committees and from five discussion groups. On the other hand, quantitative validity and reliability evidence was obtained from a sample of 1088 students and other smaller subsamples. The results suggest that the ECAQ is a short and easy-to-use tool, easily understood by administrators. The quantitative results confirm a general factor of emotional competence adjusted for three specific factors. This factor has excellent internal consistency and test-retest reliability. The ECAQ has therefore been shown to be a promising tool for assessing emotional competence in children between 3 and 5 years of age.

Evaluation of the effectiveness and equity of the maternity protection reform in Chile from 2000 to 2015

INTRODUCTION

According to the International Labor Organization, Maternity Protection (MP) policies try to harmonize child care and women's paid work, without affecting family health and economic security. Chile Law 20.545 (2011) increased benefits for economically active women and reduced requirements for accessing these benefits. The goals of the reform included: 1) to increase MP coverage; and 2) to reduce inequities in access to the benefits.

METHOD

This study uses two data sources. First, using individual data routinely collected from 2000 to 2015, yearly MP coverage access over time was calculated. Second, using national representative household surveys collected before and after the Law (2009 and 2013), coverage and a set of measures of inequality were estimated. To compare changes over time, we used non-experimental, before-after intervention design for independent samples. For each variable, we estimated comparative proportions at 95% confidence interval before and after the intervention. Additionally, we included multivariate and propensity score analysis.

RESULTS

Between 2000 and 2015, MP coverage grew from 24.4% to 44.8%. Using comparable 2009 and 2013 survey data, we observed the same trend, with 31.6% of estimated MP coverage in 2009, escalating to 39.5% in 2013. We conclude that: 1) after the reform, there was an increase in MP coverage; and, 2) there was no significant reduction of inequities in the distribution of MP benefits.

DISCUSSION/CONCLUSION

Few scientific evaluations of MP reforms have been conducted worldwide; even fewer including an equity analysis. This study provides an empirically-based evaluation of MP reform from both a population-level and an equity-focused perspective. We conclude that this reform needs to be complemented with other policies to ensure maternity protection in terms of access and equity in a country with deep socioeconomic stratification.

Evaluation of an intervention to improve the management of allergens in school food services in the city of Barcelona

BACKGROUND

An intervention to promote the development of an allergen control plan (ACP) and preventive measures for the management of allergens in school food services was implemented in all schools of Barcelona city over a three-year period (2013-2015) by the public health services. The present study aimed to assess changes regarding the management of food allergens in school food services in Barcelona after an intervention conducted by the public health services of the city.

METHODS

School meal operators of a random sample of 117 schools were assessed before and after the intervention using a structured questionnaire. The questionnaire collected general information on the students and their demand for special menus, and included 17 closed questions regarding the implementation of specific preventive measures for the management of allergens. Based on these 17 questions, a food safety score was calculated for each school. The improvement in these scores was evaluated.

RESULTS

The results showed positive increments in the percentage of implementation of 12 of the 17 preventive measures assessed. The percentage of school food services with an implemented ACP increased by 49%. Schools with external and internal food supplies increased their scores by 16.5% and 19.6%, respectively. The greatest improvements were observed in smaller food services and in schools located in districts with low gross household incomes.

CONCLUSIONS

The intervention was effective in improving school food services' management of allergens and in reducing the differences found among food services in the pre-intervention survey. We must also focus efforts on reducing socio-economic inequalities linked to the management of allergens.

Is systematic training in opioid overdose prevention effective?

The objectives were to analyze the knowledge about overdose prevention, the use of naloxone, and the number of fatal overdoses after the implementation of Systematic Training in Overdose Prevention (STOOP) program. We conducted a quasi-experimental study, and held face-to-face interviews before (n = 725) and after (n = 722) implementation of systematic training in two different samples of people who injected opioids attending harm reduction centers. We asked participants to list the main causes of overdose and the main actions that should be taken when witnessing an overdose. We created two dependent variables, the number of (a) correct and (b) incorrect answers. The main independent variable was Study Group: Intervention Group (IG), Comparison Group (CG), Pre-Intervention Group With Sporadic Training in Overdose Prevention (PREIGS), or Pre-Intervention Group Without Training in Overdose Prevention (PREIGW). The relationship between the dependent and independent variables was assessed using a multivariate Poisson regression analysis. Finally, we conducted an interrupted time series analysis of monthly fatal overdoses before and after the implementation of systematic program during the period 2006–2015. Knowledge of overdose prevention increased after implementing systematic training program. Compared to the PREIGW, the IG gave more correct answers (IRR = 1.40;95%CI:1.33–1.47), and fewer incorrect answers (IRR = 0.33;95%CI:0.25–0.44). Forty percent of people who injected opioids who received a naloxone kit had used the kit in response to an overdose they witnessed. These courses increase knowledge of overdose prevention in people who use opioids, give them the necessary skills to use naloxone, and slightly diminish the number of fatal opioid overdoses in the city of Barcelona.

Smokefree legislation effects on respiratory and sensory disorders: A systematic review and meta-analysis

Aims

The aim of this systematic review and meta-analysis is to synthesize the available evidence in scientific papers of smokefree legislation effects on respiratory diseases and sensory and respiratory symptoms (cough, phlegm, red eyes, runny nose) among all populations.

Materials and methods

Systematic review and meta-analysis were carried out. A search between January 1995 and February 2015 was performed in PubMed, EMBASE, Cochrane Library, Scopus, Web of Science, and Google Scholar databases. Inclusion criteria were: 1) original scientific studies about smokefree legislation, 2) Data before and after legislation were collected, and 3) Impact on respiratory and sensory outcomes were assessed. Paired reviewers independently carried out the screening of titles and abstracts, data extraction from full-text articles, and methodological quality assessment.

Results

A total number of 1606 papers were identified. 50 papers were selected, 26 were related to symptoms (23 concerned workers). Most outcomes presented significant decreases in the percentage of people suffering from them, especially in locations with comprehensive measures and during the immediate post-ban period (within the first six months). Four (50%) of the papers concerning pulmonary function reported some significant improvement in expiratory parameters. Significant decreases were described in 13 of the 17 papers evaluating asthma hospital admissions, and there were fewer significant reductions in chronic obstructive pulmonary disease admissions (range 1–36%) than for asthma (5–31%). Six studies regarding different respiratory diseases showed discrepant results, and four papers about mortality reported significant declines in subgroups. Low bias risk was present in 23 (46%) of the studies.

Conclusions

Smokefree legislation appears to improve respiratory and sensory symptoms at short term in workers (the overall effect being greater in comprehensive smokefree legislation in sensory symptoms) and, to a lesser degree, rates of hospitalization for asthma.

Promoting social capital to alleviate loneliness and improve health among older people in Spain

Loneliness is especially frequent among older people in Southern Europe. Furthermore, promoting social capital to tackle loneliness and its health effects is an understudied intervention strategy. Therefore, a complex intervention was piloted in Spain in a pre-post study with a 2-year follow-up. Its aims were to explore the feasibility of the intervention and its short- and long-term effects. It was conducted in one mixed rural-urban and two urban areas of diverse socioeconomic levels from 2011 to 2012. The intervention framework was based on social capital theory applying a behaviour change model and care co-ordination. The intervention comprised: (i) a co-ordinated action aimed at building a network between primary healthcare centres and community assets in the neighbourhood and (ii) a group-based programme, which promoted social capital among lonely older people, especially social support and participation. Older people active in senior centres volunteered as gatekeepers. The main outcome domain was loneliness. Secondary outcome domains were participation, social support, self-perceived health, quality of life, depressive symptoms and use of health resources. Pre-post changes were assessed with t-test, Wilcoxon signed-rank test and McNemar's test. Differences between the three time points were assessed with a one-way ANOVA with repeated measures. Social workers and nurses were successfully involved as group leaders, 10 volunteers took part and 38 participants were included. After the intervention, loneliness decreased while social participation and support significantly increased. Furthermore, the number of visits to nurses increased. Exactly 65.8% of the participants built social contacts within the group and 47.4% became engaged in new activities. Two years later, social effects were maintained and depressive symptoms had decreased. Exactly 44.7% of the participants continued to be in contact with at least one person from the group and 39.5% continued participating. The intervention contributes a novel and feasible social capital-based approach for alleviating loneliness among older adults while prompting meaningful changes in their lives.

[Effects of a physical restraint removal program on older people with dementia in residential care]

OBJECTIVE

To analyse the results of removing physical restraints from elderly patients with dementia living in nursing homes. This objective is part of a wider process of change in residential care.

METHODS

Quasi-experimental study conducted in two residences from May 2010 to May 2012. Information was collected at 7 time points and longitudinal analyses were performed. After training staff, the physical restraints in El Puig centre were phased out, while in the Conarda centre, restraints were still applied to elderly people. The main variables studied were: falls, psychotropic medication prescriptions, different indicators of mental impairment, and degree of dependence (Norton, NPI, Mini-mental, Tinetti, Barthel).

RESULTS

In the El Puig centre all the physical restraints were removed. A slight improvement was seen in the number of falls, and their consequences. The ANOVA showed significant improvements in the centre that removed restraints in prescribing psychotropic medications, cognitive impairment, and behavioural changes.

DISCUSSION

It is shown that removing physical restraints do not cause negative effects as regards the number of falls, and also positively affects the welfare and independence of elderly people (through changes in behaviour and mental impairment). Furthermore, it is demonstrated that this program must be accompanied by the reduction and control of medicines (withdrawal of the number of psychotropic prescriptions).

The relationships between the impact of alcoholic beverage control policies, selected contextual determinants, and alcohol drinking in Spain

Alcohol prevention policies alone neither cause nor explain changes in alcohol consumption, nor in related harm. Alcohol consumption in Spain throughout the period 1962-2008 was analyzed considering selected contextual factors and alcohol policies. Increased urbanization was found to be associated with higher consumption, especially of beer. Restrictive policies regulating purchase age, advertising, and licensing premises to sell alcohol were associated with decreased alcohol consumption, while lower blood alcohol concentration limits were followed by an increase. Study limitations are noted. Changes in the evolution of socioeconomic, sociodemographic, and cultural factors should be carefully analyzed to inform alcohol policy planning and evaluation.

[Experience of community participation in management adequacy of municipal solid waste in Mexico]

Objetivo:

Diseñar, implementar y evaluar una intervención educativa que contribuya al manejo adecuado de los residuos sólidos urbanos con participación de una comunidad semiurbana, al norte de Cuernavaca, Morelos, México.

Material y métodos:

Estudio con medición pre y post-intervención educativa, también llamado diseño pre-experimental, con aproximación cuanti-cualitativa. Cuestionario hecho en 27 hogares, 3 grupos focales, 8 entrevistas y creación de un registro etnográfico, de agosto 2010 a mayo 2011.

Resultados:

Participaron 23 niños/niñas y 14 mujeres de manera directa, en actividades de la intervención. Se incrementó 4,74% el conocimiento sobre manejo de los residuos ( p = 0,036), 4.5% la susceptibilidad percibida ( p = 0,041) y 3.39% los beneficios percibidos ( p = 0,032). La basura se percibe como problema asociado a daños a la salud y medio ambiente. Se identificó a la mujer como responsable del manejo de residuos sólidos. Se favoreció la relación vecinal e incorporación de acciones de separar residuos y barrer las calles con más frecuencia.

Conclusiones:

Reconocer a la población como guía de acciones en salud es fundamental para el éxito de intervenciones comunitarias. Se recomienda el uso de una metodología participativa en otras propuestas de intervención.

[Evaluation of the Health Observatory of Asturias (Spain): web and social network metrics and health professionals' opinions]

OBJECTIVE

To evaluate the Health Observatory of Asturias (Observatorio de Salud de Asturias [OBSA]), which collects and disseminates health data from Asturias through a website and social networks.

METHOD

A cross-sectional study was conducted between 2012 and 2013. The study included a process evaluation that analyzed the reach of the OBSA's website, Facebook and Twitter accounts through web metrics and the use made by health professionals in Asturias of these media. Satisfaction was assessed through an online questionnaire. To estimate the potential effects of the OBSA, the study also included an evaluation of the results with a non-experimental design.

RESULTS

The total number of visits to the website increased in 2012, with more than 37,000 visits. The questionnaire (n=43) showed that 72.1% of the health professionals knew of the OBSA and that 81.5% of them had used it. Most health professionals reported they were satisfied with the OBSA and believed that it encouraged cooperation among professionals (51.6%).

CONCLUSION

The OBSA is known and consulted by most health professionals and is achieving some of its main objectives: to inform health staff and stimulate discussion. According to the results, information and communication technologies could play an important role in the presentation of health data in a more interactive and accessible way.

[Feasibility of following up a representative sample of the adult population in Barcelona (Spain)]

The objective of this work was to study the feasibility of following up a representative sample of the adult population of Barcelona 8 years after the baseline study. We selected a random sample (n=100) of the 1161 participants who consented to be re-contacted. We contacted 66 participants: 52 (78.8%) agreed to participate in the follow-up, three (4.5%) had died, four (6.1%) had moved, and seven (10.6%) declined to participate in the follow-up. The participation rate in the feasibility study was 52%. In conclusion, the results of our study show a good feasibility of conducting a follow-up study 8 years after the baseline study.