1
|
Papadakis S. Tools for evaluating educational apps for young children: a systematic review of the literature. INTERACTIVE TECHNOLOGY AND SMART EDUCATION 2020. [DOI: 10.1108/itse-08-2020-0127] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 02/05/2023]
Abstract
Purpose
This study, by critically analyzing material from multiple sources, aims to provide an overview of what is available on evaluation tools for educational apps for children. To realize this objective, a systematic literature review was conducted to search all English literature published after January 2010 in multiple electronic databases and internet sources. Various combinations of search strings were used due to database construction differences, while the results were cross-referenced to discard repeated references, obtaining those that met the criteria for inclusion.
Design/methodology/approach
The present study was conducted according to the methods provided by Khan et al. (2003) and Thomé et al. (2016). The whole procedure included four stages: planning the review, identifying relevant studies in the literature, critical analysis of the literature, summarizing and interpreting the findings (Figure 1). Furthermore, in this analysis, a well-known checklist, PRISMA, was also used as a recommendation (Moher et al., 2015).
Findings
These review results reveal that, although there are several evaluation tools, in their majority they are not considered adequate to help teachers and parents to evaluate the pedagogical affordances of educational apps correctly and easily. Indeed, most of these tools are considered outdated. With the emergence of new issues such as General Data Protection Regulation, the quality criteria and methods for assessing children's products need to be continuously updated and adapted (Stoyanov et al., 2015). Some of these tools might be considered as good beginnings, but their “limited dimensions make generalizable considerations about the worth of apps” (Cherner, Dix and Lee, 2014, p. 179). Thus, there is a strong need for effective evaluation tools to help parents and teachers when choosing educational apps (Callaghan and Reich, 2018).
Research limitations/implications
Even though this work is performed by following the systematic mapping guideline, threats to the validity of the results presented still exist. Although custom strings that contained a rich collection of data were used to search for papers, potentially relevant publications that would have been missed by the advanced search might exist. It is recommended that at least two different reviewers should independently review titles, abstracts and later full papers for exclusion (Thomé et al., 2016). In this study, only one reviewer – the author – selected the papers and did the review. In the case of a single researcher, Kitchenham (2004) recommends that the single reviewer should consider discussing included and excluded papers with an expert panel. The researcher, following this recommendation, discussed the inclusion and exclusion procedure with an expert panel of two professionals with research experience from the Department of (removed for blind review). To deal with publication bias, the researcher in conjunction with the expert panel used the search strategies identified by Kitchenham (2004) including: Grey literature, conference proceedings, communicating with experts working in the field for any unpublished literature.
Practical implications
The purpose of this study was not to advocate any evaluation tool. Instead, the study aims to make parents, educators and software developers aware of the various evaluation tools available and to focus on their strengths, weaknesses and credibility. This study also highlights the need for a standardized app evaluation (Green et al., 2014) via reliable tools, which will allow anyone interested to evaluate apps with relative ease (Lubniewski et al., 2018). Parents and educators need a reliable, fast and easy-to-use tool for the evaluation of educational apps that is more than a general guideline (Lee and Kim, 2015). A new generation of evaluation tools would also be used as a reference among the software developers, designers to create educational apps with real educational value.
Social implications
The results of this study point to the necessity of creating new evaluation tools based on research, either in the form of rubrics or checklists to help educators and parents to choose apps with real educational value.
Originality/value
However, to date, no systematic review has been published summarizing the available app evaluation tools. This study, by critically analyzing material from multiple sources, aims to provide an overview of what is available on evaluation tools for educational apps for children.
Collapse
|
2
|
Giorgi Rossi P, Ferrari F, Amarri S, Bassi A, Bonvicini L, Dall'Aglio L, Della Giustina C, Fabbri A, Ferrari AM, Ferrari E, Fontana M, Foracchia M, Gallelli T, Ganugi G, Ilari B, Lo Scocco S, Maestri G, Moretti V, Panza C, Pinotti M, Prandini R, Storani S, Street ME, Tamelli M, Trowbridge H, Venturelli F, Volta A, Davoli AM. Describing the Process and Tools Adopted to Cocreate a Smartphone App for Obesity Prevention in Childhood: Mixed Method Study. JMIR Mhealth Uhealth 2020; 8:e16165. [PMID: 32357123 PMCID: PMC7308901 DOI: 10.2196/16165] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/09/2019] [Revised: 02/04/2020] [Accepted: 02/21/2020] [Indexed: 11/26/2022] Open
Abstract
Background Childhood obesity prevention is a public health priority in industrialized countries. The Reggio Emilia Local Health Authority has implemented a program involving primary and secondary prevention as well as the care of obese children. There are many health-promoting mobile apps, but few are targeted to children and very few are sponsored by public health agencies. Objective The goal of the research was to describe the process and tools adopted to cocreate a mobile app sponsored by the Reggio Emilia Local Health Authority to be installed in parents’ phones aimed at promoting child health and preventing obesity. Methods After stakeholder mapping, a consulting committee including relevant actors, stakeholders, and users was formed. Key persons for childhood obesity prevention were interviewed, focus groups with parents and pediatricians were conducted, and community reporting storytelling was collected. The results of these activities were presented to the consulting committee in order to define the functionalities and contents of the mobile app. Results Three key trends emerged from community reporting: being active, playing, and being outdoors; time for oneself, family, and friends; and the pressures of life and work and not having time to be active and socialize. In focus groups, interviews, and labs, mothers showed a positive attitude toward using an app to manage their children's weight, while pediatricians expressed concerns that the app could increase their workload. When these findings were explored by the consulting committee, four key themes were extracted: strong relationships with peers, family members, and the community; access to safe outdoor spaces; children’s need for age-appropriate independence; and professional support should be nonjudgmental and stigma-free. It should be a dialogue that promotes family autonomy. The app functions related to these needs include the following: (1) newsletter with anticipatory guidance, recipes, and vaccination and well-child visit reminders; (2) regional map indicating where physical activity can be done; (3) information on how to manage emergencies (eg, falls, burns, fever); (4) module for reinforcing the counseling intervention conducted by pediatricians for overweight children; and (5) a function to build a balanced daily diet. Conclusions The pilot study we conducted showed that cocreation in health promotion is feasible, with the consulting committee being the key co-governance and cocreation tool. The involvement of stakeholders in this committee made it possible to expand the number of persons and institutions actively contributing to the project.
Collapse
Affiliation(s)
- Paolo Giorgi Rossi
- Servizio Epidemiologia, Azienda USL-IRCCS di Reggio Emilia, Reggio Emilia, Italy
| | - Francesca Ferrari
- Servizio Epidemiologia, Azienda USL-IRCCS di Reggio Emilia, Reggio Emilia, Italy
| | - Sergio Amarri
- Pediatria Arcispedale Santa Maria Nuova, Azienda USL-IRCCS di Reggio Emilia, Reggio Emilia, Italy
| | - Andrea Bassi
- Dipartimento di scienze politiche e sociali, Università di Bologna, Bologna, Italy
| | - Laura Bonvicini
- Servizio Epidemiologia, Azienda USL-IRCCS di Reggio Emilia, Reggio Emilia, Italy
| | - Luca Dall'Aglio
- Servizio Tecnologie Informatiche e Telematiche Interaziendale, Azienda USL-IRCCS di Reggio Emilia, Reggio Emilia, Italy
| | - Claudia Della Giustina
- Servizio Igiene degli Alimenti e Nutrizione, Azienda USL-IRCCS di Reggio Emilia, Reggio Emilia, Italy
| | - Alessandra Fabbri
- Servizio Igiene degli Alimenti e Nutrizione, Azienda USL-IRCCS di Reggio Emilia, Reggio Emilia, Italy
| | - Anna Maria Ferrari
- Dipartimento di Salute Pubblica, Azienda USL-IRCCS di Reggio Emilia, Reggio Emilia, Italy
| | - Elena Ferrari
- Pediatra di libera scelta, Dipartimento di cure primarie, Azienda USL-IRCCS di Reggio Emilia, Reggio Emilia, Italy
| | - Marta Fontana
- Pediatria Arcispedale Santa Maria Nuova, Azienda USL-IRCCS di Reggio Emilia, Reggio Emilia, Italy
| | - Marco Foracchia
- Servizio Tecnologie Informatiche e Telematiche Interaziendale, Azienda USL-IRCCS di Reggio Emilia, Reggio Emilia, Italy
| | | | - Giulia Ganugi
- Dipartimento di scienze politiche e sociali, Università di Bologna, Bologna, Italy
| | - Barbara Ilari
- Medicina dello Sport e Prevenzione Cardiovascolare, Azienda USL-IRCCS di Reggio Emilia, Reggio Emilia, Italy
| | - Sara Lo Scocco
- Pediatria Arcispedale Santa Maria Nuova, Azienda USL-IRCCS di Reggio Emilia, Reggio Emilia, Italy
| | - Gianluca Maestri
- Dipartimento di scienze politiche e sociali, Università di Bologna, Bologna, Italy
| | - Veronica Moretti
- Dipartimento di scienze politiche e sociali, Università di Bologna, Bologna, Italy
| | - Costantino Panza
- Pediatra di libera scelta, Dipartimento di cure primarie, Azienda USL-IRCCS di Reggio Emilia, Reggio Emilia, Italy
| | - Mirco Pinotti
- Dipartimento di cure primarie, Azienda USL-IRCCS di Reggio Emilia, Reggio Emilia, Italy
| | - Riccardo Prandini
- Dipartimento di scienze politiche e sociali, Università di Bologna, Bologna, Italy
| | - Simone Storani
- Dipartimento di cure primarie, Azienda USL-IRCCS di Reggio Emilia, Reggio Emilia, Italy
| | - Maria Elisabeth Street
- Pediatria Arcispedale Santa Maria Nuova, Azienda USL-IRCCS di Reggio Emilia, Reggio Emilia, Italy
| | - Marco Tamelli
- Servizio di igiene pubblica, Azienda USL-IRCCS di Reggio Emilia, Reggio Emilia, Italy
| | | | - Francesco Venturelli
- Servizio Epidemiologia, Azienda USL-IRCCS di Reggio Emilia, Reggio Emilia, Italy.,Clinical and Experimental Medicine PhD Program, University of Modena and Reggio Emilia, Modena, Italy
| | - Alessandro Volta
- Dipartimento di cure primarie, Azienda USL-IRCCS di Reggio Emilia, Reggio Emilia, Italy
| | - Anna Maria Davoli
- Pediatra di libera scelta, Dipartimento di cure primarie, Azienda USL-IRCCS di Reggio Emilia, Reggio Emilia, Italy
| | -
- Cocreation of Service Innovation in Europe Project, Reggio Emilia, Italy
| |
Collapse
|
3
|
Developing and Exploring an Evaluation Tool for Educational Apps (E.T.E.A.) Targeting Kindergarten Children. SUSTAINABILITY 2020. [DOI: 10.3390/su12104201] [Citation(s) in RCA: 12] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 02/05/2023]
Abstract
During the last decade, there has been an explosive increase in the number of mobile apps that are called educational and target children aged three to six. Research has shown that only a few of them have been created taking into consideration young children’s development and learning processes. The key question that emerges is how parents, custodians, or teachers can choose appropriate, high-quality educational apps. Literature has presented limited assessment tools based on advanced statistical procedures, which allow one to address validity and reliability issues. This study investigates the dimensions of using and operating educational apps for kids and presents a thirteen-item assessment instrument along with its psychometric properties. Data (N = 218) were collected via an electronic questionnaire from pre-service teachers of preschool education. Principal Component Analysis (PCA) with Varimax rotation was used to investigate the underlying dimensions. The resulting structure included four factors, namely: Usability, Efficiency, Parental Control, and Security. PCA supported the factorial validity of the instrument, while the reliability measures of Cronbach’s alpha for the four dimensions were satisfactory. Finally, a lucid discussion on the findings is provided.
Collapse
|