Development of a Mobile Application for Detection of Adolescent Mental Health Problems and Feasibility Assessment with Primary Health Care Workers

Developing a Comprehensive List of Criteria to Evaluate the Characteristics and Quality of eHealth Smartphone Apps: Systematic Review

BACKGROUND

The field of eHealth is growing rapidly and chaotically. Health care professionals need guidance on reviewing and assessing health-related smartphone apps to propose appropriate ones to their patients. However, to date, no framework or evaluation tool fulfills this purpose.

OBJECTIVE

Before developing a tool to help health care professionals assess and recommend apps to their patients, we aimed to create an overview of published criteria to describe and evaluate health apps.

METHODS

We conducted a systematic review to identify existing criteria for eHealth smartphone app evaluation. Relevant databases and trial registers were queried for articles. Articles were included that (1) described tools, guidelines, dimensions, or criteria to evaluate apps, (2) were available in full text, and (3) were written in English, French, German, Italian, Portuguese, or Spanish. We proposed a conceptual framework for app evaluation based on the dimensions reported in the selected articles. This was revised iteratively in discussion rounds with international stakeholders. The conceptual framework was used to synthesize the reported evaluation criteria. The list of criteria was discussed and refined by the research team.

RESULTS

Screening of 1258 articles yielded 128 (10.17%) that met the inclusion criteria. Of these 128 articles, 30 (23.4%) reported the use of self-developed criteria and described their development processes incompletely. Although 43 evaluation instruments were used only once, 6 were used in multiple studies. Most articles (83/128, 64.8%) did not report following theoretical guidelines; those that did noted 37 theoretical frameworks. On the basis of the selected articles, we proposed a conceptual framework to explore 6 app evaluation dimensions: context, stakeholder involvement, features and requirements, development processes, implementation, and evaluation. After standardizing the definitions, we identified 205 distinct criteria. Through consensus, the research team relabeled 12 of these and added 11 more-mainly related to ethical, legal, and social aspects-resulting in 216 evaluation criteria. No criteria had to be moved between dimensions.

CONCLUSIONS

This study provides a comprehensive overview of criteria currently used in clinical practice to describe and evaluate apps. This is necessary as no reviewed criteria sets were inclusive, and none included consistent definitions and terminology. Although the resulting overview is impractical for use in clinical practice in its current form, it confirms the need to craft it into a purpose-built, theory-driven tool. Therefore, in a subsequent step, based on our current criteria set, we plan to construct an app evaluation tool with 2 parts: a short section (including 1-3 questions/dimension) to quickly disqualify clearly unsuitable apps and a longer one to investigate more likely candidates in closer detail. We will use a Delphi consensus-building process and develop a user manual to prepare for this undertaking.

TRIAL REGISTRATION

PROSPERO International Prospective Register of Systematic Reviews CRD42021227064; https://www.crd.york.ac.uk/prospero/display_record.php?ID=CRD42021227064.

Mandatory after-school use of step tracker apps improves physical activity, body composition and fitness of adolescents

Previous scientific research on the use of mobile applications to increase physical activity level and improve health among adolescents does not provide conclusive results, one of the main reasons being the lack of adherence to the intervention after the first weeks. For this reason, the main objectives of the research were to determine the changes produced by a compulsory ten-week period of after-school intervention with mobile step-tracking applications on adolescents' health; and the final objective to compare the benefits obtained by each of the mobile applications. To meet the objectives, a longitudinal study with non-probability convenience sampling was proposed. The sample consisted of 400 adolescents from two public compulsory secondary schools in the Region of Murcia, Spain, whose body composition, level of physical activity, adherence to the Mediterranean diet, and physical fitness were measured. The SPSS statistical software was used for statistical analysis. The results showed that adolescents in the experimental group showed a higher level of physical activity and better body composition and physical fitness variables after the intervention compared to the control group, with differences between the different applications used. In conclusion, this research shows the usefulness of mobile applications if they are used in a compulsory way after school hours. The relevance of these results for policymakers lies in the fact that they provide statistical data on the usefulness of mobile applications as an educational resource, being an option to make up for the lack of sufficient physical education teaching hours to meet global physical activity recommendations.