1
|
Giebel GD, Speckemeier C, Schrader NF, Abels C, Plescher F, Hillerich V, Wiedemann D, Börchers K, Wasem J, Blase N, Neusser S. Quality assessment of mHealth apps: a scoping review. FRONTIERS IN HEALTH SERVICES 2024; 4:1372871. [PMID: 38751854 PMCID: PMC11094264 DOI: 10.3389/frhs.2024.1372871] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 01/18/2024] [Accepted: 04/16/2024] [Indexed: 05/18/2024]
Abstract
Introduction The number of mHealth apps has increased rapidly during recent years. Literature suggests a number of problems and barriers to the adoption of mHealth apps, including issues such as validity, usability, as well as data privacy and security. Continuous quality assessment and assurance systems might help to overcome these barriers. Aim of this scoping review was to collate literature on quality assessment tools and quality assurance systems for mHealth apps, compile the components of the tools, and derive overarching quality dimensions, which are potentially relevant for the continuous quality assessment of mHealth apps. Methods Literature searches were performed in Medline, EMBASE and PsycInfo. Articles in English or German language were included if they contained information on development, application, or validation of generic concepts of quality assessment or quality assurance of mHealth apps. Screening and extraction were carried out by two researchers independently. Identified quality criteria and aspects were extracted and clustered into quality dimensions. Results A total of 70 publications met inclusion criteria. Included publications contain information on five quality assurance systems and further 24 quality assessment tools for mHealth apps. Of these 29 systems/tools, 8 were developed for the assessment of mHealth apps for specific diseases, 16 for assessing mHealth apps for all fields of health and another five are not restricted to health apps. Identified quality criteria and aspects were extracted and grouped into a total of 14 quality dimensions, namely "information and transparency", "validity and (added) value", "(medical) safety", "interoperability and compatibility", "actuality", "engagement", "data privacy and data security", "usability and design", "technology", "organizational aspects", "social aspects", "legal aspects", "equity and equality", and "cost(-effectiveness)". Discussion This scoping review provides a broad overview of existing quality assessment and assurance systems. Many of the tools included cover only a few dimensions and aspects and therefore do not allow for a comprehensive quality assessment or quality assurance. Our findings can contribute to the development of continuous quality assessment and assurance systems for mHealth apps. Systematic Review Registration https://www.researchprotocols.org/2022/7/e36974/, International Registered Report Identifier, IRRID (DERR1-10.2196/36974).
Collapse
Affiliation(s)
- Godwin Denk Giebel
- Institute for Healthcare Management and Research, University of Duisburg-Essen, Essen, Germany
| | - Christian Speckemeier
- Institute for Healthcare Management and Research, University of Duisburg-Essen, Essen, Germany
| | - Nils Frederik Schrader
- Institute for Healthcare Management and Research, University of Duisburg-Essen, Essen, Germany
| | - Carina Abels
- Institute for Healthcare Management and Research, University of Duisburg-Essen, Essen, Germany
| | - Felix Plescher
- Institute for Healthcare Management and Research, University of Duisburg-Essen, Essen, Germany
| | - Vivienne Hillerich
- Institute for Healthcare Management and Research, University of Duisburg-Essen, Essen, Germany
| | - Desiree Wiedemann
- Institute for Healthcare Management and Research, University of Duisburg-Essen, Essen, Germany
| | | | - Jürgen Wasem
- Institute for Healthcare Management and Research, University of Duisburg-Essen, Essen, Germany
| | - Nikola Blase
- Institute for Healthcare Management and Research, University of Duisburg-Essen, Essen, Germany
| | - Silke Neusser
- Institute for Healthcare Management and Research, University of Duisburg-Essen, Essen, Germany
| |
Collapse
|
2
|
Lee M, Lin X, Chai JZQ, Lee ES, Smith H, Tudor Car L. Smartphone apps for point-of-care information summaries: systematic assessment of the quality and content. BMJ Evid Based Med 2023; 28:320-327. [PMID: 36922021 DOI: 10.1136/bmjebm-2022-112146] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Accepted: 02/18/2023] [Indexed: 03/17/2023]
Abstract
BACKGROUND Clinicians need easy access to evidence-based information to inform their clinical practice. Point-of-care information summaries are increasingly available in the form of smartphone apps. However, the quality of information from the apps is questionable as there is currently no regulation on the content of the medical apps. OBJECTIVES This study aimed to systematically assess the quality and content of the medical apps providing point-of-care information summaries that were available in two major app stores. We evaluated apps designed specifically for healthcare professionals and assessed their content development, editorial policy, coverage of medical conditions and trustworthiness. METHODS We conducted a systematic assessment of medical apps providing point-of-care information summaries available in Google Play and Apple app stores. Apps launched or updated since January 2020 were identified through a systematic search using 42matters. Apps meeting the inclusion criteria were downloaded and assessed. The data extraction and app assessment were done in parallel and independently by at least two reviewers. Apps were evaluated against the adapted criteria: (1) general characteristics, (2) content presentation of the summaries, (3) editorial quality, (4) evidence-based methodology, (5) coverage (volume) of the medical conditions, (6) usability of apps and (7) trustworthiness of the app based on HONcode principles. HONcode principles are guidelines used to inform users about the credibility and reliability of health information online. The results were reported as a narrative review. RESULTS Eight medical apps met the inclusion criteria and were systematically appraised. Based on our evaluation criteria, UpToDate supported 16 languages, and all other apps were English. Bullet points and brief paragraphs were used in all apps, and only DynaMed and Micromedex and Pathway-medical knowledge provided a formal grading system for the strength of recommendations for all the medical conditions in their apps. All the other apps either lacked a formal grading system altogether or offered one for some of the medical conditions. About 30% of the editorial quality assessment and 47.5% of the evidence-based methodology assessment were unclear or missing. UpToDate contained the most point-of-care evidence-based documents with >10 500 documents. All apps except 5-Minute Clinical Consult and DynaMed and Micromedex were available for offline access. Only Medscape complied with the HONcode principles. CONCLUSIONS Future apps should report a more detailed evidence-based methodology, be accessible for offline use and support search in more than one language. There should be clearer information provided in future apps regarding the declaration of authorship and conflict of interest.
Collapse
Affiliation(s)
- Mauricette Lee
- Lee Kong Chian School of Medicine, Nanyang Technological University, Singapore
| | - Xiaowen Lin
- Lee Kong Chian School of Medicine, Nanyang Technological University, Singapore
| | - Joanne Zhi Qi Chai
- Lee Kong Chian School of Medicine, Nanyang Technological University, Singapore
| | - Eng Sing Lee
- Family Medicine and Primary Care, Lee Kong Chian School of Medicine, Nanyang Technological University, Singapore
| | - Helen Smith
- Family Medicine and Primary Care, Lee Kong Chian School of Medicine, Nanyang Technological University, Singapore
| | - Lorainne Tudor Car
- Lee Kong Chian School of Medicine, Nanyang Technological University, Singapore
- Department of Primary Care and Public Health, School of Public Health, Imperial College London, London, UK
| |
Collapse
|
3
|
Luo E, Wan J, Su M, Wang J, Feng J, Xie X, Hong X. Efficacy of a basal insulin dose management smartphone application for controlling fasting blood glucose in patients with type-2 diabetes mellitus: A single-centre, randomised clinical study. Clin Endocrinol (Oxf) 2023; 99:361-369. [PMID: 37528510 DOI: 10.1111/cen.14956] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 05/16/2023] [Revised: 07/21/2023] [Accepted: 07/23/2023] [Indexed: 08/03/2023]
Abstract
OBJECTIVE To explore the efficacy and safety of the 'Walk with you' application for titrating basal insulin (BI) doses in type-2 diabetes mellitus (T2DM) hospitalised patients. METHODS This was a randomised, single-centre, open-label, controlled clinical trial to compare the changes in fasting blood glucose (FBG) and postprandial blood glucose (PBG), time to reach target FBG (FBG-TRT), incidence of hypoglycaemia events and FBG coefficient of variation in the application group (weight-based titration of BI dose regimen) and control group (typical adjustment regimen). PATIENTS This study selected 173 patients with T2DM using basal-prandial insulin therapy who were admitted to Binhaiwan Central Hospital of Dongguan between December 2021 and December 2022. Patients were randomised to the control group or the application group (App group) and then titrated to achieve an FBG concentration of less than 7.0 mmol/L. RESULTS There were 86 patients in the control group and 87 patients in the App group. The FBG concentrations in the control and App groups were decreased by 6.77 ± 4.75 and 5.95 ± 4.06 mmol/L, respectively. The FBG-TRTs in the control and App groups were 3.80 ± 1.52 and 2.82 ± 1.34 days, respectively (p < .001). Fewer patients in the control group reached the FBG-TRT within 3 days than in the App group, with 46.5% and 71.3% of patients reaching that target, respectively. There was no significant between-group difference in hypoglycaemia incidence. CONCLUSION The use of this weight-based insulin dose titration protocol for BI app is effective and safe for achieving the target FBG in noncritically ill patients with T2DM and is free, easy to use and user friendly.
Collapse
Affiliation(s)
- Ensi Luo
- Department of Endocrinology, Binhaiwan Central Hospital of Dongguan, Dongguan, Guangdong Province, China
| | - Jiejun Wan
- Department of Endocrinology, Binhaiwan Central Hospital of Dongguan, Dongguan, Guangdong Province, China
| | - Minting Su
- Cardiovascular Internal Medicine, Binhaiwan Central Hospital of Dongguan, Dongguan, Guangdong Province, China
| | - Jieying Wang
- Cardiovascular Internal Medicine, Binhaiwan Central Hospital of Dongguan, Dongguan, Guangdong Province, China
| | - Jiahua Feng
- Department of Respiratory Medicine, Binhaiwan Central Hospital of Dongguan, Dongguan, Guangdong Province, China
| | - Xia Xie
- Pain Department, Binhaiwan Central Hospital of Dongguan, Dongguan, Guangdong Province, China
| | - Xiaocheng Hong
- Department of General Surgery, Binhaiwan Central Hospital of Dongguan, Dongguan, Guangdong Province, China
| |
Collapse
|
4
|
Cintra MM, Faleiros F, Corbo LN, Okano LM, Vedana KGG, Dessotte CAM, Kaeppler C. Development, validation and international certification of a health portal for people with disabilities. Rev Bras Enferm 2022; 75Suppl 2:e20210082. [DOI: 10.1590/0034-7167-2021-0082] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/01/2021] [Accepted: 09/22/2021] [Indexed: 11/22/2022] Open
Abstract
ABSTRACT Objectives: to develop, validate with specialists and internationally certify a virtual health portal, the D+Informação. Methods: a quantitative methodological study. Twenty-two expert judges validated the Portal in the health and computer science areas using the Content Validity Index and the Gwet test. International certification followed HONcode principles® to ensure the trust of information. Results: judges of health and computer science validated the portal obtaining a minimum Content Validity Index in more than 75% of the topics, in addition to the evaluation of general agreement, 0.253; content evaluation, 0.193, and interface evaluation, 0.230. All presented the value of Gwet with p ≤ 0,001. Conclusions: the portal D+Informação was developed, validated, internationally certified and is hosted on this website: https://demaisinformacao.com.br
Collapse
|
5
|
Daley BJ, Ni'Man M, Neves MR, Bobby Huda MS, Marsh W, Fenton NE, Hitman GA, McLachlan S. mHealth apps for gestational diabetes mellitus that provide clinical decision support or artificial intelligence: A scoping review. Diabet Med 2022; 39:e14735. [PMID: 34726798 DOI: 10.1111/dme.14735] [Citation(s) in RCA: 9] [Impact Index Per Article: 4.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 07/13/2021] [Revised: 10/28/2021] [Accepted: 10/31/2021] [Indexed: 01/04/2023]
Abstract
AIMS Gestational diabetes (GDM) is the most common metabolic disorder of pregnancy, requiring complex management and empowerment of those affected. Mobile health (mHealth) applications (apps) are proposed for streamlining healthcare service delivery, extending care relationships into the community, and empowering those affected by prolonged medical disorders to be equal collaborators in their healthcare. This review investigates mHealth apps intended for use with GDM; specifically those powered by artificial intelligence (AI) or providing decision support. METHODS A scoping review using the novel Survey Tool approach for collaborative literature Reviews (STaR) process was performed. RESULTS From 18 papers, 11 discrete GDM-based mHealth apps were identified, but only 3 were reasonably mature with only one currently in use in a clinical setting. Two-thirds of the apps provided condition-relevant contextual user feedback that could aid in patient self care. However, although each app targeted one or more components of the GDM clinical pathway, no app addressed the entirety from diagnosis to postpartum. CONCLUSIONS There are limited mHealth apps for GDM that incorporate AI or AI-based decision support. Many exist only to record patient information like blood glucose readings or diet, provide generic patient education or advice, or to reduce adverse events by providing medication or appointment alerts. Significant barriers remain that continue to limit the adoption of mHealth apps in clinical care settings. Further research and development are needed to deliver intelligent holistic mHealth apps using AI that can truly reduce healthcare resource use and improve outcomes by enabling patient self care in the community.
Collapse
Affiliation(s)
- Bridget J Daley
- Centre for Genomics and Child Health, Blizard Institute, Queen Mary University of London, London, UK
| | - Michael Ni'Man
- Centre for Genomics and Child Health, Blizard Institute, Queen Mary University of London, London, UK
| | - Mariana R Neves
- Risk and Information Management, Queen Mary University of London, London, UK
| | | | - William Marsh
- Risk and Information Management, Queen Mary University of London, London, UK
| | - Norman E Fenton
- Risk and Information Management, Queen Mary University of London, London, UK
| | - Graham A Hitman
- Centre for Genomics and Child Health, Blizard Institute, Queen Mary University of London, London, UK
| | - Scott McLachlan
- Risk and Information Management, Queen Mary University of London, London, UK
- Edinburgh Law School, University of Edinburgh, Birmingham, UK
| |
Collapse
|
6
|
Ni Z, Wang Y, Qian Y. Privacy Policy Compliance of Chronic Disease Management Apps in China: Scale Development and Content Evaluation. JMIR Mhealth Uhealth 2021; 9:e23409. [PMID: 33507159 PMCID: PMC7878107 DOI: 10.2196/23409] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/11/2020] [Revised: 11/10/2020] [Accepted: 12/02/2020] [Indexed: 11/21/2022] Open
Abstract
Background With the development of mobile health (mHealth), chronic disease management apps have brought not only the possibility of reducing the burden of chronic diseases but also huge privacy risks to patients’ health data. Objective The purpose of the study was to analyze the extent to which chronic disease management apps in China comply with the Personal Information Security Specification (PI Specification). Methods The compliance of 45 popular chronic disease management apps was evaluated from the perspective of the information life cycle. To conduct a fine-grained evaluation, a scale based on the PI Specification was developed. Finally, 6 level 1 indicators, 22 level 2 indicators, and 61 level 3 indicators were defined. Results There were 33/45 apps (73%) with a privacy policy, and the average score of these apps was 40.4 out of 100. Items of level 1 indicators with high scores included general characteristics (mean 51.9% [SD 28.1%]), information collection and use (mean 51.1% [SD 36.7%]), and information sharing and transfer (mean 50.3% [SD 33.5%]). Information storage and protection had the lowest compliance with PI Specification (mean 29.4% [SD 32.4%]). Few personal information (PI) controllers have stated how to handle security incidents, including security incident reporting (7/33, 21%), security incident notification (10/33, 30%), and commitment to bear corresponding legal responsibility for PI security incidents (1/33, 3%). The performance of apps in the stage of information destruction (mean 31.8% [SD 40.0%]) was poor, and only 21% (7/33) apps would notify third parties to promptly delete PI after individuals cancelled their accounts. Moreover, the scoring rate for rights of PI subjects is generally low (mean 31.2% [SD 35.5%]), especially for obtaining copies of PI (15%) and responding to requests (25%). Conclusions Although most chronic disease management apps had a privacy policy, the total compliance rate of the policy content was low, especially in the stage of information storage and protection. Thus, the field has a long way to go with regard to compliance around personal privacy protection in China.
Collapse
Affiliation(s)
- Zhenni Ni
- School of Information Management, Wuhan University, Wuhan, China.,Center for Studies of Information Resources, Wuhan University, Wuhan, China.,Big Data Institute, Wuhan University, Wuhan, China
| | - Yiying Wang
- School of International Law, Shanghai University of Political Science and Law, Shanghai, China
| | - Yuxing Qian
- School of Information Management, Wuhan University, Wuhan, China.,Center for Studies of Information Resources, Wuhan University, Wuhan, China.,Big Data Institute, Wuhan University, Wuhan, China
| |
Collapse
|