1
|
Harst L, Walther F, Rüthrich L, Keßler L, Lindemann C, Härter M, Farin-Glattacker E, Geraedts M, Schmitt J. [Patient safety in the Innovation Fund - Characterization, results and evaluation of completed projects: Results of a scoping review]. DAS GESUNDHEITSWESEN 2024. [PMID: 39146965 DOI: 10.1055/a-2309-8968] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 08/17/2024]
Abstract
The German Innovation Fund has funded various studies on patient safety. Their thematic spectrum, methodological quality, results and recommendations of the Innovation committee were to be systematically investigated in order to derive proposals for optimizing transfer success. As part of a scoping review, all Innovation Fund projects funded in the period 2016-02/2023 with a focus on patient safety were analyzed. Each included study document was critically reviewed by two independent persons. The 16 included projects addressed a wide range of populations, indications and interventions. The study quality was mostly good. The results ranged from feasible indicator sets and the prevention of adverse drug reactions to the optimization of error management. For seven projects, the Innovation Committee recommended forwarding the results to healthcare institutions with the request that they take note and/or examine the feasibility of implementation in standard care. Implementation, however, has not yet taken place. In order to facilitate implementation, the joint development of an implementation strategy by the recipients of the Innovation Committee's recommendations is necessary.
Collapse
Affiliation(s)
- Lorenz Harst
- Zentrum für Evidenzbasierte Gesundheitsversorgung, Medizinische Fakultät und Universitätsklinikum Carl Gustav Carus, TU Dresden, Dresden, Germany
| | - Felix Walther
- Zentrum für Evidenzbasierte Gesundheitsversorgung, Medizinische Fakultät und Universitätsklinikum Carl Gustav Carus, TU Dresden, Dresden, Germany
- Deutsches Netzwerk Versorgungsforschung e.V. (DNVF), Berlin, Germany
| | - Lilly Rüthrich
- Zentrum für Evidenzbasierte Gesundheitsversorgung, Medizinische Fakultät und Universitätsklinikum Carl Gustav Carus, TU Dresden, Dresden, Germany
| | - Laura Keßler
- Deutsches Netzwerk Versorgungsforschung e.V. (DNVF), Berlin, Germany
| | - Christina Lindemann
- Institut und Poliklinik für Medizinische Psychologie, Universitatsklinikum Hamburg-Eppendorf, Hamburg, Germany
| | - Martin Härter
- Deutsches Netzwerk Versorgungsforschung e.V. (DNVF), Berlin, Germany
- Center for Health Care Research & Public Health, Universitätsklinikum Hamburg-Eppendorf, Hamburg, Germany
- Institut und Poliklinik für Medizinische Psychologie, Universitatsklinikum Hamburg-Eppendorf, Hamburg, Germany
- ÄZQ, Ärztliches Zentrum für Qualität in der Medizin, Berlin, Germany
| | - Erik Farin-Glattacker
- Sektion Versorgungsforschung und Rehabilitationsforschung, Universitätsklinikum Freiburg, Medizinische Fakultät, Universität Freiburg, Freiburg, Germany
| | - Max Geraedts
- Institut für Versorgungsforschung und Klinische Epidemiologie, Fachbereich Medizin, Philipps-Universität Marburg
| | - Jochen Schmitt
- Zentrum für Evidenzbasierte Gesundheitsversorgung, Medizinische Fakultät und Universitätsklinikum Carl Gustav Carus, TU Dresden, Dresden, Germany
- Deutsches Netzwerk Versorgungsforschung e.V. (DNVF), Berlin, Germany
| |
Collapse
|
2
|
Hernández-Rodríguez JC, García-Muñoz C, Ortiz-Álvarez J, Saigí-Rubió F, Conejo-Mir J, Pereyra-Rodriguez JJ. Dropout Rate in Digital Health Interventions for the Prevention of Skin Cancer: Systematic Review, Meta-analysis, and Metaregression. J Med Internet Res 2022; 24:e42397. [PMID: 36485027 PMCID: PMC9789500 DOI: 10.2196/42397] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/03/2022] [Revised: 11/10/2022] [Accepted: 11/28/2022] [Indexed: 12/13/2022] Open
Abstract
BACKGROUND Digital strategies are innovative approaches to the prevention of skin cancer, but the attrition following this kind of intervention needs to be analyzed. OBJECTIVE The aim of this paper is to assess the dropouts from studies focused on digital strategies for the prevention of skin cancer. METHODS We conducted this systematic review with meta-analyses and metaregression according to the PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) statements. Search terms for skin cancer, digital strategies, and prevention were combined to search PubMed, Scopus, Web of Science, CINAHL, and Cochrane Library from inception until July 2022. Randomized clinical trials that reported dropouts of participants and compared digital strategies with other interventions to prevent skin cancer in healthy or disease-free participants were included. Two independent reviewers extracted data for analysis. The Revised Cochrane Collaboration Bias tool was employed. We calculated the pooled dropout rate of participants through a meta-analysis of proportions and examined whether dropout was more or less frequent in digital interventions against comparators via an odds ratio (OR) meta-analysis. Data were pooled using a random-effects model. Subgroup meta-analyses were conducted in a meta-analysis of proportions and OR meta-analysis to assess the dropout events when data were sorted by digital interventions or control comparator. A univariate metaregression based on a random-effects model assessed possible moderators of dropout. Participants' dropout rates as pooled proportions were calculated for all groups combined, and the digital and comparator groups separately. OR>1 indicated higher dropouts for digital-based interventions. Metaregressions were performed for age, sex, length of intervention, and sample size. RESULTS A total of 17 studies were included. The overall pooled dropout rate was 9.5% (95% CI 5.0-17.5). The subgroup meta-analysis of proportions revealed a dropout rate of 11.6% for digital strategies (95% CI 6.8-19.0) and 10.0% for comparators (95% CI 5.5-17.7). A trend of higher dropout rates for digital strategies was observed in the overall (OR 1.16, 95% CI 0.98-1.36) and subgroup OR meta-analysis, but no significant differences were found between the groups. None of the covariates moderated the effect size in the univariate metaregression. CONCLUSIONS Digital strategies had a higher dropout rate compared to other prevention interventions, but the difference was not significant. Standardization is needed regarding reporting the number of and reasons for dropouts. TRIAL REGISTRATION International Prospective Register of Systematic Reviews (PROSPERO) CRD42022329669; https://www.crd.york.ac.uk/prospero/display_record.php?RecordID=329669.
Collapse
Affiliation(s)
| | | | - Juan Ortiz-Álvarez
- Department of Dermatology, Virgen del Rocío University Hospital, Seville, Spain
| | | | - Julián Conejo-Mir
- Department of Dermatology, Virgen del Rocío University Hospital, Seville, Spain
- Department of Medicine, University of Seville, Seville, Spain
| | - Jose-Juan Pereyra-Rodriguez
- Department of Dermatology, Virgen del Rocío University Hospital, Seville, Spain
- Department of Medicine, University of Seville, Seville, Spain
| |
Collapse
|
3
|
Price D, Jones R, Pfister P, Cao H, Carter V, Kemppinen A, Holzhauer B, Kaplan A, Clark A, Halpin DMG, Pinnock H, Chalmers JD, van Boven JFM, Beeh KM, Kostikas K, Roche N, Usmani O, Mastoridis P. Maximizing Adherence and Gaining New Information For Your Chronic Obstructive Pulmonary Disease (MAGNIFY COPD): Study Protocol for the Pragmatic, Cluster Randomized Trial Evaluating the Impact of Dual Bronchodilator with Add-On Sensor and Electronic Monitoring on Clinical Outcomes. Pragmat Obs Res 2021; 12:25-35. [PMID: 34079422 PMCID: PMC8163732 DOI: 10.2147/por.s302809] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 01/21/2021] [Accepted: 04/19/2021] [Indexed: 12/20/2022] Open
Abstract
Background Poor treatment adherence in COPD patients is associated with poor clinical outcomes and increased healthcare burden. Personalized approaches for adherence management, supported with technology-based interventions, may offer benefits to patients and providers but are currently unproven in terms of clinical outcomes as opposed to adherence outcomes. Methods Maximizing Adherence and Gaining New Information For Your COPD (MAGNIFY COPD study), a pragmatic cluster randomized trial, aims to evaluate the impact of an adherence technology package (interventional package), comprising an adherence review, ongoing provision of a dual bronchodilator but with an add-on inhaler sensor device and a connected mobile application. This will compare time to treatment failure and other clinical outcomes in patients identified at high risk of exacerbations with historic poor treatment adherence as measured by prescription collection to mono/dual therapy over one year (1312 patients) versus usual care. Treatment failure is defined as the first occurrence of one of the following: (1) moderate/severe COPD exacerbation, (2) prescription of triple therapy (inhaled corticosteroid/long-acting β2-agonist/long-acting muscarinic antagonist [ICS/LABA/LAMA]), (3) prescription of additional chronic therapy for COPD, or (4) respiratory-related death. Adherence, moderate/severe exacerbations, respiratory-related healthcare resource utilization and costs, and intervention package acceptance rate will also be assessed. Eligible primary care practices (N=176) participating in the Optimum Patient Care Quality Improvement Program will be randomized (1:1) to either adherence support cluster arm (suitable patients already receiving or initiated Ultibro® Breezhaler® [indacaterol/glycopyrronium] will be offered interventional package) or the control cluster arm (suitable patients continue to receive usual clinical care). Patients will be identified and outcomes collected from anonymized electronic medical records within the Optimum Patient Care Research Database. On study completion, electronic medical record data will be re-extracted to analyze outcomes in both study groups. Registration Number ISRCTN10567920. Conclusion MAGNIFY will explore patient benefits of technology-based interventions for electronic adherence monitoring.
Collapse
Affiliation(s)
- David Price
- Observational and Pragmatic Research Institute, Singapore, Singapore.,Centre of Academic Primary Care, Division of Applied Health Sciences, University of Aberdeen, Aberdeen, UK
| | - Rupert Jones
- Faculty of Health, University of Plymouth, Plymouth, Devon, UK
| | | | - Hui Cao
- Novartis Pharmaceuticals Corporation, East Hanover, NJ, USA
| | - Victoria Carter
- Observational and Pragmatic Research International Ltd, Stubbs House Stubbs Green, London, Norwich, UK
| | - Anu Kemppinen
- Observational and Pragmatic Research International Ltd, Stubbs House Stubbs Green, London, Norwich, UK
| | | | - Alan Kaplan
- Department of Family and Community Medicine, University of Toronto, Toronto, Ontario, Canada
| | - Allan Clark
- Norwich Medical School, University of East Anglia, Norwich, UK
| | - David M G Halpin
- University of Exeter Medical School, College of Medicine and Health, University of Exeter, Exeter, UK
| | - Hilary Pinnock
- Allergy and Respiratory Research Group, Usher Institute, University of Edinburgh, Edinburgh, UK
| | | | - Job F M van Boven
- Department of Clinical Pharmacy & Pharmacology, Groningen Research Institute for Asthma and COPD (GRIAC), University Medical Center Groningen, University of Groningen, Groningen, the Netherlands
| | - Kai M Beeh
- Clinical Research, Insaf Respiratory Research Institute, Wiesbaden, Germany
| | - Konstantinos Kostikas
- Respiratory Medicine Department, University of Ioannina School of Medicine, Ioannina, Greece
| | - Nicolas Roche
- Cochin Hospital and Institute, APHP Centre, University of Paris, Paris, France
| | - Omar Usmani
- National Heart & Lung Institute (NHLI), Imperial College London and Royal Brompton Hospital, London, UK
| | | |
Collapse
|
4
|
Bonten TN, Rauwerdink A, Wyatt JC, Kasteleyn MJ, Witkamp L, Riper H, van Gemert-Pijnen LJ, Cresswell K, Sheikh A, Schijven MP, Chavannes NH. Online Guide for Electronic Health Evaluation Approaches: Systematic Scoping Review and Concept Mapping Study. J Med Internet Res 2020. [PMID: 32784173 DOI: 10.2196/1777] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 04/06/2023] Open
Abstract
BACKGROUND Despite the increase in use and high expectations of digital health solutions, scientific evidence about the effectiveness of electronic health (eHealth) and other aspects such as usability and accuracy is lagging behind. eHealth solutions are complex interventions, which require a wide array of evaluation approaches that are capable of answering the many different questions that arise during the consecutive study phases of eHealth development and implementation. However, evaluators seem to struggle in choosing suitable evaluation approaches in relation to a specific study phase. OBJECTIVE The objective of this project was to provide a structured overview of the existing eHealth evaluation approaches, with the aim of assisting eHealth evaluators in selecting a suitable approach for evaluating their eHealth solution at a specific evaluation study phase. METHODS Three consecutive steps were followed. Step 1 was a systematic scoping review, summarizing existing eHealth evaluation approaches. Step 2 was a concept mapping study asking eHealth researchers about approaches for evaluating eHealth. In step 3, the results of step 1 and 2 were used to develop an "eHealth evaluation cycle" and subsequently compose the online "eHealth methodology guide." RESULTS The scoping review yielded 57 articles describing 50 unique evaluation approaches. The concept mapping study questioned 43 eHealth researchers, resulting in 48 unique approaches. After removing duplicates, 75 unique evaluation approaches remained. Thereafter, an "eHealth evaluation cycle" was developed, consisting of six evaluation study phases: conceptual and planning, design, development and usability, pilot (feasibility), effectiveness (impact), uptake (implementation), and all phases. Finally, the "eHealth methodology guide" was composed by assigning the 75 evaluation approaches to the specific study phases of the "eHealth evaluation cycle." CONCLUSIONS Seventy-five unique evaluation approaches were found in the literature and suggested by eHealth researchers, which served as content for the online "eHealth methodology guide." By assisting evaluators in selecting a suitable evaluation approach in relation to a specific study phase of the "eHealth evaluation cycle," the guide aims to enhance the quality, safety, and successful long-term implementation of novel eHealth solutions.
Collapse
Affiliation(s)
- Tobias N Bonten
- Department of Public Health and Primary Care, Leiden University Medical Centre, Leiden, Netherlands
- National eHealth Living Lab, Leiden, Netherlands
| | - Anneloek Rauwerdink
- Department of Surgery, Amsterdam Gastroenterology and Metabolism, Amsterdam UMC, Amsterdam, Netherlands
| | - Jeremy C Wyatt
- Wessex Institute, University of Southampton, Southampton, United Kingdom
| | - Marise J Kasteleyn
- Department of Public Health and Primary Care, Leiden University Medical Centre, Leiden, Netherlands
- National eHealth Living Lab, Leiden, Netherlands
| | - Leonard Witkamp
- Department of Medical Informatics, Amsterdam UMC, Amsterdam, Netherlands
- Ksyos Health Management Research, Amstelveen, Netherlands
| | - Heleen Riper
- Department of Clinical, Neuro and Developmental Psychology, Vrije Universiteit, Amsterdam, Netherlands
| | - Lisette Jewc van Gemert-Pijnen
- Department of Psychology, Health and Technology, Centre for eHealth and Wellbeing Research, University of Twente, Enschede, Netherlands
| | - Kathrin Cresswell
- Centre of Medical Informatics, Usher Institute, The University of Edinburgh, Medical School, Edinburgh, United Kingdom
| | - Aziz Sheikh
- Centre of Medical Informatics, Usher Institute, The University of Edinburgh, Medical School, Edinburgh, United Kingdom
| | - Marlies P Schijven
- Department of Surgery, Amsterdam Gastroenterology and Metabolism, Amsterdam UMC, Amsterdam, Netherlands
| | - Niels H Chavannes
- Department of Public Health and Primary Care, Leiden University Medical Centre, Leiden, Netherlands
- National eHealth Living Lab, Leiden, Netherlands
| |
Collapse
|
5
|
Bonten TN, Rauwerdink A, Wyatt JC, Kasteleyn MJ, Witkamp L, Riper H, van Gemert-Pijnen LJ, Cresswell K, Sheikh A, Schijven MP, Chavannes NH. Online Guide for Electronic Health Evaluation Approaches: Systematic Scoping Review and Concept Mapping Study. J Med Internet Res 2020; 22:e17774. [PMID: 32784173 PMCID: PMC7450369 DOI: 10.2196/17774] [Citation(s) in RCA: 13] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/12/2020] [Revised: 05/09/2020] [Accepted: 06/03/2020] [Indexed: 01/15/2023] Open
Abstract
BACKGROUND Despite the increase in use and high expectations of digital health solutions, scientific evidence about the effectiveness of electronic health (eHealth) and other aspects such as usability and accuracy is lagging behind. eHealth solutions are complex interventions, which require a wide array of evaluation approaches that are capable of answering the many different questions that arise during the consecutive study phases of eHealth development and implementation. However, evaluators seem to struggle in choosing suitable evaluation approaches in relation to a specific study phase. OBJECTIVE The objective of this project was to provide a structured overview of the existing eHealth evaluation approaches, with the aim of assisting eHealth evaluators in selecting a suitable approach for evaluating their eHealth solution at a specific evaluation study phase. METHODS Three consecutive steps were followed. Step 1 was a systematic scoping review, summarizing existing eHealth evaluation approaches. Step 2 was a concept mapping study asking eHealth researchers about approaches for evaluating eHealth. In step 3, the results of step 1 and 2 were used to develop an "eHealth evaluation cycle" and subsequently compose the online "eHealth methodology guide." RESULTS The scoping review yielded 57 articles describing 50 unique evaluation approaches. The concept mapping study questioned 43 eHealth researchers, resulting in 48 unique approaches. After removing duplicates, 75 unique evaluation approaches remained. Thereafter, an "eHealth evaluation cycle" was developed, consisting of six evaluation study phases: conceptual and planning, design, development and usability, pilot (feasibility), effectiveness (impact), uptake (implementation), and all phases. Finally, the "eHealth methodology guide" was composed by assigning the 75 evaluation approaches to the specific study phases of the "eHealth evaluation cycle." CONCLUSIONS Seventy-five unique evaluation approaches were found in the literature and suggested by eHealth researchers, which served as content for the online "eHealth methodology guide." By assisting evaluators in selecting a suitable evaluation approach in relation to a specific study phase of the "eHealth evaluation cycle," the guide aims to enhance the quality, safety, and successful long-term implementation of novel eHealth solutions.
Collapse
Affiliation(s)
- Tobias N Bonten
- Department of Public Health and Primary Care, Leiden University Medical Centre, Leiden, Netherlands
- National eHealth Living Lab, Leiden, Netherlands
| | - Anneloek Rauwerdink
- Department of Surgery, Amsterdam Gastroenterology and Metabolism, Amsterdam UMC, Amsterdam, Netherlands
| | - Jeremy C Wyatt
- Wessex Institute, University of Southampton, Southampton, United Kingdom
| | - Marise J Kasteleyn
- Department of Public Health and Primary Care, Leiden University Medical Centre, Leiden, Netherlands
- National eHealth Living Lab, Leiden, Netherlands
| | - Leonard Witkamp
- Department of Medical Informatics, Amsterdam UMC, Amsterdam, Netherlands
- Ksyos Health Management Research, Amstelveen, Netherlands
| | - Heleen Riper
- Department of Clinical, Neuro and Developmental Psychology, Vrije Universiteit, Amsterdam, Netherlands
| | - Lisette Jewc van Gemert-Pijnen
- Department of Psychology, Health and Technology, Centre for eHealth and Wellbeing Research, University of Twente, Enschede, Netherlands
| | - Kathrin Cresswell
- Centre of Medical Informatics, Usher Institute, The University of Edinburgh, Medical School, Edinburgh, United Kingdom
| | - Aziz Sheikh
- Centre of Medical Informatics, Usher Institute, The University of Edinburgh, Medical School, Edinburgh, United Kingdom
| | - Marlies P Schijven
- Department of Surgery, Amsterdam Gastroenterology and Metabolism, Amsterdam UMC, Amsterdam, Netherlands
| | - Niels H Chavannes
- Department of Public Health and Primary Care, Leiden University Medical Centre, Leiden, Netherlands
- National eHealth Living Lab, Leiden, Netherlands
| |
Collapse
|
6
|
Timpel P, Harst L. Research Implications for Future Telemedicine Studies and Innovations in Diabetes and Hypertension-A Mixed Methods Study. Nutrients 2020; 12:E1340. [PMID: 32397096 PMCID: PMC7284383 DOI: 10.3390/nu12051340] [Citation(s) in RCA: 12] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/07/2020] [Revised: 05/01/2020] [Accepted: 05/06/2020] [Indexed: 12/19/2022] Open
Abstract
(1) Background: The objective of this study was to identify, categorize and prioritize current implications for future research in the use telemedicine for diabetes and hypertension in order to inform policy and practice decisions. (2) Methods: An iterative mixed methods design was followed, including three consecutive steps: An updated umbrella review of telemedicine effectiveness, qualitative content analysis of extracted data on current research needs and a quantitative survey with practitioners and health care researchers in order to prioritize the identified needs. (3) Results: Overall, 32 included records reported on future research implications. Qualitative content analysis yielded five categories as well as subcategories, covering a need for high quality studies, comprehensive technology assessments, in-depth considerations of patients' characteristics, ethics and safety as well as implementation strategies. The online survey revealed that the most pressing future research needs are data security, patient safety, patient satisfaction, implementation strategies and longer follow-ups. Chi² statistics and t-tests revealed significant differences in the priorities of participants with and without experience in telemedicine use, evaluation and development. A factor analysis revealed six over-arching factors. (4) Conclusion: These results may help learning from mistakes previously made and may serve as key topics of a future telemedicine research agenda.
Collapse
Affiliation(s)
- Patrick Timpel
- Department for Prevention and Care of Diabetes, Faculty of Medicine Carl Gustav Carus, Technische Universität Dresden, 01307 Dresden, Germany
| | - Lorenz Harst
- Research Association Public Health Saxony/Center for Evidence-Based Healthcare, Faculty of Medicine Carl Gustav Carus, Technische Universität Dresden, 01307 Dresden, Germany
| |
Collapse
|
7
|
Timpel P, Oswald S, Schwarz PEH, Harst L. Mapping the Evidence on the Effectiveness of Telemedicine Interventions in Diabetes, Dyslipidemia, and Hypertension: An Umbrella Review of Systematic Reviews and Meta-Analyses. J Med Internet Res 2020; 22:e16791. [PMID: 32186516 PMCID: PMC7113804 DOI: 10.2196/16791] [Citation(s) in RCA: 122] [Impact Index Per Article: 30.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/28/2019] [Revised: 11/26/2019] [Accepted: 12/15/2019] [Indexed: 12/22/2022] Open
Abstract
Background Telemedicine is defined by three characteristics: (1) using information and communication technologies, (2) covering a geographical distance, and (3) involving professionals who deliver care directly to a patient or a group of patients. It is said to improve chronic care management and self-management in patients with chronic diseases. However, currently available guidelines for the care of patients with diabetes, hypertension, or dyslipidemia do not include evidence-based guidance on which components of telemedicine are most effective for which patient populations. Objective The primary aim of this study was to identify, synthesize, and critically appraise evidence on the effectiveness of telemedicine solutions and their components on clinical outcomes in patients with diabetes, hypertension, or dyslipidemia. Methods We conducted an umbrella review of high-level evidence, including systematic reviews and meta-analyses of randomized controlled trials. On the basis of predefined eligibility criteria, extensive automated and manual searches of the databases PubMed, EMBASE, and Cochrane Library were conducted. Two authors independently screened the studies, extracted data, and carried out the quality assessments. Extracted data were presented according to intervention components and patient characteristics using defined thresholds of clinical relevance. Overall certainty of outcomes was assessed using the Grading of Recommendations, Assessment, Development, and Evaluation (GRADE) tool. Results Overall, 3564 references were identified, of which 46 records were included after applying eligibility criteria. The majority of included studies were published after 2015. Significant and clinically relevant reduction rates for glycated hemoglobin (HbA1c; ≤−0.5%) were found in patients with diabetes. Higher reduction rates were found for recently diagnosed patients and those with higher baseline HbA1c (>8%). Telemedicine was not found to have a significant and clinically meaningful impact on blood pressure. Only reviews or meta-analyses reporting lipid outcomes in patients with diabetes were found. GRADE assessment revealed that the overall quality of the evidence was low to very low. Conclusions The results of this umbrella review indicate that telemedicine has the potential to improve clinical outcomes in patients with diabetes. Although subgroup-specific effectiveness rates favoring certain intervention and population characteristics were found, the low GRADE ratings indicate that evidence can be considered as limited. Future updates of clinical care and practice guidelines should carefully assess the methodological quality of studies and the overall certainty of subgroup-specific outcomes before recommending telemedicine interventions for certain patient populations.
Collapse
Affiliation(s)
- Patrick Timpel
- Department for Prevention and Care of Diabetes, Faculty of Medicine Carl Gustav Carus, Technische Universität Dresden, Dresden, Germany
| | - Sarah Oswald
- Master Program Health Sciences / Public Health at the Institute and Policlinic of Occupational and Social Medicine, Faculty of Medicine at the University Clinic Carl Gustav Carus, Technische Universität Dresden, Dresden, Germany
| | - Peter E H Schwarz
- Department for Prevention and Care of Diabetes, Faculty of Medicine Carl Gustav Carus, Technische Universität Dresden, Dresden, Germany.,Paul Langerhans Institute Dresden, Helmholtz Center Munich, University Hospital and Faculty of Medicine, Technische Universität Dresden, Dresden, Germany.,German Center for Diabetes Research (DZD e V), Neuherberg, Germany
| | - Lorenz Harst
- Research Association Public Health Saxony / Center for Evidence-Based Healthcare, Faculty of Medicine Carl Gustav Carus, Technische Universität Dresden, Dresden, Germany
| |
Collapse
|
8
|
Tønning ML, Kessing LV, Bardram JE, Faurholt-Jepsen M. Methodological Challenges in Randomized Controlled Trials on Smartphone-Based Treatment in Psychiatry: Systematic Review. J Med Internet Res 2019; 21:e15362. [PMID: 31663859 PMCID: PMC6914239 DOI: 10.2196/15362] [Citation(s) in RCA: 30] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/04/2019] [Revised: 08/28/2019] [Accepted: 09/04/2019] [Indexed: 01/11/2023] Open
Abstract
BACKGROUND Smartphone-based technology is developing at high speed, and many apps offer potential new ways of monitoring and treating a range of psychiatric disorders and symptoms. However, the effects of most available apps have not been scientifically investigated. Within medicine, randomized controlled trials (RCTs) are the standard method for providing the evidence of effects. However, their rigidity and long time frame may contrast with the field of information technology research. Therefore, a systematic review of methodological challenges in designing and conducting RCTs within mobile health is needed. OBJECTIVE This systematic review aimed to (1) identify and describe RCTs investigating the effect of smartphone-based treatment in adult patients with a psychiatric diagnosis, (2) discuss methodological challenges in designing and conducting individual trials, and (3) suggest recommendations for future trials. METHODS A systematic search in English was conducted in PubMed, PsycINFO, and EMBASE up to August 12, 2019. The search terms were (1) psychiatric disorders in broad term and for specific disorders AND (2) smartphone or app AND (3) RCT. The Consolidated Standards of Reporting Trials electronic health guidelines were used as a template for data extraction. The focus was on trial design, method, and reporting. Only trials having sufficient information on diagnosis and acceptable diagnostic procedures, having a smartphone as a central part of treatment, and using an RCT design were included. RESULTS A total of 27 trials comprising 3312 patients within a range of psychiatric diagnoses were included. Among them, 2 trials were concerning drug or alcohol abuse, 3 psychosis, 10 affective disorders, 9 anxiety and posttraumatic stress disorder, 1 eating disorder, and 1 attention-deficit/hyperactivity disorder. In addition, 1 trial used a cross-diagnostic design, 7 trials included patients with a clinical diagnosis that was subsequently assessed and validated by the researchers, and 11 trials had a sample size above 100. Generally, large between-trial heterogeneity and multiple approaches to patient recruitment, diagnostic procedures, trial design, comparator, outcome measures, and analyses were identified. Only 5 trials published a trial protocol. Furthermore, 1 trial provided information regarding technological updates, and only 18 trials reported on the conflicts of interest. No trial addressed the ethical aspects of using smartphones in treatment. CONCLUSIONS This first systematic review of the methodological challenges in designing and conducting RCTs investigating smartphone-based treatment in psychiatric patients suggests an increasing number of trials but with a lower quality compared with classic medical RCTs. Heterogeneity and methodological issues in individual trials limit the evidence. Methodological recommendations are presented.
Collapse
Affiliation(s)
- Morten Lindbjerg Tønning
- Copenhagen Affective Disorder Research Center, Psychiatric Center Copenhagen, Rigshospitalet, University Hospital of Copenhagen, Copenhagen, Denmark
| | - Lars Vedel Kessing
- Copenhagen Affective Disorder Research Center, Psychiatric Center Copenhagen, Rigshospitalet, University Hospital of Copenhagen, Copenhagen, Denmark
| | - Jakob Eivind Bardram
- Department of Health Technology, Technical University of Denmark, Lyngby, Denmark
| | - Maria Faurholt-Jepsen
- Copenhagen Affective Disorder Research Center, Psychiatric Center Copenhagen, Rigshospitalet, University Hospital of Copenhagen, Copenhagen, Denmark
| |
Collapse
|
9
|
Assessment of Health Information Technology Interventions in Evidence-Based Medicine: A Systematic Review by Adopting a Methodological Evaluation Framework. Healthcare (Basel) 2018; 6:healthcare6030109. [PMID: 30200307 PMCID: PMC6165327 DOI: 10.3390/healthcare6030109] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/10/2018] [Revised: 08/15/2018] [Accepted: 08/28/2018] [Indexed: 11/17/2022] Open
Abstract
BACKGROUND The application of Health Information Technologies (HITs) can be an effective way to advance medical research and health services provision. The two-fold objective of this work is to: (i) identify and review state-of-the-art HITs that facilitate the aims of evidence-based medicine and (ii) propose a methodology for HIT assessment. METHODS The systematic review was conducted according to the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines. Furthermore, we consolidated existing knowledge in the field and proposed a Synthesis Framework for the Assessment of Health Information Technology (SF/HIT) in order to evaluate the joint use of Randomized Controlled Trials (RCTs) along with HITs in the field of evidence-based medicine. RESULTS 55 articles met the inclusion criteria and refer to 51 (RCTs) published between 2008 and 2016. Significant improvements in healthcare through the use of HITs were observed in the findings of 31 out of 51 trials-60.8%. We also confirmed that RCTs are valuable tools for assessing the effectiveness, acceptability, safety, privacy, appropriateness, satisfaction, performance, usefulness and adherence. CONCLUSIONS To improve health service delivery, RCTs apply and exhibit formalization by providing measurable outputs. Towards this direction, we propose the SF/HIT as a framework which may help researchers to carry out appropriate evaluations and extend their studies.
Collapse
|
10
|
Christopoulou SC, Kotsilieris T, Anagnostopoulos I. Evidence-based health and clinical informatics: a systematic review on randomized controlled trials. HEALTH AND TECHNOLOGY 2018. [DOI: 10.1007/s12553-016-0170-2] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/30/2022]
|
11
|
Lu JF, Chen CM, Hsu CY. Effect of home telehealth care on blood pressure control: A public healthcare centre model. J Telemed Telecare 2017; 25:35-45. [PMID: 29041841 DOI: 10.1177/1357633x17734258] [Citation(s) in RCA: 14] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/01/2023]
Abstract
OBJECTIVE This study aimed to evaluate the effectiveness of home telehealth care combined with case management by public health nurses, in improving blood pressure control in patients with hypertension. METHODS This cohort study examined the data of patients with hypertension obtained from a telehealth service centre database, between July 2011- June 2012. Eligible patients were adults (≥40 years old) with both prehypertension and hypertension, living alone or in the remote suburbs of metropolitan areas. Demographic data were collected from 12 district public health centre in Taipei, Taiwan. Following enrolment, patients received an appropriate and validated home telehealth device kit for automatic blood pressure monitoring and automated modem via a telephone line or a desktop computer with Internet connection to enable data transmission between the patient's home and telehealth service centre. Patients were instructed to upload the measured data immediately every day. The study outcomes included blood pressure and home telehealth service utilisation. RESULTS Of the 432 patients recruited, 408 (94%) completed data collection. Linear regression analysis found an average 22.1 mm Hg reduction in systolic blood pressure after one year. The mean slope of systolic blood pressure was classified as decreased or non-decreased. An systolic blood pressure decreasing trend was observed in 52.2% patients, while 47.8% patients showed an increasing systolic blood pressure trend. Patients in the decreased systolic blood pressure group tended to be older ( p = 0. 0001), with a greater proportion of hypertension alarms ( p = 0. 001), improved self-blood pressure monitoring behaviour ( p = 0.009) and higher self-measured blood pressure monitoring frequency ( p = 0. 010). Patients in the decreased systolic blood pressure group had a higher self-measured blood pressure monitoring frequency (odds ratio = 0.95, 95% confidence interval, 0.91-0.99, p = 0. 013) than their counterparts. CONCLUSIONS Home telehealth care combined with care management by public health nurses based in public health care centre was feasible and effective for improving blood pressure control among patients with hypertension. Further studies should conduct a thorough analysis of the cost-effectiveness of this intervention. A randomised controlled trial with a longer follow-up period is required to examine the effects of the improved home telehealth device kit on the care of patients with hypertension.
Collapse
Affiliation(s)
- Ju-Fen Lu
- 1 Department of Nursing and Geriatric Health Promotin, Jen-Te Junior College of Medicine, Nursing and Management, Taiwan
| | - Ching-Min Chen
- 2 Department of Nursing, College of Medicine, National Cheng Kung University, Taiwan
| | - Chien-Yeh Hsu
- 3 Department of Information Management, National Taipei University of Nursing and Health Sciences, and Master Program in Global Health and Development, College of Public Health, Taipei Medical University, Taiwan
| |
Collapse
|
12
|
A systematic review of the methodologies used to evaluate telemedicine service initiatives in hospital facilities. Int J Med Inform 2016; 97:171-194. [PMID: 27919377 DOI: 10.1016/j.ijmedinf.2016.10.012] [Citation(s) in RCA: 79] [Impact Index Per Article: 9.9] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/17/2015] [Revised: 09/30/2016] [Accepted: 10/12/2016] [Indexed: 12/17/2022]
Abstract
BACKGROUND The adoption of telemedicine into mainstream health services has been slower than expected. Many telemedicine projects tend not to progress beyond the trial phase; there are a large number of pilot or project publications and fewer 'service' publications. This issue has been noted since 1999 and continues to be acknowledged in the literature. While overall telemedicine uptake has been slow, some services have been successful. The reporting and evaluation of these successful services may help to improve future uptake and sustainability. The aim of this literature review was to identify peer-reviewed publications of deployed telemedicine services in hospital facilities; and to report, and appraise, the methodology used to evaluate these services. METHODS Computerised literature searches of bibliographic databases were performed using the MeSH terms for "Telemedicine" and "Hospital Services" or "Hospital", for papers published up to May 2016. RESULTS A total of 164 papers were identified, representing 137 telemedicine services. The majority of reported telemedicine services were based in the United States of America (n=61, 44.5%). Almost two thirds of the services (n=86, 62.7%) were delivered by real time telemedicine. Of the reviewed studies, almost half (n=81, 49.3%) assessed their services from three different evaluation perspectives: clinical outcomes, economics and satisfaction. While the remaining half (n=83, 50.6%) described their service and its activities without reporting any evaluation measures. Only 30 (18.2%) studies indicated a two-step implementation and evaluation process. There was limited information in all reported studies regarding description of a structured planning strategy. CONCLUSION Our systematic review identified only 137 telemedicine services. This suggests either telemedicine service implementation is still not a part of mainstream clinical services, or it is not being reported in the peer-reviewed literature. The depth and the quality of information were variable across studies, reducing the generalisability. The reporting of service implementation and planning strategies should be encouraged. Given the fast paced technology driven environment of telemedicine, this may enable others to learn and understand how to implement sustainable services. The key component of planning was underreported in these studies. Studies applying and reporting more rigorous methodology would contribute greatly to the evidence for telemedicine.
Collapse
|
13
|
Jongstra S, Beishuizen C, Andrieu S, Barbera M, van Dorp M, van de Groep B, Guillemont J, Mangialasche F, van Middelaar T, Moll van Charante E, Soininen H, Kivipelto M, Richard E. Development and Validation of an Interactive Internet Platform for Older People: The Healthy Ageing Through Internet Counselling in the Elderly Study. Telemed J E Health 2016; 23:96-104. [PMID: 27463120 DOI: 10.1089/tmj.2016.0066] [Citation(s) in RCA: 33] [Impact Index Per Article: 4.1] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/14/2023] Open
Abstract
BACKGROUND A myriad of Web-based applications on self-management have been developed, but few focus on older people. In the face of global aging, older people form an important target population for cardiovascular prevention. This article describes the full development of an interactive Internet platform for older people, which was designed for the Healthy Ageing Through Internet Counselling in the Elderly (HATICE) study. We provide recommendations to design senior-friendly Web-based applications for a new approach to multicomponent cardiovascular prevention. METHODS The development of the platform followed five phases: (1) conceptual framework; (2) platform concept and functional design; (3) platform building (software and content); (4) testing and pilot study; and (5) final product. RESULTS We performed a meta-analysis, reviewed guidelines for cardiovascular diseases, and consulted end users, experts, and software developers to create the platform concept and content. The software was built in iterative cycles. In the pilot study, 41 people aged ≥65 years used the platform for 8 weeks. Participants used the interactive features of the platform and appreciated the coach support. During all phases adjustments were made to incorporate all improvements from the previous phases. The final platform is a personal, secured, and interactive platform supported by a coach. DISCUSSION When carefully designed, an interactive Internet platform is acceptable and feasible for use by older people with basic computer skills. To improve acceptability by older people, we recommend involving the end users in the process of development, to personalize the platform and to combine the application with human support. The interactive HATICE platform will be tested for efficacy in a multinational randomized controlled trial (ISRCTN48151589).
Collapse
Affiliation(s)
- Susan Jongstra
- 1 Department of Neurology, Academic Medical Center, University of Amsterdam , Amsterdam, The Netherlands
| | - Cathrien Beishuizen
- 1 Department of Neurology, Academic Medical Center, University of Amsterdam , Amsterdam, The Netherlands
| | - Sandrine Andrieu
- 2 INSERM, University of Toulouse , Toulouse, France .,3 Department of Epidemiology and Public Health, Toulouse University Hospital , Toulouse, France
| | - Mariagnese Barbera
- 4 Institute of Clinical Medicine/Neurology, University of Eastern Finland , Kuopio, Finland
| | | | | | | | - Francesca Mangialasche
- 6 Ageing Research Center, Karolinska Institutet/Stockholm University , Stockholm, Sweden
| | - Tessa van Middelaar
- 1 Department of Neurology, Academic Medical Center, University of Amsterdam , Amsterdam, The Netherlands .,7 Department of Neurology, Radboud University Medical Center , Nijmegen, The Netherlands
| | - Eric Moll van Charante
- 8 Department of General Practice, Academic Medical Centre, University of Amsterdam , Amsterdam, The Netherlands
| | - Hilkka Soininen
- 4 Institute of Clinical Medicine/Neurology, University of Eastern Finland , Kuopio, Finland
| | - Miia Kivipelto
- 4 Institute of Clinical Medicine/Neurology, University of Eastern Finland , Kuopio, Finland .,6 Ageing Research Center, Karolinska Institutet/Stockholm University , Stockholm, Sweden .,9 Chronic Disease Prevention Unit, National Institute for Health and Welfare , Helsinki, Finland
| | - Edo Richard
- 1 Department of Neurology, Academic Medical Center, University of Amsterdam , Amsterdam, The Netherlands .,7 Department of Neurology, Radboud University Medical Center , Nijmegen, The Netherlands
| |
Collapse
|
14
|
Jacobs MA, Graham AL. Iterative development and evaluation methods of mHealth behavior change interventions. Curr Opin Psychol 2016. [DOI: 10.1016/j.copsyc.2015.09.001] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/22/2022]
|
15
|
Law LM, Edirisinghe N, Wason JMS. Use of an embedded, micro-randomised trial to investigate non-compliance in telehealth interventions. Clin Trials 2016; 13:417-24. [DOI: 10.1177/1740774516637075] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/17/2022]
Abstract
Background/aims: Many types of telehealth interventions rely on activity from the patient in order to have a beneficial effect on their outcome. Remote monitoring systems require the patient to record regular measurements at home, for example, blood pressure, so clinicians can see whether the patient’s health changes over time and intervene if necessary. A big problem in this type of intervention is non-compliance. Most telehealth trials report compliance rates, but they rarely compare compliance among various options of telehealth delivery, of which there may be many. Optimising telehealth delivery is vital for improving compliance and, therefore, clinical outcomes. We propose a trial design which investigates ways of improving compliance. For efficiency, this trial is embedded in a larger trial for evaluating clinical effectiveness. It employs a technique called micro-randomisation, where individual patients are randomised multiple times throughout the study. The aims of this article are (1) to verify whether the presence of an embedded secondary trial still allows valid analysis of the primary research and (2) to demonstrate the usefulness of the micro-randomisation technique for comparing compliance interventions. Methods: Simulation studies were used to simulate a large number of clinical trials, in which no embedded trial was used, a micro-randomised embedded trial was used, and a factorial embedded trial was used. Each simulation recorded the operating characteristics of the primary and secondary trials. Results: We show that the type I error rate of the primary analysis was not affected by the presence of an embedded secondary trial. Furthermore, we show that micro-randomisation is superior to a factorial design as it reduces the variation caused by within-patient correlation. It therefore requires smaller sample sizes – our simulations showed a requirement of 128 patients for a micro-randomised trial versus 760 patients for a factorial design, in the presence of within-patient correlation. Conclusion: We believe that an embedded, micro-randomised trial is a feasible technique that can potentially be highly useful in telehealth trials.
Collapse
Affiliation(s)
- Lisa M Law
- MRC Biostatistics Unit Hub for Trials Methodology Research, Cambridge, UK
| | | | - James MS Wason
- MRC Biostatistics Unit Hub for Trials Methodology Research, Cambridge, UK
| |
Collapse
|
16
|
Taylor J, Coates E, Wessels B, Mountain G, Hawley MS. Implementing solutions to improve and expand telehealth adoption: participatory action research in four community healthcare settings. BMC Health Serv Res 2015; 15:529. [PMID: 26626564 PMCID: PMC4666096 DOI: 10.1186/s12913-015-1195-3] [Citation(s) in RCA: 27] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/07/2015] [Accepted: 11/23/2015] [Indexed: 01/26/2023] Open
Abstract
Background Adoption of telehealth has been slower than anticipated, and little is known about the service improvements that help to embed telehealth into routine practice or the role of frontline staff in improving adoption. This paper reports on participatory action research carried out in four community health settings using telehealth for patients with Chronic Obstructive Pulmonary Disease and Chronic Heart Failure. Methods To inform the action research, in-depth case studies of each telehealth service were conducted (May 2012–June 2013). Each service was then supported by researchers through two cycles of action research to implement changes to increase adoption of telehealth, completed over a seven month period (July 2013–April 2014). The action research was studied via observation of multi-stakeholder workshops, analysis of implementation plans, and focus groups. Results Action research participants included 57 staff and one patient, with between eight and 20 participants per site. The case study findings were identified as a key source of information for planning change, with sites addressing common challenges identified through this work. For example, refining referral criteria; standardizing how and when patients are monitored; improving data sharing; and establishing evaluation processes. Sites also focused on raising awareness of telehealth to increase adoption in other clinical teams and to help secure future financial investment for telehealth, which was required because of short-term funding arrangements. Specific solutions varied due to local infrastructures, resources, and opinion, as well as previous service developments. Local telehealth champions played an important role in engaging multiple stakeholders in the study. Conclusions Action research enabled services to make planned changes to telehealth and share learning across multiple stakeholders about how and when to use telehealth. However, adoption was impeded by continual changes affecting telehealth and wider service provision, which also hindered implementation efforts and affected motivation of staff to engage with the action research, particularly where local decision-makers were not engaged in the study. Wider technological barriers also limited the potential for change, as did uncertainties about goals for telehealth investment, thereby making it difficult to identify outcomes for demonstrating the added value over existing practice.
Collapse
Affiliation(s)
- Johanna Taylor
- Department of Health Sciences, University of York, Area 4, 2nd Floor, ARRC Building, Heslington, York, YO10 5DD, UK. .,School of Health and Related Research, University of Sheffield, Regent Court, 30 Regent Street, Sheffield, S1 4DA, UK.
| | - Elizabeth Coates
- School of Health and Related Research, University of Sheffield, Regent Court, 30 Regent Street, Sheffield, S1 4DA, UK.
| | - Bridgette Wessels
- Department of Sociological Studies, University of Sheffield, Elmfield, Northumberland Road, Sheffield, S10 2TU, UK.
| | - Gail Mountain
- School of Health and Related Research, University of Sheffield, Regent Court, 30 Regent Street, Sheffield, S1 4DA, UK.
| | - Mark S Hawley
- School of Health and Related Research, University of Sheffield, Regent Court, 30 Regent Street, Sheffield, S1 4DA, UK.
| |
Collapse
|