1
|
Moorthy P, Weinert L, Schüttler C, Svensson L, Sedlmayr B, Müller J, Nagel T. Attributes, Methods, and Frameworks Used to Evaluate Wearables and Their Companion mHealth Apps: Scoping Review. JMIR Mhealth Uhealth 2024; 12:e52179. [PMID: 38578671 PMCID: PMC11031706 DOI: 10.2196/52179] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/25/2023] [Revised: 12/15/2023] [Accepted: 02/01/2024] [Indexed: 04/06/2024] Open
Abstract
BACKGROUND Wearable devices, mobile technologies, and their combination have been accepted into clinical use to better assess the physical fitness and quality of life of patients and as preventive measures. Usability is pivotal for overcoming constraints and gaining users' acceptance of technology such as wearables and their companion mobile health (mHealth) apps. However, owing to limitations in design and evaluation, interactive wearables and mHealth apps have often been restricted from their full potential. OBJECTIVE This study aims to identify studies that have incorporated wearable devices and determine their frequency of use in conjunction with mHealth apps or their combination. Specifically, this study aims to understand the attributes and evaluation techniques used to evaluate usability in the health care domain for these technologies and their combinations. METHODS We conducted an extensive search across 4 electronic databases, spanning the last 30 years up to December 2021. Studies including the keywords "wearable devices," "mobile apps," "mHealth apps," "physiological data," "usability," "user experience," and "user evaluation" were considered for inclusion. A team of 5 reviewers screened the collected publications and charted the features based on the research questions. Subsequently, we categorized these characteristics following existing usability and wearable taxonomies. We applied a methodological framework for scoping reviews and the PRISMA-ScR (Preferred Reporting Items for Systematic Reviews and Meta-Analyses extension for Scoping Reviews) checklist. RESULTS A total of 382 reports were identified from the search strategy, and 68 articles were included. Most of the studies (57/68, 84%) involved the simultaneous use of wearables and connected mobile apps. Wrist-worn commercial consumer devices such as wristbands were the most prevalent, accounting for 66% (45/68) of the wearables identified in our review. Approximately half of the data from the medical domain (32/68, 47%) focused on studies involving participants with chronic illnesses or disorders. Overall, 29 usability attributes were identified, and 5 attributes were frequently used for evaluation: satisfaction (34/68, 50%), ease of use (27/68, 40%), user experience (16/68, 24%), perceived usefulness (18/68, 26%), and effectiveness (15/68, 22%). Only 10% (7/68) of the studies used a user- or human-centered design paradigm for usability evaluation. CONCLUSIONS Our scoping review identified the types and categories of wearable devices and mHealth apps, their frequency of use in studies, and their implementation in the medical context. In addition, we examined the usability evaluation of these technologies: methods, attributes, and frameworks. Within the array of available wearables and mHealth apps, health care providers encounter the challenge of selecting devices and companion apps that are effective, user-friendly, and compatible with user interactions. The current gap in usability and user experience in health care research limits our understanding of the strengths and limitations of wearable technologies and their companion apps. Additional research is necessary to overcome these limitations.
Collapse
Affiliation(s)
- Preetha Moorthy
- Department of Biomedical Informatics, Center for Preventive Medicine and Digital Health, Medical Faculty Mannheim, Heidelberg University, Mannheim, Germany
| | - Lina Weinert
- Institute of Medical Informatics, Heidelberg University Hospital, Heidelberg, Germany
- Section for Oral Health, Heidelberg Institute of Global Health, Heidelberg University Hospital, Heidelberg, Germany
| | - Christina Schüttler
- Medical Center for Information and Communication Technology, University Hospital Erlangen, Erlangen, Germany
| | - Laura Svensson
- Institute of Medical Informatics, Heidelberg University Hospital, Heidelberg, Germany
| | - Brita Sedlmayr
- Institute for Medical Informatics and Biometry, Carl Gustav Carus Faculty of Medicine, Technische Universität Dresden, Dresden, Germany
| | - Julia Müller
- Institute of Medical Informatics, Heidelberg University Hospital, Heidelberg, Germany
| | - Till Nagel
- Human Data Interaction Lab, Mannheim University of Applied Sciences, Mannheim, Germany
| |
Collapse
|
2
|
Bienzeisler J, Perez-Garriga A, Brandl LC, Kock-Schoppenhauer AK, Hollenbenders Y, Kurscheidt M, Schüttler C. Report from the 68th GMDS Annual Meeting: Science. Close to People. Methods Inf Med 2023; 62:202-205. [PMID: 38377987 DOI: 10.1055/s-0043-1777733] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/22/2024]
Affiliation(s)
- Jonas Bienzeisler
- Institute of Medical Informatics Medical Faculty of RWTH Aachen University, Aachen
| | | | - Lea C Brandl
- Institute of Telematics, University of Lübeck, Lübeck, Germany
| | | | - Yasmin Hollenbenders
- Center for Machine Learning, Heilbronn University of Applied Science, Heilbronn, Germany
| | | | - Christina Schüttler
- Medical Center for Information and Communication Technology, University Hospital Erlangen, Erlangen, Germany
| |
Collapse
|
3
|
Wolfien M, Ahmadi N, Fitzer K, Grummt S, Heine KL, Jung IC, Krefting D, Kühn A, Peng Y, Reinecke I, Scheel J, Schmidt T, Schmücker P, Schüttler C, Waltemath D, Zoch M, Sedlmayr M. Ten Topics to Get Started in Medical Informatics Research. J Med Internet Res 2023; 25:e45948. [PMID: 37486754 PMCID: PMC10407648 DOI: 10.2196/45948] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/23/2023] [Revised: 03/29/2023] [Accepted: 04/11/2023] [Indexed: 07/25/2023] Open
Abstract
The vast and heterogeneous data being constantly generated in clinics can provide great wealth for patients and research alike. The quickly evolving field of medical informatics research has contributed numerous concepts, algorithms, and standards to facilitate this development. However, these difficult relationships, complex terminologies, and multiple implementations can present obstacles for people who want to get active in the field. With a particular focus on medical informatics research conducted in Germany, we present in our Viewpoint a set of 10 important topics to improve the overall interdisciplinary communication between different stakeholders (eg, physicians, computational experts, experimentalists, students, patient representatives). This may lower the barriers to entry and offer a starting point for collaborations at different levels. The suggested topics are briefly introduced, then general best practice guidance is given, and further resources for in-depth reading or hands-on tutorials are recommended. In addition, the topics are set to cover current aspects and open research gaps of the medical informatics domain, including data regulations and concepts; data harmonization and processing; and data evaluation, visualization, and dissemination. In addition, we give an example on how these topics can be integrated in a medical informatics curriculum for higher education. By recognizing these topics, readers will be able to (1) set clinical and research data into the context of medical informatics, understanding what is possible to achieve with data or how data should be handled in terms of data privacy and storage; (2) distinguish current interoperability standards and obtain first insights into the processes leading to effective data transfer and analysis; and (3) value the use of newly developed technical approaches to utilize the full potential of clinical data.
Collapse
Affiliation(s)
- Markus Wolfien
- Institute for Medical Informatics and Biometry, Faculty of Medicine Carl Gustav Carus, Technische Universität Dresden, Dresden, Germany
- Center for Scalable Data Analytics and Artificial Intelligence, Dresden, Germany
| | - Najia Ahmadi
- Institute for Medical Informatics and Biometry, Faculty of Medicine Carl Gustav Carus, Technische Universität Dresden, Dresden, Germany
| | - Kai Fitzer
- Core Unit Data Integration Center, University Medicine Greifswald, Greifswald, Germany
| | - Sophia Grummt
- Institute for Medical Informatics and Biometry, Faculty of Medicine Carl Gustav Carus, Technische Universität Dresden, Dresden, Germany
| | - Kilian-Ludwig Heine
- Institute for Medical Informatics and Biometry, Faculty of Medicine Carl Gustav Carus, Technische Universität Dresden, Dresden, Germany
| | - Ian-C Jung
- Institute for Medical Informatics and Biometry, Faculty of Medicine Carl Gustav Carus, Technische Universität Dresden, Dresden, Germany
| | - Dagmar Krefting
- Department of Medical Informatics, University Medical Center, Goettingen, Germany
| | - Andreas Kühn
- Institute for Medical Informatics and Biometry, Faculty of Medicine Carl Gustav Carus, Technische Universität Dresden, Dresden, Germany
| | - Yuan Peng
- Institute for Medical Informatics and Biometry, Faculty of Medicine Carl Gustav Carus, Technische Universität Dresden, Dresden, Germany
| | - Ines Reinecke
- Institute for Medical Informatics and Biometry, Faculty of Medicine Carl Gustav Carus, Technische Universität Dresden, Dresden, Germany
| | - Julia Scheel
- Department of Systems Biology and Bioinformatics, University of Rostock, Rostock, Germany
| | - Tobias Schmidt
- Institute for Medical Informatics, University of Applied Sciences Mannheim, Mannheim, Germany
| | - Paul Schmücker
- Institute for Medical Informatics, University of Applied Sciences Mannheim, Mannheim, Germany
| | - Christina Schüttler
- Central Biobank Erlangen, University Hospital Erlangen, Friedrich-Alexander-Universität Erlangen-Nürnberg, Erlangen, Germany
| | - Dagmar Waltemath
- Core Unit Data Integration Center, University Medicine Greifswald, Greifswald, Germany
- Department of Medical Informatics, University Medicine Greifswald, Greifswald, Germany
| | - Michele Zoch
- Institute for Medical Informatics and Biometry, Faculty of Medicine Carl Gustav Carus, Technische Universität Dresden, Dresden, Germany
| | - Martin Sedlmayr
- Institute for Medical Informatics and Biometry, Faculty of Medicine Carl Gustav Carus, Technische Universität Dresden, Dresden, Germany
- Center for Scalable Data Analytics and Artificial Intelligence, Dresden, Germany
| |
Collapse
|
4
|
Schüttler C, Ulrich H. Support of Young Talent in the GMDS. Stud Health Technol Inform 2023; 302:484-485. [PMID: 37203726 DOI: 10.3233/shti230182] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 05/20/2023]
Abstract
The German Association for Medical Informatics, Biometry and Epidemiology (GMDS) aims to develop subject-specific methods, which are then to be applied in collaboration with various medical domains. Furthermore, the support of young scientists is an essential field of activity of the GMDS, since the need for junior staff has increased due to the acceleration in medical digitization. A specially established Presidential Commission strives to promote young talents and scientists in the above-mentioned disciplines. For this purpose, various strategies and concepts are elaborated in regular meetings and finally implemented. These include online formats such as a lecture series on research-related topics, as well as events such as summer schools and PhD symposia.
Collapse
Affiliation(s)
| | - Hannes Ulrich
- Institute for Medical Informatics and Statistics, Kiel University and University Hospital Schleswig-Holstein, Germany
| |
Collapse
|
5
|
Schüttler C, Zerlik M, Gruendner J, Köhler T, Rosenau L, Prokosch HU, Sedlmayr B. Empowering researchers to query medical data and biospecimens by ensuring appropriate usability: Evaluation study of the ABIDE_MI feasibility tool (Preprint). JMIR Hum Factors 2022; 10:e43782. [PMID: 37074765 PMCID: PMC10157450 DOI: 10.2196/43782] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/24/2022] [Revised: 02/10/2023] [Accepted: 02/26/2023] [Indexed: 03/01/2023] Open
Abstract
BACKGROUND The Aligning Biobanking and Data Integration Centers Efficiently project aims to harmonize technologies and governance structures of German university hospitals and their biobanks to facilitate searching for patient data and biospecimens. The central element will be a feasibility tool for researchers to query the availability of samples and data to determine the feasibility of their study project. OBJECTIVE The objectives of the study were as follows: an evaluation of the overall user interface usability of the feasibility tool, the identification of critical usability issues, comprehensibility of the underlying ontology operability, and analysis of user feedback on additional functionalities. From these, recommendations for quality-of-use optimization, focusing on more intuitive usability, were derived. METHODS To achieve the study goal, an exploratory usability test consisting of 2 main parts was conducted. In the first part, the thinking aloud method (test participants express their thoughts aloud throughout their use of the tool) was complemented by a quantitative questionnaire. In the second part, the interview method was combined with supplementary mock-ups to collect users' opinions on possible additional features. RESULTS The study cohort rated global usability of the feasibility tool based on the System Usability Scale with a good score of 81.25. The tasks assigned posed certain challenges. No participant was able to solve all tasks correctly. A detailed analysis showed that this was mostly because of minor issues. This impression was confirmed by the recorded statements, which described the tool as intuitive and user friendly. The feedback also provided useful insights regarding which critical usability problems occur and need to be addressed promptly. CONCLUSIONS The findings indicate that the prototype of the Aligning Biobanking and Data Integration Centers Efficiently feasibility tool is headed in the right direction. Nevertheless, we see potential for optimization primarily in the display of the search functions, the unambiguous distinguishability of criteria, and the visibility of their associated classification system. Overall, it can be stated that the combination of different tools used to evaluate the feasibility tool provided a comprehensive picture of its usability.
Collapse
Affiliation(s)
| | - Maria Zerlik
- Institute for Medical Informatics and Biometry, Carl Gustav Carus Faculty of Medicine, Technische Universität Dresden, Dresden, Germany
| | - Julian Gruendner
- Chair of Medical Informatics, Friedrich-Alexander-Universität Erlangen-Nürnberg, Erlangen, Germany
| | - Thomas Köhler
- Federated Information Systems, German Cancer Research Center, Heidelberg, Germany
- Complex Data Processing in Medical Informatics, Medical Faculty Mannheim, Mannheim, Germany
| | - Lorenz Rosenau
- IT Center for Clinical Research, University of Lübeck, Lübeck, Germany
| | - Hans-Ulrich Prokosch
- Chair of Medical Informatics, Friedrich-Alexander-Universität Erlangen-Nürnberg, Erlangen, Germany
| | - Brita Sedlmayr
- Institute for Medical Informatics and Biometry, Carl Gustav Carus Faculty of Medicine, Technische Universität Dresden, Dresden, Germany
| |
Collapse
|
6
|
Schüttler C, Jahns R, Prokosch U, Wach S, Wullich B. [Biobanks, translational research and medical informatics]. Urologie 2022; 61:722-727. [PMID: 35925243 DOI: 10.1007/s00120-022-01850-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Accepted: 05/04/2022] [Indexed: 06/15/2023]
Abstract
When we think of medical research, one intuitively associates it with the analysis of study data collected for a specific research question or with the secondary use of patient data from routine care. However, these are not the only sources for answering scientific questions. Especially for translational research, tissue and liquid samples such as blood, DNA or other body fluids provide essential insights into disease pathogenesis, development of new therapies and treatment decisions. Access to these biomedical materials is provided by so-called biobanks. By collecting, characterizing, documenting and, if necessary, processing human biospecimens in accordance with high quality standards, they can support research of the causes of diseases, early diagnosis and the targeted treatment of diseases, or make a significant contribution to the investigation of common diseases.
Collapse
Affiliation(s)
- C Schüttler
- Central Biobank Erlangen (CeBE), Universitätsklinikum Erlangen und Medizinische Fakultät, Friedrich-Alexander-Universität Erlangen-Nürnberg, Erlangen, Deutschland
| | - R Jahns
- Interdisziplinäre Biomaterial- und Datenbank der Medizinischen Fakultät Würzburg, Universitätsklinikum Würzburg, Würzburg, Deutschland
| | - U Prokosch
- Lehrstuhl für Medizinische Informatik, Friedrich-Alexander-Universität Erlangen-Nürnberg, Erlangen, Deutschland
| | - S Wach
- Urologische und Kinderurologische Klinik, Universitätsklinikum Erlangen, Erlangen, Deutschland
| | - B Wullich
- Central Biobank Erlangen (CeBE), Universitätsklinikum Erlangen und Medizinische Fakultät, Friedrich-Alexander-Universität Erlangen-Nürnberg, Erlangen, Deutschland.
- Urologische und Kinderurologische Klinik, Universitätsklinikum Erlangen, Erlangen, Deutschland.
| |
Collapse
|
7
|
Holzner D, Apfelbacher T, Rödle W, Schüttler C, Prokosch HU, Mikolajczyk R, Negash S, Kartschmit N, Manuilova I, Buch C, Gundlack J, Christoph J. Attitudes and Acceptance Towards Artificial Intelligence in Medical Care. Stud Health Technol Inform 2022; 294:68-72. [PMID: 35612018 DOI: 10.3233/shti220398] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/15/2022]
Abstract
BACKGROUND Artificial intelligence (AI) in medicine is a very topical issue. As far as the attitudes and perspectives of the different stakeholders in healthcare are concerned, there is still much to be explored. OBJECTIVE Our aim was to determine attitudes and aspects towards acceptance of AI applications from the perspective of physicians in university hospitals. METHODS We conducted individual exploratory expert interviews. Low fidelity mockups were used to show interviewees potential application areas of AI in clinical care. RESULTS In principle, physicians are open to the use of AI in medical care. However, they are critical of some aspects such as data protection or the lack of explainability of the systems. CONCLUSION Although some trends in attitudes e.g., on the challenges or benefits of using AI became clear, it is necessary to conduct further research as intended by the subsequent PEAK project.
Collapse
Affiliation(s)
- Dana Holzner
- Department of Medical Informatics, Friedrich-Alexander-Universität Erlangen-Nürnberg, Erlangen, Germany
| | - Timo Apfelbacher
- Department of Medical Informatics, Friedrich-Alexander-Universität Erlangen-Nürnberg, Erlangen, Germany
| | - Wolfgang Rödle
- Department of Medical Informatics, Friedrich-Alexander-Universität Erlangen-Nürnberg, Erlangen, Germany
| | - Christina Schüttler
- Department of Medical Informatics, Friedrich-Alexander-Universität Erlangen-Nürnberg, Erlangen, Germany
| | - Hans-Ulrich Prokosch
- Department of Medical Informatics, Friedrich-Alexander-Universität Erlangen-Nürnberg, Erlangen, Germany
| | - Rafael Mikolajczyk
- Institute for Medical Epidemiology, Biometrics and Informatics, Interdisciplinary Center for Health Sciences, Faculty of Medicine, Martin-Luther-University Halle-Wittenberg, Halle, Germany
| | - Sarah Negash
- Institute for Medical Epidemiology, Biometrics and Informatics, Interdisciplinary Center for Health Sciences, Faculty of Medicine, Martin-Luther-University Halle-Wittenberg, Halle, Germany
| | - Nadja Kartschmit
- Institute for Medical Epidemiology, Biometrics and Informatics, Interdisciplinary Center for Health Sciences, Faculty of Medicine, Martin-Luther-University Halle-Wittenberg, Halle, Germany
| | - Iryna Manuilova
- Junior Research Group (Bio-)medical Data Science, Faculty of Medicine, Martin-Luther-University Halle-Wittenberg, Halle, Germany
| | - Charlotte Buch
- Institute for History and Ethics of Medicine, Center for Health Sciences Halle, Medical Faculty, Martin-Luther-University Halle-Wittenberg, Halle, Germany
| | - Jana Gundlack
- Institute of General Practice and Family Medicine, Center of Health Sciences, Faculty of Medicine, Martin-Luther-University Halle-Wittenberg, Halle, Germany
| | - Jan Christoph
- Department of Medical Informatics, Friedrich-Alexander-Universität Erlangen-Nürnberg, Erlangen, Germany.,Junior Research Group (Bio-)medical Data Science, Faculty of Medicine, Martin-Luther-University Halle-Wittenberg, Halle, Germany
| |
Collapse
|
8
|
Sedlmayr B, Sedlmayr M, Kroll B, Prokosch HU, Gruendner J, Schüttler C. Improving COVID-19 Research of University Hospitals in Germany: Formative Usability Evaluation of the CODEX Feasibility Portal. Appl Clin Inform 2022; 13:400-409. [PMID: 35445386 PMCID: PMC9021003 DOI: 10.1055/s-0042-1744549] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/02/2022] Open
Abstract
BACKGROUND Within the German "Network University Medicine," a portal is to be developed to enable researchers to query on novel coronavirus disease 2019 (COVID-19) data from university hospitals for assessing the feasibility of a clinical study. OBJECTIVES The usability of a prototype for federated feasibility queries was evaluated to identify design strengths and weaknesses and derive improvement recommendations for further development. METHODS In the course of a remote usability test with the thinking-aloud method and posttask interviews, 15 clinical researchers evaluated the usability of a prototype of the Feasibility Portal. The identified usability problems were rated according to severity, and improvement recommendations were derived. RESULTS The design of the prototype was rated as simple, intuitive, and as usable with little effort. The usability test reported a total of 26 problems, 8 of these were rated as "critical." Usability problems and revision recommendations focus primarily on improving the visual distinguishability of selected inclusion and exclusion criteria, enabling a flexible approach to criteria linking, and enhancing the free-text search. CONCLUSION Improvement proposals were developed for these user problems which will guide further development and the adaptation of the portal to user needs. This is an important prerequisite for correct and efficient use in everyday clinical work in the future. Results can provide developers of similar systems with a good starting point for interface conceptualizations. The methodological approach/the developed test guideline can serve as a template for similar evaluations.
Collapse
Affiliation(s)
- Brita Sedlmayr
- Institute for Medical Informatics and Biometry, Carl Gustav Carus Faculty of Medicine, Technische Universität Dresden, Dresden, Germany
| | - Martin Sedlmayr
- Institute for Medical Informatics and Biometry, Carl Gustav Carus Faculty of Medicine, Technische Universität Dresden, Dresden, Germany
| | - Björn Kroll
- IT Center for Clinical Research, University of Lübeck, Lübeck, Germany
| | - Hans-Ulrich Prokosch
- Department of Medical Informatics, Biometrics and Epidemiology, Chair of Medical Informatics, Friedrich-Alexander Universität Erlangen-Nürnberg, Erlangen, Germany
| | - Julian Gruendner
- Department of Medical Informatics, Biometrics and Epidemiology, Chair of Medical Informatics, Friedrich-Alexander Universität Erlangen-Nürnberg, Erlangen, Germany
| | - Christina Schüttler
- Department of Medical Informatics, Biometrics and Epidemiology, Chair of Medical Informatics, Friedrich-Alexander Universität Erlangen-Nürnberg, Erlangen, Germany
| |
Collapse
|
9
|
Gruendner J, Deppenwiese N, Folz M, Köhler T, Kroll B, Prokosch HU, Rosenau L, Rühle M, Scheidl MA, Schüttler C, Sedlmayr B, Twrdik A, Kiel A, Majeed RW. Architecture for a feasibility query portal for distributed COVID-19 Fast Healthcare Interoperability Resources (FHIR) patient data repositories: Design and Implementation Study (Preprint). JMIR Med Inform 2022; 10:e36709. [PMID: 35486893 PMCID: PMC9135115 DOI: 10.2196/36709] [Citation(s) in RCA: 7] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/24/2022] [Revised: 03/16/2022] [Accepted: 04/11/2022] [Indexed: 12/04/2022] Open
Abstract
Background An essential step in any medical research project after identifying the research question is to determine if there are sufficient patients available for a study and where to find them. Pursuing digital feasibility queries on available patient data registries has proven to be an excellent way of reusing existing real-world data sources. To support multicentric research, these feasibility queries should be designed and implemented to run across multiple sites and securely access local data. Working across hospitals usually involves working with different data formats and vocabularies. Recently, the Fast Healthcare Interoperability Resources (FHIR) standard was developed by Health Level Seven to address this concern and describe patient data in a standardized format. The Medical Informatics Initiative in Germany has committed to this standard and created data integration centers, which convert existing data into the FHIR format at each hospital. This partially solves the interoperability problem; however, a distributed feasibility query platform for the FHIR standard is still missing. Objective This study described the design and implementation of the components involved in creating a cross-hospital feasibility query platform for researchers based on FHIR resources. This effort was part of a large COVID-19 data exchange platform and was designed to be scalable for a broad range of patient data. Methods We analyzed and designed the abstract components necessary for a distributed feasibility query. This included a user interface for creating the query, backend with an ontology and terminology service, middleware for query distribution, and FHIR feasibility query execution service. Results We implemented the components described in the Methods section. The resulting solution was distributed to 33 German university hospitals. The functionality of the comprehensive network infrastructure was demonstrated using a test data set based on the German Corona Consensus Data Set. A performance test using specifically created synthetic data revealed the applicability of our solution to data sets containing millions of FHIR resources. The solution can be easily deployed across hospitals and supports feasibility queries, combining multiple inclusion and exclusion criteria using standard Health Level Seven query languages such as Clinical Quality Language and FHIR Search. Developing a platform based on multiple microservices allowed us to create an extendable platform and support multiple Health Level Seven query languages and middleware components to allow integration with future directions of the Medical Informatics Initiative. Conclusions We designed and implemented a feasibility platform for distributed feasibility queries, which works directly on FHIR-formatted data and distributed it across 33 university hospitals in Germany. We showed that developing a feasibility platform directly on the FHIR standard is feasible.
Collapse
Affiliation(s)
- Julian Gruendner
- Chair of Medical Informatics, Friedrich-Alexander University Erlangen-Nürnberg, Erlangen, Germany
| | - Noemi Deppenwiese
- Center of Medical Information and Communication Technology, University Hospital Erlangen, Erlangen, Germany
| | - Michael Folz
- Institute of Medical Informatics, Goethe University Frankfurt, Frankfurt am Main, Germany
| | - Thomas Köhler
- Federated Information Systems, German Cancer Research Center, Heidelberg, Germany
| | - Björn Kroll
- IT Center for Clinical Research, University of Lübeck, Lübeck, Germany
| | - Hans-Ulrich Prokosch
- Chair of Medical Informatics, Friedrich-Alexander University Erlangen-Nürnberg, Erlangen, Germany
| | - Lorenz Rosenau
- IT Center for Clinical Research, University of Lübeck, Lübeck, Germany
| | - Mathias Rühle
- Leipzig Research Centre for Civilization Diseases, University of Leipzig, Leipzig, Germany
| | - Marc-Anton Scheidl
- Chair of Medical Informatics, Friedrich-Alexander University Erlangen-Nürnberg, Erlangen, Germany
| | - Christina Schüttler
- Chair of Medical Informatics, Friedrich-Alexander University Erlangen-Nürnberg, Erlangen, Germany
| | - Brita Sedlmayr
- Institute for Medical Informatics and Biometry, Carl Gustav Carus Faculty of Medicine, Technische Universität Dresden, Dresden, Germany
| | - Alexander Twrdik
- Leipzig Research Centre for Civilization Diseases, University of Leipzig, Leipzig, Germany
| | - Alexander Kiel
- Federated Information Systems, German Cancer Research Center, Heidelberg, Germany
- Leipzig Research Centre for Civilization Diseases, University of Leipzig, Leipzig, Germany
| | - Raphael W Majeed
- Institute for Medical Informatics, University Clinic Rheinisch-Westfälische Technische Hochschule Aachen, Aachen, Germany
- Universities of Giessen and Marburg Lung Center, German Centre For Lung Research, Justus-Liebig University Giessen, Giessen, Germany
| |
Collapse
|
10
|
Schüttler C, Münster T, Gall C, Trollmann R, Schüttler J. General Anesthesia in the First 36 Months of Life–a Study of Cognitive Performance in Children Aged 7-11 Years (ANFOLKI-36). Dtsch Arztebl Int 2021; 118:835-841. [PMID: 34743788 DOI: 10.3238/arztebl.m2021.0355] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/28/2021] [Revised: 03/28/2021] [Accepted: 10/04/2021] [Indexed: 01/20/2023]
Abstract
BACKGROUND Experimental data have shown that the developing brain is especially vulnerable to exogenous noxious substances. The potential effects of anesthetic drugs on brain growth and development are a matter of concern. Clinical studies of children who underwent general anesthesia in their earliest years can make a major contribution to our understanding of the effects of anesthetic drugs on infants and toddlers (i.e., children under age 5). METHODS Children born at term during the years 2007-2011 who were exposed to general anesthesia before their third birthday were included in the study. Data on general anesthesia were retrospectively evaluated, and the overall intelligence quotient (IQ) was determined prospectively as the primary target parameter. Children who had not been exposed to general anesthesia were recruited as a control group. The non-inferiority threshold was set at a difference of 5 IQ points out of a consideration of clinical relevance. RESULTS 430 complete data sets were available from exposed children and 67 from members of the control group. The exposed group achieved a mean IQ score of 108.2, with a 95% confidence interval of [107; 109.4]; the corresponding values in the control group were 113 [110; 116.1]. Both groups achieved a mean score that was higher than the expected 100 points. After adjustment for age, socioeconomic status, and sex, the difference between the two groups was 2.9 points [0.2; 5.6], indicating a significantly better outcome in the control group than in the exposed group. The non-inferiority threshold of 5 IQ points was within the confidence interval; thus, non-inferiority was not demonstrated. CONCLUSION The fact that both groups achieved a higher IQ score than the expected 100 points may be attributable, at least in part, to the restriction of the study to children born at term. The results indicate that general anesthesia in early childhood is not associated with markedly reduced intelligence in later years, although non-inferiority could not be demonstrated.
Collapse
|
11
|
Schüttler C, Prokosch HU, Sedlmayr M, Sedlmayr B. Correction: Evaluation of Three Feasibility Tools for Identifying Patient Data and Biospecimen Availability: Comparative Usability Study. JMIR Med Inform 2021; 9:e33105. [PMID: 34623958 PMCID: PMC8538038 DOI: 10.2196/33105] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/24/2021] [Accepted: 09/06/2021] [Indexed: 11/13/2022] Open
Abstract
[This corrects the article DOI: 10.2196/25531.].
Collapse
Affiliation(s)
- Christina Schüttler
- Chair of Medical Informatics, Friedrich-Alexander-Universität Erlangen-Nürnberg, Erlangen, Germany
| | - Hans-Ulrich Prokosch
- Chair of Medical Informatics, Friedrich-Alexander-Universität Erlangen-Nürnberg, Erlangen, Germany
| | - Martin Sedlmayr
- Institute for Medical Informatics and Biometry, Carl Gustav Carus Faculty of Medicine, Technische Universität Dresden, Dresden, Germany
| | - Brita Sedlmayr
- Institute for Medical Informatics and Biometry, Carl Gustav Carus Faculty of Medicine, Technische Universität Dresden, Dresden, Germany
| |
Collapse
|
12
|
Schüttler C, Prokosch HU, Hummel M, Lablans M, Kroll B, Engels C. The journey to establishing an IT-infrastructure within the German Biobank Alliance. PLoS One 2021; 16:e0257632. [PMID: 34551019 PMCID: PMC8457464 DOI: 10.1371/journal.pone.0257632] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/04/2021] [Accepted: 09/04/2021] [Indexed: 11/19/2022] Open
Abstract
Background Biobanks ensure the long-term storage and accessibility of biospecimens and corresponding data sets. Thus, they form the foundation for many research projects which may contribute to improving medical care. With the establishment of the German Biobank Node and Alliance, expertise in biobanking is bundled and strengthened. An important component within this research infrastructure is the set-up of an information technology (IT) network for allowing feasibility requests across individual biobanks. Objective We aim to describe relevant aspects that have shaped the journey to interconnect biobanks, to enhance their visibility within the research-community, to harmonize data, and to enable feasibility searches to support access to available data and biosamples. Methods To achieve this task, we resorted to a wide variety of methods: we ran a requirement analysis, decided on the mode of operation for the federated team of IT-developers and on the development approach itself, took related national and international initiatives into account, and concluded with evaluations of the developed software artefacts and the operation of the entire chain of applications. Results We drew an IT framework including all heterogeneous data aspects derived from our requirement analysis and developed a comprehensive IT infrastructure. The successful implementation benefited from a smooth interaction of a federated IT team distributed across all participating sites that was even able to manage a major technology change mid-project. Authentication and project management services from associated partners could be integrated and the graphic user interface for an intuitive search tool for biospecimens was designed iteratively. The developed code is open source to ensure sustainability and the local implementation is concluded and functioning. The evaluation of the components was positive. Conclusions The entire project had given ample opportunity for challenges, predictable and unpredictable—from the mode of operation to changing some of the initial ideas. We learned our lessons concerning personnel, budget planning and technical as well as manual monitoring as well as some requirements arising only during the process of the project. Nevertheless, we can here report a success story of a network infrastructure, highly agile and much easier in local installation than initially anticipated.
Collapse
Affiliation(s)
- Christina Schüttler
- Medical Informatics, Friedrich-Alexander-Universität Erlangen-Nürnberg, Erlangen, Germany
| | - Hans-Ulrich Prokosch
- Medical Informatics, Friedrich-Alexander-Universität Erlangen-Nürnberg, Erlangen, Germany
| | - Michael Hummel
- German Biobank Node, Charité -Universitätsmedizin Berlin, Berlin, Germany
| | - Martin Lablans
- Federated Information Systems, German Cancer Research Center, Heidelberg, Germany
- University Medical Center Mannheim, Mannheim, Germany
| | - Björn Kroll
- IT Center for Clinical Research, University of Lübeck, Lübeck, Germany
| | - Cäcilia Engels
- German Biobank Node, Charité -Universitätsmedizin Berlin, Berlin, Germany
| |
Collapse
|
13
|
Schüttler C, Prokosch HU, Sedlmayr M, Sedlmayr B. Evaluation of Three Feasibility Tools for Identifying Patient Data and Biospecimen Availability: Comparative Usability Study. JMIR Med Inform 2021; 9:e25531. [PMID: 34287211 PMCID: PMC8339981 DOI: 10.2196/25531] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/06/2020] [Revised: 01/18/2021] [Accepted: 05/17/2021] [Indexed: 01/21/2023] Open
Abstract
BACKGROUND To meet the growing importance of real-word data analysis, clinical data and biosamples must be timely made available. Feasibility platforms are often the first contact point for determining the availability of such data for specific research questions. Therefore, a user-friendly interface should be provided to enable access to this information easily. The German Medical Informatics Initiative also aims to establish such a platform for its infrastructure. Although some of these platforms are actively used, their tools still have limitations. Consequently, the Medical Informatics Initiative consortium MIRACUM (Medical Informatics in Research and Care in University Medicine) committed itself to analyzing the pros and cons of existing solutions and to designing an optimized graphical feasibility user interface. OBJECTIVE The aim of this study is to identify the system that is most user-friendly and thus forms the best basis for developing a harmonized tool. To achieve this goal, we carried out a comparative usability evaluation of existing tools used by researchers acting as end users. METHODS The evaluation included three preselected search tools and was conducted as a qualitative exploratory study with a randomized design over a period of 6 weeks. The tools in question were the MIRACUM i2b2 (Informatics for Integrating Biology and the Bedside) feasibility platform, OHDSI's (Observational Health Data Sciences and Informatics) ATLAS, and the Sample Locator of the German Biobank Alliance. The evaluation was conducted in the form of a web-based usability test (usability walkthrough combined with a web-based questionnaire) with participants aged between 26 and 63 years who work as medical doctors. RESULTS In total, 17 study participants evaluated the three tools. The overall evaluation of usability, which was based on the System Usability Scale, showed that the Sample Locator, with a mean System Usability Scale score of 77.03 (SD 20.62), was significantly superior to the other two tools (Wilcoxon test; Sample Locator vs i2b2: P=.047; Sample Locator vs ATLAS: P=.001). i2b2, with a score of 59.83 (SD 25.36), performed significantly better than ATLAS, which had a score of 27.81 (SD 21.79; Wilcoxon test; i2b2 vs ATLAS: P=.005). The analysis of the material generated by the usability walkthrough method confirmed these findings. ATLAS caused the most usability problems (n=66), followed by i2b2 (n=48) and the Sample Locator (n=22). Moreover, the Sample Locator achieved the highest ratings with respect to additional questions regarding satisfaction with the tools. CONCLUSIONS This study provides data to develop a suitable basis for the selection of a harmonized tool for feasibility studies via concrete evaluation and a comparison of the usability of three different types of query builders. The feedback obtained from the participants during the usability test made it possible to identify user problems and positive design aspects of the individual tools and compare them qualitatively.
Collapse
Affiliation(s)
- Christina Schüttler
- Chair of Medical Informatics, Friedrich-Alexander-Universität Erlangen-Nürnberg, Erlangen, Germany
| | - Hans-Ulrich Prokosch
- Chair of Medical Informatics, Friedrich-Alexander-Universität Erlangen-Nürnberg, Erlangen, Germany
| | - Martin Sedlmayr
- Institute for Medical Informatics and Biometry, Carl Gustav Carus Faculty of Medicine, Technische Universität Dresden, Dresden, Germany
| | - Brita Sedlmayr
- Institute for Medical Informatics and Biometry, Carl Gustav Carus Faculty of Medicine, Technische Universität Dresden, Dresden, Germany
| |
Collapse
|
14
|
Kapsner LA, Kampf MO, Seuchter SA, Gruendner J, Gulden C, Mate S, Mang JM, Schüttler C, Deppenwiese N, Krause L, Zöller D, Balig J, Fuchs T, Fischer P, Haverkamp C, Holderried M, Mayer G, Stenzhorn H, Stolnicu A, Storck M, Storf H, Zohner J, Kohlbacher O, Strzelczyk A, Schüttler J, Acker T, Boeker M, Kaisers UX, Kestler HA, Prokosch HU. Reduced Rate of Inpatient Hospital Admissions in 18 German University Hospitals During the COVID-19 Lockdown. Front Public Health 2021; 8:594117. [PMID: 33520914 PMCID: PMC7838458 DOI: 10.3389/fpubh.2020.594117] [Citation(s) in RCA: 59] [Impact Index Per Article: 19.7] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/12/2020] [Accepted: 12/11/2020] [Indexed: 12/23/2022] Open
Abstract
The COVID-19 pandemic has caused strains on health systems worldwide disrupting routine hospital services for all non-COVID patients. Within this retrospective study, we analyzed inpatient hospital admissions across 18 German university hospitals during the 2020 lockdown period compared to 2018. Patients admitted to hospital between January 1 and May 31, 2020 and the corresponding periods in 2018 and 2019 were included in this study. Data derived from electronic health records were collected and analyzed using the data integration center infrastructure implemented in the university hospitals that are part of the four consortia funded by the German Medical Informatics Initiative. Admissions were grouped and counted by ICD 10 chapters and specific reasons for treatment at each site. Pooled aggregated data were centrally analyzed with descriptive statistics to compare absolute and relative differences between time periods of different years. The results illustrate how care process adoptions depended on the COVID-19 epidemiological situation and the criticality of the disease. Overall inpatient hospital admissions decreased by 35% in weeks 1 to 4 and by 30.3% in weeks 5 to 8 after the lockdown announcement compared to 2018. Even hospital admissions for critical care conditions such as malignant cancer treatments were reduced. We also noted a high reduction of emergency admissions such as myocardial infarction (38.7%), whereas the reduction in stroke admissions was smaller (19.6%). In contrast, we observed a considerable reduction in admissions for non-critical clinical situations, such as hysterectomies for benign tumors (78.8%) and hip replacements due to arthrosis (82.4%). In summary, our study shows that the university hospital admission rates in Germany were substantially reduced following the national COVID-19 lockdown. These included critical care or emergency conditions in which deferral is expected to impair clinical outcomes. Future studies are needed to delineate how appropriate medical care of critically ill patients can be maintained during a pandemic.
Collapse
Affiliation(s)
- Lorenz A. Kapsner
- Medical Center for Information and Communication Technology, Universitätsklinikum Erlangen, Erlangen, Germany
- Department of Radiology, Universitätsklinikum Erlangen, Friedrich-Alexander-Universität Erlangen-Nürnberg (FAU), Erlangen, Germany
| | - Marvin O. Kampf
- Medical Center for Information and Communication Technology, Universitätsklinikum Erlangen, Erlangen, Germany
| | - Susanne A. Seuchter
- Medical Center for Information and Communication Technology, Universitätsklinikum Erlangen, Erlangen, Germany
| | - Julian Gruendner
- Chair of Medical Informatics, Friedrich-Alexander-Universität Erlangen-Nürnberg (FAU), Erlangen, Germany
| | - Christian Gulden
- Chair of Medical Informatics, Friedrich-Alexander-Universität Erlangen-Nürnberg (FAU), Erlangen, Germany
| | - Sebastian Mate
- Medical Center for Information and Communication Technology, Universitätsklinikum Erlangen, Erlangen, Germany
| | - Jonathan M. Mang
- Medical Center for Information and Communication Technology, Universitätsklinikum Erlangen, Erlangen, Germany
| | - Christina Schüttler
- Chair of Medical Informatics, Friedrich-Alexander-Universität Erlangen-Nürnberg (FAU), Erlangen, Germany
| | - Noemi Deppenwiese
- Chair of Medical Informatics, Friedrich-Alexander-Universität Erlangen-Nürnberg (FAU), Erlangen, Germany
| | - Linda Krause
- Institute of Medical Biometry and Epidemiology, University Medical Center Hamburg-Eppendorf, Hamburg, Germany
| | - Daniela Zöller
- Institute of Medical Biometry and Statistics, Medical Faculty and Medical Center, University of Freiburg, Freiburg, Germany
| | - Julien Balig
- Institute of Medical Systems Biology, Ulm University, Ulm, Germany
| | - Timo Fuchs
- Department of Nuclear Medicine, University Hospital Regensburg, Regensburg, Germany
| | - Patrick Fischer
- Institute of Medical Informatics, Faculty of Medicine, Justus-Liebig-University, Gießen, Germany
| | - Christian Haverkamp
- Institute of Digitalisation in Medicine, Medical Faculty and Medical Center, University of Freiburg, Freiburg, Germany
| | - Martin Holderried
- Department of Medical Development and Quality Management, University Hospital Tübingen, Tübingen, Germany
| | - Gerhard Mayer
- Institute of Medical Systems Biology, Ulm University, Ulm, Germany
| | - Holger Stenzhorn
- Saarland University Medical Center, Institute for Medical Biometry, Epidemiology and Medical Informatics, Homburg, Germany
- Institute for Translational Bioinformatics, University Hospital Tübingen, Tübingen, Germany
| | - Ana Stolnicu
- Institute of Medical Systems Biology, Ulm University, Ulm, Germany
| | - Michael Storck
- Institute of Medical Informatics, University of Münster, Münster, Germany
| | - Holger Storf
- Medical Informatics Group, Universitätsklinikum Frankfurt, Frankfurt, Germany
| | - Jochen Zohner
- Institute of Medical Informatics, Faculty of Medicine, Justus-Liebig-University, Gießen, Germany
| | - Oliver Kohlbacher
- Institute for Translational Bioinformatics, University Hospital Tübingen, Tübingen, Germany
- Applied Bioinformatics, Department of Computer Science, University of Tübingen, Tübingen, Germany
- Institute for Bioinformatics and Medical Informatics, University of Tübingen, Tübingen, Germany
- Biomolecular Interactions, Max Planck Institute for Developmental Biology, Tübingen, Germany
| | - Adam Strzelczyk
- Epilepsy Center Frankfurt Rhine-Main, Center of Neurology and Neurosurgery, Goethe University Frankfurt, Frankfurt, Germany
| | - Jürgen Schüttler
- Department of Anesthesiology, University Hospital Erlangen, Erlangen, Germany
| | - Till Acker
- Institute of Neuropathology, Justus-Liebig-University, Gießen, Germany
| | - Martin Boeker
- Institute of Medical Biometry and Statistics, Medical Faculty and Medical Center, University of Freiburg, Freiburg, Germany
| | | | - Hans A. Kestler
- Institute of Medical Systems Biology, Ulm University, Ulm, Germany
| | - Hans-Ulrich Prokosch
- Chair of Medical Informatics, Friedrich-Alexander-Universität Erlangen-Nürnberg (FAU), Erlangen, Germany
| |
Collapse
|
15
|
Schüttler C, Huth V, von Jagwitz-Biegnitz M, Lablans M, Prokosch HU, Griebel L. A Federated Online Search Tool for Biospecimens (Sample Locator): Usability Study. J Med Internet Res 2020; 22:e17739. [PMID: 32663150 PMCID: PMC7463387 DOI: 10.2196/17739] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/13/2020] [Revised: 04/24/2020] [Accepted: 06/14/2020] [Indexed: 01/20/2023] Open
Abstract
BACKGROUND The German Biobank Alliance (GBA) aims to establish a cross-site biobank network. For this endeavor, the so-called Sample Locator, a federated search tool for biospecimens and related data, has been developed, forming the heart of its information technology (IT) infrastructure. OBJECTIVE To ensure the sustainable use of such a tool, we included researchers as participants in an end user-based usability evaluation. METHODS To develop a prototype ready for evaluation, we needed input from GBA IT experts. Thus, we conducted a 2-day workshop with 8 GBA IT team members. The focus was on the respective steps of a user-centered design process. With the acquired knowledge, the participants designed low-fidelity mock-ups. The main ideas of these mock-ups were discussed, extracted, and summarized into a comprehensive prototype using Microsoft PowerPoint. Furthermore, we created a questionnaire concerning the usability of the prototype, including the System Usability Scale (SUS), questions on negative and positive aspects, and typical tasks to be fulfilled with the tool. Subsequently, the prototype was pretested on the basis of this questionnaire with researchers who have a biobank background. Based on this preliminary work, the usability analysis was ultimately carried out with researchers and the results were evaluated. RESULTS Altogether, 27 researchers familiar with sample requests evaluated the prototype. The analysis of the feedback certified a good usability, given that the Sample Locator prototype was seen as intuitive and user-friendly by 74% (20/27) of the participants. The total SUS score by the 25 persons that completed the questionnaire was 80.4, indicating good system usability. Still, the evaluation provided useful advice on optimization potential (eg, offering a help function). CONCLUSIONS The findings of this usability analysis indicate that the considerations regarding a user-friendly application that have been made in the development process so far strongly coincide with the perception of the study participants. Nevertheless, it was important to engage prospective end users to ensure that the previous development is going in the desired direction and that the Sample Locator will be used in the future. The user comments and suggestions for improvement will be considered in upcoming iterations for refinement.
Collapse
Affiliation(s)
- Christina Schüttler
- Chair of Medical Informatics, Friedrich-Alexander-Universität Erlangen-Nürnberg, Erlangen, Germany
| | - Verena Huth
- German Biobank Node, Charité - Universitätsmedizin Berlin, Berlin, Germany
| | | | - Martin Lablans
- Federated Information Systems, German Cancer Research Center, Heidelberg, Germany.,University Medical Center Mannheim, Mannheim, Germany
| | - Hans-Ulrich Prokosch
- Chair of Medical Informatics, Friedrich-Alexander-Universität Erlangen-Nürnberg, Erlangen, Germany
| | - Lena Griebel
- Chair of Medical Informatics, Friedrich-Alexander-Universität Erlangen-Nürnberg, Erlangen, Germany
| |
Collapse
|
16
|
Schneiderheinze H, Prokosch HU, Apel H, Bellut L, Wullich B, Trollmann R, Schüttler C. Development and Usability Analysis of a Multimedia eConsent Solution. Stud Health Technol Inform 2019; 267:297-303. [PMID: 31483285 DOI: 10.3233/shti190841] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/15/2022]
Abstract
BACKGROUND More and more medical data is being stored digitally in routine care. The secondary use of patient data is only possible to a limited extent for data protection reasons. In order to enable a long-term and far-reaching use of secondary data, a possible approach is to obtain "broad consent" from patients, e.g. on research projects whose purpose is still unknown at the time of consent. OBJECTIVE To develop and evaluate an interactive eConsent prototype that presents the extensive contents of the "broad consent" in multimedia form for the purpose of a successful and resource-efficient information and consent process. METHODS The eConsent prototype was designed on basis of a literature review and in accordance with the goals of the German medical informatics initiative. User tests and subsequent questionnaire surveys using the System Usability Scale (SUS) were carried out with patients from a university hospital to assess the prototype's usability. The study was conducted in a quasi-experimental, one-group posttest-only design. RESULTS The created interactive prototype can present the contents acoustically and visually and offers the possibility to retrieve additional information. With a SUS score of 84,1/100 the results indicate a very good usability of the prototype. CONCLUSION The next steps will include further refinements of the prototype based on the feedback received and a subsequent study with a broader user group aimed at introducing an eConsent tool as part of a patient portal.
Collapse
Affiliation(s)
| | | | - Hendrik Apel
- Department of Urology and Paediatric Urology, University Hospital Erlangen
| | - Laura Bellut
- Department of Urology and Paediatric Urology, University Hospital Erlangen
| | - Bernd Wullich
- Department of Urology and Paediatric Urology, University Hospital Erlangen
| | - Regina Trollmann
- Department of Paediatrics and Adolescent Medicine, University Hospital Erlangen
| | | |
Collapse
|
17
|
Mate S, Kampf M, Rödle W, Kraus S, Proynova R, Silander K, Ebert L, Lablans M, Schüttler C, Knell C, Eklund N, Hummel M, Holub P, Prokosch HU. Pan-European Data Harmonization for Biobanks in ADOPT BBMRI-ERIC. Appl Clin Inform 2019; 10:679-692. [PMID: 31509880 PMCID: PMC6739205 DOI: 10.1055/s-0039-1695793] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/24/2022] Open
Abstract
Background
High-quality clinical data and biological specimens are key for medical research and personalized medicine. The Biobanking and Biomolecular Resources Research Infrastructure-European Research Infrastructure Consortium (BBMRI-ERIC) aims to facilitate access to such biological resources. The accompanying ADOPT BBMRI-ERIC project kick-started BBMRI-ERIC by collecting colorectal cancer data from European biobanks.
Objectives
To transform these data into a common representation, a uniform approach for data integration and harmonization had to be developed. This article describes the design and the implementation of a toolset for this task.
Methods
Based on the semantics of a metadata repository, we developed a lexical bag-of-words matcher, capable of semiautomatically mapping local biobank terms to the central ADOPT BBMRI-ERIC terminology. Its algorithm supports fuzzy matching, utilization of synonyms, and sentiment tagging. To process the anonymized instance data based on these mappings, we also developed a data transformation application.
Results
The implementation was used to process the data from 10 European biobanks. The lexical matcher automatically and correctly mapped 78.48% of the 1,492 local biobank terms, and human experts were able to complete the remaining mappings. We used the expert-curated mappings to successfully process 147,608 data records from 3,415 patients.
Conclusion
A generic harmonization approach was created and successfully used for cross-institutional data harmonization across 10 European biobanks. The software tools were made available as open source.
Collapse
Affiliation(s)
- Sebastian Mate
- Medical Centre for Information and Communication Technology, Universitätsklinikum Erlangen, Erlangen, Germany
| | - Marvin Kampf
- Medical Centre for Information and Communication Technology, Universitätsklinikum Erlangen, Erlangen, Germany
| | - Wolfgang Rödle
- Chair of Medical Informatics, Friedrich-Alexander-Universität Erlangen-Nürnberg (FAU), Erlangen, Germany
| | - Stefan Kraus
- Chair of Medical Informatics, Friedrich-Alexander-Universität Erlangen-Nürnberg (FAU), Erlangen, Germany
| | - Rumyana Proynova
- Medical Informatics in Translational Oncology, German Cancer Research Center, Heidelberg, Germany
| | - Kaisa Silander
- Genomics and Biobank Unit, Finnish National Institute for Health and Welfare, Helsinki, Finland
| | - Lars Ebert
- Federated Information Systems, German Cancer Research Center, Heidelberg, Germany
| | - Martin Lablans
- Federated Information Systems, German Cancer Research Center, Heidelberg, Germany
| | - Christina Schüttler
- Chair of Medical Informatics, Friedrich-Alexander-Universität Erlangen-Nürnberg (FAU), Erlangen, Germany
| | - Christian Knell
- Medical Centre for Information and Communication Technology, Universitätsklinikum Erlangen, Erlangen, Germany
| | - Niina Eklund
- Genomics and Biobank Unit, Finnish National Institute for Health and Welfare, Helsinki, Finland
| | - Michael Hummel
- Institute of Pathology, Charité-Universitätsmedizin Berlin, Berlin, Germany.,Biobanking and BioMolecular Resources Research Infrastructure (BBMRI-ERIC), Graz, Austria
| | - Petr Holub
- Biobanking and BioMolecular Resources Research Infrastructure (BBMRI-ERIC), Graz, Austria
| | - Hans-Ulrich Prokosch
- Medical Centre for Information and Communication Technology, Universitätsklinikum Erlangen, Erlangen, Germany.,Chair of Medical Informatics, Friedrich-Alexander-Universität Erlangen-Nürnberg (FAU), Erlangen, Germany
| |
Collapse
|
18
|
Gulden C, Kirchner M, Schüttler C, Hinderer M, Kampf M, Prokosch HU, Toddenroth D. Extractive summarization of clinical trial descriptions. Int J Med Inform 2019; 129:114-121. [PMID: 31445245 DOI: 10.1016/j.ijmedinf.2019.05.019] [Citation(s) in RCA: 10] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/19/2018] [Revised: 04/06/2019] [Accepted: 05/21/2019] [Indexed: 10/26/2022]
Abstract
PURPOSE Text summarization of clinical trial descriptions has the potential to reduce the time required to familiarize oneself with the subject of studies by condensing long-form detailed descriptions to concise, meaning-preserving synopses. This work describes the process and quality of automatically generated summaries of clinical trial descriptions using extractive text summarization methods. METHODS We generated a novel dataset from the detailed descriptions and brief summaries of trials registered on clinicaltrials.gov. We executed several text summarization algorithms on the detailed descriptions in this corpus and calculated the standard ROUGE metrics using the brief summaries included in the record as a reference. To investigate the correlation of these metrics with human sentiments, four reviewers assessed the content-completeness of the generated summaries and the helpfulness of both the generated and reference summaries via a Likert scale questionnaire. RESULTS The filtering stages of the dataset generation process reduce the 277,228 trials registered on clinicaltrials.gov to 101,016 records usable for the summarization task. On average, the summaries in this corpus are 25% the length of the detailed descriptions. Of the evaluated text summarization methods, the TextRank algorithm exhibits the overall best performance with a ROUGE-1 F1 score of 0.3531, ROUGE-2 F1 score of 0.1723, and ROUGE-L F1 score of 0.3003. These scores correlate with the assessment of the helpfulness and content similarity by the human reviewers. Inter-rater agreement for the helpfulness and content similarity was slight and fair respectively (Fleiss' kappa of 0.12 and 0.22). CONCLUSIONS Extractive summarization is a viable tool for generating meaning-preserving synopses of detailed clinical trial descriptions. Further, the human evaluation has shown that the ROUGE-L F1 score is useful for rating the general quality of generated summaries of clinical trial descriptions in an automated way.
Collapse
Affiliation(s)
- Christian Gulden
- Medical Informatics, Friedrich-Alexander Universität Erlangen-Nürnberg (FAU), Erlangen, Germany.
| | - Melanie Kirchner
- Medical Center for Information and Communication Technology, University Hospital Erlangen, Erlangen, Germany
| | - Christina Schüttler
- Medical Informatics, Friedrich-Alexander Universität Erlangen-Nürnberg (FAU), Erlangen, Germany
| | - Marc Hinderer
- Medical Informatics, Friedrich-Alexander Universität Erlangen-Nürnberg (FAU), Erlangen, Germany
| | - Marvin Kampf
- Medical Center for Information and Communication Technology, University Hospital Erlangen, Erlangen, Germany
| | - Hans-Ulrich Prokosch
- Medical Informatics, Friedrich-Alexander Universität Erlangen-Nürnberg (FAU), Erlangen, Germany
| | - Dennis Toddenroth
- Medical Informatics, Friedrich-Alexander Universität Erlangen-Nürnberg (FAU), Erlangen, Germany
| |
Collapse
|
19
|
Prokosch HU, Schüttler C, Schraudt M, Öfelein M, Maier C. Digital Patient Communication: Improving the Hospital-Patient Relationship. Stud Health Technol Inform 2019; 259:3-9. [PMID: 30923263] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 06/09/2023]
Abstract
Digitally engaging patients in their care processes was for many years limited to sharing care related documents (e.g. laboratory or radiology findings, discharge letters) with them through personal electronic health records. Newer concepts have led to the establishment of patient portals as patient frontends to a hospitalś electronic health record. Rarely however have complete patient pathways with pre-hospitalization, inpatient stay and post-hospitalization been evaluated to identify chains of communication processes involving clinical care scenarios, as well as subsequent home monitoring scenarios. Neither have such approaches been integrated with digital communication processes related to a patientś engagement in medical research projects. In order to enhance hospital-patient relationships in a holistic manner, we hypothesize that an integrated environment (e.g. patient portal) supporting shared decision making and communication in a patient´s care situation and in the same time providing communication processes for patient research engagement will optimize the patient-hospital relationship and be supportive in binding a patient to this care providing institution.
Collapse
Affiliation(s)
- Hans-Ulrich Prokosch
- Chair of Medical Informatics, Friedrich-Alexander-Universität Erlangen-Nürnberg, Erlangen, Germany
| | - Christina Schüttler
- Chair of Medical Informatics, Friedrich-Alexander-Universität Erlangen-Nürnberg, Erlangen, Germany
| | - Michaela Schraudt
- Chair of Medical Informatics, Friedrich-Alexander-Universität Erlangen-Nürnberg, Erlangen, Germany
| | - Matthias Öfelein
- Chair of Medical Informatics, Friedrich-Alexander-Universität Erlangen-Nürnberg, Erlangen, Germany
| | - Christian Maier
- Chair of Medical Informatics, Friedrich-Alexander-Universität Erlangen-Nürnberg, Erlangen, Germany
| |
Collapse
|
20
|
Schüttler C, Buschhüter N, Döllinger C, Ebert L, Hummel M, Linde J, Prokosch HU, Proynova R, Lablans M. [Erratum to: Requirements for a cross-location biobank IT infrastructure : Survey of stakeholder input on the establishment of a biobank network of the German Biobank Alliance (GBA)]. Pathologe 2018; 39:423. [PMID: 30105610 DOI: 10.1007/s00292-018-0479-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/08/2023]
Affiliation(s)
- C Schüttler
- Lehrstuhl für Medizinische Informatik, Friedrich-Alexander-Universität Erlangen-Nürnberg, Wetterkreuz 13, 91058, Erlangen-Tennenlohe, Deutschland.
| | - N Buschhüter
- Zentralisierte Biomaterialbank der Medizinischen Fakultät der RWTH Aachen University, Aachen, Deutschland
| | - C Döllinger
- BioMaterialBank Heidelberg, Universitätsklinikum Heidelberg, Heidelberg, Deutschland
| | - L Ebert
- Medizinische Informatik in der Translationalen Onkologie, Deutsches Krebsforschungszentrum, Heidelberg, Deutschland
| | - M Hummel
- Zentrale Biomaterialbank (ZeBanC) und German Biobank Node (GBN), Charité-Universitätsmedizin Berlin, Berlin, Deutschland
| | - J Linde
- UMG Biobank, Universitätsmedizin Göttingen, Göttingen, Deutschland
| | - H-U Prokosch
- Lehrstuhl für Medizinische Informatik, Friedrich-Alexander-Universität Erlangen-Nürnberg, Wetterkreuz 13, 91058, Erlangen-Tennenlohe, Deutschland
| | - R Proynova
- Medizinische Informatik in der Translationalen Onkologie, Deutsches Krebsforschungszentrum, Heidelberg, Deutschland
| | - M Lablans
- Medizinische Informatik in der Translationalen Onkologie, Deutsches Krebsforschungszentrum, Heidelberg, Deutschland
| |
Collapse
|
21
|
Schüttler C, Buschhüter N, Döllinger C, Ebert L, Hummel M, Linde J, Prokosch HU, Proynova R, Lablans M. Anforderungen an eine standortübergreifende Biobanken-IT-Infrastruktur. Pathologe 2018; 39:289-296. [DOI: 10.1007/s00292-018-0435-9] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [What about the content of this article? (0)] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 10/17/2022]
|
22
|
Schüttler C, Hinderer M, Kraus S, Lang AK, Prokosch HU, Castellanos I. Requirements Analysis for a Clinical Decision Support System Aiming at Improving the Artificial Nutrition of Critically Ill Patients. Stud Health Technol Inform 2017; 243:137-141. [PMID: 28883187] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 06/07/2023]
Abstract
BACKGROUND Nutrition support is an important aspect regarding the care of critically ill patients. Malnutrition affects the recovery process negatively. However, the impact on the clinical outcome is often underestimated in complex clinical settings due to several factors hindering optimization of nutrition. OBJECTIVE To identify the requirements for a clinical decision support system that enables the medical staff to improve its patients' nutritional status. METHODS A literature review and interviews with two senior physicians were conducted to refine the requirements for the support system as well as to determine the inclusion criteria for a subsequent intervention study. RESULTS The analysis resulted in: (i) the identification of 4 measurement parameters for the assessment of the nutrition status; (ii) the graphical layout in adherence to the standards-based implementation approach for the creation of multi-patient dashboards; (iii) the definition of the study group. The nutrition dashboard will be implemented and integrated based on the set requirements, followed by an intervention study evaluating the dashboard's efficacy.
Collapse
Affiliation(s)
| | - Marc Hinderer
- Medical Informatics, Friedrich-Alexander-Universität Erlangen-Nürnberg
| | - Stefan Kraus
- Medical Informatics, Friedrich-Alexander-Universität Erlangen-Nürnberg
| | | | | | | |
Collapse
|
23
|
Chudy M, Scheiblauer H, Hanschmann KM, Kress J, Nick S, Wend U, Schüttler C, Nübling CM, Gerlich WH. Performance of hepatitis B surface antigen tests with the first WHO international hepatitis B virus genotype reference panel. J Clin Virol 2013; 58:47-53. [PMID: 23829967 DOI: 10.1016/j.jcv.2013.06.011] [Citation(s) in RCA: 23] [Impact Index Per Article: 2.1] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/06/2013] [Revised: 05/23/2013] [Accepted: 06/09/2013] [Indexed: 12/16/2022]
Abstract
BACKGROUND Standardization of hepatitis B surface antigen (HBsAg) tests is indispensable for consistent quality and comparability. Ideally, the assays should detect all known hepatitis B virus (HBV) genotypes equally well. OBJECTIVE Development of an HBV genotype reference panel for HBsAg assays representing the most prevalent HBV subgenotypes to address commutability and traceability of the heat-inactivated 2nd WHO International Standard (IS) for HBsAg in relation to native HBsAg and to HBV genotypes. STUDY DESIGN An HBV panel of 15 non-inactivated lyophilized specimens representing the subgenotypes A1, A2, B1, B2, C2, D1-D3, E, F2, and H was evaluated in parallel to the IS by 15 laboratories using 19 different HBsAg tests and tree unitages. The virus content of the samples was reduced by ultracentrifugation and dilution to <2×10(4) IU HBV DNA/mL. RESULTS Twenty-two qualitative and 6 quantitative data sets were evaluated. Overall, the results demonstrated consistent detection of HBV genotypes by the majority of tests with a mean potency variability relative to the IS of 36%. Some assays showed significant genotype-dependent differences in analytical sensitivity. Some tests were more sensitive with the IS, others less. On average, one IU HBsAg corresponded to 0.88±0.20 ng HBsAg protein. CONCLUSIONS The panel was accepted by the WHO as the "1st International Reference Panel for HBV genotypes for HBsAg-based assays". The panel is a helpful complementation to the IS to validate HBV genotype specific analytical test sensitivities.
Collapse
Affiliation(s)
- M Chudy
- Section of Molecular Virology, Paul-Ehrlich-Institut, Langen, Germany.
| | | | | | | | | | | | | | | | | |
Collapse
|
24
|
Knöpnadel I, Schüttler C, Hammermaier A, Reich E, Bögl W. [Radiochemical purity studies on 10 radiopharmaceuticals]. Nuklearmedizin 1984; 23:311-6. [PMID: 6531216] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [MESH Headings] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/20/2023]
Abstract
Ten radiopharmaceuticals in frequent clinical use were examined for their radiochemical purity. Thin-layer chromatography, paper chromatography and electrophoresis were used. The activity of the separated components was measured in a gamma sample changer. The assumed chemical identity of the radiochemical impurities was evaluated by comparing the results with data described in the literature. For all radiopharmaceuticals tested, the radiochemical purity was found to be not lower than the value claimed by the manufacturer and to be in accordance with the requirements of the European Pharmacopoeia as far as those pharmaceuticals are listed therein.
Collapse
|
25
|
Knöpnadel I, Schüttler C, Reich E, Bögl W, Hammermaier A. Radiochemische Reinheitsuntersuchungen an zehn Radiopharmaka. Nuklearmedizin 1984. [DOI: 10.1055/s-0038-1624262] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/17/2022]
Abstract
ZusammenfassungZehn in der klinischen Routine häufig verwendete Radiopharmaka wurden auf ihre radiochemische Reinheit untersucht. Dabei angewandte Analysenmethoden waren die Dünnschichtchromatographie, die Papierchromatographie und die Elektrophorese. Die Messung der Aktivitäten der getrennten Komponenten erfolgte in einem Gamma-Probenwechsler. Die vermutliche chemische Identität der radiochemischen Verunreinigungen wurde durch Vergleich der Untersuchungsergebnisse mit Daten aus der Literatur ermittelt. Die radiochemische Reinheit unterschritt bei allen untersuchten Radiopharmaka nicht den vom Hersteller angegebenen Wert und erfüllte auch die Anforderungen des Europäischen Arzneibuches, soweit die Arzneimittel dort verzeichnet sind.
Collapse
|