1
|
APLUS: A Python library for usefulness simulations of machine learning models in healthcare. J Biomed Inform 2023; 139:104319. [PMID: 36791900 DOI: 10.1016/j.jbi.2023.104319] [Citation(s) in RCA: 5] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/11/2022] [Revised: 02/09/2023] [Accepted: 02/10/2023] [Indexed: 02/16/2023]
Abstract
Despite the creation of thousands of machine learning (ML) models, the promise of improving patient care with ML remains largely unrealized. Adoption into clinical practice is lagging, in large part due to disconnects between how ML practitioners evaluate models and what is required for their successful integration into care delivery. Models are just one component of care delivery workflows whose constraints determine clinicians' abilities to act on models' outputs. However, methods to evaluate the usefulness of models in the context of their corresponding workflows are currently limited. To bridge this gap we developed APLUS, a reusable framework for quantitatively assessing via simulation the utility gained from integrating a model into a clinical workflow. We describe the APLUS simulation engine and workflow specification language, and apply it to evaluate a novel ML-based screening pathway for detecting peripheral artery disease at Stanford Health Care.
Collapse
|
2
|
Pecoraro F, Luzi D. Using Unified Modeling Language to Analyze Business Processes in the Delivery of Child Health Services. INTERNATIONAL JOURNAL OF ENVIRONMENTAL RESEARCH AND PUBLIC HEALTH 2022; 19:13456. [PMID: 36294033 PMCID: PMC9602458 DOI: 10.3390/ijerph192013456] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 08/19/2022] [Revised: 09/27/2022] [Accepted: 10/03/2022] [Indexed: 06/16/2023]
Abstract
Business Process Management (BPM) has been increasingly used in recent years in the healthcare domain to analyze, optimize, harmonize and compare clinical and healthcare processes. The main aim of this methodology is to model the interactions between medical and organizational activities needed to deliver health services, measure their complexity, variability and deviations to improve the quality of care and its efficiency. Among the different tools, languages and notations developed in the decades, UML (Unified Modeling Language) represents a widely adopted technique to model, analyze and compare business processes in healthcare. We adopted its diagrams in the MOCHA project to compare the different ways of organizing, coordinating and delivering child care across 30 EU/EEA countries both from an organization and control-flow perspectives. This paper provides an overview of the main components used to represent the business process using UML diagrams, also highlighting how we customized them to capture the specificity of the healthcare domain taking into account that processes are reconstructed on the basis of country experts' responses to questionnaires. The benefits of the application of this methodology are demonstrated by providing examples of comparing different aspects of child care.
Collapse
|
3
|
|
4
|
Mincarone P, Leo CG, Trujillo-Martín MDM, Manson J, Guarino R, Ponzini G, Sabina S. Standardized languages and notations for graphical modelling of patient care processes: a systematic review. Int J Qual Health Care 2018; 30:169-177. [PMID: 29346638 DOI: 10.1093/intqhc/mzx197] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/19/2017] [Accepted: 12/22/2017] [Indexed: 11/12/2022] Open
Abstract
Purpose The importance of working toward quality improvement in healthcare implies an increasing interest in analysing, understanding and optimizing process logic and sequences of activities embedded in healthcare processes. Their graphical representation promotes faster learning, higher retention and better compliance. The study identifies standardized graphical languages and notations applied to patient care processes and investigates their usefulness in the healthcare setting. Data sources Peer-reviewed literature up to 19 May 2016. Information complemented by a questionnaire sent to the authors of selected studies. Study selection Systematic review conducted in accordance with the Preferred Reporting Items for Systematic Reviews and Meta-Analyses statement. Data extraction Five authors extracted results of selected studies. Results of data synthesis Ten articles met the inclusion criteria. One notation and language for healthcare process modelling were identified with an application to patient care processes: Business Process Model and Notation and Unified Modeling Language™. One of the authors of every selected study completed the questionnaire. Users' comprehensibility and facilitation of inter-professional analysis of processes have been recognized, in the filled in questionnaires, as major strengths for process modelling in healthcare. Conclusion Both the notation and the language could increase the clarity of presentation thanks to their visual properties, the capacity of easily managing macro and micro scenarios, the possibility of clearly and precisely representing the process logic. Both could increase guidelines/pathways applicability by representing complex scenarios through charts and algorithms hence contributing to reduce unjustified practice variations which negatively impact on quality of care and patient safety.
Collapse
Affiliation(s)
- Pierpaolo Mincarone
- National Research Council of Italy, Institute for Research on Population and Social Policies, URT Brindisi, c/o ex Osp. Di Summa, Piazza Di Summa, 72100 Brindisi, Italy
| | - Carlo Giacomo Leo
- National Research Council of Italy, Institute of Clinical Physiology, Unit of Lecce, c/o Ecotekne via Monteroni, 73100 Lecce, Italy.,Tufts Medical Center, Department of Medicine, 800 Washington Street, Boston, MA 02111, USA
| | - Maria Del Mar Trujillo-Martín
- Canary Foundation of Health Research, Camino Candelaria, 44 C.S. San Isidro-El Chorrillo, 38109 El Rosario, Canary Islands, Spain
| | - Jan Manson
- Scottish Medicines Consortium, Delta House, 50 West Nile Street, Glasgow G1 2NP, UK
| | - Roberto Guarino
- National Research Council of Italy, Institute of Clinical Physiology, Unit of Lecce, c/o Ecotekne via Monteroni, 73100 Lecce, Italy
| | - Giuseppe Ponzini
- National Research Council of Italy, Institute for Research on Population and Social Policies, URT Brindisi, c/o ex Osp. Di Summa, Piazza Di Summa, 72100 Brindisi, Italy
| | - Saverio Sabina
- National Research Council of Italy, Institute of Clinical Physiology, Unit of Lecce, c/o Ecotekne via Monteroni, 73100 Lecce, Italy
| |
Collapse
|
5
|
Yagahara A, Yokooka Y, Jiang G, Tsuji S, Fukuda A, Nishimoto N, Kurowarabi K, Ogasawara K. Construction of mammographic examination process ontology using bottom-up hierarchical task analysis. Radiol Phys Technol 2018; 11:73-81. [PMID: 29322305 DOI: 10.1007/s12194-017-0439-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/29/2017] [Revised: 12/26/2017] [Accepted: 12/28/2017] [Indexed: 10/18/2022]
Abstract
Describing complex mammography examination processes is important for improving the quality of mammograms. It is often difficult for experienced radiologic technologists to explain the process because their techniques depend on their experience and intuition. In our previous study, we analyzed the process using a new bottom-up hierarchical task analysis and identified key components of the process. Leveraging the results of the previous study, the purpose of this study was to construct a mammographic examination process ontology to formally describe the relationships between the process and image evaluation criteria to improve the quality of mammograms. First, we identified and created root classes: task, plan, and clinical image evaluation (CIE). Second, we described an "is-a" relation referring to the result of the previous study and the structure of the CIE. Third, the procedural steps in the ontology were described using the new properties: "isPerformedBefore," "isPerformedAfter," and "isPerformedAfterIfNecessary." Finally, the relationships between tasks and CIEs were described using the "isAffectedBy" property to represent the influence of the process on image quality. In total, there were 219 classes in the ontology. By introducing new properties related to the process flow, a sophisticated mammography examination process could be visualized. In relationships between tasks and CIEs, it became clear that the tasks affecting the evaluation criteria related to positioning were greater in number than those for image quality. We developed a mammographic examination process ontology that makes knowledge explicit for a comprehensive mammography process. Our research will support education and help promote knowledge sharing about mammography examination expertise.
Collapse
Affiliation(s)
- Ayako Yagahara
- Faculty of Health Sciences, Hokkaido University of Science, 7-15-4-1 Maeda, Teine-ku, Sapporo, Hokkaido, 006-8585, Japan. .,Faculty of Health Sciences, Hokkaido University, N12W5, Sapporo, 060-0812, Japan.
| | - Yuki Yokooka
- Department of Medical Informatics Section, National Institute of Quantum and Radiological Sciences and Technology, National Institute of Radiological Science Hospital, 4-9-1 Anagawa, Inage-ku, Chiba-shi, Chiba, 263-8555, Japan
| | - Guoqian Jiang
- Department of Health Sciences Research, Mayo Clinic College of Medicine, 200 First Street, SW, Rochester, MN, 55905, USA
| | - Shintarou Tsuji
- Faculty of Health Sciences, Hokkaido University, N12W5, Sapporo, 060-0812, Japan
| | - Akihisa Fukuda
- Department of Radiological Technology, Hokkaido Medical Center, 5-7-1-1 Yamanote, Nisi-ku, Sapporo, Hokkaido, 063-0005, Japan
| | - Naoki Nishimoto
- Clinical Research Support Center, Kagawa University Hospital, 1750-1 Ikenobe, Miki-cho, Kita-gun, Kagawa, 761-0793, Japan
| | - Kunio Kurowarabi
- Department of Radiology, Hokkaido Cancer Society, Kita 26, Higashi 14-1-15 Higashi-ku, Sapporo, Hokkaido, 065-0026, Japan
| | - Katsuhiko Ogasawara
- Faculty of Health Sciences, Hokkaido University, N12W5, Sapporo, 060-0812, Japan
| |
Collapse
|
6
|
Ferrante S, Bonacina S, Pozzi G, Pinciroli F, Marceglia S. A Design Methodology for Medical Processes. Appl Clin Inform 2016; 7:191-210. [PMID: 27081415 DOI: 10.4338/aci-2015-08-ra-0111] [Citation(s) in RCA: 18] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/15/2015] [Accepted: 01/24/2016] [Indexed: 11/23/2022] Open
Abstract
BACKGROUND Healthcare processes, especially those belonging to the clinical domain, are acknowledged as complex and characterized by the dynamic nature of the diagnosis, the variability of the decisions made by experts driven by their experiences, the local constraints, the patient's needs, the uncertainty of the patient's response, and the indeterminacy of patient's compliance to treatment. Also, the multiple actors involved in patient's care need clear and transparent communication to ensure care coordination. OBJECTIVES In this paper, we propose a methodology to model healthcare processes in order to break out complexity and provide transparency. METHODS The model is grounded on a set of requirements that make the healthcare domain unique with respect to other knowledge domains. The modeling methodology is based on three main phases: the study of the environmental context, the conceptual modeling, and the logical modeling. RESULTS The proposed methodology was validated by applying it to the case study of the rehabilitation process of stroke patients in the specific setting of a specialized rehabilitation center. The resulting model was used to define the specifications of a software artifact for the digital administration and collection of assessment tests that was also implemented. CONCLUSIONS Despite being only an example, our case study showed the ability of process modeling to answer the actual needs in healthcare practices. Independently from the medical domain in which the modeling effort is done, the proposed methodology is useful to create high-quality models, and to detect and take into account relevant and tricky situations that can occur during process execution.
Collapse
Affiliation(s)
- Simona Ferrante
- Dipartimento di Elettronica, Informazione e Bioingegneria, Politecnico di Milano , Milano, Italy
| | - Stefano Bonacina
- Health Informatics Centre, Department of Learning, Informatics, Management and Ethics, Karolinska Institutet , Stockholm, Sweden
| | - Giuseppe Pozzi
- Dipartimento di Elettronica, Informazione e Bioingegneria, Politecnico di Milano , Milano, Italy
| | - Francesco Pinciroli
- Dipartimento di Elettronica, Informazione e Bioingegneria, Politecnico di Milano, Milano, Italy; Engineering in Health and Wellbeing Research Group at the National Research Council of Italy IEIIT - Istituto di Elettronica e di Ingegneria dell'Informazione e delle Telecomunicazioni, Trieste, Italy
| | - Sara Marceglia
- Dipartimento di Ingegneria e Architettura, Università degli Studi di Trieste, Trieste, Italy; Clinical Center for Neurostimulation, Neurotechnology, and Movement Disorders Fondazione IRCCS Ca'Granda Ospedale Maggiore Policlinico, Milano, Italy
| |
Collapse
|
7
|
The Latin American laws of correct nutrition: Review, unified interpretation, model and tools. Comput Biol Med 2016; 70:67-79. [PMID: 26807801 DOI: 10.1016/j.compbiomed.2015.12.019] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/25/2015] [Revised: 11/29/2015] [Accepted: 12/22/2015] [Indexed: 11/21/2022]
Abstract
BACKGROUND The "Laws of Correct Nutrition": the Law of Quantity, the Law of Quality, the Law of Harmony and the Law of Adequacy, provide the basis of a proper diet, i.e. one that provides the body with the energy required and nutrients it needs for daily activities and maintenance of vital functions. For several decades, these Laws have been the basis of nourishing menus designed in Latin America; however, they are stated in a colloquial language, which leads to differences in interpretation and ambiguities for non-experts and even experts in the field. METHODS We present a review of the different interpretations of the Laws and describe a consensus. We represent concepts related to nourishing menu design employing the Unified Modeling Language (UML). We formalize the Laws using the Object Constraint Language (OCL). We design a nourishing menu for a particular user through enforcement of the Laws. RESULTS We designed a domain model with the essential elements to plan a nourishing menu and we expressed the necessary constraints to make the model׳s behavior conform to the four Laws. We made a formal verification and validation of the model via USE (UML-based Specification Environment) and we developed a software prototype for menu design under the Laws. CONCLUSION Diet planning is considered as an art but consideration should be given to the need for a set of strict rules to design adequate menus. Thus, we model the "Laws of Nutrition" as a formal basis and standard framework for this task.
Collapse
|