1
|
Aissaoui Ferhi L, Ben Amar M, Choubani F, Bouallegue R. Enhancing diagnostic accuracy in symptom-based health checkers: a comprehensive machine learning approach with clinical vignettes and benchmarking. Front Artif Intell 2024; 7:1397388. [PMID: 39421435 PMCID: PMC11483353 DOI: 10.3389/frai.2024.1397388] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/07/2024] [Accepted: 07/17/2024] [Indexed: 10/19/2024] Open
Abstract
Introduction The development of machine learning models for symptom-based health checkers is a rapidly evolving area with significant implications for healthcare. Accurate and efficient diagnostic tools can enhance patient outcomes and optimize healthcare resources. This study focuses on evaluating and optimizing machine learning models using a dataset of 10 diseases and 9,572 samples. Methods The dataset was divided into training and testing sets to facilitate model training and evaluation. The following models were selected and optimized: Decision Tree, Random Forest, Naive Bayes, Logistic Regression and K-Nearest Neighbors. Evaluation metrics included accuracy, F1 scores, and 10-fold cross-validation. ROC-AUC and precision-recall curves were also utilized to assess model performance, particularly in scenarios with imbalanced datasets. Clinical vignettes were employed to gauge the real-world applicability of the models. Results The performance of the models was evaluated using accuracy, F1 scores, and 10-fold cross-validation. The use of ROC-AUC curves revealed that model performance improved with increasing complexity. Precision-recall curves were particularly useful in evaluating model sensitivity in imbalanced dataset scenarios. Clinical vignettes demonstrated the robustness of the models in providing accurate diagnoses. Discussion The study underscores the importance of comprehensive model evaluation techniques. The use of clinical vignette testing and analysis of ROC-AUC and precision-recall curves are crucial in ensuring the reliability and sensitivity of symptom-based health checkers. These techniques provide a more nuanced understanding of model performance and highlight areas for further improvement. Conclusion This study highlights the significance of employing diverse evaluation metrics and methods to ensure the robustness and accuracy of machine learning models in symptom-based health checkers. The integration of clinical vignettes and the analysis of ROC-AUC and precision-recall curves are essential steps in developing reliable and sensitive diagnostic tools.
Collapse
Affiliation(s)
- Leila Aissaoui Ferhi
- Virtual University of Tunis, Tunis, Tunisia
- Innov’Com Laboratory at SUPCOM, University of Carthage, Carthage, Tunisia
| | - Manel Ben Amar
- Virtual University of Tunis, Tunis, Tunisia
- Innov’Com Laboratory at SUPCOM, University of Carthage, Carthage, Tunisia
- Faculty of Dental Medicine of Monastir, University of Monastir, Monastir, Tunisia
| | - Fethi Choubani
- Innov’Com Laboratory at SUPCOM, University of Carthage, Carthage, Tunisia
| | - Ridha Bouallegue
- Innov’Com Laboratory at SUPCOM, University of Carthage, Carthage, Tunisia
| |
Collapse
|
2
|
Gasparino RC, da Silva SMN, Minatogawa LBDB, Ribeiro OMPL, Bernardes A. Cross-cultural adaptation and validation of the Healthy Work Environment Assessment Tool in Brazilian culture. Rev Bras Enferm 2024; 77:e20230505. [PMID: 39319969 PMCID: PMC11419688 DOI: 10.1590/0034-7167-2023-0505] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/30/2024] [Accepted: 05/23/2024] [Indexed: 09/26/2024] Open
Abstract
OBJECTIVES to adapt and validate the content of the Healthy Work Environment Assessment Tool for Brazilian culture, and evaluate the practical aspects of its application. METHODS methodological study that followed six stages: translation; synthesis; back translation; content validation by a group of experts, pre-testing and approval of the process by the author of the original instrument. RESULTS the first three stages were carried out by contracted companies. In the committee, two items and the title of a subscale were evaluated in a second round, when consensus was reached among experts. In the pre-test, more than 93% of professionals agreed that the tool was easy to understand. The average completion time was 8.53 minutes. The American Association of Critical-Care Nurses authorized publication of the results. CONCLUSIONS the adaptation of the tool to Brazilian culture was completed following the adopted framework. In addition to the evidence of content validity, the tool appears promising for managerial use.
Collapse
Affiliation(s)
- Renata Cristina Gasparino
- Universidade de São Paulo. Ribeirão Preto, São Paulo, Brazil
- Universidade Estadual de Campinas. Campinas, São Paulo, Brazil
| | | | | | | | | |
Collapse
|
3
|
Muniz EA, Queiroz MVO, Pinheiro PNDC, Silva MRFD, Moreira TMM, Oliveira EN, Almeida IFDPD, Barbosa Filho VC. Guia de Enfermagem Escolar para promoção da saúde de jovens estudantes: construção e validação. Rev Bras Enferm 2023. [DOI: 10.1590/0034-7167-2022-0260pt] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/23/2022] Open
Abstract
RESUMO Objetivos: descrever o processo de construção e validação do Guia de Enfermagem Escolar para promoção da saúde de jovens estudantes. Métodos: estudo metodológico, realizado de fevereiro a dezembro de 2021, composto por Pesquisa Convergente-Assistencial fundamentada no Modelo de Promoção da Saúde de Pender. A partir da literatura e diálogo com 11 enfermeiros nos sete grupos focais online, foram construídas ações. Posteriormente, 24 juízes avaliaram o conteúdo e a aparência. Resultados: o guia propõe estratégias para o desenvolvimento das práticas de enfermagem escolar enfocando a promoção da saúde. O Índice de Validade de Aparência variou de 0,63 a 1,0, e o total foi de 0,84. O Índice de Validade de Conteúdo variou de 0,95 a 1,0, e o total foi de 0,997. Conclusões: o guia incorporou as necessidades dos jovens reconhecidas pelos profissionais, e a fase de avaliação confirma sua validação, podendo ser utilizado no contexto da prática com jovens.
Collapse
Affiliation(s)
- Emanoel Avelar Muniz
- Instituto Federal de Educação, Ciência e Tecnologia do Ceará, Brazil; Universidade Estadual do Ceará, Brazil
| | | | | | | | | | | | | | | |
Collapse
|
4
|
Muniz EA, Queiroz MVO, Pinheiro PNDC, da Silva MRF, Moreira TMM, Oliveira EN, de Almeida IFDP, Barbosa VC. School Nursing Guide for student health promotion: construction and validity. Rev Bras Enferm 2022; 76:e20220260. [PMID: 36542056 PMCID: PMC9749768 DOI: 10.1590/0034-7167-2022-0260] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/11/2022] [Accepted: 08/02/2022] [Indexed: 12/23/2022] Open
Abstract
OBJECTIVES to describe the process of construction and validity of a School Nursing Guide for student health promotion. METHODS a methodological study, carried out from February to December 2021, composed of Convergent Care Research based on Pender's Health Promotion Model. Based on the literature and dialogue with 11 nurses in the seven online focus groups, actions were constructed. Subsequently, 24 judges assessed content and appearance. RESULTS the guide proposes strategies for developing school nursing practices focusing on health promotion. The Appearance Validity Index ranged from 0.63 to 1.0, and the total was 0.84. The Content Validity Index ranged from 0.95 to 1.0, and the total was 0.997. CONCLUSIONS the guide incorporated the needs of young people recognized by professionals, and the assessment phase confirms its validity, and can be used in the context of practice with young people.
Collapse
Affiliation(s)
- Emanoel Avelar Muniz
- Instituto Federal de Educação, Ciência e Tecnologia do Ceará. Acaraú, Ceará, Brazil,Universidade Estadual do Ceará. Fortaleza, Ceará, Brazil
| | | | | | | | | | | | | | - Valter Cordeiro Barbosa
- Universidade Estadual do Ceará. Fortaleza, Ceará, Brazil,Instituto Federal de Educação, Ciência e Tecnologia do Ceará. Aracati, Ceará, Brazil
| |
Collapse
|
5
|
Marques CAV, Figueiredo END, Gutiérrez MGRD. Breast cancer screening program for risk groups: facts and perspectives. Rev Bras Enferm 2021; 75:e20210050. [PMID: 34669830 DOI: 10.1590/0034-7167-2021-0050] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/07/2021] [Accepted: 06/22/2021] [Indexed: 12/09/2022] Open
Abstract
OBJECTIVES to measure the frequency and compliance of breast cancer screening, according to the risk for this disease. METHODS a cross-sectional study with 950 female users of 38 public Primary Health Care services in São Paulo, between October and December 2013. According to UHS criteria, participants were grouped into high risk and standard risk, and frequency, association (p≤0.05), and screening compliance were measured. RESULTS 6.7% had high risk and 93.3% standard risk, respectively; in these groups, the frequency and compliance of clinical breast examination were 40.3% and 37.1%, and 43.5% and 43.0% (frequency p=0.631, compliance p=0.290). Mammograms were 67.7% and 35.5% for participants at high risk, and 57.4% and 25.4% for those at standard risk (frequency p=0.090, compliance p=0.000). CONCLUSIONS in the groups, attendance and conformity of the clinical breast exam were similar; for mammography, it was higher in those at high risk, with assertiveness lower than the 70% set in UHS.
Collapse
|
6
|
Araújo HPA, dos Santos LC, Domingos TDS, Alencar RA. Multiprofessional family health residency as a setting for education and interprofessional practices. Rev Lat Am Enfermagem 2021; 29:e3450. [PMID: 34190941 PMCID: PMC8253368 DOI: 10.1590/1518-8345.4484.3450] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/12/2020] [Accepted: 11/02/2020] [Indexed: 11/22/2022] Open
Abstract
OBJECTIVE to know the experiences lived during the residency by graduates of a Multiprofessional Residency Program in Family Health that could contribute to the development of Interprofessional Education and/or Collaborative Practice. METHOD a qualitative study with residents who entered a Multiprofessional Residency Program of a Brazilian public university in 2017, a period in which the theme of interprofessionality was implemented in the activities of the residency. Data was collected using an electronic form built from the theoretical framework of interprofessional education. Content analysis was used to process the data. RESULTS nine residents participated, distributed among the professions of Physical Education, Nursing, Nutrition, Dentistry, Psychology and Social Work, five of whom were female and with a mean age of 28.4. Two categories emerged: the Residency as a setting for learning from the other, and the Residency as a setting for understanding the role of the other. Interprofessional education and practice provided opportunities for the development of collaborative skills, enhancing teamwork and interprofessional work. CONCLUSION the multiprofessional logic was evidenced in the resident's practice; and the gradual insertion of activities such as case discussions, shared services and inter-sectoral actions aligned with the theoretical-methodological framework of interprofessionality favored an approach to interprofessional work.
Collapse
Affiliation(s)
- Heloísa Pimenta Arruda Araújo
- Universidade Estadual Paulista “Júlio de Mesquita Filho”,
Departamento de Enfermagem, Botucatu, SP, Brazil
- Sociedade Beneficente de Senhoras Hospital Sírio Libanês, Saúde
Corporativa, São Paulo, SP, Brazil
| | - Lucas Cardoso dos Santos
- Universidade Estadual Paulista “Júlio de Mesquita Filho”,
Departamento de Enfermagem, Botucatu, SP, Brazil
- Sociedade Beneficente de Senhoras Hospital Sírio Libanês, Saúde
Corporativa, São Paulo, SP, Brazil
| | - Thiago da Silva Domingos
- Universidade Federal de São Paulo, Escola Paulista de Enfermagem,
Departamento de Enfermagem Clínica e Cirúrgica, São Paulo, SP, Brazil
| | - Rúbia Aguiar Alencar
- Universidade Estadual Paulista “Júlio de Mesquita Filho”,
Departamento de Enfermagem, Botucatu, SP, Brazil
| |
Collapse
|
7
|
Klein A, Agarwal S, Cholley B, Fassl J, Griffin M, Kaakinen T, Mzallassi Z, Paulus P, Rex S, Siegemund M, van Saet A. A survey of patient blood management for patients undergoing cardiac surgery in nine European countries. J Clin Anesth 2021; 72:110311. [PMID: 33905900 DOI: 10.1016/j.jclinane.2021.110311] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/14/2021] [Revised: 03/30/2021] [Accepted: 04/01/2021] [Indexed: 12/22/2022]
Abstract
STUDY OBJECTIVE To describe and compare patient blood management (PBM) practices in cardiac surgery in nine European countries and identify the main risk factors for bleeding or transfusion according to the surveyed centres. DESIGN We set up an online survey to evaluate PBM practices in two clinical scenarios, risk factors for bleeding or transfusion, and previous experience with antifibrinolytics. SETTING This survey was completed by European anesthesiologists in 2019. PATIENTS No patients were included in the survey. INTERVENTION None. MEASUREMENTS We evaluated the degree of implementation of PBM practices in patients undergoing cardiac surgery. MAIN RESULTS Ninety-eight of 177 responses (38%) were complete with variable response rates by country. In a non-emergent situation, no respondents would transfuse red cells preoperatively in an anaemic patient, while cell salvage (89%) and antifibrinolytics (82%) would almost always be used. Optimization of Hemoglobin level (36%) and use of off-pump techniques (34%), minimally invasive surgery (25%) and relatively recently-developed CPB technologies such as mini-bypass (32%) and autologous priming (38%), varied greatly across countries. In an emergent clinical situation, topical haemostatic agents would frequently be used (61%). Tranexamic acid (72%) and aprotinin (20%) were the main antifibrinolytics used, with method of administration and dose varying markedly across countries. Five factors were considered to increase risk of bleeding or transfusion by at least 90% of respondents: pre-operative anaemia, prior cardiac surgery, clopidogrel 5 days or less before surgery, use of other P2Y12 inhibitors at any point, and thrombocytopenia <100.109 platelets/mm3. CONCLUSION PBM guidelines are not universally implemented in European cardiac surgery centres or countries, resulting in discrepancies in techniques and products used for a given clinical situation.
Collapse
Affiliation(s)
- Andrew Klein
- Consultant, Department of Anaesthesia and Intensive Care, Royal Papworth Hospital, Cambridge Biomedical Campus, Cambridge, UK.
| | - Seema Agarwal
- Consultant in Cardiac Anaesthesia and ICU Honorary Senior Lecturer Manchester University Hospitals, Manchester, UK
| | - Bernard Cholley
- AP-HP Hôpital Européen Georges Pompidou, 20 rue Leblanc, F-75015 Paris, France; Université de PARIS, INSERM UMR-S 1140, Innovations Thérapeutiques en Hémostase, Faculté de Pharmacie, 4 avenue de l'observatoire, 75006 Paris, France
| | - Jens Fassl
- Herzzentrum Dresden GmbH Universitätsklinik an der Technischen Universität Dresden, Fetscherstraße 76, 01307 Dresden, Germany
| | - Michael Griffin
- Mater University Hospital and Mater Private Hospital, Dublin, Associate Professor of Anaesthesiology & Perioperative Medicine, UCD Medical School, Irish Medical Council, Dublin, Ireland
| | - Timo Kaakinen
- Research Group of Surgery, Anaesthesiology and Intensive Care Medicine, Medical Research Center of Oulu University, Oulu University Hospital, Oulu, Finland
| | - Zineb Mzallassi
- Department of Anesthesiology; Erasmus Medical Center, Rotterdam, the Netherlands
| | - Patrick Paulus
- Kepler University Hospital GmbH, Med Campus III, Department of Anesthesiology and Intensive Care Medicine, Krankenhausstrasse 9, 4020 Linz, Austria
| | - Steffen Rex
- Department of Anesthesiology, University Hospitals Leuven, Leuven, Belgium; and Department of Cardiovascular Sciences, KU Leuven, Leuven, Belgium
| | - Martin Siegemund
- Intensive Care Unit Department of Clinical Research, University Basel, Switzerland
| | - Annewil van Saet
- Department of Anesthesiology; Erasmus Medical Center, Rotterdam, the Netherlands
| |
Collapse
|