|
1
|
Vaira LA, Lechien JR, Abbate V, Allevi F, Audino G, Beltramini GA, Bergonzani M, Boscolo-Rizzo P, Califano G, Cammaroto G, Chiesa-Estomba CM, Committeri U, Crimi S, Curran NR, di Bello F, di Stadio A, Frosolini A, Gabriele G, Gengler IM, Lonardi F, Maglitto F, Mayo-Yáñez M, Petrocelli M, Pucci R, Saibene AM, Saponaro G, Tel A, Trabalzini F, Trecca EMC, Vellone V, Salzano G, De Riu G. Validation of the Quality Analysis of Medical Artificial Intelligence (QAMAI) tool: a new tool to assess the quality of health information provided by AI platforms. Eur Arch Otorhinolaryngol 2024:10.1007/s00405-024-08710-0. [PMID: 38703195 DOI: 10.1007/s00405-024-08710-0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/03/2024] [Accepted: 04/27/2024] [Indexed: 05/06/2024]
Abstract
BACKGROUND The widespread diffusion of Artificial Intelligence (AI) platforms is revolutionizing how health-related information is disseminated, thereby highlighting the need for tools to evaluate the quality of such information. This study aimed to propose and validate the Quality Assessment of Medical Artificial Intelligence (QAMAI), a tool specifically designed to assess the quality of health information provided by AI platforms. METHODS The QAMAI tool has been developed by a panel of experts following guidelines for the development of new questionnaires. A total of 30 responses from ChatGPT4, addressing patient queries, theoretical questions, and clinical head and neck surgery scenarios were assessed by 27 reviewers from 25 academic centers worldwide. Construct validity, internal consistency, inter-rater and test-retest reliability were assessed to validate the tool. RESULTS The validation was conducted on the basis of 792 assessments for the 30 responses given by ChatGPT4. The results of the exploratory factor analysis revealed a unidimensional structure of the QAMAI with a single factor comprising all the items that explained 51.1% of the variance with factor loadings ranging from 0.449 to 0.856. Overall internal consistency was high (Cronbach's alpha = 0.837). The Interclass Correlation Coefficient was 0.983 (95% CI 0.973-0.991; F (29,542) = 68.3; p < 0.001), indicating excellent reliability. Test-retest reliability analysis revealed a moderate-to-strong correlation with a Pearson's coefficient of 0.876 (95% CI 0.859-0.891; p < 0.001). CONCLUSIONS The QAMAI tool demonstrated significant reliability and validity in assessing the quality of health information provided by AI platforms. Such a tool might become particularly important/useful for physicians as patients increasingly seek medical information on AI platforms.
Collapse
Affiliation(s)
- Luigi Angelo Vaira
- Maxillofacial Surgery Operative Unit, Department of Medicine, Surgery and Pharmacy, University of Sassari, Viale San Pietro 43/B, 07100, Sassari, Italy.
- PhD School of Biomedical Science, Biomedical Sciences Department, University of Sassari, Sassari, Italy.
| | - Jerome R Lechien
- Department of Laryngology and Bronchoesophagology, EpiCURA Hospital, Mons School of Medicine, UMONS. Research Institute for Health Sciences and Technology, University of Mons (UMons), Mons, Belgium
- Department of Otolaryngology-Head Neck Surgery, Elsan Polyclinic of Poitiers, Poitiers, France
| | - Vincenzo Abbate
- Head and Neck Section, Department of Neurosciences, Reproductive and Odontostomatological Science, Federico II University of Naples, Naples, Italy
| | - Fabiana Allevi
- Maxillofacial Surgery Department, ASSt Santi Paolo e Carlo, University of Milan, Milan, Italy
| | - Giovanni Audino
- Head and Neck Section, Department of Neurosciences, Reproductive and Odontostomatological Science, Federico II University of Naples, Naples, Italy
| | - Giada Anna Beltramini
- Department of Biomedical, Surgical and Dental Sciences, University of Milan, Milan, Italy
- Maxillofacial and Dental Unit, Fondazione IRCCS Cà Granda Ospedale Maggiore Policlinico, Milan, Italy
| | - Michela Bergonzani
- Maxillo-Facial Surgery Division, Head and Neck Department, University Hospital of Parma, Parma, USA
| | - Paolo Boscolo-Rizzo
- Department of Medical, Surgical and Health Sciences, Section of Otolaryngology, University of Trieste, Trieste, Italy
| | - Gianluigi Califano
- Department of Neurosciences, Reproductive and Odontostomatological Science, Federico II University of Naples, Naples, Italy
| | - Giovanni Cammaroto
- ENT Department, Morgagni Pierantoni Hospital, AUSL Romagna, Forlì, Italy
| | - Carlos M Chiesa-Estomba
- Department of Otorhinolaryngology-Head and Neck Surgery, Hospital Universitario Donostia, San Sebastian, Spain
| | - Umberto Committeri
- Head and Neck Section, Department of Neurosciences, Reproductive and Odontostomatological Science, Federico II University of Naples, Naples, Italy
| | - Salvatore Crimi
- Operative Unit of Maxillofacial Surgery, Policlinico San Marco, University of Catania, Catania, Italy
| | - Nicholas R Curran
- Department of Otolaryngology-Head and Neck Surgery, University of Cincinnati Medical Center, Cincinnati, OH, USA
| | - Francesco di Bello
- Department of Neurosciences, Reproductive and Odontostomatological Science, Federico II University of Naples, Naples, Italy
| | - Arianna di Stadio
- Otolaryngology Unit, GF Ingrassia Department, University of Catania, Catania, Italy
| | - Andrea Frosolini
- Department of Maxillofacial Surgery, University of Siena, Siena, Italy
| | - Guido Gabriele
- Department of Maxillofacial Surgery, University of Siena, Siena, Italy
| | - Isabelle M Gengler
- Department of Otolaryngology-Head and Neck Surgery, University of Cincinnati Medical Center, Cincinnati, OH, USA
| | - Fabio Lonardi
- Department of Maxillofacial Surgery, University of Verona, Verona, Italy
| | - Fabio Maglitto
- Maxillo-Facial Surgery Unit, University of Bari "Aldo Moro", Bari, Italy
| | - Miguel Mayo-Yáñez
- Otorhinolaryngology, Head and Neck Surgery Department, Complexo Hospitalario Universitario A Coruña (CHUAC), A Coruña, Galicia, Spain
| | - Marzia Petrocelli
- Maxillofacial Surgery Operative Unit, Bellaria and Maggiore Hospital, Bologna, Italy
| | - Resi Pucci
- Maxillofacial Surgery Unit, San Camillo-Forlanini Hospital, Rome, Italy
| | - Alberto Maria Saibene
- Otolaryngology Unit, Santi Paolo e Carlo Hospital, Department of Health Sciences, University of Milan, Milan, Italy
| | - Gianmarco Saponaro
- Maxillo-Facial Surgery Unit, IRCSS "A. Gemelli" Foundation-Catholic University of the Sacred Heart, Rome, Italy
| | - Alessandro Tel
- Clinic of Maxillofacial Surgery, Department of Head and Neck Surgery and Neuroscience, University Hospital of Udine, Udine, Italy
| | - Franco Trabalzini
- Department of Otorhinolaryngology, Head and Neck Surgery, Meyer Children's Hospital, Florence, Italy
| | - Eleonora M C Trecca
- Department of Otorhinolaryngology and Maxillofacial Surgery, IRCCS Hospital Casa Sollievo Della Sofferenza, San Giovanni Rotondo, Foggia, Italy
- Department of Otorhinolaryngology, University Hospital of Foggia, Foggia, Italy
| | | | - Giovanni Salzano
- Head and Neck Section, Department of Neurosciences, Reproductive and Odontostomatological Science, Federico II University of Naples, Naples, Italy
| | - Giacomo De Riu
- Maxillofacial Surgery Operative Unit, Department of Medicine, Surgery and Pharmacy, University of Sassari, Viale San Pietro 43/B, 07100, Sassari, Italy
| |
Collapse
|
|
2
|
Lechien JR, Maniaci A, Gengler IM, Barillari MR, Vaira LA, Mayo-Yanez M. Acute or persistent mechanisms of dysphonia in COVID-19 patients. Am J Otolaryngol 2024; 45:104223. [PMID: 38241760 DOI: 10.1016/j.amjoto.2024.104223] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/22/2023] [Accepted: 09/24/2023] [Indexed: 01/21/2024]
Affiliation(s)
- Jerome R Lechien
- Research Committee of Young Otolaryngologists of International Federation of Otorhinolaryngological Societies (World Ear, Nose, and Throat Federation), Paris, France; Department of Laryngology and Bronchoesophagology, EpiCURA Hospital, Faculty of Medicine, UMONS Research Institute for Health Sciences and Technology, University of Mons (UMons), Mons, Belgium; Department of Otolaryngology-Head & Neck Surgery, Foch Hospital, School of Medicine, UFR Simone Veil, Université Versailles Saint-Quentin-en-Yvelines (Paris Saclay University), Paris, France.
| | - Antonino Maniaci
- Research Committee of Young Otolaryngologists of International Federation of Otorhinolaryngological Societies (World Ear, Nose, and Throat Federation), Paris, France; Department of Medical, Surgical Sciences and Advanced Technologies G.F. Ingrassia, ENT Section, University of Catania, Catania 95123, Italy
| | - Isabelle M Gengler
- Research Committee of Young Otolaryngologists of International Federation of Otorhinolaryngological Societies (World Ear, Nose, and Throat Federation), Paris, France; Department of Otolaryngology-Head and Neck Surgery, University of Cincinnati Medical Center, Cincinnati, OH, USA
| | - Maria Rosaria Barillari
- Research Committee of Young Otolaryngologists of International Federation of Otorhinolaryngological Societies (World Ear, Nose, and Throat Federation), Paris, France; Department of Mental and Physical Health and Preventive Medicine, "L. Vanvitelli" University, Naples, Naples, Italy
| | - Luigi A Vaira
- Research Committee of Young Otolaryngologists of International Federation of Otorhinolaryngological Societies (World Ear, Nose, and Throat Federation), Paris, France; Maxillofacial Surgery Operative Unit, Department of Medicine, Surgery and Pharmacy, University of Sassari, Italy; Biomedical Science PhD School, Biomedical Science Department, University of Sassari, Italy
| | - Miguel Mayo-Yanez
- Research Committee of Young Otolaryngologists of International Federation of Otorhinolaryngological Societies (World Ear, Nose, and Throat Federation), Paris, France; Otorhinolaryngology-Head and Neck Surgery Department, Complexo Hospitalario Universitario A Coruña (CHUAC), A Coruña, Galicia, Spain
| |
Collapse
|
|
3
|
Lechien JR, Maniaci A, Gengler IM, Al Barajraji M, Mayo-Yanez M. Laryngopharyngeal reflux in otitis media with effusion. Am J Otolaryngol 2024; 45:104152. [PMID: 38134846 DOI: 10.1016/j.amjoto.2023.104152] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/20/2023] [Accepted: 10/29/2023] [Indexed: 12/24/2023]
Affiliation(s)
- Jerome R Lechien
- Research Committee of Young Otolaryngologists of International Federation of Otorhinolaryngological Societies (World Ear, Nose, and Throat Federation), Paris, France; Department of Laryngology and Bronchoesophagology, EpiCURA Hospital, Faculty of Medicine, UMONS Research Institute for Health Sciences and Technology, University of Mons (UMons), Mons, Belgium; Department of Otolaryngology-Head & Neck Surgery, Foch Hospital, School of Medicine, UFR Simone Veil, Université Versailles Saint-Quentin-en-Yvelines (Paris Saclay University), Paris, France.
| | - Antonino Maniaci
- Research Committee of Young Otolaryngologists of International Federation of Otorhinolaryngological Societies (World Ear, Nose, and Throat Federation), Paris, France; Department of Medical, Surgical Sciences and Advanced Technologies G.F. Ingrassia, ENT Section, University of Catania, Catania 95123, Italy
| | - Isabelle M Gengler
- Research Committee of Young Otolaryngologists of International Federation of Otorhinolaryngological Societies (World Ear, Nose, and Throat Federation), Paris, France; Department of Otolaryngology-Head and Neck Surgery, University of Cincinnati Medical Center, Cincinnati, OH, USA
| | - Mejdeddine Al Barajraji
- Research Committee of Young Otolaryngologists of International Federation of Otorhinolaryngological Societies (World Ear, Nose, and Throat Federation), Paris, France
| | - Miguel Mayo-Yanez
- Research Committee of Young Otolaryngologists of International Federation of Otorhinolaryngological Societies (World Ear, Nose, and Throat Federation), Paris, France; Otorhinolaryngology-Head and Neck Surgery Department, Complexo Hospitalario Universitario A Coruña (CHUAC), A Coruña, Galicia, Spain
| |
Collapse
|
|
4
|
Lechien JR, Maniaci A, Gengler IM, Mayo-Yanez M, Vaira LA. Asthma, chronic rhinosinusitis and laryngopharyngeal reflux. Am J Otolaryngol 2023; 44:103953. [PMID: 37331128 DOI: 10.1016/j.amjoto.2023.103953] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/27/2023] [Accepted: 03/19/2023] [Indexed: 06/20/2023]
Affiliation(s)
- Jerome R Lechien
- Research Committee of Young Otolaryngologists of International Federation of Otorhinolaryngological Societies (World Ear, Nose, and Throat Federation), Paris, France; Department of Laryngology and Bronchoesophagology, EpiCURA Hospital, Faculty of Medicine, UMONS Research Institute for Health Sciences and Technology, University of Mons (UMons), Mons, Belgium; Department of Otolaryngology-Head & Neck Surgery, Foch Hospital, School of Medicine, UFR Simone Veil, Université Versailles Saint-Quentin-en-Yvelines (Paris Saclay University), Paris, France.
| | - Antonino Maniaci
- Research Committee of Young Otolaryngologists of International Federation of Otorhinolaryngological Societies (World Ear, Nose, and Throat Federation), Paris, France; Department of Medical, Surgical Sciences and Advanced Technologies G.F. Ingrassia, ENT Section, University of Catania, Catania 95123, Italy
| | - Isabelle M Gengler
- Research Committee of Young Otolaryngologists of International Federation of Otorhinolaryngological Societies (World Ear, Nose, and Throat Federation), Paris, France; Department of Otolaryngology-Head and Neck Surgery, University of Cincinnati Medical Center, Cincinnati, OH, USA
| | - Miguel Mayo-Yanez
- Otorhinolaryngology-Head and Neck Surgery Department, Complexo Hospitalario Universitario A Coruña (CHUAC), A Coruña, Galicia, Spain
| | - Luigi A Vaira
- Research Committee of Young Otolaryngologists of International Federation of Otorhinolaryngological Societies (World Ear, Nose, and Throat Federation), Paris, France; Maxillofacial Surgery Operative Unit, Department of Medicine, Surgery and Pharmacy, University of Sassari, Italy; Biomedical Science PhD School, Biomedical Science Department, University of Sassari, Italy
| |
Collapse
|
|
5
|
Lechien JR, Chiesa-Estomba CM, Maniaci A, Vaira LA, Gengler IM. Dysphagia after supraglottic laryngeal cancer surgery. Am J Otolaryngol 2023; 44:103925. [PMID: 37207574 DOI: 10.1016/j.amjoto.2023.103925] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/01/2023] [Accepted: 02/18/2023] [Indexed: 05/21/2023]
Affiliation(s)
- Jerome R Lechien
- Head Neck Surgery Group of Young Otolaryngologists of International Federation of Otorhinolaryngological Societies, Paris, France; Department of Laryngology and Bronchoesophagology, EpiCURA Hospital, Faculty of Medicine, UMONS Research Institute for Health Sciences and Technology, University of Mons (UMons), Mons, Belgium; Department of Otolaryngology-Head & Neck Surgery, Foch Hospital, School of Medicine, UFR Simone Veil, Université Versailles Saint-Quentin-en-Yvelines (Paris Saclay University), Paris, France.
| | - Carlos M Chiesa-Estomba
- Head Neck Surgery Group of Young Otolaryngologists of International Federation of Otorhinolaryngological Societies, Paris, France; Department of Otolaryngology-Head & Neck Surgery, Donostia University Hospital, Biodonostia Research Institute, San Sebastian, Deusto University, Spain
| | - Antonino Maniaci
- Head Neck Surgery Group of Young Otolaryngologists of International Federation of Otorhinolaryngological Societies, Paris, France; Department of Medical, Surgical Sciences and Advanced Technologies G.F. Ingrassia, ENT Section, University of Catania, Catania 95123, Italy
| | - Luigi A Vaira
- Head Neck Surgery Group of Young Otolaryngologists of International Federation of Otorhinolaryngological Societies, Paris, France; Maxillofacial Surgery Operative Unit, Department of Medical, Surgical and Experimental Sciences, University of Sassari, Italy; Biomedical Science PhD School, Biomedical Science Department, University of Sassari, Italy
| | - Isabelle M Gengler
- Head Neck Surgery Group of Young Otolaryngologists of International Federation of Otorhinolaryngological Societies, Paris, France; Department of Otolaryngology-Head and Neck Surgery, University of Cincinnati Medical Center, Cincinnati, OH, USA
| |
Collapse
|
|
6
|
Vaira LA, De Riu G, Mayo-Yáñez M, Gengler IM, Lechien JR. Prevalence of chemosensitive disorders with Omicron infections and the possible impacts of vaccination. Int J Infect Dis 2023; 129:205-206. [PMID: 36805326 DOI: 10.1016/j.ijid.2023.02.007] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/02/2023] [Revised: 02/08/2023] [Accepted: 02/09/2023] [Indexed: 02/17/2023] Open
Affiliation(s)
- Luigi Angelo Vaira
- Young Otolaryngologists of International Federation of Otorhinolaryngological Societies, Paris, France; Maxillofacial Surgery Operative Unit, Department of Medicine, Surgery and Pharmacy, University of Sassari, Sassari, Italy; Biomedical Science Department, PhD School of Biomedical Science, University of Sassari, Sassari, Italy.
| | - Giacomo De Riu
- Maxillofacial Surgery Operative Unit, Department of Medicine, Surgery and Pharmacy, University of Sassari, Sassari, Italy; Biomedical Science Department, PhD School of Biomedical Science, University of Sassari, Sassari, Italy
| | - Miguel Mayo-Yáñez
- Young Otolaryngologists of International Federation of Otorhinolaryngological Societies, Paris, France; Otorhinolaryngology, Head and Neck Surgery Department, University Hospital Complex of A Coruña (CHUAC), A Coruña, Spain
| | - Isabelle M Gengler
- Young Otolaryngologists of International Federation of Otorhinolaryngological Societies, Paris, France; Department of Otolaryngology-Head and Neck Surgery, University of Cincinnati Medical Center, Cincinnati, USA
| | - Jerome R Lechien
- Young Otolaryngologists of International Federation of Otorhinolaryngological Societies, Paris, France; Department of Laryngology and Bronchoesophagology, EpiCURA Hospital, Faculty of Medicine, UMONS Research Institute for Health Sciences and Technology, University of Mons (UMons), Mons, Belgium; Department of Otolaryngology-Head & Neck Surgery, Foch Hospital, School of Medicine, UFR Simone Veil, Université Versailles Saint-Quentin-en-Yvelines (Paris Saclay University), Paris, France
| |
Collapse
|