Artificial intelligence chatbots as sources of patient education material for obstructive sleep apnoea: ChatGPT versus Google Bard

PURPOSE

To perform the first head-to-head comparative evaluation of patient education material for obstructive sleep apnoea generated by two artificial intelligence chatbots, ChatGPT and its primary rival Google Bard.

METHODS

Fifty frequently asked questions on obstructive sleep apnoea in English were extracted from the patient information webpages of four major sleep organizations and categorized as input prompts. ChatGPT and Google Bard responses were selected and independently rated using the Patient Education Materials Assessment Tool-Printable (PEMAT-P) Auto-Scoring Form by two otolaryngologists, with a Fellowship of the Royal College of Surgeons (FRCS) and a special interest in sleep medicine and surgery. Responses were subjectively screened for any incorrect or dangerous information as a secondary outcome. The Flesch-Kincaid Calculator was used to evaluate the readability of responses for both ChatGPT and Google Bard.

RESULTS

A total of 46 questions were curated and categorized into three domains: condition (n = 14), investigation (n = 9) and treatment (n = 23). Understandability scores for ChatGPT versus Google Bard on the various domains were as follows: condition 90.86% vs.76.32% (p < 0.001); investigation 89.94% vs. 71.67% (p < 0.001); treatment 90.78% vs.73.74% (p < 0.001). Actionability scores for ChatGPT versus Google Bard on the various domains were as follows: condition 77.14% vs. 51.43% (p < 0.001); investigation 72.22% vs. 54.44% (p = 0.05); treatment 73.04% vs. 54.78% (p = 0.002). The mean Flesch-Kincaid Grade Level for ChatGPT was 9.0 and Google Bard was 5.9. No incorrect or dangerous information was identified in any of the generated responses from both ChatGPT and Google Bard.

CONCLUSION

Evaluation of ChatGPT and Google Bard patient education material for OSA indicates the former to offer superior information across several domains.

Probable mechanisms underlying interallelic complementation and temperature-sensitivity of mutations at the shibire locus of Drosophila melanogaster

The shibire locus of Drosophila melanogaster encodes dynamin, a GTPase required for the fission of endocytic vesicles from plasma membrane. Biochemical studies indicate that mammalian dynamin is part of a complex containing multiple dynamin subunits and other polypeptides. To gain insight into sequences of dynamin critical for its function, we have characterized in detail a collection of conditional and lethal shi alleles. We describe a probable null allele of shi and show that its properties are distinct from those of two classes of lethal alleles (termed I and II) that show intergroup, interallelic complementation. Sequenced class I alleles, which display dominant properties, carry missense mutations in conserved residues in the GTPase domain of dynamin. In contrast, the sequenced class II alleles, which appear completely recessive, carry missense mutations in conserved residues of a previously uncharacterized "middle domain" that lies adjacent to the GTPase region. These data suggest that critical interactions mediated by this middle domain are severely affected by the class II lethal mutations; thus, the mutant sequences should be very useful for confirming the in vivo relevance of interactions observed in vitro. Viable heteroallelic combinations of shi lethals show rapid and reversible temperature-sensitive paralytic phenotypes hitherto only described for the ts alleles of shi. When taken together with the molecular analysis of shi mutations, these observations suggest that the GTPase domain of dynamin carries an intrinsically temperature-sensitive activity: hypomorphic mutations that reduce this activity at low temperatures result in conditional temperature-sensitive phenotype. These observations explain why screens for conditional paralytic mutants in Drosophila inevitably recover ts alleles of shi at high frequencies.

Clinical outcomes, Kadish-INSICA staging and therapeutic targeting of somatostatin receptor 2 in olfactory neuroblastoma

INTRODUCTION

Olfactory neuroblastoma (ONB) is a rare cancer of the sinonasal region. We provide a comprehensive analysis of this malignancy with molecular and clinical trial data on a subset of our cohort to report on the potential efficacy of somatostatin receptor 2 (SSTR2)-targeting imaging and therapy.

METHODS

We conducted a retrospective analysis of 404 primary, locally recurrent, and metastatic olfactory neuroblastoma (ONB) patients from 12 institutions in the United States of America, United Kingdom and Europe. Clinicopathological characteristics and treatment approach were evaluated. SSTR2 expression, SSTR2-targeted imaging and the efficacy of peptide receptor radionuclide therapy [PRRT](177Lu-DOTATATE) were reported in a subset of our cohort (LUTHREE trial; NCT03454763).

RESULTS

Dural infiltration at presentation was a significant predictor of overall survival (OS) and disease-free survival (DFS) in primary cases (n = 278). Kadish-Morita staging and Dulguerov T-stage both had limitations regarding their prognostic value. Multivariable survival analysis demonstrated improved outcomes with lower stage and receipt of adjuvant radiotherapy. Prophylactic neck irradiation significantly reduces the rate of nodal recurrence. 82.4% of the cohort were positive for SSTR2; treatment of three metastatic cases with SSTR2-targeted peptide-radionuclide receptor therapy (PRRT) in the LUTHREE trial was well-tolerated and resulted in stable disease (SD).

CONCLUSIONS

This study presents pertinent clinical data from the largest dataset, to date, on ONB. We identify key prognostic markers and integrate these into an updated staging system, highlight the importance of adjuvant radiotherapy across all disease stages, the utility of prophylactic neck irradiation and the potential efficacy of targeting SSTR2 to manage disease.

International Multicenter Study of Clinical Outcomes of Sinonasal Melanoma Shows Survival Benefit for Patients Treated with Immune Checkpoint Inhibitors and Potential Improvements to the Current TNM Staging System

Objectives Sinonasal mucosal melanoma (SNMM) is an extremely rare and challenging sinonasal malignancy with a poor prognosis. Standard treatment involves complete surgical resection, but the role of adjuvant therapy remains unclear. Crucially, our understanding of its clinical presentation, course, and optimal treatment remains limited, and few advancements in improving its management have been made in the recent past.

Methods We conducted an international multicenter retrospective analysis of 505 SNMM cases from 11 institutions across the United States, United Kingdom, Ireland, and continental Europe. Data on clinical presentation, diagnosis, treatment, and clinical outcomes were assessed.

Results One-, three-, and five-year recurrence-free and overall survival were 61.4, 30.6, and 22.0%, and 77.6, 49.2, and 38.3%, respectively. Compared with disease confined to the nasal cavity, sinus involvement confers significantly worse survival; based on this, further stratifying the T3 stage was highly prognostic (p < 0.001) with implications for a potential modification to the current TNM staging system. There was a statistically significant survival benefit for patients who received adjuvant radiotherapy, compared with those who underwent surgery alone (hazard ratio [HR] = 0.74, 95% confidence interval [CI]: 0.57–0.96, p = 0.021). Immune checkpoint blockade for the management of recurrent or persistent disease, with or without distant metastasis, conferred longer survival (HR = 0.50, 95% CI: 0.25–1.00, p = 0.036).

Conclusions We present findings from the largest cohort of SNMM reported to date. We demonstrate the potential utility of further stratifying the T3 stage by sinus involvement and present promising data on the benefit of immune checkpoint inhibitors for recurrent, persistent, or metastatic disease with implications for future clinical trials in this field.

Performance of artificial intelligence chatbots in sleep medicine certification board exams: ChatGPT versus Google Bard

PURPOSE

To conduct a comparative performance evaluation of GPT-3.5, GPT-4 and Google Bard in self-assessment questions at the level of the American Sleep Medicine Certification Board Exam.

METHODS

A total of 301 text-based single-best-answer multiple choice questions with four answer options each, across 10 categories, were included in the study and transcribed as inputs for GPT-3.5, GPT-4 and Google Bard. The first output responses generated were selected and matched for answer accuracy against the gold-standard answer provided by the American Academy of Sleep Medicine for each question. A global score of 80% and above is required by human sleep medicine specialists to pass each exam category.

RESULTS

GPT-4 successfully achieved the pass mark of 80% or above in five of the 10 exam categories, including the Normal Sleep and Variants Self-Assessment Exam (2021), Circadian Rhythm Sleep-Wake Disorders Self-Assessment Exam (2021), Insomnia Self-Assessment Exam (2022), Parasomnias Self-Assessment Exam (2022) and the Sleep-Related Movements Self-Assessment Exam (2023). GPT-4 demonstrated superior performance in all exam categories and achieved a higher overall score of 68.1% when compared against both GPT-3.5 (46.8%) and Google Bard (45.5%), which was statistically significant (p value < 0.001). There was no significant difference in the overall score performance between GPT-3.5 and Google Bard.

CONCLUSIONS

Otolaryngologists and sleep medicine physicians have a crucial role through agile and robust research to ensure the next generation AI chatbots are built safely and responsibly.

The role of surgery in antineutrophil cytoplasmic antibody-associated vasculitides affecting the nose and sinuses: A systematic review

Background:

The ear, nose and throat region has been reported to be one of the commonest sites involved in antineutrophil cytoplasmic antibody (ANCA)–associated vasculitis diseases and often precedes the diagnosis of ANCA–associated vasculitis by many months. Although treatment for ANCA–associated vasculitis primarily requires systemic immunosuppressive therapy, there are specific indications for sinonasal surgery during the course of the disease process. The three major roles for surgery in sinonasal vasculitis are to aid diagnosis through biopsy, enable symptom relief and nasal reconstructive surgery consideration when in remission.

Purpose:

The aim of this systematic review is to provide an overview of the surgical procedures which can be performed in patients with ANCA–associated vasculitis presenting with sinonasal involvement.

Materials and methods:

A systematic literature search was performed for scientific articles on MEDLINE (PubMed Advanced MEDLINE Search) and EMBASE. The search included all articles up to April 2020.

Conclusion:

Surgical intervention during the active phase of ANCA–associated vasculitis disease can improve the patient’s symptoms and enable histological diagnosis. The surgical decision to manage the nose requires a multidisciplinary approach involving the vasculitis specialist and the ear, nose and throat surgeon. Nasal reconstruction can be performed to restore form and function but only when the disease is in remission so as to maximise success and minimise complications.

Paediatric aneurysmal bone cyst: not as easy as ABC

Aneurysmal bone cysts (ABCs) are expansile cystic lesions that can affect any bone of the body. Whilst these lesions are histologically benign, the lesions are locally aggressive and can affect the integrity of the affected bone as well as surrounding structures. ABCs arising in the head and neck region, particularly the paranasal sinuses are rare and they are limited to case reports in the literature. Due to the proximity of critical anatomical structures and the visual apparatus, the potential complications can be devastating. The present article discusses both the clinical and radiological findings of an ABC arising from the ethmoid sinuses in a 6-year-old child and the potentially challenging diagnosis with its complex ensuing surgical management. The identification of an ABC arising in the paranasal sinuses is both a diagnostic and surgical challenge and ideally requires complex management in a joint paediatric ENT and craniofacial unit.

ENT training amongst general practitioners: results from a questionnaire

OBJECTIVES

To evaluate the level of undergraduate and post-graduate ENT exposure amongst general practitioners and their perceived quality of this training. A secondary aim was to examine whether general practitioners believe ENT department based rotations should remain in the undergraduate curriculum.

METHOD

An online questionnaire-based survey was sent to general practices in England.

RESULTS

A total of 417 general practitioners completed the questionnaire. Sixty-seven per cent had completed an ENT rotation at medical school whereas 27 per cent had undertaken a postgraduate placement in ENT. Fifty-one per cent had received post-graduate teaching in ENT, mainly in the form of lectures. The majority of general practitioners were not satisfied with their training in ENT at undergraduate and post-graduate levels. Eighty-five per cent of general practitioners believed formal hospital-based ENT training should remain in the undergraduate curriculum.

CONCLUSION

General practitioners reported insufficient exposure to ENT during both post-graduate and undergraduate training. Proposals to outsource undergraduate ENT teaching to affiliated departments such as general practice are of concern.

Postoperative Care in Aesthetic Rhinoplasty Patients

After rhinoplasty, during the first 24 hours, the patients should be closely monitored for pain and discomfort, nausea and vomiting, and cool compresses must be applied regularly to decrease edema and ecchymosis. In the early postoperative period of the first month, the sutures, cast, and splints are usually removed during the first week. Then the patient is followed-up at 1, 3, 6, and 12-month intervals routinely to observe healing. In the meantime, any kind of intranasal and extranasal complications should be noted. The outcome measures such as ROE, NOSE, or SCHNOS should be used 3 to 6 months after surgery. If the patient is closely followed-up, then any unwanted complication or dissatisfaction can be solved after 6 to 12 months.

Transnasal transpterygoid resection of meningoencephalocoele with abolition of seizures

Meningoencephalocoeles are herniations of intracranial contents through skull base defects. Patients may present with a plethora of symptoms ranging from cerebrospinal fluid (CSF) rhinorrhoea to epileptic convulsions, or indeed may be asymptomatic. We present a case of a 24-year-old man suffering from new onset, drug-resistant tonic-clonic seizures. Imaging studies revealed neural tissue and meninges protruding through the pterygoid portion of the sphenoid bone, into the anteromedial aspect of the middle cranial fossa. An image-guided endoscopic transnasal transpterygoid approach was carried out as a joint otolaryngological and neurosurgical procedure, resulting in the patient being seizure-free for over 12 months postoperatively. There is a paucity of literature supporting such an endoscopic approach to treat epilepsy secondary to a meningoencephalocoele. We illustrate that this is a safe and minimally invasive treatment option which ultimately rendered the patient free of all anticonvulsants.

A Unilateral Mucoperichondrial/Mucoperiosteal Flap Including Inferior Turbinate with Contralateral Underlay Xenograft for a Large Nasal Septal Perforation Repair

Findings: We describe a septal perforation repair technique aimed for moderate to large perforations, which involves a unilateral transpositional/rotational flap utilizing lateral nasal wall and inferior turbinate (IT) mucosa and a contralateral underlay porcine small intestinal submucosa mesh. Meaning: The addition of IT mucosa as part of the unilateral lateral nasal wall mucoperichondrium/periosteal flap combined with a contralateral acellular matrix underlay optimizes the repair of larger perforations. The underlay acellular matrix acts as a scaffold for the regeneration of healthy mucoperichondrium akin to a tympanoplasty repair and reduces donor site morbidity.

Olfactory dysfunction in antineutrophil cytoplasmic antibody-associated vasculitides: A review of the literature

Olfactory dysfunction (OD) has been described in patients with antineutrophil cytoplasmic antibody-associated vasculitides (AAV), but the underlying mechanisms are not completely understood. The causes of altered smell function can generally be divided into conductive, sensorineural or others. To date no specific treatment is available for AAV-related OD and the efficacy of currently available options has not been explored. The aim of this review is to provide an overview of the causes that may lead to OD in patients with AAV. Current available treatments for OD and possible options in patients with AAV presenting with smell impairment are also mentioned.

Using Cumulative Summation to Draw Otolaryngology Trainees’ Learning Curves in Tonsillectomy

Objectives:

Assess the applicability of cumulative summation (CUSUM) in 1) showing trainees progress, 2) achieving competency, and 3) highlighting concerns in tonsillectomy surgery.

Methods:

We followed 9 otolaryngology junior trainees in their first 6-12 months in the specialty between 2011-2013. Tonsillectomy is the most common operation that introduces trainees to operative otolaryngology. Two outcome measures were used: operative time and post-operative bleeding. These were then compared to experienced surgeons (>100 tonsillectomies). For time CUSUM, the mean and standard deviation of the experts’ performance was used as the factor to draw the curve applying the formula (Cn=0, Cn-1+Xn-k) on consecutive procedures. k=0.2 to allow for 20% incidence of overrunning. For bleeding CUSUM, any post-operative bleed was regarded a negative outcome and k=0.05 to allow for 5% incidence.

Results:

Trainees performed 14-35 tonsillectomies each (ongoing). The average time for experts over 150 procedures was 23min (SD:11). Trainees’ operative time was higher (38min, SD:16, P<0.01). Xn=0 if the time was within 1SD of the experts (34min) and 1 if higher. Trainees’ time CUSUM plateaued after a variable number of cases (20-30) while that of experts remained low. For bleeding CUSUM, Xn=1 if reported and 0 if not. Bleeding was rare and did not reflect the same pattern.

Conclusions:

CUSUM using time can be used to monitor performance and draw learning curves for tonsillectomy. Bleeding is a rare complication and hence needs larger numbers to show improvement. The flexibility of the CUSUM makes it adaptable to any outcome. It allows early detection of poor performance to instigate intervention.

Acute otitis externa: Consensus definition, diagnostic criteria and core outcome set development

OBJECTIVE

Evidence for the management of acute otitis externa (AOE) is limited, with unclear diagnostic criteria and variably reported outcome measures that may not reflect key stakeholder priorities. We aimed to develop 1) a definition, 2) diagnostic criteria and 3) a core outcome set (COS) for AOE.

STUDY DESIGN

COS development according to Core Outcome Measures in Effectiveness Trials (COMET) methodology and parallel consensus selection of diagnostic criteria/definition.

SETTING

Stakeholders from the United Kingdom.

SUBJECTS AND METHODS

Comprehensive literature review identified candidate items for the COS, definition and diagnostic criteria. Nine individuals with past AOE generated further patient-centred candidate items. Candidate items were rated for importance by patient and professional (ENT doctors, general practitioners, microbiologists, nurses, audiologists) stakeholders in a three-round online Delphi exercise. Consensus items were grouped to form the COS, diagnostic criteria, and definition.

RESULTS

Candidate COS items from patients (n = 28) and literature (n = 25) were deduplicated and amalgamated to a final candidate list (n = 46). Patients emphasised quality-of-life and the impact on daily activities/work. Via the Delphi process, stakeholders agreed on 31 candidate items. The final COS covered six outcomes: pain; disease severity; impact on quality-of-life and daily activities; patient satisfaction; treatment-related outcome; and microbiology. 14 candidate diagnostic criteria were identified, 8 reaching inclusion consensus. The final definition for AOE was 'diffuse inflammation of the ear canal skin of less than 6 weeks duration'.

CONCLUSION

The development and adoption of a consensus definition, diagnostic criteria and a COS will help to standardise future research in AOE, facilitating meta-analysis. Consulting former patients throughout development highlighted deficiencies in the outcomes adopted previously, in particular concerning the impact of AOE on daily life.

Enhancing paranasal sinus disease detection with AutoML: efficient AI development and evaluation via magnetic resonance imaging

PURPOSE

Artificial intelligence (AI) in the form of automated machine learning (AutoML) offers a new potential breakthrough to overcome the barrier of entry for non-technically trained physicians. A Clinical Decision Support System (CDSS) for screening purposes using AutoML could be beneficial to ease the clinical burden in the radiological workflow for paranasal sinus diseases.

METHODS

The main target of this work was the usage of automated evaluation of model performance and the feasibility of the Vertex AI image classification model on the Google Cloud AutoML platform to be trained to automatically classify the presence or absence of sinonasal disease. The dataset is a consensus labelled Open Access Series of Imaging Studies (OASIS-3) MRI head dataset by three specialised head and neck consultant radiologists. A total of 1313 unique non-TSE T2w MRI head sessions were used from the OASIS-3 repository.

RESULTS

The best-performing image classification model achieved a precision of 0.928. Demonstrating the feasibility and high performance of the Vertex AI image classification model to automatically detect the presence or absence of sinonasal disease on MRI.

CONCLUSION

AutoML allows for potential deployment to optimise diagnostic radiology workflows and lay the foundation for further AI research in radiology and otolaryngology. The usage of AutoML could serve as a formal requirement for a feasibility study.

Objective and Subjective Outcomes Following Radiofrequency of Inferior Turbinates in Patients with Sleep-Disordered Breathing

BACKGROUND

Nasal obstruction is a frequent problem amongst patients with sleep-disordered breathing (SDB). Radiofrequency of the inferior turbinates (RFIT) is commonly utilized for inferior turbinate (IT) reduction but its effectiveness in SDB patients remains unproven. We aim to evaluate long-term objective and subjective nasal, olfactory and sleep outcomes following RFIT in SDB patients.

METHODS

Patients were assessed at baseline (T0) and at 3 months (T1), 6 months (T2) and 12 months (T3) following RFIT. At T0, T1, T2 and T3, the patients underwent objective assessments of their nasal airways and smell function and an evaluation of their quality-of-life, sinonasal, olfactory and sleep symptoms. Sleep studies were carried out at T0 and T2.

RESULTS

Seventeen patients (with a median age of 42 years) underwent RFIT. A statistically significant objective and subjective improvement of the patients' nasal airways was demonstrated at T1. No other statistically significant changes were observed in the patients' nasal airways, smell, sleep study parameters or patient-reported outcomes at the other follow-ups. A multivariate analysis confirmed a statistically significant influence of age (older), sex (male), a higher BMI, the presence of septal deviation and the presence of allergic rhinitis in some of the studies' parameters. A statistically significant objective and subjective improvement of the patients' nasal airways was confirmed in the fitted model when considering the influence of the available variables.

CONCLUSIONS

Our study confirms that the benefits of RFIT alone in SDB patients are limited and possibly only in the short-term period. Patient-related variables can potentially influence the final outcomes.

Rare and unusual metastases of a gastrointestinal stromal tumour

Gastrointestinal stromal tumours (GISTs) are the most common mesenchymal tumours of the gastrointestinal tract, histological and immunohistochemistry findings help to differentiate such tumours from other gastrointestinal malignancies. Metastasis is common to the stomach and small bowel and often presents with gastrointestinal bleeding. This is a case of an 82 year old man with an inguinal mass that following exploratory examination was found on histology to be a GIST metastases, imaging also showed pulmonary metastases. Following colonoscopy the primary caecal mass was found. Such metastatic presentations are extremely rare for this type of tumour. This case report highlights these unusual findings.