3
|
Huang W, Koh T, Tromp J, Chandramouli C, Ewe SH, Ng CT, Lee ASY, Teo LLY, Hummel Y, Huang F, Lam CSP. Point-of-care AI-enhanced novice echocardiography for screening heart failure (PANES-HF). Sci Rep 2024; 14:13503. [PMID: 38866831 PMCID: PMC11169397 DOI: 10.1038/s41598-024-62467-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/16/2023] [Accepted: 05/17/2024] [Indexed: 06/14/2024] Open
Abstract
The increasing prevalence of heart failure (HF) in ageing populations drives demand for echocardiography (echo). There is a worldwide shortage of trained sonographers and long waiting times for expert echo. We hypothesised that artificial intelligence (AI)-enhanced point-of-care echo can enable HF screening by novices. The primary endpoint was the accuracy of AI-enhanced novice pathway in detecting reduced LV ejection fraction (LVEF) < 50%. Symptomatic patients with suspected HF (N = 100, mean age 61 ± 15 years, 56% men) were prospectively recruited. Novices with no prior echo experience underwent 2-weeks' training to acquire echo images with AI guidance using the EchoNous Kosmos handheld echo, with AI-automated reporting by Us2.ai (AI-enhanced novice pathway). All patients also had standard echo by trained sonographers interpreted by cardiologists (reference standard). LVEF < 50% by reference standard was present in 27 patients. AI-enhanced novice pathway yielded interpretable results in 96 patients and took a mean of 12 min 51 s per study. The area under the curve (AUC) of the AI novice pathway was 0.880 (95% CI 0.802, 0.958). The sensitivity, specificity, positive predictive and negative predictive values of the AI-enhanced novice pathway in detecting LVEF < 50% were 84.6%, 91.4%, 78.5% and 94.1% respectively. The median absolute deviation of the AI-novice pathway LVEF from the reference standard LVEF was 6.03%. AI-enhanced novice pathway holds potential to task shift echo beyond tertiary centres and improve the HF diagnostic workflow.
Collapse
Affiliation(s)
- Weiting Huang
- National Heart Centre Singapore, 5 Hospital Drive, Singapore, 169609, Singapore.
- Duke-NUS Medical School, Singapore, Singapore.
| | - Tracy Koh
- National Heart Centre Singapore, 5 Hospital Drive, Singapore, 169609, Singapore
- Duke-NUS Medical School, Singapore, Singapore
| | - Jasper Tromp
- Duke-NUS Medical School, Singapore, Singapore
- Saw Swee Hock School of Public Health, National University of Singapore, and National University Health System Singapore, Singapore, Singapore
| | - Chanchal Chandramouli
- National Heart Centre Singapore, 5 Hospital Drive, Singapore, 169609, Singapore
- Duke-NUS Medical School, Singapore, Singapore
| | - See Hooi Ewe
- National Heart Centre Singapore, 5 Hospital Drive, Singapore, 169609, Singapore
- Duke-NUS Medical School, Singapore, Singapore
| | - Choon Ta Ng
- National Heart Centre Singapore, 5 Hospital Drive, Singapore, 169609, Singapore
- Duke-NUS Medical School, Singapore, Singapore
| | - Audry Shan Yin Lee
- National Heart Centre Singapore, 5 Hospital Drive, Singapore, 169609, Singapore
- Duke-NUS Medical School, Singapore, Singapore
| | - Louis Loon Yee Teo
- National Heart Centre Singapore, 5 Hospital Drive, Singapore, 169609, Singapore
- Duke-NUS Medical School, Singapore, Singapore
| | | | | | - Carolyn Su Ping Lam
- National Heart Centre Singapore, 5 Hospital Drive, Singapore, 169609, Singapore
- Duke-NUS Medical School, Singapore, Singapore
- Us2.ai, Singapore, Singapore
| |
Collapse
|
4
|
Snelling PJ, Jones P, Bade D, Bindra R, Davison M, Gillespie A, McEniery J, Moore M, Keijzers G, Ware RS. Diagnostic Accuracy of Point-of-Care Ultrasound Versus Radiographic Imaging for Pediatric Distal Forearm Fractures: A Randomized Controlled Trial. Ann Emerg Med 2024; 83:198-207. [PMID: 37999655 DOI: 10.1016/j.annemergmed.2023.10.008] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/15/2023] [Revised: 10/05/2023] [Accepted: 10/10/2023] [Indexed: 11/25/2023]
Abstract
STUDY OBJECTIVE In patients aged 5 to 15 years with a clinically nondeformed distal forearm injury presenting to the emergency department (ED), we examined whether point-of-care ultrasound or radiographic imaging had better diagnostic accuracy, with the reference diagnosis determined by an expert panel review. METHODS This multicenter, open-label, diagnostic randomized controlled trial was conducted in South East Queensland, Australia. Eligible patients were randomized to receive initial imaging through point-of-care ultrasound performed by an ED clinician or radiograph. Images were defined as "no," "buckle," or "other" fracture by the treating clinician. The primary outcome was the diagnostic accuracy of the treating clinician's interpretation compared against the reference standard diagnosis, which was determined retrospectively by an expert panel consisting of an emergency physician, pediatric radiologist, and pediatric orthopedic surgeon, who reviewed all imaging and follow-up. RESULTS Two-hundred and seventy participants were enrolled, with 135 randomized to each initial imaging modality. There were 132 (97.8%) and 112 (83.0%) correctly diagnosed participants by ED clinicians in the point-of-care ultrasound and radiograph groups, respectively (absolute difference [AD]=14.8%; 95% confidence interval [CI] 8.0% to 21.6%; P<.001). Point-of-care ultrasound had better accuracy for participants with "buckle" fractures (AD=18.5%; 95% CI 7.1% to 29.8%) and "other" fractures (AD=17.1%; 95% CI 2.7% to 31.6%). No clinically important fractures were missed in either group. CONCLUSION In children and adolescents presenting to the ED with a clinically nondeformed distal forearm injury, clinician-performed (acquired and interpreted) point-of-care ultrasound more accurately identified the correct diagnosis than clinician-interpreted radiographic imaging.
Collapse
Affiliation(s)
- Peter J Snelling
- School of Medicine and Dentistry Menzies Health Institute Queensland, Griffith University, Southport, Queensland, Australia; Department of Emergency Medicine, Gold Coast University Hospital, Southport, Queensland, Australia; Sonography Innovation and Research (Sonar) Group, Queensland, Australia; Child Health Research Centre, University of Queensland, Brisbane, Queensland, Australia.
| | - Philip Jones
- School of Medicine and Dentistry Menzies Health Institute Queensland, Griffith University, Southport, Queensland, Australia; Department of Emergency Medicine, Gold Coast University Hospital, Southport, Queensland, Australia; Sonography Innovation and Research (Sonar) Group, Queensland, Australia
| | - David Bade
- Child Health Research Centre, University of Queensland, Brisbane, Queensland, Australia; Department of Orthopaedics, Queensland Children's Hospital, South Brisbane, Queensland, Australia; Griffith Centre of Biomedical and Rehabilitation Engineering (GCORE), Menzies Health Institute, Griffith University, Southport, Queensland, Australia
| | - Randy Bindra
- Department of Orthopaedics, Gold Coast University Hospital, Southport, Queensland, Australia
| | - Michelle Davison
- School of Medicine and Dentistry Menzies Health Institute Queensland, Griffith University, Southport, Queensland, Australia; Department of Emergency Medicine, Sunshine Coast University Hospital, Birtinya, Queensland, Australia
| | - Alan Gillespie
- Department of Emergency Medicine, Gold Coast University Hospital, Southport, Queensland, Australia
| | - Jane McEniery
- Department of Medical Imaging and Nuclear Medicine, Queensland Children's Hospital, South Brisbane, Queensland, Australia; Faculty of Medicine, University of Queensland, Brisbane, Queensland, Australia
| | - Mark Moore
- Department of Emergency Medicine, Queensland Children's Hospital, South Brisbane, Queensland, Australia
| | - Gerben Keijzers
- School of Medicine and Dentistry Menzies Health Institute Queensland, Griffith University, Southport, Queensland, Australia; Department of Emergency Medicine, Gold Coast University Hospital, Southport, Queensland, Australia; Faculty of Health Sciences and Medicine, Bond University, Gold Coast, QLD, Australia
| | - Robert S Ware
- School of Medicine and Dentistry Menzies Health Institute Queensland, Griffith University, Southport, Queensland, Australia
| |
Collapse
|
8
|
Snelling PJ, Jones P, Bade D, Bindra R, Byrnes J, Davison M, George S, Moore M, Keijzers G, Ware RS. Ultrasonography or Radiography for Suspected Pediatric Distal Forearm Fractures. N Engl J Med 2023; 388:2049-2057. [PMID: 37256975 DOI: 10.1056/nejmoa2213883] [Citation(s) in RCA: 5] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 06/02/2023]
Abstract
BACKGROUND Data on whether ultrasonography for the initial diagnostic imaging of forearm fractures in children and adolescents is noninferior to radiography for subsequent physical function of the arm are limited. METHODS In this open-label, multicenter, noninferiority, randomized trial in Australia, we recruited participants 5 to 15 years of age who presented to the emergency department with an isolated distal forearm injury, without a clinically visible deformity, in whom further evaluation with imaging was indicated. Participants were randomly assigned to initially undergo point-of-care ultrasonography or radiography, and were then followed for 8 weeks. The primary outcome was physical function of the affected arm at 4 weeks as assessed with the use of the validated Pediatric Upper Extremity Short Patient-Reported Outcomes Measurement Information System (PROMIS) score (range, 8 to 40, with higher scores indicating better function); the noninferiority margin was 5 points. RESULTS A total of 270 participants were enrolled, with outcomes for 262 participants (97%) available at 4 weeks (with a window of ±3 days) as prespecified. PROMIS scores at 4 weeks in the ultrasonography group were noninferior to those in the radiography group (mean, 36.4 and 36.3 points, respectively; mean difference, 0.1 point; 95% confidence interval [CI], -1.3 to 1.4). Intention-to-treat analyses (in 266 participants with primary outcome data recorded at any time) produced similar results (mean difference, 0.1 point; 95% CI, -1.3 to 1.4). No clinically important fractures were missed, and there were no between-group differences in the occurrence of adverse events. CONCLUSIONS In children and adolescents with a distal forearm injury, the use of ultrasonography as the initial diagnostic imaging method was noninferior to radiography with regard to the outcome of physical function of the arm at 4 weeks. (Funded by the Emergency Medicine Foundation and others; BUCKLED Australian New Zealand Clinical Trials Registry number, ACTRN12620000637943).
Collapse
Affiliation(s)
- Peter J Snelling
- From the School of Medicine and Dentistry and Menzies Health Institute Queensland (P.J.S., P.J., R.B., M.D., S.G., G.K., R.S.W.) and the Centre for Applied Health Economics, School of Medicine and Dentistry (J.B.), Griffith University, the Departments of Emergency Medicine (P.J.S., S.G., G.K.) and Orthopaedics (R.B.) and the Children's Critical Care Unit (S.G.), Gold Coast University Hospital, and the Sonography Innovation and Research (Sonar) Group (P.J.S.), Southport, the Child Health Research Centre, University of Queensland, Brisbane (P.J.S., S.G.), the Departments of Orthopaedics (D.B.) and Emergency Medicine (M.M.), Queensland Children's Hospital, South Brisbane, the Department of Emergency Medicine, Sunshine Coast University Hospital, Birtinya (M.D.), and the Faculty of Health Sciences and Medicine, Bond University, Gold Coast (G.K.) - all in Queensland, Australia
| | - Philip Jones
- From the School of Medicine and Dentistry and Menzies Health Institute Queensland (P.J.S., P.J., R.B., M.D., S.G., G.K., R.S.W.) and the Centre for Applied Health Economics, School of Medicine and Dentistry (J.B.), Griffith University, the Departments of Emergency Medicine (P.J.S., S.G., G.K.) and Orthopaedics (R.B.) and the Children's Critical Care Unit (S.G.), Gold Coast University Hospital, and the Sonography Innovation and Research (Sonar) Group (P.J.S.), Southport, the Child Health Research Centre, University of Queensland, Brisbane (P.J.S., S.G.), the Departments of Orthopaedics (D.B.) and Emergency Medicine (M.M.), Queensland Children's Hospital, South Brisbane, the Department of Emergency Medicine, Sunshine Coast University Hospital, Birtinya (M.D.), and the Faculty of Health Sciences and Medicine, Bond University, Gold Coast (G.K.) - all in Queensland, Australia
| | - David Bade
- From the School of Medicine and Dentistry and Menzies Health Institute Queensland (P.J.S., P.J., R.B., M.D., S.G., G.K., R.S.W.) and the Centre for Applied Health Economics, School of Medicine and Dentistry (J.B.), Griffith University, the Departments of Emergency Medicine (P.J.S., S.G., G.K.) and Orthopaedics (R.B.) and the Children's Critical Care Unit (S.G.), Gold Coast University Hospital, and the Sonography Innovation and Research (Sonar) Group (P.J.S.), Southport, the Child Health Research Centre, University of Queensland, Brisbane (P.J.S., S.G.), the Departments of Orthopaedics (D.B.) and Emergency Medicine (M.M.), Queensland Children's Hospital, South Brisbane, the Department of Emergency Medicine, Sunshine Coast University Hospital, Birtinya (M.D.), and the Faculty of Health Sciences and Medicine, Bond University, Gold Coast (G.K.) - all in Queensland, Australia
| | - Randy Bindra
- From the School of Medicine and Dentistry and Menzies Health Institute Queensland (P.J.S., P.J., R.B., M.D., S.G., G.K., R.S.W.) and the Centre for Applied Health Economics, School of Medicine and Dentistry (J.B.), Griffith University, the Departments of Emergency Medicine (P.J.S., S.G., G.K.) and Orthopaedics (R.B.) and the Children's Critical Care Unit (S.G.), Gold Coast University Hospital, and the Sonography Innovation and Research (Sonar) Group (P.J.S.), Southport, the Child Health Research Centre, University of Queensland, Brisbane (P.J.S., S.G.), the Departments of Orthopaedics (D.B.) and Emergency Medicine (M.M.), Queensland Children's Hospital, South Brisbane, the Department of Emergency Medicine, Sunshine Coast University Hospital, Birtinya (M.D.), and the Faculty of Health Sciences and Medicine, Bond University, Gold Coast (G.K.) - all in Queensland, Australia
| | - Joshua Byrnes
- From the School of Medicine and Dentistry and Menzies Health Institute Queensland (P.J.S., P.J., R.B., M.D., S.G., G.K., R.S.W.) and the Centre for Applied Health Economics, School of Medicine and Dentistry (J.B.), Griffith University, the Departments of Emergency Medicine (P.J.S., S.G., G.K.) and Orthopaedics (R.B.) and the Children's Critical Care Unit (S.G.), Gold Coast University Hospital, and the Sonography Innovation and Research (Sonar) Group (P.J.S.), Southport, the Child Health Research Centre, University of Queensland, Brisbane (P.J.S., S.G.), the Departments of Orthopaedics (D.B.) and Emergency Medicine (M.M.), Queensland Children's Hospital, South Brisbane, the Department of Emergency Medicine, Sunshine Coast University Hospital, Birtinya (M.D.), and the Faculty of Health Sciences and Medicine, Bond University, Gold Coast (G.K.) - all in Queensland, Australia
| | - Michelle Davison
- From the School of Medicine and Dentistry and Menzies Health Institute Queensland (P.J.S., P.J., R.B., M.D., S.G., G.K., R.S.W.) and the Centre for Applied Health Economics, School of Medicine and Dentistry (J.B.), Griffith University, the Departments of Emergency Medicine (P.J.S., S.G., G.K.) and Orthopaedics (R.B.) and the Children's Critical Care Unit (S.G.), Gold Coast University Hospital, and the Sonography Innovation and Research (Sonar) Group (P.J.S.), Southport, the Child Health Research Centre, University of Queensland, Brisbane (P.J.S., S.G.), the Departments of Orthopaedics (D.B.) and Emergency Medicine (M.M.), Queensland Children's Hospital, South Brisbane, the Department of Emergency Medicine, Sunshine Coast University Hospital, Birtinya (M.D.), and the Faculty of Health Sciences and Medicine, Bond University, Gold Coast (G.K.) - all in Queensland, Australia
| | - Shane George
- From the School of Medicine and Dentistry and Menzies Health Institute Queensland (P.J.S., P.J., R.B., M.D., S.G., G.K., R.S.W.) and the Centre for Applied Health Economics, School of Medicine and Dentistry (J.B.), Griffith University, the Departments of Emergency Medicine (P.J.S., S.G., G.K.) and Orthopaedics (R.B.) and the Children's Critical Care Unit (S.G.), Gold Coast University Hospital, and the Sonography Innovation and Research (Sonar) Group (P.J.S.), Southport, the Child Health Research Centre, University of Queensland, Brisbane (P.J.S., S.G.), the Departments of Orthopaedics (D.B.) and Emergency Medicine (M.M.), Queensland Children's Hospital, South Brisbane, the Department of Emergency Medicine, Sunshine Coast University Hospital, Birtinya (M.D.), and the Faculty of Health Sciences and Medicine, Bond University, Gold Coast (G.K.) - all in Queensland, Australia
| | - Mark Moore
- From the School of Medicine and Dentistry and Menzies Health Institute Queensland (P.J.S., P.J., R.B., M.D., S.G., G.K., R.S.W.) and the Centre for Applied Health Economics, School of Medicine and Dentistry (J.B.), Griffith University, the Departments of Emergency Medicine (P.J.S., S.G., G.K.) and Orthopaedics (R.B.) and the Children's Critical Care Unit (S.G.), Gold Coast University Hospital, and the Sonography Innovation and Research (Sonar) Group (P.J.S.), Southport, the Child Health Research Centre, University of Queensland, Brisbane (P.J.S., S.G.), the Departments of Orthopaedics (D.B.) and Emergency Medicine (M.M.), Queensland Children's Hospital, South Brisbane, the Department of Emergency Medicine, Sunshine Coast University Hospital, Birtinya (M.D.), and the Faculty of Health Sciences and Medicine, Bond University, Gold Coast (G.K.) - all in Queensland, Australia
| | - Gerben Keijzers
- From the School of Medicine and Dentistry and Menzies Health Institute Queensland (P.J.S., P.J., R.B., M.D., S.G., G.K., R.S.W.) and the Centre for Applied Health Economics, School of Medicine and Dentistry (J.B.), Griffith University, the Departments of Emergency Medicine (P.J.S., S.G., G.K.) and Orthopaedics (R.B.) and the Children's Critical Care Unit (S.G.), Gold Coast University Hospital, and the Sonography Innovation and Research (Sonar) Group (P.J.S.), Southport, the Child Health Research Centre, University of Queensland, Brisbane (P.J.S., S.G.), the Departments of Orthopaedics (D.B.) and Emergency Medicine (M.M.), Queensland Children's Hospital, South Brisbane, the Department of Emergency Medicine, Sunshine Coast University Hospital, Birtinya (M.D.), and the Faculty of Health Sciences and Medicine, Bond University, Gold Coast (G.K.) - all in Queensland, Australia
| | - Robert S Ware
- From the School of Medicine and Dentistry and Menzies Health Institute Queensland (P.J.S., P.J., R.B., M.D., S.G., G.K., R.S.W.) and the Centre for Applied Health Economics, School of Medicine and Dentistry (J.B.), Griffith University, the Departments of Emergency Medicine (P.J.S., S.G., G.K.) and Orthopaedics (R.B.) and the Children's Critical Care Unit (S.G.), Gold Coast University Hospital, and the Sonography Innovation and Research (Sonar) Group (P.J.S.), Southport, the Child Health Research Centre, University of Queensland, Brisbane (P.J.S., S.G.), the Departments of Orthopaedics (D.B.) and Emergency Medicine (M.M.), Queensland Children's Hospital, South Brisbane, the Department of Emergency Medicine, Sunshine Coast University Hospital, Birtinya (M.D.), and the Faculty of Health Sciences and Medicine, Bond University, Gold Coast (G.K.) - all in Queensland, Australia
| |
Collapse
|