Caglar U, Yildiz O, Meric A, Ayranci A, Gelmis M, Sarilar O, Ozgor F. Evaluating the performance of ChatGPT in answering questions related to pediatric urology.
J Pediatr Urol 2024;
20:26.e1-26.e5. [PMID:
37596194 DOI:
10.1016/j.jpurol.2023.08.003]
[Citation(s) in RCA: 7] [Impact Index Per Article: 7.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 05/31/2023] [Revised: 07/25/2023] [Accepted: 08/01/2023] [Indexed: 08/20/2023]
Abstract
INTRODUCTION
Artificial intelligence is advancing in various domains, including medicine, and its progress is expected to continue in the future.
OBJECTIVE
This research aimed to assess the precision and consistency of ChatGPT's responses to commonly asked inquiries related to pediatric urology.
MATERIALS AND METHODS
We examined commonly posed inquiries regarding pediatric urology found on urology association websites, hospitals, and social media platforms. Additionally, we referenced the recommendations tables in the European Urology Association's (EAU) 2022 Guidelines on Pediatric Urology, which contained robust data at the strong recommendation level. All questions were systematically presented to ChatGPT's May 23 Version, and two expert urologists independently assessed and assigned scores ranging from 1 to 4 to each response.
RESULTS
A hundred thirty seven questions about pediatric urology were included in the study. The answers to questions resulted in 92.0% completely correct. The completely correct rate in the questions prepared according to the strong recommendations of the EAU guideline was 93.6%. No question was answered completely wrong. The similarity rates of the answers to the repeated questions were between 93.8% and 100%.
CONCLUSION
ChatGPT has provided satisfactory responses to inquiries related to pediatric urology. Despite its limitations, it is foreseeable that this continuously evolving platform will occupy a crucial position in the healthcare industry.
Collapse