Baldwin AJ. An artificial intelligence language model improves readability of burns first aid information.
Burns 2024;
50:1122-1127. [PMID:
38492982 DOI:
10.1016/j.burns.2024.03.005]
[Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/17/2023] [Revised: 01/29/2024] [Accepted: 03/05/2024] [Indexed: 03/18/2024]
Abstract
AIMS
This study aimed to assess the potential of using an artificial intelligence (AI) large language model to improve the readability of burns first aid information.
METHODS
An AI language model (ChatGPT-3) was used to rewrite content from the top 50 English-language webpages containing burns first aid information to be understandable by an individual with the literacy level of an 11-year-old, as recommended by the American Medical Association and Health Education England. The assessment of readability was conducted using five validated tools.
RESULTS
In their original form, only 4% of the patient education materials (PEMs) met the target readability level across all tools. The median grade was 6.9 (SD=1.1). One-sample one-tailed t-test revealed that this was not significantly below the target (p = .31). After AI-modification, 18% of PEMs reached the target level using all tools, with a median grade of 6 (SD=0.9), which was significantly below the target level (p < .001). Once rewritten using AI, paired t-test demonstrated that all readability scores improved significantly (p < .001).
CONCLUSION
Utilising an AI language model proved an effective and viable method for enhancing readability of burns first aid information.
Collapse