1
|
Xue X, Zhang D, Sun C, Shi Y, Wang R, Tan T, Gao P, Fan S, Zhai G, Hu M, Wu Y. Xiaoqing: A Q&A model for glaucoma based on LLMs. Comput Biol Med 2024; 174:108399. [PMID: 38615461 DOI: 10.1016/j.compbiomed.2024.108399] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/01/2024] [Revised: 03/06/2024] [Accepted: 04/01/2024] [Indexed: 04/16/2024]
Abstract
Glaucoma is one of the leading cause of blindness worldwide. Individuals affected by glaucoma, including patients and their family members, frequently encounter a deficit in dependable support beyond the confines of clinical environments. Seeking advice via the internet can be a difficult task due to the vast amount of disorganized and unstructured material available on these sites, nevertheless. This research explores how Large Language Models (LLMs) can be leveraged to better serve medical research and benefit glaucoma patients. We introduce Xiaoqing, a Natural Language Processing (NLP) model specifically tailored for the glaucoma field, detailing its development and deployment. To evaluate its effectiveness, we conducted two forms of experiments: comparative and experiential. In the comparative analysis, we presented 22 glaucoma-related questions in simplified Chinese to three medical NLP models (Xiaoqing LLMs, HuaTuo, Ivy GPT) and two general models (ChatGPT-3.5 and ChatGPT-4), covering a range of topics from basic glaucoma knowledge to treatment, surgery, research, management standards, and patient lifestyle. Responses were assessed for informativeness and readability. The experiential experiment involved glaucoma patients and non-patients interacting with Xiaoqing, collecting and analyzing their questions and feedback on the same criteria. The findings demonstrated that Xiaoqing notably outperformed the other models in terms of informativeness and readability, suggesting that Xiaoqing is a significant advancement in the management and treatment of glaucoma in China. We also provide a Web-based version of Xiaoqing, allowing readers to directly experience its functionality. The Web-based Xiaoqing is available at https://qa.glaucoma-assistant.com//qa.
Collapse
Affiliation(s)
- Xiaojuan Xue
- Shanghai Key Laboratory of Multidimensional Information Processing, East China Normal University, Shanghai, China.
| | - Deshiwei Zhang
- Shanghai Key Laboratory of Multidimensional Information Processing, East China Normal University, Shanghai, China; School of Civil Engineering, Southeast University, Jiangsu, China.
| | - Chengyang Sun
- Department of Ophthalmology, Ninth People's Hospital Affiliated to Shanghai Jiao Tong University School of Medicine, Shanghai, China.
| | - Yiqiao Shi
- Shanghai Key Laboratory of Multidimensional Information Processing, East China Normal University, Shanghai, China.
| | - Rongsheng Wang
- Faculty of Applied Sciences, Macao Polytechnic University, Macao Special Administrative Region of China.
| | - Tao Tan
- Faculty of Applied Sciences, Macao Polytechnic University, Macao Special Administrative Region of China.
| | - Peng Gao
- Department of Ophthalmology, Shanghai Tenth People's Hospital of Tongji University, Shanghai, China.
| | - Sujie Fan
- Department of Ophthalmology, Handan Eye Hospital (the Third Hospital of Handan), Hebei, China.
| | - Guangtao Zhai
- School of Electronic Information and Electrical Engineering, Shanghai Jiao Tong University, Shanghai, China.
| | - Menghan Hu
- Shanghai Key Laboratory of Multidimensional Information Processing, East China Normal University, Shanghai, China.
| | - Yue Wu
- Department of Ophthalmology, Ninth People's Hospital Affiliated to Shanghai Jiao Tong University School of Medicine, Shanghai, China.
| |
Collapse
|