Treating chronic hepatitis B virus: Chinese physicians’ awareness of the 2010 guidelines

Assessing ChatGPT as a Medical Consultation Assistant for Chronic Hepatitis B: Cross-Language Study of English and Chinese

BACKGROUND

Chronic hepatitis B (CHB) imposes substantial economic and social burdens globally. The management of CHB involves intricate monitoring and adherence challenges, particularly in regions like China, where a high prevalence of CHB intersects with health care resource limitations. This study explores the potential of ChatGPT-3.5, an emerging artificial intelligence (AI) assistant, to address these complexities. With notable capabilities in medical education and practice, ChatGPT-3.5's role is examined in managing CHB, particularly in regions with distinct health care landscapes.

OBJECTIVE

This study aimed to uncover insights into ChatGPT-3.5's potential and limitations in delivering personalized medical consultation assistance for CHB patients across diverse linguistic contexts.

METHODS

Questions sourced from published guidelines, online CHB communities, and search engines in English and Chinese were refined, translated, and compiled into 96 inquiries. Subsequently, these questions were presented to both ChatGPT-3.5 and ChatGPT-4.0 in independent dialogues. The responses were then evaluated by senior physicians, focusing on informativeness, emotional management, consistency across repeated inquiries, and cautionary statements regarding medical advice. Additionally, a true-or-false questionnaire was employed to further discern the variance in information accuracy for closed questions between ChatGPT-3.5 and ChatGPT-4.0.

RESULTS

Over half of the responses (228/370, 61.6%) from ChatGPT-3.5 were considered comprehensive. In contrast, ChatGPT-4.0 exhibited a higher percentage at 74.5% (172/222; P<.001). Notably, superior performance was evident in English, particularly in terms of informativeness and consistency across repeated queries. However, deficiencies were identified in emotional management guidance, with only 3.2% (6/186) in ChatGPT-3.5 and 8.1% (15/154) in ChatGPT-4.0 (P=.04). ChatGPT-3.5 included a disclaimer in 10.8% (24/222) of responses, while ChatGPT-4.0 included a disclaimer in 13.1% (29/222) of responses (P=.46). When responding to true-or-false questions, ChatGPT-4.0 achieved an accuracy rate of 93.3% (168/180), significantly surpassing ChatGPT-3.5's accuracy rate of 65.0% (117/180) (P<.001).

CONCLUSIONS

In this study, ChatGPT demonstrated basic capabilities as a medical consultation assistant for CHB management. The choice of working language for ChatGPT-3.5 was considered a potential factor influencing its performance, particularly in the use of terminology and colloquial language, and this potentially affects its applicability within specific target populations. However, as an updated model, ChatGPT-4.0 exhibits improved information processing capabilities, overcoming the language impact on information accuracy. This suggests that the implications of model advancement on applications need to be considered when selecting large language models as medical consultation assistants. Given that both models performed inadequately in emotional guidance management, this study highlights the importance of providing specific language training and emotional management strategies when deploying ChatGPT for medical purposes. Furthermore, the tendency of these models to use disclaimers in conversations should be further investigated to understand the impact on patients' experiences in practical applications.

Baseline Characteristics and Treatment Patterns of the Patients Recruited to the China Registry of Hepatitis B

Background and Aims: Chronic hepatitis B virus (HBV) infection remains a major public health problem globally. Here, we describe the baseline characteristics and treatment profiles of HBV-infected patients recruited to the China Registry of Hepatitis B. Methods: Inclusion criteria were patients with different stages of chronic HBV infection and complete key data. Exclusion criteria were patients with hepatocellular carcinoma. The baseline clinical, laboratory and treatment profiles were analyzed. Results: Finally, 40,431 patients were included. The median age was 43 years, with 65.2% being men and 51.3% being positive for hepatitis B e antigen (HBeAg). The most common initial diagnosis was chronic hepatitis B (81.0%), followed by cirrhosis (9.3%), inactive carrier of hepatitis B surface antigen (HBsAg) (6.7%), and immune tolerant phase of hepatitis B infection (3.0%). Among the 21,228 patients who were on treatment, 88.0%, 10.0% and 2.0% received nucleos(t)ide analogues (NAs), interferon or combination of NAs and interferon, respectively. The proportion of patients who received preferred NAs (entecavir or tenofovir disoproxil fumarate) had increased from 13.5% in 2003 to 79.7% in 2016. Conclusions: We concluded that middle-aged men accounted for most of the patients with chronic hepatitis B in this cross-sectional study. About half of the patients were HBeAg-positive. NAs were the most commonly used therapy, and use of the preferred NAs had steadily increased in the past decade.