A Critical Review of ChatGPT as a Potential Substitute for Diabetes Educators

How Digital Solutions Might Provide a World of New Opportunities for Holistic and Empathic Support of Patients with Hidradenitis Suppurativa

Hidradenitis suppurativa (HS) is a complex chronic relapsing inflammatory condition anchored in the hair follicle wherein painful abscesses, nodules, and tunnels form under the skin with the potential for intermittent pus drainage and tissue scarring. Current estimates of incidence are 1-4% globally with the disease three times more prevalent in women and higher rates among Black populations. Patients with HS are also more likely to suffer from depression, anxiety, and loneliness underscoring the need for carefully approached strategies on disease awareness and interventions. Delays in formal diagnosis, which have been estimated at 7-10 years on average, impede timely provision of optimal care. Despite best intent, when patients present at a physician's office, stigmas relating to physical appearance can be exacerbated by negative interactions experienced by patients. In addition to long wait times and the dearth of available HS expert dermatology professionals, patients perceive heightened physician focus on two of the HS flare risk factors (smoking and body mass index [BMI]) as negatively impacting their care. Given the need for continual, personal, and sensitive patient support, herein we advocate for re-examination of approach to care and the leveraging of highly personalized digital support solutions. New medications which can directly or indirectly control elements of the disease and its comorbidities are also entering the marketplace. Collectively, we posit that these new developments provide opportunity for a holistic approach for patients with HS, leading to long-term engagement and improved outcomes.

Generative AI for diabetologists: a concise tutorial on dataset analysis

Objectives

This paper aims to provide a tutorial for diabetologists and endocrinologists on using generative AI to analyze datasets. It is designed to be accessible to those new to generative AI or without programming experience.

Methods

The paper presents three examples using a real diabetes dataset. The examples demonstrate binary classification with the 'Group' variable, cross-validation analysis, and NT-proBNP regression.

Results

The binary classification achieved a prediction accuracy of nearly 0.9. However, the NT-proBNP regression was not successful with this dataset. The calculated R-squared values indicate a poor fit between the predicted model and the raw data.

Conclusions

The unsuccessful NT-proBNP regression may be due to insufficient training data or the need for additional determinants. The dataset may be too small or new metrics may be required to accurately predict NT-proBNP regression values. It is crucial for users to verify the generated codes to ensure that they can achieve their desired objectives.

Educating the next generation of radiologists: a comparative report of ChatGPT and e-learning resources

Rapid technological advances have transformed medical education, particularly in radiology, which depends on advanced imaging and visual data. Traditional electronic learning (e-learning) platforms have long served as a cornerstone in radiology education, offering rich visual content, interactive sessions, and peer-reviewed materials. They excel in teaching intricate concepts and techniques that necessitate visual aids, such as image interpretation and procedural demonstrations. However, Chat Generative Pre-Trained Transformer (ChatGPT), an artificial intelligence (AI)-powered language model, has made its mark in radiology education. It can generate learning assessments, create lesson plans, act as a round-the-clock virtual tutor, enhance critical thinking, translate materials for broader accessibility, summarize vast amounts of information, and provide real-time feedback for any subject, including radiology. Concerns have arisen regarding ChatGPT's data accuracy, currency, and potential biases, especially in specialized fields such as radiology. However, the quality, accessibility, and currency of e-learning content can also be imperfect. To enhance the educational journey for radiology residents, the integration of ChatGPT with expert-curated e-learning resources is imperative for ensuring accuracy and reliability and addressing ethical concerns. While AI is unlikely to entirely supplant traditional radiology study methods, the synergistic combination of AI with traditional e-learning can create a holistic educational experience.

The role of an artificial intelligence model in antiretroviral therapy counselling and advice for people living with HIV

OBJECTIVES

People living with HIV may find personalized access to accurate information on antiretroviral therapy (ART) challenging given the stigma and costs potentially associated with attending physical consultations. Artificial intelligence (AI) chatbots such as ChatGPT may help to lower barriers to accessing information addressing concerns around ART initiation. However, the safety and accuracy of the information provided remains to be studied.

METHODS

We instructed ChatGPT to answer questions that people living with HIV frequently ask about ART, covering i) knowledge of and access to ART; ii) ART initiation, side effects, and adherence, and iii) general sexual health practices while receiving ART. We checked the accuracy of the advice against international HIV clinical practice guidelines.

RESULTS

ChatGPT answered all questions accurately and comprehensively. It recognized potentially life-threatening scenarios such as abacavir hypersensitivity reaction and gave appropriate advice. However, in certain contexts, such as specific geographic locations or for pregnant individuals, the advice lacked specificity to an individual's unique circumstances and may be inadequate. Nevertheless, ChatGPT consistently re-directed the individual to seek help from a healthcare professional to obtain targeted advice.

CONCLUSIONS

ChatGPT may act as a useful adjunct in the process of ART counselling for people living with HIV. Improving access to information on and knowledge about ART may improve access and adherence to ART and outcomes for people living with HIV overall.

A Survey of Clinicians' Views of the Utility of Large Language Models

OBJECTIVES

 Large language models (LLMs) like Generative pre-trained transformer (ChatGPT) are powerful algorithms that have been shown to produce human-like text from input data. Several potential clinical applications of this technology have been proposed and evaluated by biomedical informatics experts. However, few have surveyed health care providers for their opinions about whether the technology is fit for use.

METHODS

 We distributed a validated mixed-methods survey to gauge practicing clinicians' comfort with LLMs for a breadth of tasks in clinical practice, research, and education, which were selected from the literature.

RESULTS

 A total of 30 clinicians fully completed the survey. Of the 23 tasks, 16 were rated positively by more than 50% of the respondents. Based on our qualitative analysis, health care providers considered LLMs to have excellent synthesis skills and efficiency. However, our respondents had concerns that LLMs could generate false information and propagate training data bias.Our survey respondents were most comfortable with scenarios that allow LLMs to function in an assistive role, like a physician extender or trainee.

CONCLUSION

 In a mixed-methods survey of clinicians about LLM use, health care providers were encouraging of having LLMs in health care for many tasks, and especially in assistive roles. There is a need for continued human-centered development of both LLMs and artificial intelligence in general.

Comparison of the problem-solving performance of ChatGPT-3.5, ChatGPT-4, Bing Chat, and Bard for the Korean emergency medicine board examination question bank

Large language models (LLMs) have been deployed in diverse fields, and the potential for their application in medicine has been explored through numerous studies. This study aimed to evaluate and compare the performance of ChatGPT-3.5, ChatGPT-4, Bing Chat, and Bard for the Emergency Medicine Board Examination question bank in the Korean language. Of the 2353 questions in the question bank, 150 questions were randomly selected, and 27 containing figures were excluded. Questions that required abilities such as analysis, creative thinking, evaluation, and synthesis were classified as higher-order questions, and those that required only recall, memory, and factual information in response were classified as lower-order questions. The answers and explanations obtained by inputting the 123 questions into the LLMs were analyzed and compared. ChatGPT-4 (75.6%) and Bing Chat (70.7%) showed higher correct response rates than ChatGPT-3.5 (56.9%) and Bard (51.2%). ChatGPT-4 showed the highest correct response rate for the higher-order questions at 76.5%, and Bard and Bing Chat showed the highest rate for the lower-order questions at 71.4%. The appropriateness of the explanation for the answer was significantly higher for ChatGPT-4 and Bing Chat than for ChatGPT-3.5 and Bard (75.6%, 68.3%, 52.8%, and 50.4%, respectively). ChatGPT-4 and Bing Chat outperformed ChatGPT-3.5 and Bard in answering a random selection of Emergency Medicine Board Examination questions in the Korean language.

Using ChatGPT for Clinical Practice and Medical Education: Cross-Sectional Survey of Medical Students' and Physicians' Perceptions

BACKGROUND

ChatGPT is a well-known large language model-based chatbot. It could be used in the medical field in many aspects. However, some physicians are still unfamiliar with ChatGPT and are concerned about its benefits and risks.

OBJECTIVE

We aim to evaluate the perception of physicians and medical students toward using ChatGPT in the medical field.

METHODS

A web-based questionnaire was sent to medical students, interns, residents, and attending staff with questions regarding their perception toward using ChatGPT in clinical practice and medical education. Participants were also asked to rate their perception of ChatGPT's generated response about knee osteoarthritis.

RESULTS

Participants included 124 medical students, 46 interns, 37 residents, and 32 attending staff. After reading ChatGPT's response, 132 of the 239 (55.2%) participants had a positive rating about using ChatGPT for clinical practice. The proportion of positive answers was significantly lower in graduated physicians (48/115, 42%) compared with medical students (84/124, 68%; P<.001). Participants listed a lack of a patient-specific treatment plan, updated evidence, and a language barrier as ChatGPT's pitfalls. Regarding using ChatGPT for medical education, the proportion of positive responses was also significantly lower in graduate physicians (71/115, 62%) compared to medical students (103/124, 83.1%; P<.001). Participants were concerned that ChatGPT's response was too superficial, might lack scientific evidence, and might need expert verification.

CONCLUSIONS

Medical students generally had a positive perception of using ChatGPT for guiding treatment and medical education, whereas graduated doctors were more cautious in this regard. Nonetheless, both medical students and graduated doctors positively perceived using ChatGPT for creating patient educational materials.

Popular large language model chatbots' accuracy, comprehensiveness, and self-awareness in answering ocular symptom queries

In light of growing interest in using emerging large language models (LLMs) for self-diagnosis, we systematically assessed the performance of ChatGPT-3.5, ChatGPT-4.0, and Google Bard in delivering proficient responses to 37 common inquiries regarding ocular symptoms. Responses were masked, randomly shuffled, and then graded by three consultant-level ophthalmologists for accuracy (poor, borderline, good) and comprehensiveness. Additionally, we evaluated the self-awareness capabilities (ability to self-check and self-correct) of the LLM-Chatbots. 89.2% of ChatGPT-4.0 responses were 'good'-rated, outperforming ChatGPT-3.5 (59.5%) and Google Bard (40.5%) significantly (all p < 0.001). All three LLM-Chatbots showed optimal mean comprehensiveness scores as well (ranging from 4.6 to 4.7 out of 5). However, they exhibited subpar to moderate self-awareness capabilities. Our study underscores the potential of ChatGPT-4.0 in delivering accurate and comprehensive responses to ocular symptom inquiries. Future rigorous validation of their performance is crucial to ensure their reliability and appropriateness for actual clinical use.

Opportunities and Challenges for ChatGPT and Large Language Models in Biomedicine and Health

ChatGPT has drawn considerable attention from both the general public and domain experts with its remarkable text generation capabilities. This has subsequently led to the emergence of diverse applications in the field of biomedicine and health. In this work, we examine the diverse applications of large language models (LLMs), such as ChatGPT, in biomedicine and health. Specifically we explore the areas of biomedical information retrieval, question answering, medical text summarization, information extraction, and medical education, and investigate whether LLMs possess the transformative power to revolutionize these tasks or whether the distinct complexities of biomedical domain presents unique challenges. Following an extensive literature survey, we find that significant advances have been made in the field of text generation tasks, surpassing the previous state-of-the-art methods. For other applications, the advances have been modest. Overall, LLMs have not yet revolutionized biomedicine, but recent rapid progress indicates that such methods hold great potential to provide valuable means for accelerating discovery and improving health. We also find that the use of LLMs, like ChatGPT, in the fields of biomedicine and health entails various risks and challenges, including fabricated information in its generated responses, as well as legal and privacy concerns associated with sensitive patient data. We believe this survey can provide a comprehensive and timely overview to biomedical researchers and healthcare practitioners on the opportunities and challenges associated with using ChatGPT and other LLMs for transforming biomedicine and health.

A Novel Approach: Evaluating ChatGPT's Utility for the Management of Thyroid Nodules

Background and objective Artificial intelligence (AI) applications such as Chat Generative Pre-Trained Transformer (ChatGPT) created by OpenAI, which represent the revolutionary aspects of today's technology, have benefitted professionals in many fields and society at large. In this study, we aimed to assess how effective is ChatGPT in helping both the patient and the physician manage thyroid nodules, a very common pathology. Methods Fifty-five questions frequently asked by patients were identified and asked to ChatGPT. Subsequently, three cases of thyroid nodules were progressively presented to ChatGPT. The answers to patient questions were scored for correctness and reliability by two endocrinologists. As for the cases, diagnostic and therapeutic approaches provided by ChatGPT were analyzed and scored by two endocrinologists for correctness, safety, and usability. The responses were evaluated by using 7-point Likert-type scales designed by us. Results The answers to patient questions were found to be mostly correct and reliable by both raters (Rater #1: 6.47 ± 0.50 and 6.27 ± 0.52; Rater #2: 6.18 ± 0.92 and 6.09 ± 0.96). Regarding the management of cases, ChatGPT's approach was found to be largely correct, safe, and usable by Rater #1, while Rater #2 evaluated the approaches as partially or mostly correct, safe, and usable. Conclusion Based on our findings, ChatGPT can be used as an informative and reliable resource for managing patients with thyroid nodules. While it is not suitable to be used as a primary resource for physicians, it has the potential to be a helpful and supportive tool.