Me-LLaMA: Foundation Large Language Models for Medical Applications

Optimizing large language models in digestive disease: strategies and challenges to improve clinical outcomes

Large Language Models (LLMs) are transformer-based neural networks with billions of parameters trained on very large text corpora from diverse sources. LLMs have the potential to improve healthcare due to their capability to parse complex concepts and generate context-based responses. The interest in LLMs has not spared digestive disease academics, who have mainly investigated foundational LLM accuracy, which ranges from 25% to 90% and is influenced by the lack of standardized rules to report methodologies and results for LLM-oriented research. In addition, a critical issue is the absence of a universally accepted definition of accuracy, varying from binary to scalar interpretations, often tied to grader expertise without reference to clinical guidelines. We address strategies and challenges to increase accuracy. In particular, LLMs can be infused with domain knowledge using Retrieval Augmented Generation (RAG) or Supervised Fine-Tuning (SFT) with reinforcement learning from human feedback (RLHF). RAG faces challenges with in-context window limits and accurate information retrieval from the provided context. SFT, a deeper adaptation method, is computationally demanding and requires specialized knowledge. LLMs may increase patient quality of care across the field of digestive diseases, where physicians are often engaged in screening, treatment and surveillance for a broad range of pathologies for which in-context learning or SFT with RLHF could improve clinical decision-making and patient outcomes. However, despite their potential, the safe deployment of LLMs in healthcare still needs to overcome hurdles in accuracy, suggesting a need for strategies that integrate human feedback with advanced model training.

Designing medical artificial intelligence systems for global use: focus on interoperability, scalability, and accessibility

Advances in artificial intelligence (AI) and machine learning systems promise faster, more efficient, and more personalized care. While many of these models are built on the premise of improving access to the timely screening, diagnosis, and treatment of cardiovascular disease, their validity and accessibility across diverse and international cohorts remain unknown. In this mini-review article, we summarize key obstacles in the effort to design AI systems that will be scalable, accessible, and accurate across distinct geographical and temporal settings. We discuss representativeness, interoperability, quality assurance, and the importance of vendor-agnostic data types that will be available to end-users across the globe. These topics illustrate how the timely integration of these principles into AI development is crucial to maximizing the global benefits of AI in cardiology.