Transfer learning as an AI-based solution to address limited datasets in space medicine

FA4SANS-GAN: A Novel Machine Learning Generative Adversarial Network to Further Understand Ophthalmic Changes in Spaceflight Associated Neuro-Ocular Syndrome (SANS)

Purpose

To provide an automated system for synthesizing fluorescein angiography (FA) images from color fundus photographs for averting risks associated with fluorescein dye and extend its future application to spaceflight associated neuro-ocular syndrome (SANS) detection in spaceflight where resources are limited.

Design

Development and validation of a novel conditional generative adversarial network (GAN) trained on limited amount of FA and color fundus images with diabetic retinopathy and control cases.

Participants

Color fundus and FA paired images for unique patients were collected from a publicly available study.

Methods

FA4SANS-GAN was trained to generate FA images from color fundus photographs using 2 multiscale generators coupled with 2 patch-GAN discriminators. Eight hundred fifty color fundus and FA images were utilized for training by augmenting images from 17 unique patients. The model was evaluated on 56 fluorescein images collected from 14 unique patients. In addition, it was compared with 3 other GAN architectures trained on the same data set. Furthermore, we test the robustness of the models against acquisition noise and retaining structural information when introduced to artificially created biological markers.

Main Outcome Measures

For GAN synthesis, metric Fréchet Inception Distance (FID) and Kernel Inception Distance (KID). Also, two 1-sided tests (TOST) based on Welch's t test for measuring statistical significance.

Results

On test FA images, mean FID for FA4SANS-GAN was 39.8 (standard deviation, 9.9), which is better than GANgio model's mean of 43.2 (standard deviation, 13.7), Pix2PixHD's mean of 57.3 (standard deviation, 11.5) and Pix2Pix's mean of 67.5 (standard deviation, 11.7). Similarly for KID, FA4SANS-GAN achieved mean of 0.00278 (standard deviation, 0.00167) which is better than other 3 model's mean KID of 0.00303 (standard deviation, 0.00216), 0.00609 (standard deviation, 0.00238), 0.00784 (standard deviation, 0.00218). For TOST measurement, FA4SANS-GAN was proven to be statistically significant versus GANgio (P = 0.006); versus Pix2PixHD (P < 0.00001); and versus Pix2Pix (P < 0.00001).

Conclusions

Our study has shown FA4SANS-GAN to be statistically significant for 2 GAN synthesis metrics. Moreover, it is robust against acquisition noise, and can retain clear biological markers compared with the other 3 GAN architectures. This deployment of this model can be crucial in the International Space Station for detecting SANS.

Financial Disclosures

The authors have no proprietary or commercial interest in any materials discussed in this article.

Prioritizing open science in space medicine: perspectives following the NASA "Transform to Open Science (TOPS)" Curriculum

The National Aeronautics and Space Administration (NASA) has recently made a long-term commitment towards fostering open science. The NASA Transform to Open Science (TOPS) initiative provides recommendations, best practices, and tools related to open science. The principles of open science include the transparent sharing of data, findings, and methods and is designed to accelerate the pace of discovery and foster collaboration. The goal of open science is to allow data, publications, software, and physical samples to be accessible to all, regardless of being a professional or an amateur. In this paper, we summarize several key points open science that were presented as part of NASA's Open Science 101 Module 1 at an in-person training event in Washington, D.C., and include how open science can be beneficial for researchers and society as a whole.

Generative artificial intelligence in ophthalmology

Generative AI has revolutionized medicine over the past several years. A generative adversarial network (GAN) is a deep learning framework that has become a powerful technique in medicine, particularly in ophthalmology and image analysis. In this paper we review the current ophthalmic literature involving GANs, and highlight key contributions in the field. We briefly touch on ChatGPT, another application of generative AI, and its potential in ophthalmology. We also explore the potential uses for GANs in ocular imaging, with a specific emphasis on 3 primary domains: image enhancement, disease identification, and generating of synthetic data. PubMed, Ovid MEDLINE, Google Scholar were searched from inception to October 30, 2022 to identify applications of GAN in ophthalmology. A total of 40 papers were included in this review. We cover various applications of GANs in ophthalmic-related imaging including optical coherence tomography, orbital magnetic resonance imaging, fundus photography, and ultrasound; however, we also highlight several challenges, that resulted in the generation of inaccurate and atypical results during certain iterations. Finally, we examine future directions and considerations for generative AI in ophthalmology.

"Spaceflight-to-Eye Clinic": Terrestrial advances in ophthalmic healthcare delivery from space-based innovations

The phrase "Bench-to-Bedside" is a well-known phrase in medicine, highlighting scientific discoveries that directly translate to impacting patient care. Key examples of translational research include identification of key molecular targets in diseases and development of diagnostic laboratory tests for earlier disease detection. Bridging these scientific advances to the bedside/clinic has played a meaningful impact in numerous patient lives. The spaceflight environment poses a unique opportunity to also make this impact; the nature of harsh extraterrestrial conditions and medically austere and remote environments push for cutting-edge technology innovation. Many of these novel technologies built for the spaceflight environment also have numerous benefits for human health on Earth. In this manuscript, we focus on "Spaceflight-to-Eye Clinic" and discuss technologies built for the spaceflight environment that eventually helped to optimize ophthalmic health on Earth (e.g., LADAR for satellite docking now utilized in eye-tracking technology for LASIK). We also discuss current technology research for spaceflight associated neuro-ocular syndrome (SANS) that may also be applied to terrestrial ophthalmic health. Ultimately, various advances made to enable to the future of space exploration have also advanced the ophthalmic health of individuals on Earth.

The diagnostic, therapeutic, and ethical impact of artificial intelligence in modern medicine

In the evolution of modern medicine, artificial intelligence (AI) has been proven to provide an integral aspect of revolutionizing clinical diagnosis, drug discovery, and patient care. With the potential to scrutinize colossal amounts of medical data, radiological and histological images, and genomic data in healthcare institutions, AI-powered systems can recognize, determine, and associate patterns and provide impactful insights that would be strenuous and challenging for clinicians to detect during their daily clinical practice. The outcome of AI-mediated search offers more accurate, personalized patient diagnoses, guides in research for new drug therapies, and provides a more effective multidisciplinary treatment plan that can be implemented for patients with chronic diseases. Among the many promising applications of AI in modern medicine, medical imaging stands out distinctly as an area with tremendous potential. AI-powered algorithms can now accurately and sensitively identify cancer cells and other lesions in medical images with greater accuracy and sensitivity. This allows for earlier diagnosis and treatment, which can significantly impact patient outcomes. This review provides a comprehensive insight into diagnostic, therapeutic, and ethical issues with the advent of AI in modern medicine.

SANS-CNN: An automated machine learning technique for spaceflight associated neuro-ocular syndrome with astronaut imaging data

Spaceflight associated neuro-ocular syndrome (SANS) is one of the largest physiologic barriers to spaceflight and requires evaluation and mitigation for future planetary missions. As the spaceflight environment is a clinically limited environment, the purpose of this research is to provide automated, early detection and prognosis of SANS with a machine learning model trained and validated on astronaut SANS optical coherence tomography (OCT) images. In this study, we present a lightweight convolutional neural network (CNN) incorporating an EfficientNet encoder for detecting SANS from OCT images titled "SANS-CNN." We used 6303 OCT B-scan images for training/validation (80%/20% split) and 945 for testing with a combination of terrestrial images and astronaut SANS images for both testing and validation. SANS-CNN was validated with SANS images labeled by NASA to evaluate accuracy, specificity, and sensitivity. To evaluate real-world outcomes, two state-of-the-art pre-trained architectures were also employed on this dataset. We use GRAD-CAM to visualize activation maps of intermediate layers to test the interpretability of SANS-CNN's prediction. SANS-CNN achieved 84.2% accuracy on the test set with an 85.6% specificity, 82.8% sensitivity, and 84.1% F1-score. Moreover, SANS-CNN outperforms two other state-of-the-art pre-trained architectures, ResNet50-v2 and MobileNet-v2, in accuracy by 21.4% and 13.1%, respectively. We also apply two class-activation map techniques to visualize critical SANS features perceived by the model. SANS-CNN represents a CNN model trained and validated with real astronaut OCT images, enabling fast and efficient prediction of SANS-like conditions for spaceflight missions beyond Earth's orbit in which clinical and computational resources are extremely limited.

Generative Pre-Trained Transformers (GPT) and Space Health: A Potential Frontier in Astronaut Health During Exploration Missions

In anticipation of space exploration where astronauts are traveling away from Earth, and for longer durations with an increasing communication lag, artificial intelligence (AI) frameworks such as large language learning models (LLMs) that can be trained on Earth can provide real-time answers. This emerging technology may be helpful for acute medical emergencies, particularly in austere and distant space environments. In this manuscript, we provide an overview of generative pre-trained transformer (GPT) technology, a rapidly emerging AI technology, and implications, considerations, and limitations of such technology for space health.