Generative Adversarial Networks Can Create High Quality Artificial Prostate Cancer Magnetic Resonance Images

Data free knowledge distillation with feature synthesis and spatial consistency for image analysis

Privacy and security concerns restrict access to original training datasets, posing significant challenges for model compression. Data-Free Knowledge Distillation (DFKD) emerges as a solution, aiming to transfer knowledge from teacher to student networks without accessing original data. Existing DFKD methods struggle to generate high-quality synthetic samples that capture the complexities of real-world data, leading to suboptimal knowledge transfer. Moreover, these approaches often fail to preserve the spatial attributes of the teacher network, resulting in shortcut learning and limited generalization.To address these issues, a novel DFKD strategy is proposed with three innovations: (1) an enhanced DCGAN generator with an attention module for synthesizing samples with improved micro-discriminative features; (2) a Multi-Scale Spatial Activation Region Consistency (MSARC) mechanism to accurately replicate the teacher's spatial attributes; and (3) an adversarial learning framework that creates a dynamic competitive environment between the generative and distillation phases. Rigorous evaluation of the method on several benchmark datasets, including CIFAR-10, CIFAR-100, Tiny-ImageNet, and medical imaging datasets such as PathMNIST, BloodMNIST, and PneumoniaMNIST, demonstrates superior performance compared to existing DFKD methods. Specifically, on CIFAR-100, the student network attains an accuracy of 77.85%, surpassing previous methods like CMI and SpaceshipNet. On BloodMNIST, the method achieves an accuracy of 80.50%, outperforming the next best method by over 5%.

Generative adversarial networks for spine imaging: A critical review of current applications

PURPOSE

In recent years, the field of medical imaging has witnessed remarkable advancements, with innovative technologies which revolutionized the visualization and analysis of the human spine. Among the groundbreaking developments in medical imaging, Generative Adversarial Networks (GANs) have emerged as a transformative tool, offering unprecedented possibilities in enhancing spinal imaging techniques and diagnostic outcomes. This review paper aims to provide a comprehensive overview of the use of GANs in spinal imaging, and to emphasize their potential to improve the diagnosis and treatment of spine-related disorders. A specific review focusing on Generative Adversarial Networks (GANs) in the context of medical spine imaging is needed to provide a comprehensive and specialized analysis of the unique challenges, applications, and advancements within this specific domain, which might not be fully addressed in broader reviews covering GANs in general medical imaging. Such a review can offer insights into the tailored solutions and innovations that GANs bring to the field of spinal medical imaging.

METHODS

An extensive literature search from 2017 until July 2023, was conducted using the most important search engines and identified studies that used GANs in spinal imaging.

RESULTS

The implementations include generating fat suppressed T2-weighted (fsT2W) images from T1 and T2-weighted sequences, to reduce scan time. The generated images had a significantly better image quality than true fsT2W images and could improve diagnostic accuracy for certain pathologies. GANs were also utilized in generating virtual thin-slice images of intervertebral spaces, creating digital twins of human vertebrae, and predicting fracture response. Lastly, they could be applied to convert CT to MRI images, with the potential to generate near-MR images from CT without MRI.

CONCLUSIONS

GANs have promising applications in personalized medicine, image augmentation, and improved diagnostic accuracy. However, limitations such as small databases and misalignment in CT-MRI pairs, must be considered.

Quality of T2-weighted MRI re-acquisition versus deep learning GAN image reconstruction: A multi-reader study

PURPOSE

To evaluate CycleGAN's ability to enhance T2-weighted image (T2WI) quality.

METHOD

A CycleGAN algorithm was used to enhance T2WI quality. 96 patients (192 scans) were identified from patients who underwent multiple axial T2WI due to poor quality on the first attempt (RAD1) and improved quality on re-acquisition (RAD2). CycleGAN algorithm gave DL classifier scores (0-1) for quality quantification and produced enhanced versions of QI1 and QI2 from RAD1 and RAD2, respectively. A subset (n = 20 patients) was selected for a blinded, multi-reader study, where four radiologists rated T2WI on a scale of 1-4 for quality. The multi-reader study presented readers with 60 image pairs (RAD1 vs RAD2, RAD1 vs QI1, and RAD2 vs QI2), allowing for selecting sequence preferences and quantifying the quality changes.

RESULTS

The DL classifier correctly discerned 71.9 % of quality classes, with 90.6 % (96/106) as poor quality and 48.8 % (42/86) as diagnostic in original sequences (RAD1, RAD2). CycleGAN images (QI1, QI2) demonstrated quantitative improvements, with consistently higher DL classifier scores than original scans (p < 0.001). In the multi-reader analysis, CycleGAN demonstrated no qualitative improvements, with diminished overall quality and motion in QI2 in most patients compared to RAD2, with noise levels remaining similar (8/20). No readers preferred QI2 to RAD2 for diagnosis.

CONCLUSION

Despite quantitative enhancements with CycleGAN, there was no qualitative boost in T2WI diagnostic quality, noise, or motion. Expert radiologists didn't favor CycleGAN images over standard scans, highlighting the divide between quantitative and qualitative metrics.

Research related to the diagnosis of prostate cancer based on machine learning medical images: A review

BACKGROUND

Prostate cancer is currently the second most prevalent cancer among men. Accurate diagnosis of prostate cancer can provide effective treatment for patients and greatly reduce mortality. The current medical imaging tools for screening prostate cancer are mainly MRI, CT and ultrasound. In the past 20 years, these medical imaging methods have made great progress with machine learning, especially the rise of deep learning has led to a wider application of artificial intelligence in the use of image-assisted diagnosis of prostate cancer.

METHOD

This review collected medical image processing methods, prostate and prostate cancer on MR images, CT images, and ultrasound images through search engines such as web of science, PubMed, and Google Scholar, including image pre-processing methods, segmentation of prostate gland on medical images, registration between prostate gland on different modal images, detection of prostate cancer lesions on the prostate.

CONCLUSION

Through these collated papers, it is found that the current research on the diagnosis and staging of prostate cancer using machine learning and deep learning is in its infancy, and most of the existing studies are on the diagnosis of prostate cancer and classification of lesions, and the accuracy is low, with the best results having an accuracy of less than 0.95. There are fewer studies on staging. The research is mainly focused on MR images and much less on CT images, ultrasound images.

DISCUSSION

Machine learning and deep learning combined with medical imaging have a broad application prospect for the diagnosis and staging of prostate cancer, but the research in this area still has more room for development.