Automated 2D Slice-Based Skull Stripping Multi-View Ensemble Model on NFBS and IBSR Datasets

CSAMDT: Conditional Self Attention Memory-Driven Transformers for Radiology Report Generation from Chest X-Ray

A radiology report plays a crucial role in guiding patient treatment, but writing these reports is a time-consuming task that demands a radiologist's expertise. In response to this challenge, researchers in the subfields of artificial intelligence for healthcare have explored techniques for automatically interpreting radiographic images and generating free-text reports, while much of the research on medical report creation has focused on image captioning methods without adequately addressing particular report aspects. This study introduces a Conditional Self Attention Memory-Driven Transformer model for generating radiological reports. The model operates in two phases: initially, a multi-label classification model, utilizing ResNet152 v2 as an encoder, is employed for feature extraction and multiple disease diagnosis. In the second phase, the Conditional Self Attention Memory-Driven Transformer serves as a decoder, utilizing self-attention memory-driven transformers to generate text reports. Comprehensive experimentation was conducted to compare existing and proposed techniques based on Bilingual Evaluation Understudy (BLEU) scores ranging from 1 to 4. The model outperforms the other state-of-the-art techniques by increasing the BLEU 1 (0.475), BLEU 2 (0.358), BLEU 3 (0.229), and BLEU 4 (0.165) respectively. This study's findings can alleviate radiologists' workloads and enhance clinical workflows by introducing an autonomous radiological report generation system.

Dimensionality Reduction Hybrid U-Net for Brain Extraction in Magnetic Resonance Imaging

In various applications, such as disease diagnosis, surgical navigation, human brain atlas analysis, and other neuroimage processing scenarios, brain extraction is typically regarded as the initial stage in MRI image processing. Whole-brain semantic segmentation algorithms, such as U-Net, have demonstrated the ability to achieve relatively satisfactory results even with a limited number of training samples. In order to enhance the precision of brain semantic segmentation, various frameworks have been developed, including 3D U-Net, slice U-Net, and auto-context U-Net. However, the processing methods employed in these models are relatively complex when applied to 3D data models. In this article, we aim to reduce the complexity of the model while maintaining appropriate performance. As an initial step to enhance segmentation accuracy, the preprocessing extraction of full-scale information from magnetic resonance images is performed with a cluster tool. Subsequently, three multi-input hybrid U-Net model frameworks are tested and compared. Finally, we propose utilizing a fusion of two-dimensional segmentation outcomes from different planes to attain improved results. The performance of the proposed framework was tested using publicly accessible benchmark datasets, namely LPBA40, in which we obtained Dice overlap coefficients of 98.05%. Improvement was achieved via our algorithm against several previous studies.

A Deep Learning Framework for Skull Stripping in Brain MRI

Skull-stripping, an important pre-processing step in neuroimage computing, involves the automated removal of non-brain anatomy (such as the skull, eyes, and ears) from brain images to facilitate brain segmentation and analysis. Manual segmentation is still practiced, but it is time-consuming and highly dependent on the expertise of clinicians or image analysts. Prior studies have developed various skull-stripping algorithms that perform well on brains with mild or no structural abnormalities. Nonetheless, they were not able to address the issue for brains with significant morphological changes, such as those caused by brain tumors, particularly when the tumors are located near the skull's border. In such cases, a portion of the normal brain may be stripped, or the reverse may occur during skull stripping. To address this limitation, we propose to use a novel deep learning framework based on nnUNet for skull stripping in brain MRI. Two publicly available datasets were used to evaluate the proposed method, including a normal brain MRI dataset - The Neurofeedback Skull-stripped Repository (NFBS), and a brain tumor MRI dataset - The Cancer Genome Atlas (TCGA). The method proposed in the study performed better than six other current methods, namely BSE, ROBEX, UNet, SC-UNet, MV-UNet, and 3D U-Net. The proposed method achieved an average Dice coefficient of 0.9960, a sensitivity of 0.9999, and a specificity of 0.9996 on the NFBS dataset, and an average Dice coefficient of 0.9296, a sensitivity of 0.9288, a specificity of 0.9866 and an accuracy of 0.9762 on the TCGA brain tumor dataset.