Application and prospects of AI-based radiomics in ultrasound diagnosis

Automatic Quantitative Assessment of Muscle Strength Based on Deep Learning and Ultrasound

Skeletal muscle is a vital organ that promotes human movement and maintains posture. Accurate assessment of muscle strength is helpful to provide valuable insights for athletes' rehabilitation and strength training. However, traditional techniques rely heavily on the operator's expertise, which may affect the accuracy of the results. In this study, we propose an automated method to evaluate muscle strength using ultrasound and deep learning techniques. B-mode ultrasound data of biceps brachii of multiple athletes at different strength levels were collected and then used to train our deep learning model. To evaluate the effectiveness of this method, this study tested the contraction of the biceps brachii under different force levels. The classification accuracy of this method for grade 4 and grade 6 muscle strength reached 98% and 96%, respectively, and the overall average accuracy was 93% and 87%, respectively. The experimental results confirm that the innovative methods in this paper can accurately and effectively evaluate and classify muscle strength.

NIR-II light in clinical oncology: opportunities and challenges

Novel strategies utilizing light in the second near-infrared region (NIR-II; 900-1,880 nm wavelengths) offer the potential to visualize and treat solid tumours with enhanced precision. Over the past few decades, numerous techniques leveraging NIR-II light have been developed with the aim of precisely eliminating tumours while maximally preserving organ function. During cancer surgery, NIR-II optical imaging enables the visualization of clinically occult lesions and surrounding vital structures with increased sensitivity and resolution, thereby enhancing surgical quality and improving patient prognosis. Furthermore, the use of NIR-II light promises to improve cancer phototherapy by enabling the selective delivery of increased therapeutic energy to tissues at greater depths. Initial clinical studies of NIR-II-based imaging and phototherapy have indicated impressive potential to decrease cancer recurrence, reduce complications and prolong survival. Despite the encouraging results achieved, clinical translation of innovative NIR-II techniques remains challenging and inefficient; multidisciplinary cooperation is necessary to bridge the gap between preclinical research and clinical practice, and thus accelerate the translation of technical advances into clinical benefits. In this Review, we summarize the available clinical data on NIR-II-based imaging and phototherapy, demonstrating the feasibility and utility of integrating these technologies into the treatment of cancer. We also introduce emerging NIR-II-based approaches with substantial potential to further enhance patient outcomes, while also highlighting the challenges associated with imminent clinical studies of these modalities.

Prospective study of AI-assisted prediction of breast malignancies in physical health examinations: role of off-the-shelf AI software and comparison to radiologist performance

Objective

In physical health examinations, breast sonography is a commonly used imaging method, but it can lead to repeated exams and unnecessary biopsy due to discrepancies among radiologists and health centers. This study explores the role of off-the-shelf artificial intelligence (AI) software in assisting radiologists to classify incidentally found breast masses in two health centers.

Methods

Female patients undergoing breast ultrasound examinations with incidentally discovered breast masses were categorized according to the 5th edition of the Breast Imaging Reporting and Data System (BI-RADS), with categories 3 to 5 included in this study. The examinations were conducted at two municipal health centers from May 2021 to May 2023.The final pathological results from surgical resection or biopsy served as the gold standard for comparison. Ultrasonographic images were obtained in longitudinal and transverse sections, and two junior radiologists and one senior radiologist independently assessed the images without knowing the pathological findings. The BI-RADS classification was adjusted following AI assistance, and diagnostic performance was compared using receiver operating characteristic curves.

Results

A total of 196 patients with 202 breast masses were included in the study, with pathological results confirming 107 benign and 95 malignant masses. The receiver operating characteristic curve showed that experienced breast radiologists had higher diagnostic performance in BI-RADS classification than junior radiologists, similar to AI classification (AUC = 0.936, 0.806, 0.896, and 0.950, p < 0.05). The AI software improved the accuracy, sensitivity, and negative predictive value of the adjusted BI-RADS classification for the junior radiologists' group (p< 0.05), while no difference was observed in the senior radiologist group. Furthermore, AI increased the negative predictive value for BI-RADS 4a masses and the positive predictive value for 4b masses among radiologists (p < 0.05). AI enhances the sensitivity of invasive breast cancer detection more effectively than ductal carcinoma in situ and rare subtypes of breast cancer.

Conclusions

The AI software enhances diagnostic efficiency for breast masses, reducing the performance gap between junior and senior radiologists, particularly for BI-RADS 4a and 4b masses. This improvement reduces unnecessary repeat examinations and biopsies, optimizing medical resource utilization and enhancing overall diagnostic effectiveness.

Breaking boundaries in radiology: redefining AI diagnostics via raw data ahead of reconstruction

Objective.In the realm of utilizing artificial intelligence (AI) for medical image analysis, the paradigm of 'signal-image-knowledge' has remained unchanged. However, the process of 'signal to image' inevitably introduces information distortion, ultimately leading to irrecoverable biases in the 'image to knowledge' process. Our goal is to skip reconstruction and build a diagnostic model directly from the raw data (signal).Approach. This study focuses on computed tomography (CT) and its raw data (sinogram) as the research subjects. We simulate the real-world process of 'human-signal-image' using the workflow 'CT-simulated data- reconstructed CT,' and we develop a novel AI predictive model directly targeting raw data (RCTM). This model comprises orientation, spatial, and global analysis modules, embodying the fusion of local to global information extraction from raw data. We selected 1994 patients with retrospective cases of solid lung nodules and modeled different types of data.Main results. We employed predefined radiomic features to assess the diagnostic feature differences caused by reconstruction. The results indicated that approximately 14% of the features had Spearman correlation coefficients below 0.8. These findings suggest that despite the increasing maturity of CT reconstruction algorithms, they still introduce perturbations to diagnostic features. Moreover, our proposed RCTM achieved an area under the curve (AUC) of 0.863 in the diagnosis task, showcasing a comprehensive superiority over models constructed from secondary reconstructed CTs (0.840, 0.822, and 0.825). Additionally, the performance of RCTM closely resembled that of models constructed from original CT scans (0.868, 0.878, and 0.866).Significance. The diagnostic and therapeutic approach directly based on CT raw data can enhance the precision of AI models and the concept of 'signal-to-image' can be extended to other types of imaging. AI diagnostic models tailored to raw data offer the potential to disrupt the traditional paradigm of 'signal-image-knowledge', opening up new avenues for more accurate medical diagnostics.

Multi-task approach based on combined CNN-transformer for efficient segmentation and classification of breast tumors in ultrasound images

Accurate segmentation of breast ultrasound (BUS) images is crucial for early diagnosis and treatment of breast cancer. Further, the task of segmenting lesions in BUS images continues to pose significant challenges due to the limitations of convolutional neural networks (CNNs) in capturing long-range dependencies and obtaining global context information. Existing methods relying solely on CNNs have struggled to address these issues. Recently, ConvNeXts have emerged as a promising architecture for CNNs, while transformers have demonstrated outstanding performance in diverse computer vision tasks, including the analysis of medical images. In this paper, we propose a novel breast lesion segmentation network CS-Net that combines the strengths of ConvNeXt and Swin Transformer models to enhance the performance of the U-Net architecture. Our network operates on BUS images and adopts an end-to-end approach to perform segmentation. To address the limitations of CNNs, we design a hybrid encoder that incorporates modified ConvNeXt convolutions and Swin Transformer. Furthermore, to enhance capturing the spatial and channel attention in feature maps we incorporate the Coordinate Attention Module. Second, we design an Encoder-Decoder Features Fusion Module that facilitates the fusion of low-level features from the encoder with high-level semantic features from the decoder during the image reconstruction. Experimental results demonstrate the superiority of our network over state-of-the-art image segmentation methods for BUS lesions segmentation.