Artificial Intelligence in Vascular-PET:: Translational and Clinical Applications

Automated multiclass segmentation, quantification, and visualization of the diseased aorta on hybrid PET/CT-SEQUOIA

BACKGROUND

Cardiovascular disease is the most common cause of death worldwide, including infection and inflammation related conditions. Multiple studies have demonstrated potential advantages of hybrid positron emission tomography combined with computed tomography (PET/CT) as an adjunct to current clinical inflammatory and infectious biochemical markers. To quantitatively analyze vascular diseases at PET/CT, robust segmentation of the aorta is necessary. However, manual segmentation is extremely time-consuming and labor-intensive.

PURPOSE

To investigate the feasibility and accuracy of an automated tool to segment and quantify multiple parts of the diseased aorta on unenhanced low-dose computed tomography (LDCT) as an anatomical reference for PET-assessed vascular disease.

METHODS

A software pipeline was developed including automated segmentation using a 3D U-Net, calcium scoring, PET uptake quantification, background measurement, radiomics feature extraction, and 2D surface visualization of vessel wall calcium and tracer uptake distribution. To train the 3D U-Net, 352 non-contrast LDCTs from (2-[18F]FDG and Na[18F]F) PET/CTs performed in patients with various vascular pathologies with manual segmentation of the ascending aorta, aortic arch, descending aorta, and abdominal aorta were used. The last 22 consecutive scans were used as a hold-out internal test set. The remaining dataset was randomly split into training (n = 264; 80%) and validation (n = 66; 20%) sets. Further evaluation was performed on an external test set of 49 PET/CTs. The dice similarity coefficient (DSC) and Hausdorff distance (HD) were used to assess segmentation performance. Automatically obtained calcium scores and uptake values were compared with manual scoring obtained using clinical softwares (syngo.via and Affinity Viewer) in six patient images. intraclass correlation coefficients (ICC) were calculated to validate calcium and uptake values.

RESULTS

Fully automated segmentation of the aorta using a 3D U-Net was feasible in LDCT obtained from PET/CT scans. The external test set yielded a DSC of 0.867 ± 0.030 and HD of 1.0 [0.6-1.4] mm, similar to an open-source model with a DSC of 0.864 ± 0.023 and HD of 1.4 [1.0-1.8] mm. Quantification of calcium and uptake values were in excellent agreement with clinical software (ICC: 1.00 [1.00-1.00] and 0.99 [0.93-1.00] for calcium and uptake values, respectively).

CONCLUSIONS

We present an automated pipeline to segment the ascending aorta, aortic arch, descending aorta, and abdominal aorta on LDCT from PET/CT and to accurately provide uptake values, calcium scores, background measurement, radiomics features, and a 2D visualization. We call this algorithm SEQUOIA (SEgmentation, QUantification, and visualizatiOn of the dIseased Aorta) and is available at https://github.com/UMCG-CVI/SEQUOIA. This model could augment the utility of aortic evaluation at PET/CT studies tremendously, irrespective of the tracer, and potentially provide fast and reliable quantification of cardiovascular diseases in clinical practice, both for primary diagnosis and disease monitoring.

What does artificial intelligence mean in rheumatology?

Intelligence is the ability of humans to learn from experiences to ascribe conscious weights and unconscious biases to modulate their outputs from given inputs. Transferring this ability to computers is artificial intelligence (AI). The ability of computers to understand data in an intelligent manner is machine learning. When such learning is with images and videos, which involves deeper layers of artificial neural networks, it is described as deep learning. Large language models are the latest development in AI which incorporate self-learning into deep learning through transformers. AI in Rheumatology has immense potential to revolutionize healthcare and research. Machine learning could aid clinical diagnosis and decision-making, and deep learning could extend this to analyze images of radiology or positron emission tomography scans or histopathology images to aid a clinician's diagnosis. Analysis of routinely obtained patient data or continuously collected information from wearables could predict disease flares. Analysis of high-volume genomics, transcriptomics, proteomics, or metabolomics data from patients could help identify novel markers of disease prognosis. AI might identify newer therapeutic targets based on in-silico modelling of omics data. AI could help automate medical administrative work such as inputting information into electronic health records or transcribing clinic notes. AI could help automate patient education and counselling. Beyond the clinic, AI has the potential to aid medical education. The ever-expanding capabilities of AI models bring along with them considerable ethical challenges, particularly related to risks of misuse. Nevertheless, the widespread use of AI in Rheumatology is inevitable and a progress with great potential.

The clinical value of quantitative cardiovascular molecular imaging: a step towards precision medicine

Cardiovascular diseases (CVD) are the leading cause of death worldwide and have an increasing impact on society. Precision medicine, in which optimal care is identified for an individual or a group of individuals rather than for the average population, might provide significant health benefits for this patient group and decrease CVD morbidity and mortality. Molecular imaging provides the opportunity to assess biological processes in individuals in addition to anatomical context provided by other imaging modalities and could prove to be essential in the implementation of precision medicine in CVD. New developments in single-photon emission computed tomography (SPECT) and positron emission tomography (PET) systems, combined with rapid innovations in promising and specific radiopharmaceuticals, provide an impressive improvement of diagnostic accuracy and therapy evaluation. This may result in improved health outcomes in CVD patients, thereby reducing societal impact. Furthermore, recent technical advances have led to new possibilities for accurate image quantification, dynamic imaging, and quantification of radiotracer kinetics. This potentially allows for better evaluation of disease activity over time and treatment response monitoring. However, the clinical implementation of these new methods has been slow. This review describes the recent advances in molecular imaging and the clinical value of quantitative PET and SPECT in various fields in cardiovascular molecular imaging, such as atherosclerosis, myocardial perfusion and ischemia, infiltrative cardiomyopathies, systemic vascular diseases, and infectious cardiovascular diseases. Moreover, the challenges that need to be overcome to achieve clinical translation are addressed, and future directions are provided.

Update on Positron Emission Tomography/Magnetic Resonance Imaging: Cancer and Inflammation Imaging in the Clinic

Hybrid PET/MRI is highly valuable, having made significant strides in overcoming technical challenges and offering unique advantages such as reduced radiation, precise data coregistration, and motion correction. Growing evidence highlights the value of PET/MRI in broad clinical aspects, including inflammatory and oncological imaging in adults, pregnant women, and pediatrics, potentially surpassing PET/CT. This newly integrated solution may be preferred over PET/CT in many clinical conditions. However, further technological advancements are required to facilitate its broader adoption as a routine diagnostic modality.

Artificial Intelligence in Nuclear Medicine: Opportunities, Challenges, and Responsibilities Toward a Trustworthy Ecosystem

Trustworthiness is a core tenet of medicine. The patient-physician relationship is evolving from a dyad to a broader ecosystem of health care. With the emergence of artificial intelligence (AI) in medicine, the elements of trust must be revisited. We envision a road map for the establishment of trustworthy AI ecosystems in nuclear medicine. In this report, AI is contextualized in the history of technologic revolutions. Opportunities for AI applications in nuclear medicine related to diagnosis, therapy, and workflow efficiency, as well as emerging challenges and critical responsibilities, are discussed. Establishing and maintaining leadership in AI require a concerted effort to promote the rational and safe deployment of this innovative technology by engaging patients, nuclear medicine physicians, scientists, technologists, and referring providers, among other stakeholders, while protecting our patients and society. This strategic plan was prepared by the AI task force of the Society of Nuclear Medicine and Molecular Imaging.

Advances in positron emission tomography tracers related to vascular calcification

Microcalcification, a type of vascular calcification, increases the instability of plaque and easily leads to acute clinical events. Positron emission tomography (PET) is a new examination technology with significant advantages in identifying vascular calcification, especially microcalcification. The use of the ¹⁸F-NaF is undoubtedly the benchmark, and other PET tracers related to vascular calcification are also currently in development. Despite all this, a large number of studies are still needed to further clarify the specific mechanisms and characteristics. This review aimed at providing a summary of the application and progress of different PET tracers and also the future development direction.