GIFTed Demons: deformable image registration with local structure-preserving regularization using supervoxels for liver applications

Residual Aligner-based Network (RAN): Motion-separable structure for coarse-to-fine discontinuous deformable registration

Deformable image registration, the estimation of the spatial transformation between different images, is an important task in medical imaging. Deep learning techniques have been shown to perform 3D image registration efficiently. However, current registration strategies often only focus on the deformation smoothness, which leads to the ignorance of complicated motion patterns (e.g., separate or sliding motions), especially for the intersection of organs. Thus, the performance when dealing with the discontinuous motions of multiple nearby objects is limited, causing undesired predictive outcomes in clinical usage, such as misidentification and mislocalization of lesions or other abnormalities. Consequently, we proposed a novel registration method to address this issue: a new Motion Separable backbone is exploited to capture the separate motion, with a theoretical analysis of the upper bound of the motions' discontinuity provided. In addition, a novel Residual Aligner module was used to disentangle and refine the predicted motions across the multiple neighboring objects/organs. We evaluate our method, Residual Aligner-based Network (RAN), on abdominal Computed Tomography (CT) scans and it has shown to achieve one of the most accurate unsupervised inter-subject registration for the 9 organs, with the highest-ranked registration of the veins (Dice Similarity Coefficient (%)/Average surface distance (mm): 62%/4.9mm for the vena cava and 34%/7.9mm for the portal and splenic vein), with a smaller model structure and less computation compared to state-of-the-art methods. Furthermore, when applied to lung CT, the RAN achieves comparable results to the best-ranked networks (94%/3.0mm), also with fewer parameters and less computation.

Comprehensive Imaging Characterization of Colorectal Liver Metastases

Colorectal liver metastases (CRLM) have heterogenous histopathological and immunohistochemical phenotypes, which are associated with variable responses to treatment and outcomes. However, this information is usually only available after resection, and therefore of limited value in treatment planning. Improved techniques for in vivo disease assessment, which can characterise the variable tumour biology, would support further personalization of management strategies. Advanced imaging of CRLM including multiparametric MRI and functional imaging techniques have the potential to provide clinically-actionable phenotypic characterisation. This includes assessment of the tumour-liver interface, internal tumour components and treatment response. Advanced analysis techniques, including radiomics and machine learning now have a growing role in assessment of imaging, providing high-dimensional imaging feature extraction which can be linked to clinical relevant tumour phenotypes, such as a the Consensus Molecular Subtypes (CMS). In this review, we outline how imaging techniques could reproducibly characterize the histopathological features of CRLM, with several matched imaging and histology examples to illustrate these features, and discuss the oncological relevance of these features. Finally, we discuss the future challenges and opportunities of CRLM imaging, with a focus on the potential value of advanced analytics including radiomics and artificial intelligence, to help inform future research in this rapidly moving field.

Grey-Wolf-Based Wang's Demons for Retinal Image Registration

Image registration has an imperative role in medical imaging. In this work, a grey-wolf optimizer (GWO)-based non-rigid demons registration is proposed to support the retinal image registration process. A comparative study of the proposed GWO-based demons registration framework with cuckoo search, firefly algorithm, and particle swarm optimization-based demons registration is conducted. In addition, a comparative analysis of different demons registration methods, such as Wang’s demons, Tang’s demons, and Thirion’s demons which are optimized using the proposed GWO is carried out. The results established the superiority of the GWO-based framework which achieved 0.9977 correlation, and fast processing compared to the use of the other optimization algorithms. Moreover, GWO-based Wang’s demons performed better accuracy compared to the Tang’s demons and Thirion’s demons framework. It also achieved the best less registration error of 8.36 × 10⁻⁵.

Accuracy of deformable image registration techniques for alignment of longitudinal cholangiocarcinoma CT images

PURPOSE

Response assessment of radiotherapy for the treatment of intrahepatic cholangiocarcinoma (IHCC) across longitudinal images is challenging due to anatomical changes. Advanced deformable image registration (DIR) techniques are required to correlate corresponding tissues across time. In this study, the accuracy of five commercially available DIR algorithms in four treatment planning systems (TPS) was investigated for the registration of planning images with posttreatment follow-up images for response assessment or re-treatment purposes.

METHODS

Twenty-nine IHCC patients treated with hypofractionated radiotherapy and with pretreatment and posttreatment contrast-enhanced computed tomography (CT) images were analyzed. Liver segmentations were semiautomatically generated on all CTs and the posttreatment CT was then registered to the pretreatment CT using five commercially available algorithms (Demons, B-splines, salient feature-based, anatomically constrained and finite element-based) in four TPSs. This was followed by an in-depth analysis of 10 DIR strategies (plus global and liver-focused rigid registration) in one of the TPSs. Eight of the strategies were variants of the anatomically constrained DIR while the two were based on a finite element-based biomechanical registration. The anatomically constrained techniques were combinations of: (a) initializations with the two rigid registrations; (b) two similarity metrics - correlation coefficient (CC) and mutual information (MI); and (c) with and without a controlling region of interest (ROI) - the liver. The finite element-based techniques were initialized by the two rigid registrations. The accuracy of each registration was evaluated using target registration error (TRE) based on identified vessel bifurcations. The results were statistically analyzed with a one-way analysis of variance (ANOVA) and pairwise comparison tests. Stratified analysis was conducted on the inter-TPS data (plus the liver-focused rigid registration) using treatment volume changes, slice thickness, time between scans, and abnormal lab values as stratifying factors.

RESULTS

The complex deformation observed following treatment resulted in average TRE exceeding the image voxel size for all techniques. For the inter-TPS comparison, the Demons algorithm had the lowest TRE, which was significantly superior to all the other algorithms. The respective mean (standard deviation) TRE (in mm) for the Demons, B-splines, salient feature-based, anatomically constrained, and finite element-based algorithms were 4.6 (2.0), 7.4 (2.7), 7.2 (2.6), 6.3 (2.3), and 7.5 (4.0). In the follow-up comparison of the anatomically constrained DIR, the strategy with liver-focused rigid registration initialization, CC as similarity metric and liver as a controlling ROI had the lowest mean TRE - 6.0 (2.0). The maximum TRE for all techniques exceeded 10 mm. Selection of DIR strategy was found to be a statistically significant factor for registration accuracy. Tumor volume change had a significant effect on TRE for finite element-based registration and B-splines DIR. Time between scans had a substantial effect on TRE for all registrations but was only significant for liver-focused rigid, finite element-based and salient feature-based DIRs.

CONCLUSIONS

This study demonstrates the limitations of commercially available DIR techniques in TPSs for alignment of longitudinal images of liver cancer presenting complex anatomical changes including local hypertrophy and fibrosis/necrosis. DIR in this setting should be used with caution and careful evaluation.