A new fully automatic and robust algorithm for fast segmentation of liver tissue and tumors from CT scans

MediLite3DNet: A lightweight network for segmentation of nasopharyngeal airways

The precise segmentation and three-dimensional reconstruction of the nasopharyngeal airway are crucial for the diagnosis and treatment of adenoid hypertrophy in children. However, traditional methods face challenges such as information loss and low computational efficiency when addressing this task. To overcome these issues, this paper introduces an innovative lightweight 3D medical image segmentation network-MediLite3DNet. The core of this network is the Parallel Multi-Scale High-Resolution Network (PMHNet), which effectively retains detailed features of the airway and optimizes the fusion of multi-scale features through its parallel structure. In response to the complexity of existing networks and their reliance on vast amounts of training data, this paper presents an efficient Hierarchical Decoupled Convolution Module (EHDC) to reduce computational costs while maintaining efficient feature extraction capabilities. Furthermore, to enhance the accuracy of segmentation, a lightweight Channel and Spatial Attention Mechanism (LCSA) is proposed. This mechanism identifies and emphasizes key channels and spatial features, improving the processing of complex medical images while controlling the increase in the number of parameters. Experiments conducted on a clinical CT dataset demonstrate the network's exceptional performance, with a Dice coefficient of 97.42%, sensitivity of 98.69%, and Jaccard index of 95%. Maintaining high precision, the model has a parameter count of only 0.227M and a floating-point operation count (FLOPs) of 24.526G, proving its computational efficiency. The significance of this study is that it provides a highly efficient and accurate diagnostic tool for children with adenoid hypertrophy. Additionally, with the innovative MediLite3DNet design, it brings a new lightweight solution to the domain of medical image segmentation.

ResTransUnet: An effective network combined with Transformer and U-Net for liver segmentation in CT scans

Liver segmentation is a fundamental prerequisite for the diagnosis and surgical planning of hepatocellular carcinoma. Traditionally, the liver contour is drawn manually by radiologists using a slice-by-slice method. However, this process is time-consuming and error-prone, depending on the radiologist's experience. In this paper, we propose a new end-to-end automatic liver segmentation framework, named ResTransUNet, which exploits the transformer's ability to capture global context for remote interactions and spatial relationships, as well as the excellent performance of the original U-Net architecture. The main contribution of this paper lies in proposing a novel fusion network that combines Unet and Transformer architectures. In the encoding structure, a dual-path approach is utilized, where features are extracted separately using both convolutional neural networks (CNNs) and Transformer networks. Additionally, an effective feature enhancement unit is designed to transfer the global features extracted by the Transformer network to the CNN for feature enhancement. This model aims to address the drawbacks of traditional Unet-based methods, such as feature loss during encoding and poor capture of global features. Moreover, it avoids the disadvantages of pure Transformer models, which suffer from large parameter sizes and high computational complexity. The experimental results on the LiTS2017 dataset demonstrate remarkable performance for our proposed model, with Dice coefficients, volumetric overlap error (VOE), and relative volume difference (RVD) values for liver segmentation reaching 0.9535, 0.0804, and -0.0007, respectively. Furthermore, to further validate the model's generalization capability, we conducted tests on the 3Dircadb, Chaos, and Sliver07 datasets. The experimental results demonstrate that the proposed method outperforms other closely related models with higher liver segmentation accuracy. In addition, significant improvements can be achieved by applying our method when handling liver segmentation with small and discontinuous liver regions, as well as blurred liver boundaries. The code is available at the website: https://github.com/Jouiry/ResTransUNet.

Leveraging radiomics and AI for precision diagnosis and prognostication of liver malignancies

Liver tumors, whether primary or metastatic, have emerged as a growing concern with substantial global health implications. Timely identification and characterization of liver tumors are pivotal factors in order to provide optimum treatment. Imaging is a crucial part of the detection of liver tumors; however, conventional imaging has shortcomings in the proper characterization of these tumors which leads to the need for tissue biopsy. Artificial intelligence (AI) and radiomics have recently emerged as investigational opportunities with the potential to enhance the detection and characterization of liver lesions. These advancements offer opportunities for better diagnostic accuracy, prognostication, and thereby improving patient care. In particular, these techniques have the potential to predict the histopathology, genotype, and immunophenotype of tumors based on imaging data, hence providing guidance for personalized treatment of such tumors. In this review, we outline the progression and potential of AI in the field of liver oncology imaging, specifically emphasizing manual radiomic techniques and deep learning-based representations. We discuss how these tools can aid in clinical decision-making challenges. These challenges encompass a broad range of tasks, from prognosticating patient outcomes, differentiating benign treatment-related factors and actual disease progression, recognizing uncommon response patterns, and even predicting the genetic and molecular characteristics of the tumors. Lastly, we discuss the pitfalls, technical limitations and future direction of these AI-based techniques.

The Liver Tumor Segmentation Benchmark (LiTS)

In this work, we report the set-up and results of the Liver Tumor Segmentation Benchmark (LiTS), which was organized in conjunction with the IEEE International Symposium on Biomedical Imaging (ISBI) 2017 and the International Conferences on Medical Image Computing and Computer-Assisted Intervention (MICCAI) 2017 and 2018. The image dataset is diverse and contains primary and secondary tumors with varied sizes and appearances with various lesion-to-background levels (hyper-/hypo-dense), created in collaboration with seven hospitals and research institutions. Seventy-five submitted liver and liver tumor segmentation algorithms were trained on a set of 131 computed tomography (CT) volumes and were tested on 70 unseen test images acquired from different patients. We found that not a single algorithm performed best for both liver and liver tumors in the three events. The best liver segmentation algorithm achieved a Dice score of 0.963, whereas, for tumor segmentation, the best algorithms achieved Dices scores of 0.674 (ISBI 2017), 0.702 (MICCAI 2017), and 0.739 (MICCAI 2018). Retrospectively, we performed additional analysis on liver tumor detection and revealed that not all top-performing segmentation algorithms worked well for tumor detection. The best liver tumor detection method achieved a lesion-wise recall of 0.458 (ISBI 2017), 0.515 (MICCAI 2017), and 0.554 (MICCAI 2018), indicating the need for further research. LiTS remains an active benchmark and resource for research, e.g., contributing the liver-related segmentation tasks in http://medicaldecathlon.com/. In addition, both data and online evaluation are accessible via https://competitions.codalab.org/competitions/17094.

MHA-Net: A Multibranch Hybrid Attention Network for Medical Image Segmentation

The robust segmentation of organs from the medical image is the key technique in medical image analysis for disease diagnosis. U-Net is a robust structure for medical image segmentation. However, U-Net adopts consecutive downsampling encoders to capture multiscale features, resulting in the loss of contextual information and insufficient recovery of high-level semantic features. In this paper, we present a new multibranch hybrid attention network (MHA-Net) to capture more contextual information and high-level semantic features. The main idea of our proposed MHA-Net is to use the multibranch hybrid attention feature decoder to recover more high-level semantic features. The lightweight pyramid split attention (PSA) module is used to connect the encoder and decoder subnetwork to obtain a richer multiscale feature map. We compare the proposed MHA-Net to state-of-art approaches on the DRIVE dataset, the fluoroscopic roentgenographic stereophotogrammetric analysis X-ray dataset, and the polyp dataset. The experimental results on different modal images reveal that our proposed MHA-Net provides better segmentation results than other segmentation approaches.

3D printing in aortic endovascular therapies

Endovascular treatment of aortic disease, including aneurysm or dissection, is expanding at a rapid pace. Often, the specific patient anatomy in these cases is complex. Additive manufacturing, also known as three-dimensional (3D) printing, is especially useful in the treatment of aortic disease, due to its ability to manufacture physical models of complex patient anatomy. Compared to other surgical procedures, endovascular aortic repair can readily exploit the advantages of 3D printing with regard to operative planning and preoperative training. To date, there have been numerous uses of 3D printing in the treatment of aortic pathology as an adjunct in presurgical planning and as a basis for training modules for fellows and residents. In this review, we summarize the current uses of 3D printing in the endovascular management of aortic disease. We also review the process of producing these models, the limitations of their applications, and future directions of 3D printing in this field.

Edge Constraint and Location Mapping for Liver Tumor Segmentation from Nonenhanced Images

As there is no contrast enhancement, the liver tumor area in nonenhanced MRI exists with blurred edges and low contrast, which greatly affects the speed and accuracy of liver tumor diagnosis. As a result, precise segmentation of liver tumor from nonenhanced MRI has become an urgent and challenging task. In this paper, we propose an edge constraint and localization mapping segmentation model (ECLMS) to accurately segment liver tumor from nonenhanced MRI. It consists of two parts: localization network and dual-branch segmentation network. We build the localization network, which generates prior coarse masks to provide position mapping for the segmentation network. This part enhances the ability of the model to localize liver tumor in nonenhanced images. We design a dual-branch segmentation network, where the main decoding branch focuses on the feature representation in the core region of the tumor and the edge decoding branch concentrates on capturing the edge information of the tumor. To improve the ability of the model for capturing detailed features, sSE blocks and dense upward connections are introduced into it. We design the bottleneck multiscale module to construct multiscale feature representations using kernels of different sizes while integrating the location mapping of tumor. The ECLMS model is evaluated on a private nonenhanced MRI dataset that comprises 215 different subjects. The model achieves the best Dice coefficient, precision, and accuracy of 90.23%, 92.25%, and 92.39%, correspondingly. The effectiveness of our model is demonstrated by experiment results, and our model reaches superior results in the segmentation task of nonenhanced liver tumor compared to existing segmentation methods.

Deep Learning Model With Convolutional Neural Network for Detecting and Segmenting Hepatocellular Carcinoma in CT: A Preliminary Study

Introduction

Hepatocellular carcinoma (HCC) is one of the most common malignancies in the world. Early detection and accurate diagnosis of HCC play an important role in patient management. This study aimed to develop a convolutional neural network-based model to identify and segment HCC lesions utilizing dynamic contrast agent-enhanced computed tomography (CT).

Methods

This retrospective study used CT image sets of histopathology-confirmed hepatocellular carcinoma over three phases (arterial, venous, and delayed). The proposed convolutional neural network (CNN) segmentation method was based on the U-Net architecture and trained using the domain adaptation technique. The proposed method was evaluated using 115 liver masses of 110 patients (87 men and 23 women; mean age, 56.9 years ± 11.9 (SD); mean mass size, 6.0 cm ± 3.6). The sensitivity for identifying HCC of the model and Dice score for segmentation of liver masses between radiologists and the CNN model were calculated for the test set.

Results

The sensitivity for HCC identification of the model was 100%. The median Dice score for HCC segmenting between radiologists and the CNN model was 0.81 for the test set.

Conclusion

Deep learning with CNN had high performance in the identification and segmentation of HCC on dynamic CT.

Radiomics in hepatocellular carcinoma: A state-of-the-art review

Hepatocellular carcinoma (HCC) is the most common cancer and the second major contributor to cancer-related mortality. Radiomics, a burgeoning technology that can provide invisible high-dimensional quantitative and mineable data derived from routine-acquired images, has enormous potential for HCC management from diagnosis to prognosis as well as providing contributions to the rapidly developing deep learning methodology. This article aims to review the radiomics approach and its current state-of-the-art clinical application scenario in HCC. The limitations, challenges, and thoughts on future directions are also summarized.

Effects of Multiple Filters on Liver Tumor Segmentation From CT Images

Segmentation of liver tumors from Computerized Tomography (CT) images remains a challenge due to the natural variation in tumor shape and structure as well as the noise in CT images. A key assumption is that the performance of liver tumor segmentation depends on the characteristics of multiple features extracted from multiple filters. In this paper, we design an enhanced approach based on a two-class (liver, tumor) convolutional neural network that discriminates tumor as well as liver from CT images. First, the contrast and intensity values in CT images are adjusted and high frequencies are removed using Hounsfield units (HU) filtering and standardization. Then, the liver tumor is segmented from entire images with multiple filter U-net (MFU-net). Finally, a quantitative analysis is carried out to evaluate the segmentation results using three different methods: boundary-distance-based metrics, size-based metrics, and overlap-based metrics. The proposed method is validated on CT images from the 3Dircadb and LiTS dataset. The results demonstrate that the multiple filters are useful for extracting local and global feature simultaneously, minimizing the boundary distance errors, and our approach demonstrates better performance in heterogeneous tumor regions of CT images.

Progress of MRI Radiomics in Hepatocellular Carcinoma

Background

Hepatocellular carcinoma (HCC) is the sixth most common cancer in the world and the third leading cause of cancer-related death. Although the diagnostic scheme of HCC is currently undergoing refinement, the prognosis of HCC is still not satisfactory. In addition to certain factors, such as tumor size and number and vascular invasion displayed on traditional imaging, some histopathological features and gene expression parameters are also important for the prognosis of HCC patients. However, most parameters are based on postoperative pathological examinations, which cannot help with preoperative decision-making. As a new field, radiomics extracts high-throughput imaging data from different types of images to build models and predict clinical outcomes noninvasively before surgery, rendering it a powerful aid for making personalized treatment decisions preoperatively.

Objective

This study reviewed the workflow of radiomics and the research progress on magnetic resonance imaging (MRI) radiomics in the diagnosis and treatment of HCC.

Methods

A literature review was conducted by searching PubMed for search of relevant peer-reviewed articles published from May 2017 to June 2021.The search keywords included HCC, MRI, radiomics, deep learning, artificial intelligence, machine learning, neural network, texture analysis, diagnosis, histopathology, microvascular invasion, surgical resection, radiofrequency, recurrence, relapse, transarterial chemoembolization, targeted therapy, immunotherapy, therapeutic response, and prognosis.

Results

Radiomics features on MRI can be used as biomarkers to determine the differential diagnosis, histological grade, microvascular invasion status, gene expression status, local and systemic therapeutic responses, and prognosis of HCC patients.

Conclusion

Radiomics is a promising new imaging method. MRI radiomics has high application value in the diagnosis and treatment of HCC.

SAR-U-Net: Squeeze-and-excitation block and atrous spatial pyramid pooling based residual U-Net for automatic liver segmentation in Computed Tomography

BACKGROUND AND OBJECTIVE

Liver segmentation is an essential prerequisite for liver cancer diagnosis and surgical planning. Traditionally, liver contour is delineated manually by radiologist in a slice-by-slice fashion. However, this process is time-consuming and prone to errors depending on radiologist's experience. In this paper, a modified U-Net based framework is presented, which leverages techniques from Squeeze-and-Excitation (SE) block, Atrous Spatial Pyramid Pooling (ASPP) and residual learning for accurate and robust liver Computed Tomography (CT) segmentation, and the effectiveness of the proposed method was tested on two public datasets LiTS17 and SLiver07.

METHODS

A new network architecture, called SAR-U-Net was designed, which is grounded in the classical U-Net. Firstly, the SE block is introduced to adaptively extract image features after each convolution in the U-Net encoder, while suppressing irrelevant regions, and highlighting features of specific segmentation task; Secondly, the ASPP is employed to replace the transition layer and the output layer, and acquire multi-scale image information via different receptive fields. Thirdly, to alleviate the gradient vanishment problem, the traditional convolution block is replaced with the residual structures, and thus prompt the network to gain accuracy from considerably increased depth.

RESULTS

In the LiTS17 database experiment, five popular metrics were used for evaluation, including Dice coefficient, VOE, RVD, ASD and MSD. Compared with other closely related models, the proposed method achieved the highest accuracy. In addition, in the experiment of the SLiver07 dataset, compared with other closely related models, the proposed method achieved the highest segmentation accuracy except for the RVD.

CONCLUSION

An improved U-Net network combining SE, ASPP, and residual structures is developed for automatic liver segmentation from CT images. This new model shows a great improvement on the accuracy compared to other closely related models, and its robustness to challenging problems, including small liver regions, discontinuous liver regions, and fuzzy liver boundaries, is also well demonstrated and validated.

Radiomics in liver diseases: Current progress and future opportunities

Liver diseases, a wide spectrum of pathologies from inflammation to neoplasm, have become an increasingly significant health problem worldwide. Noninvasive imaging plays a critical role in the clinical workflow of liver diseases, but conventional imaging assessment may provide limited information. Accurate detection, characterization and monitoring remain challenging. With progress in quantitative imaging analysis techniques, radiomics emerged as an efficient tool that shows promise to aid in personalized diagnosis and treatment decision-making. Radiomics could reflect the heterogeneity of liver lesions via extracting high-throughput and high-dimensional features from multi-modality imaging. Machine learning algorithms are then used to construct clinical target-oriented imaging biomarkers to assist disease management. Here, we review the methodological process in liver disease radiomics studies in a stepwise fashion from data acquisition and curation, region of interest segmentation, liver-specific feature extraction, to task-oriented modelling. Furthermore, the applications of radiomics in liver diseases are outlined in aspects of diagnosis and staging, evaluation of liver tumour biological behaviours, and prognosis according to different disease type. Finally, we discuss the current limitations of radiomics in liver disease studies and explore its future opportunities.

Liver tumor segmentation in CT volumes using an adversarial densely connected network

Background

Malignant liver tumor is one of the main causes of human death. In order to help physician better diagnose and make personalized treatment schemes, in clinical practice, it is often necessary to segment and visualize the liver tumor from abdominal computed tomography images. Due to the large number of slices in computed tomography sequence, developing an automatic and reliable segmentation method is very favored by physicians. However, because of the noise existed in the scan sequence and the similar pixel intensity of liver tumors with their surrounding tissues, besides, the size, position and shape of tumors also vary from one patient to another, automatic liver tumor segmentation is still a difficult task.

Results

We perform the proposed algorithm to the Liver Tumor Segmentation Challenge dataset and evaluate the segmentation results. Experimental results reveal that the proposed method achieved an average Dice score of 68.4% for tumor segmentation by using the designed network, and ASD, MSD, VOE and RVD improved from 27.8 to 21, 147 to 124, 0.52 to 0.46 and 0.69 to 0.73, respectively after performing adversarial training strategy, which proved the effectiveness of the proposed method.

Conclusions

The testing results show that the proposed method achieves improved performance, which corroborated the adversarial training based strategy can achieve more accurate and robustness results on liver tumor segmentation task.

Analysis of Abdominal Computed Tomography Images for Automatic Liver Cancer Diagnosis Using Image Processing Algorithm

Background:

The application of image processing algorithms for medical image analysis has been found effectual in the past years. Imaging techniques provide assistance to the radiologists and physicians for the diagnosis of abnormalities in different organs.

Objective:

The proposed algorithm is designed for automatic computer-aided diagnosis of liver cancer from low contrast CT images. The idea expressed in this article is to classify the malignancy of the liver tumor ahead of liver segmentation and to locate HCC burden on the liver.

Methods:

A novel Fuzzy Linguistic Constant (FLC) is designed for image enhancement. To classify the enhanced liver image as cancerous or non-cancerous, fuzzy membership function is applied. The extracted features are assessed for malignancy and benignancy using the structural similarity index. The malignant CT image is further processed for automatic tumor segmentation and grading by applying morphological image processing techniques.

Results:

The validity of the concept is verified on a dataset of 179 clinical cases which consist of 98 benign and 81 malignant liver tumors. Classification accuracy of 98.3% is achieved by Support Vector Machine (SVM). The proposed method has the ability to automatically segment the tumor with an improved detection rate of 78% and a precision value of 0.6.

Conclusion:

The algorithm design offers an efficient tool to the radiologist in classifying the malignant cases from benign cases. The CAD system allows automatic segmentation of tumor and locates tumor burden on the liver. The methodology adopted can aid medical practitioners in tumor diagnosis and surgery planning.

A robust multi-variability model based liver segmentation algorithm for CT-scan and MRI modalities

Developing methods to segment the liver in medical images, study and analyze it remains a significant challenge. The shape of the liver can vary considerably from one patient to another, and adjacent organs are visualized in medical images with similar intensities, making the boundaries of the liver ambiguous. Consequently, automatic or semi-automatic segmentation of liver is a difficult task. Moreover, scanning systems and magnetic resonance imaging have different settings and parameters. Thus the images obtained differ from one machine to another. In this article, we propose an automatic model-based segmentation that allows building a faithful 3-D representation of the liver, with a mean Dice value equal to 90.3% on CT and MRI datasets. We compare our algorithm with a semi-automatic method and with other approaches according to the state of the art. Our method works with different data sources, we use a large quantity of CT and MRI images from machines in various hospitals and multiple DICOM images available from public challenges. Finally, for evaluation of liver segmentation approaches in state of the art, robustness is not adequacy addressed with a precise definition. Another originality of this article is the introduction of a novel measure of robustness, which takes into account the liver variability at different scales.

Automatic segmentation methods for liver and hepatic vessels from CT and MRI volumes, applied to the Couinaud scheme

BACKGROUND

Proper segmentation of the liver from medical images is critical for computer-assisted diagnosis, therapy and surgical planning. Knowledge of its vascular structure allows division of the liver into eight functionally independent segments, each with its own vascular inflow, known as the Couinaud scheme. Couinaud's description is the most widely used classification, since it is well-suited for surgery and accurate for the localization of lesions. However, automatic segmentation of the liver and its vascular structure to construct the Couinaud scheme remains a challenging task.

METHODS

We present a complete framework to obtain Couinaud's classification in three main steps; first, we propose a model-based liver segmentation, then a vascular segmentation based on a skeleton process, and finally, the construction of the eight independent liver segments. Our algorithms are automatic and allow 3D visualizations.

RESULTS

We validate these algorithms on various databases with different imaging modalities (Magnetic Resonance Imaging (MRI) and Computed Tomography (CT)). Experimental results are presented on diseased livers, which pose complex challenges because both the overall organ shape and the vessels can be severely deformed. A mean DICE score of 0.915 is obtained for the liver segmentation, and an average accuracy of 0.98 for the vascular network. Finally, we present an evaluation of our method for performing the Couinaud segmentation thanks to medical reports with promising results.

CONCLUSIONS

We were able to automatically reconstruct 3-D volumes of the liver and its vessels on MRI and CT scans. Our goal is to develop an improved method to help radiologists with tumor localization.

SEGMENTATION OF LIVER TUMOR USING FAST GREEDY SNAKE ALGORITHM

Back Ground: Liver tumors are a type of growth found in the liver which can be categorized as malignant or benign. It is also called as hepatic tumors. Early stage detection of tumor could be treated at a faster phase; if it is left undiagnosed it may lead to several complications. Traditional method adopted for diagnosis can be time consuming, error-prone and also requires an experts study. Hence a non invasive diagnostic method is required which overcomes the flaws of conventional method. Liver segmentation from CT images in post processing techniques not only is an essential prerequisite, but, by playing an important role in confirming liver function, pathological, and anatomical studies, is also a key technique for diagnosis of liver disease. Hence in the proposed study Fast greedy snakes algorithm in abdominal CT images were used for segmenting tumor portion.

Aim & Objectives: The aim and objectives of study is: (i) to segment tumor region in the liver image using Fast Greedy Snakes Algorithm (FGSA); (ii) to extract the GLCM features from the segmented region; (iii) to classify the normal and abnormal liver image using neural network classifier.

Methodology: The study involved a total of 30 normal and 30 abnormal Images from database. In the proposed study automated segmentation was performed using Fast Greedy Snakes (FGS) Algorithm and the features were extracted using GLCM method. Classification of normal and abnormal images was carried out using Back propagation Neural Network classifier.

Result: The proposed FGS algorithm provides accurate segmentation in liver images. Statistical features like mean, kurtosis, correlation and Entropy showed a higher value for the normal image than liver tumor image. On the other hand, features like Skewness, Homogeneity, contrast, Energy and standard deviation showed a comparatively higher value for a liver tumor image than the normal. Statistical features such as Mean, Contrast, Homogeneity and standard deviation are statistically significant at [Formula: see text]. Features like correlation, entropy and energy exhibits significance at [Formula: see text]. The feature extracted values provided significant difference between the normal and abnormal liver images. The neural network classifier yields the sensitivity of 95.8%, sensitivity of 81.4% and achieved the overall accuracy of 92%.

Conclusion: A most accurate, reliable and fast automated method was implemented to segment the liver tumor image using Fast Greedy snakes algorithm. Hence the proposed algorithm resulted in effective segmentation and the classifier could classify the normal and abnormal images with greater accuracy.

An Overview of Segmentation Algorithms for the Analysis of Anomalies on Medical Images

Human disease identification from the scanned body parts helps medical practitioners make the right decision in lesser time. Image segmentation plays a vital role in automated diagnosis for the delineation of anatomical organs and anomalies. There are many variants of segmentation algorithms used by current researchers, whereas there is no universal algorithm for all medical images. This paper classifies some of the widely used medical image segmentation algorithms based on their evolution, and the features of each generation are also discussed. The comparative analysis of segmentation algorithms is done based on characteristics like spatial consideration, region continuity, computation complexity, selection of parameters, noise immunity, accuracy, and computation time. Finally, in this work, some of the typical segmentation algorithms are implemented on real-time datasets using Matlab 2010 software, and the outcome of this work will be an aid for the researchers in medical image processing.

Three-dimensional (3D) printing and its applications for aortic diseases

Three-dimensional (3D) printing is a process which generates prototypes from virtual objects in computer-aided design (CAD) software. Since 3D printing enables the creation of customized objects, it is a rapidly expanding field in an age of personalized medicine. We discuss the use of 3D printing in surgical planning, training, and creation of devices for the treatment of aortic diseases. 3D printing can provide operators with a hands-on model to interact with complex anatomy, enable prototyping of devices for implantation based upon anatomy, or even provide pre-procedural simulation. Potential exists to expand upon current uses of 3D printing to create personalized implantable devices such as grafts. Future studies should aim to demonstrate the impact of 3D printing on outcomes to make this technology more accessible to patients with complex aortic diseases.

Radiogenomics of hepatocellular carcinoma: multiregion analysis-based identification of prognostic imaging biomarkers by integrating gene data-a preliminary study

Our objective was to identify prognostic imaging biomarkers for hepatocellular carcinoma in contrast-enhanced computed tomography (CECT) with biological interpretations by associating imaging features and gene modules. We retrospectively analyzed 371 patients who had gene expression profiles. For the 38 patients with CECT imaging data, automatic intra-tumor partitioning was performed, resulting in three spatially distinct subregions. We extracted a total of 37 quantitative imaging features describing intensity, geometry, and texture from each subregion. Imaging features were selected after robustness and redundancy analysis. Gene modules acquired from clustering were chosen for their prognostic significance. By constructing an association map between imaging features and gene modules with Spearman rank correlations, the imaging features that significantly correlated with gene modules were obtained. These features were evaluated with Cox's proportional hazard models and Kaplan-Meier estimates to determine their prognostic capabilities for overall survival (OS). Eight imaging features were significantly correlated with prognostic gene modules, and two of them were associated with OS. Among these, the geometry feature volume fraction of the subregion, which was significantly correlated with all prognostic gene modules representing cancer-related interpretation, was predictive of OS (Cox p  =  0.022, hazard ratio  =  0.24). The texture feature cluster prominence in the subregion, which was correlated with the prognostic gene module representing lipid metabolism and complement activation, also had the ability to predict OS (Cox p  =  0.021, hazard ratio  =  0.17). Imaging features depicting the volume fraction and textural heterogeneity in subregions have the potential to be predictors of OS with interpretable biological meaning.

3D Liver Tumor Segmentation in CT Images Using Improved Fuzzy C-Means and Graph Cuts

Three-dimensional (3D) liver tumor segmentation from Computed Tomography (CT) images is a prerequisite for computer-aided diagnosis, treatment planning, and monitoring of liver cancer. Despite many years of research, 3D liver tumor segmentation remains a challenging task. In this paper, an efficient semiautomatic method was proposed for liver tumor segmentation in CT volumes based on improved fuzzy C-means (FCM) and graph cuts. With a single seed point, the tumor volume of interest (VOI) was extracted using confidence connected region growing algorithm to reduce computational cost. Then, initial foreground/background regions were labeled automatically, and a kernelized FCM with spatial information was incorporated in graph cuts segmentation to increase segmentation accuracy. The proposed method was evaluated on the public clinical dataset (3Dircadb), which included 15 CT volumes consisting of various sizes of liver tumors. We achieved an average volumetric overlap error (VOE) of 29.04% and Dice similarity coefficient (DICE) of 0.83, with an average processing time of 45 s per tumor. The experimental results showed that the proposed method was accurate for 3D liver tumor segmentation with a reduction of processing time.

A Deep Learning Approach for Hepatocellular Carcinoma Grading

Introduction and objective: Computer Aided Decision (CAD) systems based on Medical Imaging could support radiologists in grading Hepatocellular carcinoma (HCC) by means of Computed Tomography (CT) images, thus avoiding medical invasive procedures such as biopsies. The identification and characterization of Regions of Interest (ROIs) containing lesions is an important phase allowing an easier classification in two classes of HCCs. Two steps are needed for the detection of lesioned ROIs: a liver isolation in each CT slice and a lesion segmentation. Materials and methods: Materials consist in abdominal CT hepatic lesion from 18 patients subjected to liver transplant, partial hepatectomy, or US-guided needle biopsy. Several approaches are implemented to segment the region of liver and, then, detect the lesion ROI. Results: A Deep Learning approach using Convolutional Neural Network is followed for HCC grading. The obtained good results confirm the robustness of the segmentation algorithms leading to a more accurate classification.

Automatic segmentation of liver tumors from multiphase contrast-enhanced CT images based on FCNs

This paper presents a novel, fully automatic approach based on a fully convolutional network (FCN) for segmenting liver tumors from CT images. Specifically, we designed a multi-channel fully convolutional network (MC-FCN) to segment liver tumors from multiphase contrast-enhanced CT images. Because each phase of contrast-enhanced data provides distinct information on pathological features, we trained one network for each phase of the CT images and fused their high-layer features together. The proposed approach was validated on CT images taken from two databases: 3Dircadb and JDRD. In the case of 3Dircadb, using the FCN, the mean ratios of the volumetric overlap error (VOE), relative volume difference (RVD), average symmetric surface distance (ASD), root mean square symmetric surface distance (RMSD) and maximum symmetric surface distance (MSSD) were 15.6±4.3%, 5.8±3.5%, 2.0±0.9%, 2.9±1.5mm, 7.1±6.2mm, respectively. For JDRD, using the MC-FCN, the mean ratios of VOE, RVD, ASD, RMSD, and MSSD were 8.1±4.5%, 1.7±1.0%, 1.5±0.7%, 2.0±1.2mm, 5.2±6.4mm, respectively. The test results demonstrate that the MC-FCN model provides greater accuracy and robustness than previous methods.

Comparison of MRI- and CT-based semiautomated liver segmentation: a validation study

PURPOSE

To compare the repeatability, agreement, and efficiency of MRI- and CT-based semiautomated liver segmentation for the assessment of total and subsegmental liver volume.

METHODS

This retrospective study was conducted in 31 subjects who underwent contemporaneous liver MRI and CT. Total and subsegmental liver volumes were segmented from contrast-enhanced 3D gradient-recalled echo MRI sequences and CT images. Semiautomated segmentation was based on variational interpolation and Laplacian mesh optimization. All segmentations were repeated after 2 weeks. Manual segmentation of CT images using an active contour tool was used as the reference standard. Repeatability and agreement of the methods were evaluated with intra-class correlation coefficients (ICC) and Bland-Altman analysis. Total interaction time was recorded.

RESULTS

Intra-reader ICC were ≥0.987 for MRI and ≥0.995 for CT. Intra-reader repeatability was 30 ± 217 ml (bias ± 1.96 SD) (95% limits of agreement: -187 to 247 ml) for MRI and -10 ± 143 ml (-153 to 133 ml) for CT. Inter-method ICC between semiautomated and manual volumetry were ≥0.995 for MRI and ≥0.986 for CT. Inter-method segmental ICC varied between 0.584 and 0.865 for MRI and between 0.596 and 0.890 for CT. Inter-method agreement was -14 ± 136 ml (-150 to 122 ml) for MRI and 50 ± 226 ml (-176 to 276 ml) for CT. Inter-method segmental agreement ranged from 10 ± 47 ml (-37 to 57 ml) to 2 ± 214 ml (-212 to 216 ml) for MRI and 9 ± 45 ml (-36 to 54 ml) to -46 ± 183 ml (-229 to 137 ml) for CT. Interaction time (mean ± SD) was significantly shorter for MRI-based semiautomated segmentation (7.2 ± 0.1 min, p < 0.001) and for CT-based semiautomated segmentation (6.5 ± 0.2 min, p < 0.001) than for CT-based manual segmentation (14.5 ± 0.4 min).

CONCLUSION

MRI-based semiautomated segmentation provides similar repeatability and agreement to CT-based segmentation for total liver volume.

Automatic Echographic Detection of Halloysite Clay Nanotubes in a Low Concentration Range

Aim of this work was to investigate the automatic echographic detection of an experimental drug delivery agent, halloysite clay nanotubes (HNTs), by employing an innovative method based on advanced spectral analysis of the corresponding "raw" radiofrequency backscatter signals. Different HNT concentrations in a low range (5.5-66 × 1010 part/mL, equivalent to 0.25-3.00 mg/mL) were dispersed in custom-designed tissue-mimicking phantoms and imaged through a clinically-available echographic device at a conventional ultrasound diagnostic frequency (10 MHz). The most effective response (sensitivity = 60%, specificity = 95%), was found at a concentration of 33 × 1010 part/mL (1.5 mg/mL), representing a kind of best compromise between the need of enough particles to introduce detectable spectral modifications in the backscattered signal and the necessity to avoid the losses of spectral peculiarity associated to higher HNT concentrations. Based on theoretical considerations and quantitative comparisons with literature-available results, this concentration could also represent an optimal concentration level for the automatic echographic detection of different solid nanoparticles when employing a similar ultrasound frequency. Future dedicated studies will assess the actual clinical usefulness of the proposed approach and the potential of HNTs for effective theranostic applications.

Semantic representation of reported measurements in radiology

Background

In radiology, a vast amount of diverse data is generated, and unstructured reporting is standard. Hence, much useful information is trapped in free-text form, and often lost in translation and transmission. One relevant source of free-text data consists of reports covering the assessment of changes in tumor burden, which are needed for the evaluation of cancer treatment success. Any change of lesion size is a critical factor in follow-up examinations. It is difficult to retrieve specific information from unstructured reports and to compare them over time. Therefore, a prototype was implemented that demonstrates the structured representation of findings, allowing selective review in consecutive examinations and thus more efficient comparison over time.

Methods

We developed a semantic Model for Clinical Information (MCI) based on existing ontologies from the Open Biological and Biomedical Ontologies (OBO) library. MCI is used for the integrated representation of measured image findings and medical knowledge about the normal size of anatomical entities. An integrated view of the radiology findings is realized by a prototype implementation of a ReportViewer. Further, RECIST (Response Evaluation Criteria In Solid Tumors) guidelines are implemented by SPARQL queries on MCI. The evaluation is based on two data sets of German radiology reports: An oncologic data set consisting of 2584 reports on 377 lymphoma patients and a mixed data set consisting of 6007 reports on diverse medical and surgical patients. All measurement findings were automatically classified as abnormal/normal using formalized medical background knowledge, i.e., knowledge that has been encoded into an ontology. A radiologist evaluated 813 classifications as correct or incorrect. All unclassified findings were evaluated as incorrect.

Results

The proposed approach allows the automatic classification of findings with an accuracy of 96.4 % for oncologic reports and 92.9 % for mixed reports. The ReportViewer permits efficient comparison of measured findings from consecutive examinations. The implementation of RECIST guidelines with SPARQL enhances the quality of the selection and comparison of target lesions as well as the corresponding treatment response evaluation.

Conclusions

The developed MCI enables an accurate integrated representation of reported measurements and medical knowledge. Thus, measurements can be automatically classified and integrated in different decision processes. The structured representation is suitable for improved integration of clinical findings during decision-making. The proposed ReportViewer provides a longitudinal overview of the measurements.

Validation of a semiautomated liver segmentation method using CT for accurate volumetry

RATIONALE AND OBJECTIVES

To compare the repeatability and agreement of a semiautomated liver segmentation method with manual segmentation for assessment of total liver volume on CT (computed tomography).

MATERIALS AND METHODS

This retrospective, institutional review board-approved study was conducted in 41 subjects who underwent liver CT for preoperative planning. The major pathologies encountered were colorectal cancer metastases, benign liver lesions and hepatocellular carcinoma. This semiautomated segmentation method is based on variational interpolation and 3D minimal path-surface segmentation. Total and subsegmental liver volumes were segmented from contrast-enhanced CT images in venous phase. Two image analysts independently performed semiautomated segmentations and two other image analysts performed manual segmentations. Repeatability and agreement of both methods were evaluated with intraclass correlation coefficients (ICC) and Bland-Altman analysis. Interaction time was recorded for both methods.

RESULTS

Bland-Altman analysis revealed an intrareader agreement of -1 ± 27 mL (mean ± 1.96 standard deviation) with ICC of 0.999 (P < .001) for manual segmentation and 12 ± 97 mL with ICC of 0.991 (P < .001) for semiautomated segmentation. Bland-Altman analysis revealed an interreader agreement of -4 ± 22 mL with ICC of 0.999 (P < .001) for manual segmentation and 5 ± 98 mL with ICC of 0.991 (P < .001) for semiautomated segmentation. Intermethod agreement was found to be 3 ± 120 mL with ICC of 0.988 (P < .001). Mean interaction time was 34.3 ± 16.7 minutes for the manual method and 8.0 ± 1.2 minutes for the semiautomated method (P < .001).

CONCLUSIONS

A semiautomated segmentation method can substantially shorten interaction time while preserving a high repeatability and agreement with manual segmentation.

Tracking fuzzy borders using geodesic curves with application to liver segmentation on planning CT

PURPOSE

This work aims to develop a robust and efficient method to track the fuzzy borders between liver and the abutted organs where automatic liver segmentation usually suffers, and to investigate its applications in automatic liver segmentation on noncontrast-enhanced planning computed tomography (CT) images.

METHODS

In order to track the fuzzy liver-chestwall and liver-heart borders where oversegmentation is often found, a starting point and an ending point were first identified on the coronal view images; the fuzzy border was then determined as a geodesic curve constructed by minimizing the gradient-weighted path length between these two points near the fuzzy border. The minimization of path length was numerically solved by fast-marching method. The resultant fuzzy borders were incorporated into the authors' automatic segmentation scheme, in which the liver was initially estimated by a patient-specific adaptive thresholding and then refined by a geodesic active contour model. By using planning CT images of 15 liver patients treated with stereotactic body radiation therapy, the liver contours extracted by the proposed computerized scheme were compared with those manually delineated by a radiation oncologist.

RESULTS

The proposed automatic liver segmentation method yielded an average Dice similarity coefficient of 0.930 ± 0.015, whereas it was 0.912 ± 0.020 if the fuzzy border tracking was not used. The application of fuzzy border tracking was found to significantly improve the segmentation performance. The mean liver volume obtained by the proposed method was 1727 cm(3), whereas it was 1719 cm(3) for manual-outlined volumes. The computer-generated liver volumes achieved excellent agreement with manual-outlined volumes with correlation coefficient of 0.98.

CONCLUSIONS

The proposed method was shown to provide accurate segmentation for liver in the planning CT images where contrast agent is not applied. The authors' results also clearly demonstrated that the application of tracking the fuzzy borders could significantly reduce contour leakage during active contour evolution.

Tumor growth prediction with reaction-diffusion and hyperelastic biomechanical model by physiological data fusion

The goal of tumor growth prediction is to model the tumor growth process, which can be achieved by physiological modeling and model personalization from clinical measurements. Although image-driven frameworks have been proposed with promising results, several issues such as infinitesimal strain assumptions, complicated personalization procedures, and the lack of functional information, may limit their prediction accuracy. In view of these issues, we propose a framework for pancreatic neuroendocrine tumor growth prediction, which comprises a FEM-based tumor growth model with coupled reaction-diffusion equation and nonlinear biomechanics. Physiological data fusion of structural and functional images is used to improve the subject-specificity of model personalization, and a derivative-free global optimization algorithm is adopted to facilitate the complicated model and accommodate flexible choices of objective functions. With this flexibility, we propose an objective function accounting for both the tumor volume difference and the root-mean-squared error of intracellular volume fractions. Experiments were performed on synthetic and clinical data to verify the parameter estimation capability and the prediction performance. Comparisons of using different biomechanical models and objective functions were also performed. From the experimental results of eight patient data sets, the average recall, precision, Dice coefficient, and relative volume difference between predicted and measured tumor volumes were 84.5 ± 6.9%, 85.8 ± 8.2%, 84.6 ± 1.7%, and 14.2 ± 8.4%, respectively.

Semiautomated hybrid algorithm for estimation of three-dimensional liver surface in CT using dynamic cellular automata and level-sets

Liver segmentation continues to remain a major challenge, largely due to its intense complexity with surrounding anatomical structures (stomach, kidney, and heart), high noise level and lack of contrast in pathological computed tomography (CT) data. We present an approach to reconstructing the liver surface in low contrast CT. The main contributions are: (1) a stochastic resonance-based methodology in discrete cosine transform domain is developed to enhance the contrast of pathological liver images, (2) a new formulation is proposed to prevent the object boundary, resulting from the cellular automata method, from leaking into the surrounding areas of similar intensity, and (3) a level-set method is suggested to generate intermediate segmentation contours from two segmented slices distantly located in a subject sequence. We have tested the algorithm on real datasets obtained from two sources, Hamad General Hospital and medical image computing and computer-assisted interventions grand challenge workshop. Various parameters in the algorithm, such as [Formula: see text], [Formula: see text], [Formula: see text], [Formula: see text], [Formula: see text], [Formula: see text], and [Formula: see text], play imperative roles, thus their values are precisely selected. Both qualitative and quantitative evaluation performed on liver data show promising segmentation accuracy when compared with ground truth data reflecting the potential of the proposed method.

Adaptive Cosegmentation of Pheochromocytomas in CECT Images Using Localized Level Set Models

Segmentation of pheochromocytomas in contrast-enhanced computed tomography (CECT) images is an ill-posed problem due to the presence of weak boundaries, intratumoral degeneration, and nearby structures and clutter. Additional information from different phases of CECT images needs to be imposed for better mass segmentations. In this paper, a novel adaptive cosegmentation method is proposed by incorporating a localized region-based level set model (LRLSM). The energy function is formulated with consideration of adaptive tradeoff between the complementary local information from image pairs. Gradient direction and shape dissimilarity measure are integrated to guide the level set evolution. Automatic localization radius selection is added to further facilitate the segmentation. Then, two level set functions from each image pair are evolved and refined alternately to minimize the energy function. Experimental results in 50 CECT image pairs show that the adaptive LRLSM-based method is effective in segmentation of pheochromocytoma at two phases and produces better results, especially in the cases with weak boundaries, and complex foreground and background.

User-guided segmentation of preterm neonate ventricular system from 3-D ultrasound images using convex optimization

A three-dimensional (3-D) ultrasound (US) system has been developed to monitor the intracranial ventricular system of preterm neonates with intraventricular hemorrhage (IVH) and the resultant dilation of the ventricles (ventriculomegaly). To measure ventricular volume from 3-D US images, a semi-automatic convex optimization-based approach is proposed for segmentation of the cerebral ventricular system in preterm neonates with IVH from 3-D US images. The proposed semi-automatic segmentation method makes use of the convex optimization technique supervised by user-initialized information. Experiments using 58 patient 3-D US images reveal that our proposed approach yielded a mean Dice similarity coefficient of 78.2% compared with the surfaces that were manually contoured, suggesting good agreement between these two segmentations. Additional metrics, the mean absolute distance of 0.65 mm and the maximum absolute distance of 3.2 mm, indicated small distance errors for a voxel spacing of 0.22 × 0.22 × 0.22 mm(3). The Pearson correlation coefficient (r = 0.97, p < 0.001) indicated a significant correlation of algorithm-generated ventricular system volume (VSV) with the manually generated VSV. The calculated minimal detectable difference in ventricular volume change indicated that the proposed segmentation approach with 3-D US images is capable of detecting a VSV difference of 6.5 cm(3) with 95% confidence, suggesting that this approach might be used for monitoring IVH patients' ventricular changes using 3-D US imaging. The mean segmentation times of the graphics processing unit (GPU)- and central processing unit-implemented algorithms were 50 ± 2 and 205 ± 5 s for one 3-D US image, respectively, in addition to 120 ± 10 s for initialization, less than the approximately 35 min required by manual segmentation. In addition, repeatability experiments indicated that the intra-observer variability ranges from 6.5% to 7.5%, and the inter-observer variability is 8.5% in terms of the coefficient of variation of the Dice similarity coefficient. The intra-class correlation coefficient for ventricular system volume measurements for each independent observer ranged from 0.988 to 0.996 and was 0.945 for three different observers. The coefficient of variation and intra-class correlation coefficient revealed that the intra- and inter-observer variability of the proposed approach introduced by the user initialization was small, indicating good reproducibility, independent of different users.

Magnifying endoscopy of gastric epithelial dysplasia based on the morphologic characteristics

AIM: To investigate the difference in magnifying endoscopic findings of gastric epithelial dysplasias (GEDs) according to the morphologic characteristics.

METHODS: This study included 46 GED lesions in 45 patients who underwent magnifying endoscopy using narrow band imaging (ME-NBI) before endoscopic resection. During ME-NBI, the microvascular and microsurface (MS) patterns and the presence of light blue crest (LBC) and white opaque substance were investigated. GEDs were categorized as adenomatous, foveolar, and hybrid types, and their mucin phenotype was evaluated.

RESULTS: Of the 46 lesions, 27 (59%) were categorized as adenomatous, 15 (32%) as hybrid, and the remaining 4 (9%) as foveolar. All adenomatous GEDs showed the round pit and/or tubular MS patterns, all foveolar GEDs showed the papillary pattern, and hybrid GEDs showed mixed patterns (P < 0.001). LBC was more frequently observed in adenomatous GEDs than in hybrid or foveolar GEDs (52%, 33%, 0%, respectively), although this difference was not significant (P = 0.127). The papillary MS pattern was associated with MUC5AC and MUC6 expression, and the round pit and/or tubular MS patterns were associated with CD10 expression.

CONCLUSION: The MS pattern in ME-NBI findings is useful for predicting the morphologic category and mucin phenotype of GEDs, and ME-NBI findings may guide decisions regarding GED treatment.

A low-interaction automatic 3D liver segmentation method using computed tomography for selective internal radiation therapy

This study introduces a novel liver segmentation approach for estimating anatomic liver volumes towards selective internal radiation treatment (SIRT). The algorithm requires minimal human interaction since the initialization process to segment the entire liver in 3D relied on a single computed tomography (CT) slice. The algorithm integrates a localized contouring algorithm with a modified k-means method. The modified k-means segments each slice into five distinct regions belonging to different structures. The liver region is further segmented using localized contouring. The novelty of the algorithm is in the design of the initialization masks for region contouring to minimize human intervention. Intensity based region growing together with novel volume of interest (VOI) based corrections is used to accomplish the single slice initialization. The performance of the algorithm is evaluated using 34 liver CT scans. Statistical experiments were performed to determine consistency of segmentation and to assess user dependency on the initialization process. Volume estimations are compared to the manual gold standard. Results show an average accuracy of 97.22% for volumetric calculation with an average Dice coefficient of 0.92. Statistical tests show that the algorithm is highly consistent (P = 0.55) and independent of user initialization (P = 0.20 and Fleiss' Kappa = 0.77 ± 0.06).

Preoperative assessment of postoperative liver function: the importance of residual liver volume

An inadequate volume of future liver remnant (FLR) remains an absolute contraindication to liver resection. FLR measurement correlates with surgical outcome and is fundamental to identify those patients that may benefit from portal vein embolization (PVE) and to assess the liver volume change following embolization. In order to minimize the risk of postoperative liver failure, preoperative analysis of FLR must be included in the surgical planning of every major liver resection. The aims of this review are to describe the use of preoperative volumetric analysis in modern liver surgery and indications for PVE.

Three-dimensional spatiotemporal features for fast content-based retrieval of focal liver lesions

Content-based image retrieval systems for 3-D medical datasets still largely rely on 2-D image-based features extracted from a few representative slices of the image stack. Most 2 -D features that are currently used in the literature not only model a 3-D tumor incompletely but are also highly expensive in terms of computation time, especially for high-resolution datasets. Radiologist-specified semantic labels are sometimes used along with image-based 2-D features to improve the retrieval performance. Since radiological labels show large interuser variability, are often unstructured, and require user interaction, their use as lesion characterizing features is highly subjective, tedious, and slow. In this paper, we propose a 3-D image-based spatiotemporal feature extraction framework for fast content-based retrieval of focal liver lesions. All the features are computer generated and are extracted from four-phase abdominal CT images. Retrieval performance and query processing times for the proposed framework is evaluated on a database of 44 hepatic lesions comprising of five pathological types. Bull's eye percentage score above 85% is achieved for three out of the five lesion pathologies and for 98% of query lesions, at least one same type of lesion is ranked among the top two retrieved results. Experiments show that the proposed system's query processing is more than 20 times faster than other already published systems that use 2-D features. With fast computation time and high retrieval accuracy, the proposed system has the potential to be used as an assistant to radiologists for routine hepatic tumor diagnosis.

Stereoscopic visualization of laparoscope image using depth information from 3D model

Laparoscopic surgery is indispensable from the current surgical procedures. It uses an endoscope system of camera and light source, and surgical instruments which pass through the small incisions on the abdomen of the patients undergoing laparoscopic surgery. Conventional laparoscope (endoscope) systems produce 2D colored video images which do not provide surgeons an actual depth perception of the scene. In this work, the problem was formulated as synthesizing a stereo image of the monocular (conventional) laparoscope image by incorporating into them the depth information from a 3D CT model. Various algorithms of the computer vision including the algorithms for the feature detection, matching and tracking in the video frames, and for the reconstruction of 3D shape from shading in the 2D laparoscope image were combined for making the system. The current method was applied to the laparoscope video at the rate of up to 5 frames per second to visualize its stereo video. A correlation was investigated between the depth maps calculated with our method with those from the shape from shading algorithm. The correlation coefficients between the depth maps were within the range of 0.70-0.95 (P<0.05). A t-test was used for the statistical analysis.

A non-parametric permutation method for assessing agreement for distance matrix observations

Distance matrix data are occurring ever more frequently in medical research, particularly in fields such as genetics, DNA research, and image analysis. We propose a non-parametric permutation method for assessing agreement when the data under study are distance matrices. We apply agglomerative hierarchical clustering and accompanying dendrograms to visualize the internal structure of the matrix observations. The accompanying test is based on random permutations of the elements within individual matrix observations and the corresponding matrix mean of these permutations. We compare the within-matrix element sum of squares (WMESS) for the observed mean against the WMESS for the permutation means. The methodology is exemplified using simulations and real data from magnetic resonance imaging.

Automated liver lesion detection in CT images based on multi-level geometric features

PURPOSE

Due to the increasing number of liver cancer cases in clinical practice, there is a significant need for efficient tools for computer-assisted liver lesion analysis. A wide range of clinical applications, such as lesion characterization, quantification and follow-up, can be facilitated by automated liver lesion detection. Liver lesions vary significantly in size, shape, density and heterogeneity, which make them difficult to detect automatically. The goal of this work was to develop a method that can detect all types of liver lesions with high sensitivity and low false positive rate within a short run time.

METHODS

The proposed method identifies abnormal regions in liver CT images based on their intensity using a multi-level segmentation approach. The abnormal regions are analyzed from the inside-out using basic geometric features (such as asymmetry, compactness or volume). Using this multi-level shape characterization, the abnormal regions are classified into lesions and other region types (including vessel, liver boundary). The proposed analysis also allows defining the contour of each finding. The method was trained on a set of 55 cases involving 120 lesions and evaluated on a set of 30 images involving 59 (various types of) lesions, which were manually contoured by a physician.

RESULTS

The proposed algorithm demonstrated a high detection rate (92 %) at a low (1.7) false positive per case (precision 51 %), when the method was started from a manually contoured liver. The same level of false positive per case (1.6) and precision (51 %) was achieved at a somewhat lower detection rate (85 %), when the volume of interest was defined by a fully automated liver segmentation.

CONCLUSIONS

The proposed method can efficiently detect liver lesions irrespective of their size, shape, density and heterogeneity within half a minute. According to the evaluation, its accuracy is competitive with the actual state-of-the-art approaches, and the contour of the detected findings is acceptable in most of the cases. Future work shall focus on more precise lesion contouring so that the proposed method can be a solid basis for fully automated liver tumour burden estimation.

A hybrid semi-automatic method for liver segmentation based on level-set methods using multiple seed points

The present study developed a hybrid semi-automatic method to extract the liver from abdominal computerized tomography (CT) images. The proposed hybrid method consists of a customized fast-marching level-set method for detection of an optimal initial liver region from multiple seed points selected by the user and a threshold-based level-set method for extraction of the actual liver region based on the initial liver region. The performance of the hybrid method was compared with those of the 2D region growing method implemented in OsiriX using abdominal CT datasets of 15 patients. The hybrid method showed a significantly higher accuracy in liver extraction (similarity index, SI=97.6 ± 0.5%; false positive error, FPE = 2.2 ± 0.7%; false negative error, FNE=2.5 ± 0.8%; average symmetric surface distance, ASD=1.4 ± 0.5mm) than the 2D (SI=94.0 ± 1.9%; FPE = 5.3 ± 1.1%; FNE=6.5 ± 3.7%; ASD=6.7 ± 3.8mm) region growing method. The total liver extraction time per CT dataset of the hybrid method (77 ± 10 s) is significantly less than the 2D region growing method (575 ± 136 s). The interaction time per CT dataset between the user and a computer of the hybrid method (28 ± 4 s) is significantly shorter than the 2D region growing method (484 ± 126 s). The proposed hybrid method was found preferred for liver segmentation in preoperative virtual liver surgery planning.