An Automated Brain Metastasis Detection and Segmentation System from MRI with a Large Multi-Institutional Dataset

PURPOSE/OBJECTIVE(S)

Developments of automated systems for brain metastasis (BM) detection and segmentation from MRI for assisting early detection and stereotactic radiosurgery (SRS) have been reported but most based upon relatively small datasets from single institutes. This work aims to develop and evaluate a system using a large multi-institutional dataset, and to improve both identification of small/subtle BMs and segmentation accuracy of large BMs.

MATERIALS/METHODS

A 3D U-Net system was trained and evaluated to detect and segment intraparenchymal BMs with a size > 2mm using 1856 MRI volumes from 1791 patients treated with SRS from seven institutions (1539 volumes for training, 183 for validation, and 134 for testing). All patients had 3D post-Gd T1w MRI scans pre-SRS. Gross tumor volumes (GTVs) of BMs for SRS were curated by each institute first. Then, additional efforts were spent to create GTVs for the untreated and/or uncontoured BMs, including central reviews by two radiologists, to improve accuracy of ground truth. The training dataset was augmented with synthetic BMs of 3773 MRIs using a 3D generative pipeline. Our system consists of two U-Nets with one using small 3D patches dedicated for detecting small BMs and another using large 3D patches for segmenting large BMs, and a random-forest based fusion module for combining the two network outputs. The first U-Net was trained with 3D patches containing at least one BM < 0.1 cm3. For detection performance, we measured BM-level sensitivity and case-level false-positive (FP) rate. For segmentation performance, we measured BM-level Dice similarity coefficient (DSC) and 95-percentile Hausdorff distance (HD95). We also stratified performances based upon BM sizes.

RESULTS

For 739 BMs in the 134 testing cases, the overall lesion-level sensitivity was 0.870 with an average case-level FP of 1.34±1.92 (95% CI: 1.02-1.67). The sensitivity was >0.969 for the BMs >0.1 cm3, but dropped to 0.755 for the BMs < 0.1 cm3 (Table 1). The average DSC and HD95 for all detected BMs were 0.786 and 1.35mm. The worse performance for BMs > 20 cm3 was caused by a case with 83 cm3 GTV and artifacts in the MRI volume.

CONCLUSION

We achieved excellent detection sensitivity and segmentation accuracy for BMs > 0.1 cm3, and promising performance for small BMs (<0.1cm3) with a controlled FP rate using a large multi-institutional dataset. Clinical utility for assisting early detection and SRS planning will be investigated. Table 1: Per-lesion detection and segmentation performance stratified by individual BM size. N is the number of BMs in each category.

Progressive data transmission for anatomical landmark detection in a cloud

BACKGROUND

In the concept of cloud-computing-based systems, various authorized users have secure access to patient records from a number of care delivery organizations from any location. This creates a growing need for remote visualization, advanced image processing, state-of-the-art image analysis, and computer aided diagnosis.

OBJECTIVES

This paper proposes a system of algorithms for automatic detection of anatomical landmarks in 3D volumes in the cloud computing environment. The system addresses the inherent problem of limited bandwidth between a (thin) client, data center, and data analysis server.

METHODS

The problem of limited bandwidth is solved by a hierarchical sequential detection algorithm that obtains data by progressively transmitting only image regions required for processing. The client sends a request to detect a set of landmarks for region visualization or further analysis. The algorithm running on the data analysis server obtains a coarse level image from the data center and generates landmark location candidates. The candidates are then used to obtain image neighborhood regions at a finer resolution level for further detection. This way, the landmark locations are hierarchically and sequentially detected and refined.

RESULTS

Only image regions surrounding landmark location candidates need to be trans- mitted during detection. Furthermore, the image regions are lossy compressed with JPEG 2000. Together, these properties amount to at least 30 times bandwidth reduction while achieving similar accuracy when compared to an algorithm using the original data.

CONCLUSIONS

The hierarchical sequential algorithm with progressive data transmission considerably reduces bandwidth requirements in cloud-based detection systems.

Computer-assisted discrimination among malignant lymphomas and leukemia using immunophenotyping, intelligent image repositories, and telemicroscopy

The process of discriminating among pathologies involving peripheral blood, bone marrow, and lymph node has traditionally begun with subjective morphological assessment of cellular materials viewed using light microscopy. The subtle visible differences exhibited by some malignant lymphomas and leukemia, however, give rise to a significant number of false negatives during microscopic evaluation by medical technologists. We have developed a distributed, clinical decision support prototype for distinguishing among hematologic malignancies. The system consists of two major components, a distributed telemicroscopy system and an intelligent image repository. The hybrid system enables individuals located at disparate clinical and research sites to engage in interactive consultation and to obtain computer-assisted decision support. Software, written in JAVA, allows primary users to control the specimen stage, objective lens, light levels, and focus of a robotic microscope remotely while a digital representation of the specimen is continuously broadcast to all session participants. Primary user status can be passed as a token. The system features shared graphical pointers, text messaging capability, and automated database management. Search engines for the database allow one to automatically identify and retrieve images, diagnoses, and correlated clinical data of cases from a "gold standard" database which exhibit spectral and spatial profiles which are most similar to a given query image. The system suggests the most likely diagnosis based on majority logic of the retrieved cases. The system was used to discriminate among three lymphoproliferative disorders and healthy cells. The system provided the correct classification in more than 83% of the cases studied. System performance was evaluated using rigorous statistical assessment and by comparison with human observers.