Global error minimization in image mosaicing using graph connectivity and its applications in microscopy

Several applications such as multiprojector displays and microscopy require the mosaicing of images (tiles) acquired by a camera as it traverses an unknown trajectory in 3D space. A homography relates the image coordinates of a point in each tile to those of a reference tile provided the 3D scene is planar. Our approach in such applications is to first perform pairwise alignment of the tiles that have imaged common regions in order to recover a homography relating the tile pair. We then find the global set of homographies relating each individual tile to a reference tile such that the homographies relating all tile pairs are kept as consistent as possible. Using these global homographies, one can generate a mosaic of the entire scene. We derive a general analytical solution for the global homographies by representing the pair-wise homographies on a connectivity graph. Our solution can accommodate imprecise prior information regarding the global homographies whenever such information is available. We also derive equations for the special case of translation estimation of an X-Y microscopy stage used in histology imaging and present examples of stitched microscopy slices of specimens obtained after radical prostatectomy or prostate biopsy. In addition, we demonstrate the superiority of our approach over tree-structured approaches for global error minimization.

Review of Neurosurgical Fluorescence Imaging Methodologies

Fluorescence imaging in neurosurgery has a long historical development, with several different biomarkers and biochemical agents being used, and several technological approaches. This review focuses on the different contrast agents, summarizing endogenous fluorescence, exogenously stimulated fluorescence and exogenous contrast agents, and then on tools used for imaging. It ends with a summary of key clinical trials that lead to consensus studies. The practical utility of protoporphyrin IX (PpIX) as stimulated by administration of δ-aminolevulinic acid (ALA) has had substantial pilot clinical studies and basic science research completed. Recently multi-center clinical trials using PpIx fluorescence to guide resection have shown efficacy for improved short term survival. Exogenous agents are being developed and tested pre-clinically, and hopefully hold the potential for long term survival benefit if they provide additional capabilities for resection of micro-invasive disease or certain tumor sub-types that do not produce PpIX or help delineate low grade tumors. The range of technologies used for measurement and imaging ranges widely, with most clinical trials being carried out with either point probes or modified surgical microscopes. At this point in time, optimized probe approaches are showing efficacy in clinical trials, and fully commercialized imaging systems are emerging, which will clearly help lead to adoption into neurosurgical practice.

Review of Neurosurgical Fluorescence Imaging Methodologies

Fluorescence imaging in neurosurgery has a long historical development, with several different biomarkers and biochemical agents being used, and several technological approaches. This review focuses on the different contrast agents, summarizing endogenous fluorescence, exogenously stimulated fluorescence and exogenous contrast agents, and then on tools used for imaging. It ends with a summary of key clinical trials that lead to consensus studies. The practical utility of protoporphyrin IX (PpIX) as stimulated by administration of δ-aminolevulinic acid (ALA) has had substantial pilot clinical studies and basic science research completed. Recently multi-center clinical trials using PpIx fluorescence to guide resection have shown efficacy for improved short term survival. Exogenous agents are being developed and tested pre-clinically, and hopefully hold the potential for long term survival benefit if they provide additional capabilities for resection of micro-invasive disease or certain tumor sub-types that do not produce PpIX or help delineate low grade tumors. The range of technologies used for measurement and imaging ranges widely, with most clinical trials being carried out with either point probes or modified surgical microscopes. At this point in time, optimized probe approaches are showing efficacy in clinical trials, and fully commercialized imaging systems are emerging, which will clearly help lead to adoption into neurosurgical practice.

COMPUTER-AIDED GLEASON GRADING OF PROSTATE CANCER HISTOPATHOLOGICAL IMAGES USING TEXTON FORESTS

The Gleason score is the single most important prognostic indicator for prostate cancer candidates and plays a significant role in treatment planning. Histopathological imaging of prostate tissue samples provides the gold standard for obtaining the Gleason score, but the manual assignment of Gleason grades is a labor-intensive and error-prone process. We have developed a texture classification system for automatic and reproducible Gleason grading. Our system characterizes the texture in images belonging to a tumor grade by clustering extracted filter responses at each pixel into textons (basic texture elements). We have used random forests to cluster the filter responses into textons followed by the spatial pyramid match kernel in conjunction with an SVM classifier. We have demonstrated the efficacy of our system in distinguishing between Gleason grades 3 and 4.

Image-guided near-infrared fluorescent sentinel lymph node mapping in human breast cancer

e11591

Background: Breast cancer surgery is presently performed without real-time image-guidance. We have developed a novel optical imaging system for image-guided surgery that uses invisible near-infrared (NIR) fluorescent light to highlight structures on the surgical field with high sensitivity, specificity, and contrast. We have also performed the first human clinical trial of the imaging system in women undergoing SLN mapping for breast cancer. Methods: We used a portable imaging system with an articulating arm that has 6 degrees of freedom, high power LED light source, custom optics, custom software, and sterile drape. The imaging system provided simultaneous and real-time imaging of color video and NIR fluorescence at up to 15 frames per second. N = 6 women with biopsy- confirmed breast cancer undergoing SLN mapping gave informed consent. All subjects received conventional mapping with Tc-99m sulfur colloid using a handheld gamma probe as well as NIR fluorescence-guided SLN mapping using a mixture of indocyanine green (ICG) diluted to a final concentration of 10 μM in human serum albumin (ICG:HSA). Results: The imaging system was easy to position in the operating room, with the articulating arm providing 50” horizontal reach and 70” vertical reach. Working distance to the patient was 18”. NIR fluorescence excitation was 20 mW/cm2 at 760 nm. NIR-depleted white light was 40,000 lux. A total of 1.6 ml of ICG:HSA was injected intra-tumorally and peri-tumorally and the site massaged for 5 min. 8 of 9 SLNs identified by Tc- 99m sulfur colloid were also identified by NIR fluorescence. However, NIR fluorescence identified an SLN, confirmed to have cancer in it, that was not identified by Tc-99m sulfur colloid. These differences were consistent with asynchrony in the injection techniques. Unlike the gamma-ray probe, NIR fluorescence provided high-resolution, large area optical imaging of the surgical field, and helped guide surgical resection. Conclusions: In this 6-patient pilot study, a novel NIR fluorescence optical imaging system was used for the first time, and provided real-time image-guided surgery for SLN mapping of breast cancer.

No significant financial relationships to disclose.