1
|
Zhang Y, Kang L, Wong IHM, Dai W, Li X, Chan RCK, Hsin MKY, Wong TTW. High-Throughput, Label-Free and Slide-Free Histological Imaging by Computational Microscopy and Unsupervised Learning. ADVANCED SCIENCE (WEINHEIM, BADEN-WURTTEMBERG, GERMANY) 2022; 9:e2102358. [PMID: 34747142 PMCID: PMC8805566 DOI: 10.1002/advs.202102358] [Citation(s) in RCA: 9] [Impact Index Per Article: 4.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 06/04/2021] [Revised: 10/03/2021] [Indexed: 06/13/2023]
Abstract
Rapid and high-resolution histological imaging with minimal tissue preparation has long been a challenging and yet captivating medical pursuit. Here, the authors propose a promising and transformative histological imaging method, termed computational high-throughput autofluorescence microscopy by pattern illumination (CHAMP). With the assistance of computational microscopy, CHAMP enables high-throughput and label-free imaging of thick and unprocessed tissues with large surface irregularity at an acquisition speed of 10 mm2 /10 s with 1.1-µm lateral resolution. Moreover, the CHAMP image can be transformed into a virtually stained histological image (Deep-CHAMP) through unsupervised learning within 15 s, where significant cellular features are quantitatively extracted with high accuracy. The versatility of CHAMP is experimentally demonstrated using mouse brain/kidney and human lung tissues prepared with various clinical protocols, which enables a rapid and accurate intraoperative/postoperative pathological examination without tissue processing or staining, demonstrating its great potential as an assistive imaging platform for surgeons and pathologists to provide optimal adjuvant treatment.
Collapse
Affiliation(s)
- Yan Zhang
- Translational and Advanced Bioimaging Laboratory, Department of Chemical and Biological Engineering, The Hong Kong University of Science and Technology, Kowloon, Hong Kong, China
| | - Lei Kang
- Translational and Advanced Bioimaging Laboratory, Department of Chemical and Biological Engineering, The Hong Kong University of Science and Technology, Kowloon, Hong Kong, China
| | - Ivy H M Wong
- Translational and Advanced Bioimaging Laboratory, Department of Chemical and Biological Engineering, The Hong Kong University of Science and Technology, Kowloon, Hong Kong, China
| | - Weixing Dai
- Translational and Advanced Bioimaging Laboratory, Department of Chemical and Biological Engineering, The Hong Kong University of Science and Technology, Kowloon, Hong Kong, China
| | - Xiufeng Li
- Translational and Advanced Bioimaging Laboratory, Department of Chemical and Biological Engineering, The Hong Kong University of Science and Technology, Kowloon, Hong Kong, China
| | - Ronald C K Chan
- Department of Anatomical and Cellular Pathology, The Chinese University of Hong Kong, Shatin, Hong Kong, China
| | - Michael K Y Hsin
- Department of Cardiothoracic Surgery, Queen Mary Hospital, Kowloon, Hong Kong, China
| | - Terence T W Wong
- Translational and Advanced Bioimaging Laboratory, Department of Chemical and Biological Engineering, The Hong Kong University of Science and Technology, Kowloon, Hong Kong, China
| |
Collapse
|
2
|
Hinsdale TA, Malik BH, Cheng S, Benavides OR, Giger ML, Wright JM, Patel PB, Jo JA, Maitland KC. Enhanced detection of oral dysplasia by structured illumination fluorescence lifetime imaging microscopy. Sci Rep 2021; 11:4984. [PMID: 33654229 PMCID: PMC7925521 DOI: 10.1038/s41598-021-84552-8] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/18/2020] [Accepted: 02/17/2021] [Indexed: 12/15/2022] Open
Abstract
We demonstrate that structured illumination microscopy has the potential to enhance fluorescence lifetime imaging microscopy (FLIM) as an early detection method for oral squamous cell carcinoma. FLIM can be used to monitor or detect changes in the fluorescence lifetime of metabolic cofactors (e.g. NADH and FAD) associated with the onset of carcinogenesis. However, out of focus fluorescence often interferes with this lifetime measurement. Structured illumination fluorescence lifetime imaging (SI-FLIM) addresses this by providing depth-resolved lifetime measurements, and applied to oral mucosa, can localize the collected signal to the epithelium. In this study, the hamster model of oral carcinogenesis was used to evaluate SI-FLIM in premalignant and malignant oral mucosa. Cheek pouches were imaged in vivo and correlated to histopathological diagnoses. The potential of NADH fluorescence signal and lifetime, as measured by widefield FLIM and SI-FLIM, to differentiate dysplasia (pre-malignancy) from normal tissue was evaluated. ROC analysis was carried out with the task of discriminating between normal tissue and mild dysplasia, when changes in fluorescence characteristics are localized to the epithelium only. The results demonstrate that SI-FLIM (AUC = 0.83) is a significantly better (p-value = 0.031) marker for mild dysplasia when compared to widefield FLIM (AUC = 0.63).
Collapse
Affiliation(s)
- Taylor A Hinsdale
- Department of Biomedical Engineering, Texas A&M University, College Station, USA
- Delft University of Technology, Delft, The Netherlands
| | - Bilal H Malik
- Department of Biomedical Engineering, Texas A&M University, College Station, USA
- QT Imaging, Inc, 3 Hamilton Landing, Suite 160, Novato, CA, 94949, USA
| | - Shuna Cheng
- Department of Biomedical Engineering, Texas A&M University, College Station, USA
| | - Oscar R Benavides
- Department of Biomedical Engineering, Texas A&M University, College Station, USA
| | | | - John M Wright
- Department of Diagnostic Science, Texas A&M College of Dentistry, Dallas, USA
| | - Paras B Patel
- Department of Diagnostic Science, Texas A&M College of Dentistry, Dallas, USA
| | - Javier A Jo
- Department of Biomedical Engineering, Texas A&M University, College Station, USA
- Department of Electrical and Computer Engineering, University of Oklahoma, Norman, USA
| | - Kristen C Maitland
- Department of Biomedical Engineering, Texas A&M University, College Station, USA.
| |
Collapse
|
3
|
New 1,3-Disubstituted Benzo[ h]Isoquinoline Cyclen-Based Ligand Platform: Synthesis, Eu 3+ Multiphoton Sensitization and Imaging Applications. Molecules 2020; 26:molecules26010058. [PMID: 33374449 PMCID: PMC7795479 DOI: 10.3390/molecules26010058] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/28/2020] [Revised: 12/15/2020] [Accepted: 12/17/2020] [Indexed: 11/17/2022] Open
Abstract
The development of lanthanide-based luminescent probes with a long emission lifetime has the potential to revolutionize imaging-based diagnostic techniques. By a rational design strategy taking advantage of computational predictions, a novel, water-soluble Eu3+ complex from a cyclen-based ligand bearing 1,3-disubstituted benzo[h]isoquinoline arms was realized. The ligand has been obtained overcoming the lack of reactivity of position 3 of the isoquinoline moiety. Notably, steric hindrance of the heteroaromatic chromophore allowed selective and stoichiometry-controlled insertion of two or three antennas on the cyclen platform without any protection strategy. The complex bears a fourth heptanoic arm for easy conjugation to biomolecules. This new chromophore allowed the sensitization of the metal center either with one or two photons excitation. The suitability as a luminescent bioprobe was validated by imaging BMI1 oncomarker in lung carcinoma cells following an established immunofluorescence approach. The use of a conventional epifluorescence microscope equipped with a linear structured illumination module disclosed a simple and inexpensive way to image confocally Ln-bioprobes by single photon excitation in the 350–400 nm window, where ordinary confocal systems have no excitation sources.
Collapse
|
4
|
Reflection-mode virtual histology using photoacoustic remote sensing microscopy. Sci Rep 2020; 10:19121. [PMID: 33154496 PMCID: PMC7644651 DOI: 10.1038/s41598-020-76155-6] [Citation(s) in RCA: 22] [Impact Index Per Article: 5.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/05/2020] [Accepted: 10/23/2020] [Indexed: 12/30/2022] Open
Abstract
Histological visualizations are critical to clinical disease management and are fundamental to biological understanding. However, current approaches that rely on bright-field microscopy require extensive tissue preparation prior to imaging. These processes are both labor intensive and contribute to creating significant delays in clinical feedback for treatment decisions that can extend to 2–3 weeks for standard paraffin-embedded tissue preparation and interpretation, especially if ancillary testing is needed. Here, we present the first comprehensive study on the broad application of a novel label-free reflection-mode imaging modality known as photoacoustic remote sensing (PARS) for visualizing salient subcellular structures from various common histopathological tissue preparations and for use in unprocessed freshly resected tissues. The PARS modality permits non-contact visualizations of intrinsic endogenous optical absorption contrast to be extracted from thick and opaque biological targets with optical resolution. The technique was examined both as a rapid assessment tool that is capable of managing large samples (> 1 cm2) in under 10 min, and as a high contrast imaging modality capable of extracting specific biological contrast to simulate conventional histological stains such as hematoxylin and eosin (H&E). The capabilities of the proposed method are demonstrated in a variety of human tissue preparations including formalin-fixed paraffin-embedded tissue blocks and unstained slides sectioned from these blocks, including normal and neoplastic human brain, and breast epithelium involved with breast cancer. Similarly, PARS images of human skin prepared by frozen section clearly demonstrated basal cell carcinoma and normal human skin tissue. Finally, we imaged unprocessed murine kidney and achieved histologically relevant subcellular morphology in fresh tissue. This represents a vital step towards an effective real-time clinical microscope that overcomes the limitations of standard histopathologic tissue preparations and enables real-time pathology assessment.
Collapse
|
5
|
Johnson KA, Hagen GM. Artifact-free whole-slide imaging with structured illumination microscopy and Bayesian image reconstruction. Gigascience 2020; 9:giaa035. [PMID: 32285910 PMCID: PMC7155289 DOI: 10.1093/gigascience/giaa035] [Citation(s) in RCA: 10] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/27/2019] [Revised: 12/06/2019] [Accepted: 03/24/2020] [Indexed: 01/19/2023] Open
Abstract
BACKGROUND Structured illumination microscopy (SIM) is a method that can be used to image biological samples and can achieve both optical sectioning and super-resolution effects. Optimization of the imaging set-up and data-processing methods results in high-quality images without artifacts due to mosaicking or due to the use of SIM methods. Reconstruction methods based on Bayesian estimation can be used to produce images with a resolution beyond that dictated by the optical system. FINDINGS Five complete datasets are presented including large panoramic SIM images of human tissues in pathophysiological conditions. Cancers of the prostate, skin, ovary, and breast, as well as tuberculosis of the lung, were imaged using SIM. The samples are available commercially and are standard histological preparations stained with hematoxylin-eosin. CONCLUSION The use of fluorescence microscopy is increasing in histopathology. There is a need for methods that reduce artifacts caused by the use of image-stitching methods or optical sectioning methods such as SIM. Stitched SIM images produce results that may be useful for intraoperative histology. Releasing high-quality, full-slide images and related data will aid researchers in furthering the field of fluorescent histopathology.
Collapse
Affiliation(s)
- Karl A Johnson
- UCCS BioFrontiers Center, University of Colorado at Colorado Springs, 1420 Austin Bluffs Parkway, Colorado Springs, CO 80918, USA
| | - Guy M Hagen
- UCCS BioFrontiers Center, University of Colorado at Colorado Springs, 1420 Austin Bluffs Parkway, Colorado Springs, CO 80918, USA
| |
Collapse
|
6
|
van der Graaff L, van Leenders GJLH, Boyaval F, Stallinga S. Multi-line fluorescence scanning microscope for multi-focal imaging with unlimited field of view. BIOMEDICAL OPTICS EXPRESS 2019; 10:6313-6339. [PMID: 31853402 PMCID: PMC6913394 DOI: 10.1364/boe.10.006313] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/30/2019] [Revised: 11/07/2019] [Accepted: 11/09/2019] [Indexed: 05/12/2023]
Abstract
Confocal scanning microscopy is the de facto standard modality for fluorescence imaging. Point scanning, however, leads to a limited throughput and makes the technique unsuitable for fast multi-focal scanning over large areas. We propose an architecture for multi-focal fluorescence imaging that is scalable to large area imaging. The design is based on the concept of line scanning with continuous 'push broom' scanning. Instead of a line sensor, we use an area sensor that is tilted with respect to the optical axis to acquire image data from multiple depths inside the sample simultaneously. A multi-line illumination where the lines span a plane conjugate to the tilted sensor is created by means of a diffractive optics design, implemented on a spatial light modulator. In particular, we describe a design that uses higher order astigmatism to generate focal lines of substantially constant peak intensity along the lines. The proposed method is suitable for fast 3D image acquisition with unlimited field of view, it requires no moving components except for the sample scanning stage, and provides intrinsic alignment of the simultaneously scanned focal slices. As proof of concept, we have scanned 9 focal slices simultaneously over an area of 36 mm2 at 0.29 µm pixel size in object space. The projected ultimate throughput that can be realized with the proposed architecture is in excess of 100 Mpixel/s.
Collapse
Affiliation(s)
- Leon van der Graaff
- Department of Imaging Physics, Delft University of Technology, The Netherlands
| | | | - Fanny Boyaval
- Department of Pathology, Leiden University Medical Center, The Netherlands
| | - Sjoerd Stallinga
- Department of Imaging Physics, Delft University of Technology, The Netherlands
| |
Collapse
|
7
|
All-optical Reflection-mode Microscopic Histology of Unstained Human Tissues. Sci Rep 2019; 9:13392. [PMID: 31527734 PMCID: PMC6746717 DOI: 10.1038/s41598-019-49849-9] [Citation(s) in RCA: 24] [Impact Index Per Article: 4.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/06/2019] [Accepted: 09/02/2019] [Indexed: 01/28/2023] Open
Abstract
Surgical oncologists depend heavily on visual field acuity during cancer resection surgeries for in-situ margin assessment. Clinicians must wait up to two weeks for results from a pathology lab to confirm a post-operative diagnosis, potentially resulting in subsequent treatments. Currently, there are no clinical tools that can visualize diagnostically pertinent tissue information in-situ. Here, we present the first microscopy capable of non-contact label-free visualization of human cellular morphology in a reflection-mode apparatus. This is possible with the recently reported imaging modality called photoacoustic remote sensing microscopy which enables non-contact detection of optical absorption contrast. By taking advantage of the 266-nanometer optical absorption peak of DNA, photoacoustic remote sensing is efficacious in recovering qualitatively similar nuclear information in comparison to that provided by the hematoxylin stain in the gold-standard hematoxylin and eosin (H&E) prepared samples. A photoacoustic remote sensing system was employed utilizing a 266-nanometer pulsed excitation beam to induce photoacoustic pressures within the sample resulting in refractive index modulation of the optical absorber. A 1310-nanometer continuous-wave interrogation beam detects these perturbed regions as back reflected intensity variations due to the changes in the local optical properties. Using this technique, clinically useful histologic images of human tissue samples including breast cancer (invasive ductal carcinoma), tonsil, gastrointestinal, and pancreatic tissue images were formed. These were qualitatively comparable to standard H&E prepared samples.
Collapse
|
8
|
Cahill LC, Giacomelli MG, Yoshitake T, Vardeh H, Faulkner-Jones BE, Connolly JL, Sun CK, Fujimoto JG. Rapid virtual hematoxylin and eosin histology of breast tissue specimens using a compact fluorescence nonlinear microscope. J Transl Med 2018; 98:150-160. [PMID: 29131161 PMCID: PMC5752596 DOI: 10.1038/labinvest.2017.116] [Citation(s) in RCA: 43] [Impact Index Per Article: 7.2] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/04/2017] [Revised: 09/07/2017] [Accepted: 09/08/2017] [Indexed: 12/25/2022] Open
Abstract
Up to 40% of patients undergoing breast conserving surgery for breast cancer require repeat surgeries due to close to or positive margins. The lengthy processing required for evaluating surgical margins by standard paraffin-embedded histology precludes its use during surgery and therefore, technologies for rapid evaluation of surgical pathology could improve the treatment of breast cancer by reducing the number of surgeries required. We demonstrate real-time histological evaluation of breast cancer surgical specimens by staining specimens with acridine orange (AO) and sulforhodamine 101 (SR101) analogously to hematoxylin and eosin (H&E) and then imaging the specimens with fluorescence nonlinear microscopy (NLM) using a compact femtosecond fiber laser. A video-rate computational light absorption model was used to produce realistic virtual H&E images of tissue in real time and in three dimensions. NLM imaging could be performed to depths of 100 μm below the tissue surface, which is important since many surgical specimens require subsurface evaluation due to contamination artifacts on the tissue surface from electrocautery, surgical ink, or debris from specimen handling. We validate this method by expert review of NLM images compared to formalin-fixed, paraffin-embedded (FFPE) H&E histology. Diagnostically important features such as normal terminal ductal lobular units, fibrous and adipose stromal parenchyma, inflammation, invasive carcinoma, and in situ lobular and ductal carcinoma were present in NLM images associated with pathologies identified on standard FFPE H&E histology. We demonstrate that AO and SR101 were extracted to undetectable levels after FFPE processing and fluorescence in situ hybridization (FISH) HER2 amplification status was unaffected by the NLM imaging protocol. This method potentially enables cost-effective, real-time histological guidance of surgical resections.
Collapse
MESH Headings
- Acridine Orange/chemistry
- Breast/cytology
- Breast/immunology
- Breast/pathology
- Breast/surgery
- Breast Carcinoma In Situ/diagnosis
- Breast Carcinoma In Situ/immunology
- Breast Carcinoma In Situ/pathology
- Breast Carcinoma In Situ/surgery
- Breast Neoplasms/diagnosis
- Breast Neoplasms/immunology
- Breast Neoplasms/pathology
- Breast Neoplasms/surgery
- Carcinoma, Ductal, Breast/diagnosis
- Carcinoma, Ductal, Breast/immunology
- Carcinoma, Ductal, Breast/pathology
- Carcinoma, Ductal, Breast/surgery
- Carcinoma, Lobular/diagnosis
- Carcinoma, Lobular/immunology
- Carcinoma, Lobular/pathology
- Carcinoma, Lobular/surgery
- Coloring Agents/chemistry
- Female
- Fluorescent Dyes/chemistry
- Humans
- Imaging, Three-Dimensional
- Intraoperative Period
- Margins of Excision
- Mastectomy
- Mastectomy, Segmental
- Microscopy, Fluorescence
- Neoplasm Invasiveness
- Nonlinear Optical Microscopy
- Organ Sparing Treatments
- Rhodamines/chemistry
Collapse
Affiliation(s)
- Lucas C. Cahill
- Department of Electrical Engineering and Computer Science and Research Laboratory of Electronics, Massachusetts Institute of Technology, Cambridge, MA, USA
- Harvard-MIT Division of Health Sciences and Technology, Cambridge, MA, USA
| | - Michael G. Giacomelli
- Department of Electrical Engineering and Computer Science and Research Laboratory of Electronics, Massachusetts Institute of Technology, Cambridge, MA, USA
| | - Tadayuki Yoshitake
- Department of Electrical Engineering and Computer Science and Research Laboratory of Electronics, Massachusetts Institute of Technology, Cambridge, MA, USA
| | - Hilde Vardeh
- Department of Pathology, Beth Israel Deaconess Medical Center, Harvard Medical School, Boston, MA, USA
| | - Beverly E. Faulkner-Jones
- Department of Pathology, Beth Israel Deaconess Medical Center, Harvard Medical School, Boston, MA, USA
| | - James L. Connolly
- Department of Pathology, Beth Israel Deaconess Medical Center, Harvard Medical School, Boston, MA, USA
| | - Chi-Kuang Sun
- Department of Electrical Engineering and Graduate Institute of Photonics and Optoelectronics, National Taiwan University, Taipei, 10617 Taiwan
| | - James G. Fujimoto
- Department of Electrical Engineering and Computer Science and Research Laboratory of Electronics, Massachusetts Institute of Technology, Cambridge, MA, USA
| |
Collapse
|
9
|
Hu B, Bolus D, Brown JQ. Improved contrast in inverted selective plane illumination microscopy of thick tissues using confocal detection and structured illumination. BIOMEDICAL OPTICS EXPRESS 2017; 8:5546-5559. [PMID: 29296487 PMCID: PMC5745102 DOI: 10.1364/boe.8.005546] [Citation(s) in RCA: 6] [Impact Index Per Article: 0.9] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/28/2017] [Revised: 10/26/2017] [Accepted: 11/09/2017] [Indexed: 05/08/2023]
Abstract
Inverted selective plane illumination microscopy (iSPIM) enables fast, large field-of-view, long term imaging with compatibility with conventional sample mounting. However, the imaging quality can be deteriorated in thick tissues due to sample scattering. Three strategies have been adopted in this paper to optimize the imaging performance of iSPIM on thick tissue imaging: electronic confocal slit detection (eCSD), structured illumination (SI) and the two combined. We compared the image contrast when using SPIM, confocal SPIM (using eCSD alone), SI SPIM (using SI alone) or confocal-SI SPIM (combining both methods) on images of gelatin phantom and highly-scattering fluorescently-stained human tissue. We demonstrate that all the three methods showed remarkable contrast enhancement on both samples compared to iSPIM alone, and SI SPIM and the combined confocal-SI mode outperformed confocal SPIM in contrast enhancement. Moreover, the use of SI at high pattern frequencies outperformed confocal SPIM in terms of optical sectioning capability. However, image signal-to-noise ratio (SNR) was decreased at high pattern frequencies when imaging scattering samples with SI SPIM. By combining eCSD with SI to reduce background signal and noise, the superior optical sectioning performance of SI could be achieved while also maintaining high image SNR.
Collapse
|
10
|
Zhu C, Martinez AF, Martin HL, Li M, Crouch BT, Carlson DA, Haystead TAJ, Ramanujam N. Near-simultaneous intravital microscopy of glucose uptake and mitochondrial membrane potential, key endpoints that reflect major metabolic axes in cancer. Sci Rep 2017; 7:13772. [PMID: 29062013 PMCID: PMC5653871 DOI: 10.1038/s41598-017-14226-x] [Citation(s) in RCA: 21] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/18/2017] [Accepted: 10/06/2017] [Indexed: 12/19/2022] Open
Abstract
While the demand for metabolic imaging has increased in recent years, simultaneous in vivo measurement of multiple metabolic endpoints remains challenging. Here we report on a novel technique that provides in vivo high-resolution simultaneous imaging of glucose uptake and mitochondrial metabolism within a dynamic tissue microenvironment. Two indicators were leveraged; 2-[N-(7-nitrobenz-2-oxa-1, 3-diazol-4-yl) amino]-2-deoxy-D-glucose (2-NBDG) reports on glucose uptake and Tetramethylrhodamine ethyl ester (TMRE) reports on mitochondrial membrane potential. Although we demonstrated that there was neither optical nor chemical crosstalk between 2-NBDG and TMRE, TMRE uptake was significantly inhibited by simultaneous injection with 2-NBDG in vivo. A staggered delivery scheme of the two agents (TMRE injection was followed by 2-NBDG injection after a 10-minute delay) permitted near-simultaneous in vivo microscopy of 2-NBDG and TMRE at the same tissue site by mitigating the interference of 2-NBDG with normal glucose usage. The staggered delivery strategy was evaluated under both normoxic and hypoxic conditions in normal tissues as well as in a murine breast cancer model. The results were consistent with those expected for independent imaging of 2-NBDG and TMRE. This optical imaging technique allows for monitoring of key metabolic endpoints with the unique benefit of repeated, non-destructive imaging within an intact microenvironment.
Collapse
Affiliation(s)
- Caigang Zhu
- Department of Biomedical Engineering, Duke University, Durham, NC, 27708, USA
| | - Amy F Martinez
- Department of Biomedical Engineering, Duke University, Durham, NC, 27708, USA
| | - Hannah L Martin
- Department of Biomedical Engineering, Duke University, Durham, NC, 27708, USA
| | - Martin Li
- Department of Biomedical Engineering, Duke University, Durham, NC, 27708, USA
| | - Brian T Crouch
- Department of Biomedical Engineering, Duke University, Durham, NC, 27708, USA
| | - David A Carlson
- Department of Pharmacology and Cancer Biology, Duke University, Durham, NC, 27710, USA
| | - Timothy A J Haystead
- Department of Pharmacology and Cancer Biology, Duke University, Durham, NC, 27710, USA
| | - Nimmi Ramanujam
- Department of Biomedical Engineering, Duke University, Durham, NC, 27708, USA.
| |
Collapse
|
11
|
Xu X, Wang Y, Xiang J, Liu JTC, Tichauer KM. Rinsing paired-agent model (RPAM) to quantify cell-surface receptor concentrations in topical staining applications of thick tissues. Phys Med Biol 2017; 62:5098-5113. [PMID: 28548970 DOI: 10.1088/1361-6560/aa6cf1] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.1] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/19/2022]
Abstract
Conventional molecular assessment of tissue through histology, if adapted to fresh thicker samples, has the potential to enhance cancer detection in surgical margins and monitoring of 3D cell culture molecular environments. However, in thicker samples, substantial background staining is common despite repeated rinsing, which can significantly reduce image contrast. Recently, 'paired-agent' methods-which employ co-administration of a control (untargeted) imaging agent-have been applied to thick-sample staining applications to account for background staining. To date, these methods have included (1) a simple ratiometric method that is relatively insensitive to noise in the data but has accuracy that is dependent on the staining protocol and the characteristics of the sample; and (2) a complex paired-agent kinetic modeling method that is more accurate but is more noise-sensitive and requires a precise serial rinsing protocol. Here, a new simplified mathematical model-the rinsing paired-agent model (RPAM)-is derived and tested that offers a good balance between the previous models, is adaptable to arbitrary rinsing-imaging protocols, and does not require calibration of the imaging system. RPAM is evaluated against previous models and is validated by comparison to estimated concentrations of targeted biomarkers on the surface of 3D cell culture and tumor xenograft models. This work supports the use of RPAM as a preferable model to quantitatively analyze targeted biomarker concentrations in topically stained thick tissues, as it was found to match the accuracy of the complex paired-agent kinetic model while retaining the low noise-sensitivity characteristics of the ratiometric method.
Collapse
Affiliation(s)
- Xiaochun Xu
- Department of Biomedical Engineering, Illinois Institute of Technology, Chicago, IL 60616, United States of America
| | | | | | | | | |
Collapse
|
12
|
Teodori L, Crupi A, Costa A, Diaspro A, Melzer S, Tarnok A. Three-dimensional imaging technologies: a priority for the advancement of tissue engineering and a challenge for the imaging community. JOURNAL OF BIOPHOTONICS 2017; 10:24-45. [PMID: 27110674 DOI: 10.1002/jbio.201600049] [Citation(s) in RCA: 32] [Impact Index Per Article: 4.6] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 02/17/2016] [Revised: 04/04/2016] [Accepted: 04/05/2016] [Indexed: 06/05/2023]
Abstract
Tissue engineering/regenerative medicine (TERM) is an interdisciplinary field that applies the principle of engineering and life sciences to restore/replace damaged tissues/organs with in vitro artificially-created ones. Research on TERM quickly moves forward. Today newest technologies and discoveries, such as 3D-/bio-printing, allow in vitro fabrication of ex-novo made tissues/organs, opening the door to wide and probably never-ending application possibilities, from organ transplant to drug discovery, high content screening and replacement of laboratory animals. Imaging techniques are fundamental tools for the characterization of tissue engineering (TE) products at any stage, from biomaterial/scaffold to construct/organ analysis. Indeed, tissue engineers need versatile imaging methods capable of monitoring not only morphological but also functional and molecular features, allowing three-dimensional (3D) and time-lapse in vivo analysis, in a non-destructive, quantitative, multidimensional analysis of TE constructs, to analyze their pre-implantation quality assessment and their fate after implantation. This review focuses on the newest developments in imaging technologies and applications in the context of requirements of the different steps of the TERM field, describing strengths and weaknesses of the current imaging approaches.
Collapse
Affiliation(s)
- Laura Teodori
- Diagnostics and Metrology Laboratory FSN-TECFIS-DIM ENEA CR Frascati, Via Enrico Fermi 44, 00044, Rome, Italy
| | - Annunziata Crupi
- Diagnostics and Metrology Laboratory FSN-TECFIS-DIM ENEA CR Frascati, Via Enrico Fermi 44, 00044, Rome, Italy
- Fondazione San Raffaele, S.S. Ceglie San Michele km 1200, 72013, Ceglie Messapica, Italy
| | - Alessandra Costa
- University of Pittsburgh McGowan Institute, 3550 Terrace St 5606, Pittsburgh, PA 15261, USA
| | - Alberto Diaspro
- Department of Nanophysics, Istituto Italiano di Tecnologia, Genova, Italy
- Dipartimento di Fisica, Università degli Studi di Genova, Genova, Italy
- Nikon Imaging Center, Genova, Italy, www.nic.iit.it
| | - Susanne Melzer
- Sächsische Inkubator für klinische Translation (SIKT), University of Leipzig, Philipp-Rosenthal-Straße 55, 04103, Leipzig, Germany
- Department of Pediatric Cardiology, HELIOS Heart Center Leipzig, University of Leipzig, Strümpellstraße 39, 04289, Leipzig, Germany
| | - Attila Tarnok
- Sächsische Inkubator für klinische Translation (SIKT), University of Leipzig, Philipp-Rosenthal-Straße 55, 04103, Leipzig, Germany
- Department of Pediatric Cardiology, HELIOS Heart Center Leipzig, University of Leipzig, Strümpellstraße 39, 04289, Leipzig, Germany
| |
Collapse
|
13
|
Elfer KN, Sholl AB, Wang M, Tulman DB, Mandava SH, Lee BR, Brown JQ. DRAQ5 and Eosin ('D&E') as an Analog to Hematoxylin and Eosin for Rapid Fluorescence Histology of Fresh Tissues. PLoS One 2016; 11:e0165530. [PMID: 27788264 PMCID: PMC5082869 DOI: 10.1371/journal.pone.0165530] [Citation(s) in RCA: 45] [Impact Index Per Article: 5.6] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/27/2016] [Accepted: 10/13/2016] [Indexed: 01/17/2023] Open
Abstract
Real-time on-site histopathology review of biopsy tissues at the point-of-procedure has great potential for significant clinical value and improved patient care. For instance, on-site review can aid in rapid screening of diagnostic biopsies to reduce false-negative results, or in quantitative assessment of biospecimen quality to increase the efficacy of downstream laboratory and histopathology analysis. However, the only currently available rapid pathology method, frozen section analysis (FSA), is too time- and labor-intensive for use in screening large quantities of biopsy tissues and is too destructive for maximum tissue conservation in multiple small needle core biopsies. In this work we demonstrate the spectrally-compatible combination of the nuclear stain DRAQ5 and the anionic counterstain eosin as a dual-component fluorescent staining analog to hematoxylin and eosin intended for use on fresh, unsectioned tissues. Combined with optical sectioning fluorescence microscopy and pseudo-coloring algorithms, DRAQ5 and eosin (“D&E”) enables very fast, non-destructive psuedohistological imaging of tissues at the point-of-acquisition with minimal tissue handling and processing. D&E was validated against H&E on a one-to-one basis on formalin-fixed paraffin-embedded and frozen section tissues of various human organs using standard epi-fluorescence microscopy, demonstrating high fidelity of the staining mechanism as an H&E analog. The method was then applied to fresh, whole 18G renal needle core biopsies and large needle core prostate biospecimen biopsies using fluorescence structured illumination optical sectioning microscopy. We demonstrate the ability to obtain high-resolution histology-like images of unsectioned, fresh tissues similar to subsequent H&E staining of the tissue. The application of D&E does not interfere with subsequent standard-of-care H&E staining and imaging, preserving the integrity of the tissue for thorough downstream analysis. These results indicate that this dual-stain pseudocoloring method could provide a real-time histology-like image at the time of acquisition and valuable objective tissue analysis for the clinician at the time of service.
Collapse
Affiliation(s)
- Katherine N. Elfer
- Dept. of Biomedical Engineering, Tulane University, New Orleans, Louisiana, United States of America
| | - Andrew B. Sholl
- Dept. of Pathology and Laboratory Medicine, Tulane University School of Medicine, New Orleans, Louisiana, United States of America
| | - Mei Wang
- Dept. of Biomedical Engineering, Tulane University, New Orleans, Louisiana, United States of America
| | - David B. Tulman
- Dept. of Biomedical Engineering, Tulane University, New Orleans, Louisiana, United States of America
| | - Sree H. Mandava
- Dept. of Urology, Tulane University School of Medicine, New Orleans, Louisiana, United States of America
| | - Benjamin R. Lee
- Dept. of Urology, Tulane University School of Medicine, New Orleans, Louisiana, United States of America
| | - J. Quincy Brown
- Dept. of Biomedical Engineering, Tulane University, New Orleans, Louisiana, United States of America
- * E-mail:
| |
Collapse
|
14
|
Chitalia R, Mueller J, Fu HL, Whitley MJ, Kirsch DG, Brown JQ, Willett R, Ramanujam N. Algorithms for differentiating between images of heterogeneous tissue across fluorescence microscopes. BIOMEDICAL OPTICS EXPRESS 2016; 7:3412-3424. [PMID: 27699108 PMCID: PMC5030020 DOI: 10.1364/boe.7.003412] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/23/2016] [Revised: 07/25/2016] [Accepted: 08/04/2016] [Indexed: 06/06/2023]
Abstract
Fluorescence microscopy can be used to acquire real-time images of tissue morphology and with appropriate algorithms can rapidly quantify features associated with disease. The objective of this study was to assess the ability of various segmentation algorithms to isolate fluorescent positive features (FPFs) in heterogeneous images and identify an approach that can be used across multiple fluorescence microscopes with minimal tuning between systems. Specifically, we show a variety of image segmentation algorithms applied to images of stained tumor and muscle tissue acquired with 3 different fluorescence microscopes. Results indicate that a technique called maximally stable extremal regions followed by thresholding (MSER + Binary) yielded the greatest contrast in FPF density between tumor and muscle images across multiple microscopy systems.
Collapse
Affiliation(s)
- Rhea Chitalia
- Department of Biomedical Engineering, Duke University, Durham, North Carolina, USA;
| | - Jenna Mueller
- Department of Biomedical Engineering, Duke University, Durham, North Carolina, USA;
| | - Henry L Fu
- Department of Biomedical Engineering, Duke University, Durham, North Carolina, USA
| | - Melodi Javid Whitley
- Department of Pharmacology & Cancer Biology, Duke University School of Medicine, Durham, North Carolina, USA
| | - David G Kirsch
- Department of Pharmacology & Cancer Biology, Duke University School of Medicine, Durham, North Carolina, USA; Department of Radiation Oncology, Duke University School of Medicine, Durham, North Carolina, USA
| | - J Quincy Brown
- Department of Biomedical Engineering, Tulane University, New Orleans, Louisiana, USA
| | - Rebecca Willett
- Department of Electrical and Computer Engineering, University of Wisconsin-Madison, Madison, Wisconsin, USA
| | - Nimmi Ramanujam
- Department of Biomedical Engineering, Duke University, Durham, North Carolina, USA
| |
Collapse
|
15
|
Wang M, Tulman DB, Sholl AB, Kimbrell HZ, Mandava SH, Elfer KN, Luethy S, Maddox MM, Lai W, Lee BR, Brown JQ. Gigapixel surface imaging of radical prostatectomy specimens for comprehensive detection of cancer-positive surgical margins using structured illumination microscopy. Sci Rep 2016; 6:27419. [PMID: 27257084 PMCID: PMC4891779 DOI: 10.1038/srep27419] [Citation(s) in RCA: 37] [Impact Index Per Article: 4.6] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/11/2016] [Accepted: 05/18/2016] [Indexed: 01/07/2023] Open
Abstract
Achieving cancer-free surgical margins in oncologic surgery is critical to reduce the need for additional adjuvant treatments and minimize tumor recurrence; however, there is a delicate balance between completeness of tumor removal and preservation of adjacent tissues critical for normal post-operative function. We sought to establish the feasibility of video-rate structured illumination microscopy (VR-SIM) of the intact removed tumor surface as a practical and non-destructive alternative to intra-operative frozen section pathology, using prostate cancer as an initial target. We present the first images of the intact human prostate surface obtained with pathologically-relevant contrast and subcellular detail, obtained in 24 radical prostatectomy specimens immediately after excision. We demonstrate that it is feasible to routinely image the full prostate circumference, generating gigapixel panorama images of the surface that are readily interpreted by pathologists. VR-SIM confirmed detection of positive surgical margins in 3 out of 4 prostates with pathology-confirmed adenocarcinoma at the circumferential surgical margin, and furthermore detected extensive residual cancer at the circumferential margin in a case post-operatively classified by histopathology as having negative surgical margins. Our results suggest that the increased surface coverage of VR-SIM could also provide added value for detection and characterization of positive surgical margins over traditional histopathology.
Collapse
Affiliation(s)
- Mei Wang
- Department of Biomedical Engineering, Tulane University, New Orleans, LA 70118, USA
| | - David B Tulman
- Bioinnovation Program, Tulane University, New Orleans, LA 70118, USA
| | - Andrew B Sholl
- Department of Pathology and Laboratory Medicine, Tulane University School of Medicine, New Orleans, LA 70112, USA
| | - Hillary Z Kimbrell
- Department of Pathology and Laboratory Medicine, Tulane University School of Medicine, New Orleans, LA 70112, USA
| | - Sree H Mandava
- Department of Urology, Tulane University School of Medicine, New Orleans, LA 70112, USA
| | - Katherine N Elfer
- Department of Biomedical Engineering, Tulane University, New Orleans, LA 70118, USA
| | - Samuel Luethy
- Department of Biomedical Engineering, Tulane University, New Orleans, LA 70118, USA
| | - Michael M Maddox
- Department of Urology, Tulane University School of Medicine, New Orleans, LA 70112, USA
| | - Weil Lai
- Department of Urology, Tulane University School of Medicine, New Orleans, LA 70112, USA
| | - Benjamin R Lee
- Department of Urology, Tulane University School of Medicine, New Orleans, LA 70112, USA
| | - J Quincy Brown
- Department of Biomedical Engineering, Tulane University, New Orleans, LA 70118, USA
| |
Collapse
|
16
|
Prieto SP, Lai KK, Laryea JA, Mizell JS, Muldoon TJ. Quantitative analysis of ex vivo colorectal epithelium using an automated feature extraction algorithm for microendoscopy image data. J Med Imaging (Bellingham) 2016; 3:024502. [PMID: 27335893 DOI: 10.1117/1.jmi.3.2.024502] [Citation(s) in RCA: 12] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/04/2015] [Accepted: 04/28/2016] [Indexed: 12/20/2022] Open
Abstract
Qualitative screening for colorectal polyps via fiber bundle microendoscopy imaging has shown promising results, with studies reporting high rates of sensitivity and specificity, as well as low interobserver variability with trained clinicians. A quantitative image quality control and image feature extraction algorithm (QFEA) was designed to lessen the burden of training and provide objective data for improved clinical efficacy of this method. After a quantitative image quality control step, QFEA extracts field-of-view area, crypt area, crypt circularity, and crypt number per image. To develop and validate this QFEA, a training set of microendoscopy images was collected from freshly resected porcine colon epithelium. The algorithm was then further validated on ex vivo image data collected from eight human subjects, selected from clinically normal appearing regions distant from grossly visible tumor in surgically resected colorectal tissue. QFEA has proven flexible in application to both mosaics and individual images, and its automated crypt detection sensitivity ranges from 71 to 94% despite intensity and contrast variation within the field of view. It also demonstrates the ability to detect and quantify differences in grossly normal regions among different subjects, suggesting the potential efficacy of this approach in detecting occult regions of dysplasia.
Collapse
Affiliation(s)
- Sandra P Prieto
- University of Arkansas , Department of Biomedical Engineering, 1 University Boulevard, Fayetteville, Arkansas 72701, United States
| | - Keith K Lai
- University of Arkansas for Medical Sciences , Department of Pathology, 4301 West Markham Street, Little Rock, Arkansas 72205, United States
| | - Jonathan A Laryea
- University of Arkansas for Medical Sciences , Department of Gastrointestinal Surgery, 4301 West Markham Street, Little Rock, Arkansas 72205, United States
| | - Jason S Mizell
- University of Arkansas for Medical Sciences , Department of Gastrointestinal Surgery, 4301 West Markham Street, Little Rock, Arkansas 72205, United States
| | - Timothy J Muldoon
- University of Arkansas , Department of Biomedical Engineering, 1 University Boulevard, Fayetteville, Arkansas 72701, United States
| |
Collapse
|
17
|
Fu HL, Mueller JL, Whitley MJ, Cardona DM, Willett RM, Kirsch DG, Brown JQ, Ramanujam N. Structured Illumination Microscopy and a Quantitative Image Analysis for the Detection of Positive Margins in a Pre-Clinical Genetically Engineered Mouse Model of Sarcoma. PLoS One 2016; 11:e0147006. [PMID: 26799613 PMCID: PMC4723137 DOI: 10.1371/journal.pone.0147006] [Citation(s) in RCA: 6] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/13/2015] [Accepted: 12/28/2015] [Indexed: 11/18/2022] Open
Abstract
Intraoperative assessment of surgical margins is critical to ensuring residual tumor does not remain in a patient. Previously, we developed a fluorescence structured illumination microscope (SIM) system with a single-shot field of view (FOV) of 2.1 × 1.6 mm (3.4 mm2) and sub-cellular resolution (4.4 μm). The goal of this study was to test the utility of this technology for the detection of residual disease in a genetically engineered mouse model of sarcoma. Primary soft tissue sarcomas were generated in the hindlimb and after the tumor was surgically removed, the relevant margin was stained with acridine orange (AO), a vital stain that brightly stains cell nuclei and fibrous tissues. The tissues were imaged with the SIM system with the primary goal of visualizing fluorescent features from tumor nuclei. Given the heterogeneity of the background tissue (presence of adipose tissue and muscle), an algorithm known as maximally stable extremal regions (MSER) was optimized and applied to the images to specifically segment nuclear features. A logistic regression model was used to classify a tissue site as positive or negative by calculating area fraction and shape of the segmented features that were present and the resulting receiver operator curve (ROC) was generated by varying the probability threshold. Based on the ROC curves, the model was able to classify tumor and normal tissue with 77% sensitivity and 81% specificity (Youden's index). For an unbiased measure of the model performance, it was applied to a separate validation dataset that resulted in 73% sensitivity and 80% specificity. When this approach was applied to representative whole margins, for a tumor probability threshold of 50%, only 1.2% of all regions from the negative margin exceeded this threshold, while over 14.8% of all regions from the positive margin exceeded this threshold.
Collapse
Affiliation(s)
- Henry L. Fu
- Department of Biomedical Engineering, Duke University, Durham, North Carolina, United States of America
| | - Jenna L. Mueller
- Department of Biomedical Engineering, Duke University, Durham, North Carolina, United States of America
| | - Melodi J. Whitley
- Department of Pharmacology & Cancer Biology, Duke University School of Medicine, Durham, North Carolina, United States of America
| | - Diana M. Cardona
- Department of Pathology, Duke University School of Medicine, Durham, North Carolina, United States of America
| | - Rebecca M. Willett
- Department of Electrical and Computer Engineering, University of Wisconsin—Madison, Madison, Wisconsin, United States of America
| | - David G. Kirsch
- Department of Pharmacology & Cancer Biology, Duke University School of Medicine, Durham, North Carolina, United States of America
- Department of Radiation Oncology, Duke University School of Medicine, Durham, North Carolina, United States of America
| | - J. Quincy Brown
- Department of Biomedical Engineering, Tulane University, New Orleans, Louisiana, United States of America
| | - Nimmi Ramanujam
- Department of Biomedical Engineering, Duke University, Durham, North Carolina, United States of America
| |
Collapse
|
18
|
Lazarides AL, Whitley MJ, Strasfeld DB, Cardona DM, Ferrer JM, Mueller JL, Fu HL, DeWitt SB, Brigman BE, Ramanujam N, Kirsch DG, Eward WC. A Fluorescence-Guided Laser Ablation System for Removal of Residual Cancer in a Mouse Model of Soft Tissue Sarcoma. Am J Cancer Res 2016; 6:155-66. [PMID: 26877775 PMCID: PMC4729765 DOI: 10.7150/thno.13536] [Citation(s) in RCA: 17] [Impact Index Per Article: 2.1] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/12/2015] [Accepted: 09/28/2015] [Indexed: 12/22/2022] Open
Abstract
The treatment of soft tissue sarcoma (STS) generally involves tumor excision with a wide margin. Although advances in fluorescence imaging make real-time detection of cancer possible, removal is limited by the precision of the human eye and hand. Here, we describe a novel pulsed Nd:YAG laser ablation system that, when used in conjunction with a previously described molecular imaging system, can identify and ablate cancer in vivo. Mice with primary STS were injected with the protease-activatable probe LUM015 to label tumors. Resected tissues from the mice were then imaged and treated with the laser using the paired fluorescence-imaging/ laser ablation device, generating ablation clefts with sub-millimeter precision and minimal underlying tissue damage. Laser ablation was guided by fluorescence to target tumor tissues, avoiding normal structures. The selective ablation of tumor implants in vivo improved recurrence-free survival after tumor resection in a cohort of 14 mice compared to 12 mice that received no ablative therapy. This prototype system has the potential to be modified so that it can be used during surgery to improve recurrence-free survival in patients with cancer.
Collapse
|
19
|
Whitley MJ, Weissleder R, Kirsch DG. Tailoring Adjuvant Radiation Therapy by Intraoperative Imaging to Detect Residual Cancer. Semin Radiat Oncol 2015; 25:313-21. [PMID: 26384279 PMCID: PMC4575408 DOI: 10.1016/j.semradonc.2015.05.005] [Citation(s) in RCA: 6] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/04/2023]
Abstract
For many solid cancers, radiation therapy is offered as an adjuvant to surgical resection to lower rates of local recurrence and improve survival. However, a subset of patients treated with surgery alone will not have a local recurrence. Currently, there is no way to accurately determine which patients have microscopic residual disease in the tumor bed after surgery and therefore are most likely to benefit from adjuvant radiation therapy. To address this problem, a number of technologies have been developed to try to improve margin assessment of resected tissue and to detect residual cancer in the tumor bed. Moreover, some of these approaches have been translated from the preclinical arena into clinical trials. Here, we review different types of intraoperative molecular imaging systems for cancer. Optical imaging techniques like epi-illumination, fluorescence molecular tomography and optoacoustic imaging can be coupled with exogenous fluorescent imaging probes that accumulate in tumors passively via the enhanced permeability and retention effect or are targeted to tumor tissues based on affinity or enzyme activity. In these approaches, detection of fluorescence in the tumor bed may indicate residual disease. Protease activated probes have generated great interest because of their potential for leading to high tumor to normal contrast. Recently, the first Phase I clinical trial to assess the safety and activation of a protease activated probe was conducted. Spectroscopic methods like radiofrequency spectroscopy and Raman spectroscopy, which are based on energy absorption and scattering, respectively, have also been tested in humans and are able to distinguish between normal and tumors tissues intraoperatively. Most recently, multimodal contrast agents have been developed that target tumors and contain both fluorescent dyes and magnetic resonance imaging contrast agents, allowing for preoperative planning and intraoperative margin assessment with a single contrast agent. Further clinical testing of these various intraoperative imaging approaches may lead to more accurate methods for margin assessment and the intraoperative detection of microscopic residual disease, which could guide further resection and the use of adjuvant radiation therapy.
Collapse
Affiliation(s)
- Melodi J Whitley
- Department of Pharmacology and Cancer Biology, Duke University Medical Center, Durham, NC
| | - Ralph Weissleder
- Center for Systems Biology, Massachusetts General Hospital, Boston, MA; Department of Systems Biology, Harvard Medical School, Boston, MA
| | - David G Kirsch
- Department of Pharmacology and Cancer Biology, Duke University Medical Center, Durham, NC; Department of Radiation Oncology, Duke University Medical Center, Durham, NC.
| |
Collapse
|
20
|
Wang M, Kimbrell HZ, Sholl AB, Tulman DB, Elfer KN, Schlichenmeyer TC, Lee BR, Lacey M, Brown JQ. High-Resolution Rapid Diagnostic Imaging of Whole Prostate Biopsies Using Video-Rate Fluorescence Structured Illumination Microscopy. Cancer Res 2015; 75:4032-41. [PMID: 26282168 DOI: 10.1158/0008-5472.can-14-3806] [Citation(s) in RCA: 49] [Impact Index Per Article: 5.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/02/2015] [Accepted: 07/24/2015] [Indexed: 11/16/2022]
Abstract
Rapid assessment of prostate core biopsy pathology at the point-of-procedure could provide benefit in a variety of clinical situations. Even with advanced transrectal ultrasound guidance and saturation biopsy protocols, prostate cancer can be missed in up to half of all initial biopsy procedures. In addition, collection of tumor specimens for downstream histologic, molecular, and genetic analysis is hindered by low tumor yield due to inability to identify prostate cancer grossly. However, current point-of-procedure pathology protocols, such as frozen section analysis (FSA), are destructive and too time- and labor-intensive to be practical or economical. Ex vivo microscopy of the excised specimens, stained with fast-acting fluorescent histology dyes, could be an attractive nondestructive alternative to FSA. In this work, we report the first demonstration of video-rate structured illumination microscopy (VR-SIM) for rapid high-resolution diagnostic imaging of prostate biopsies in realistic point-of-procedure timeframes. Large mosaic images of prostate biopsies stained with acridine orange are rendered in seconds and contain excellent contrast and detail, exhibiting close correlation with corresponding hematoxylin and eosin histology. A clinically relevant review of VR-SIM images of 34 unfixed and uncut prostate core biopsies by two independent pathologists resulted in an area under the receiver operative curve (AUC) of 0.82-0.88, with a sensitivity ranging from 63% to 88% and a specificity ranging from 78% to 89%. When biopsies contained more than 5% tumor content, the sensitivity improved to 75% to 92%. The image quality, speed, minimal complexity, and ease of use of VR-SIM could prove to be features in favor of adoption as an alternative to destructive pathology at the point-of-procedure.
Collapse
Affiliation(s)
- Mei Wang
- Department of Biomedical Engineering, Tulane University, New Orleans, Louisiana
| | - Hillary Z Kimbrell
- Department of Pathology and Laboratory Medicine, Tulane University School of Medicine, New Orleans, Louisiana
| | - Andrew B Sholl
- Department of Pathology and Laboratory Medicine, Tulane University School of Medicine, New Orleans, Louisiana
| | - David B Tulman
- Bioinnovation Program, Tulane University, New Orleans, Louisiana
| | - Katherine N Elfer
- Department of Biomedical Engineering, Tulane University, New Orleans, Louisiana
| | | | - Benjamin R Lee
- Department of Urology, Tulane University School of Medicine, New Orleans, Louisiana
| | - Michelle Lacey
- Department of Mathematics, Tulane University, New Orleans, Louisiana
| | - J Quincy Brown
- Department of Biomedical Engineering, Tulane University, New Orleans, Louisiana.
| |
Collapse
|
21
|
Mueller JL, Fu HL, Mito JK, Whitley MJ, Chitalia R, Erkanli A, Dodd L, Cardona DM, Geradts J, Willett RM, Kirsch DG, Ramanujam N. A quantitative microscopic approach to predict local recurrence based on in vivo intraoperative imaging of sarcoma tumor margins. Int J Cancer 2015; 137:2403-12. [PMID: 25994353 DOI: 10.1002/ijc.29611] [Citation(s) in RCA: 7] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/06/2015] [Accepted: 04/30/2015] [Indexed: 11/12/2022]
Abstract
The goal of resection of soft tissue sarcomas located in the extremity is to preserve limb function while completely excising the tumor with a margin of normal tissue. With surgery alone, one-third of patients with soft tissue sarcoma of the extremity will have local recurrence due to microscopic residual disease in the tumor bed. Currently, a limited number of intraoperative pathology-based techniques are used to assess margin status; however, few have been widely adopted due to sampling error and time constraints. To aid in intraoperative diagnosis, we developed a quantitative optical microscopy toolbox, which includes acriflavine staining, fluorescence microscopy, and analytic techniques called sparse component analysis and circle transform to yield quantitative diagnosis of tumor margins. A series of variables were quantified from images of resected primary sarcomas and used to optimize a multivariate model. The sensitivity and specificity for differentiating positive from negative ex vivo resected tumor margins was 82 and 75%. The utility of this approach was tested by imaging the in vivo tumor cavities from 34 mice after resection of a sarcoma with local recurrence as a bench mark. When applied prospectively to images from the tumor cavity, the sensitivity and specificity for differentiating local recurrence was 78 and 82%. For comparison, if pathology was used to predict local recurrence in this data set, it would achieve a sensitivity of 29% and a specificity of 71%. These results indicate a robust approach for detecting microscopic residual disease, which is an effective predictor of local recurrence.
Collapse
Affiliation(s)
- Jenna L Mueller
- Department of Biomedical Engineering, Duke University, Durham, North Carolina
| | - Henry L Fu
- Department of Biomedical Engineering, Duke University, Durham, North Carolina
| | - Jeffrey K Mito
- Department of Pharmacology & Cancer Biology, Duke University School of Medicine, Durham, North Carolina
| | - Melodi J Whitley
- Department of Pharmacology & Cancer Biology, Duke University School of Medicine, Durham, North Carolina
| | - Rhea Chitalia
- Department of Biomedical Engineering, Duke University, Durham, North Carolina
| | - Alaattin Erkanli
- Department of Biostatistics & Bioinformatics, Duke University, Durham, North Carolina
| | - Leslie Dodd
- Department of Pathology, University of North Carolina School of Medicine, Chapel Hill, North Carolina
| | - Diana M Cardona
- Department of Pathology, Duke University Medical Center, Durham, North Carolina
| | - Joseph Geradts
- Department of Pathology, Duke University Medical Center, Durham, North Carolina
| | - Rebecca M Willett
- Department of Electrical and Computer Engineering, University of Wisconsin-Madison, Madison, Wisconsin
| | - David G Kirsch
- Department of Pharmacology & Cancer Biology, Duke University School of Medicine, Durham, North Carolina.,Department of Radiation Oncology, Duke University School of Medicine, Durham, North Carolina
| | - Nimmi Ramanujam
- Department of Biomedical Engineering, Duke University, Durham, North Carolina
| |
Collapse
|
22
|
Nuclear shape descriptors by automated morphometry may distinguish aggressive variants of squamous cell carcinoma from relatively benign skin proliferative lesions: a pilot study. Tumour Biol 2015; 36:6125-31. [PMID: 25753477 DOI: 10.1007/s13277-015-3294-5] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/18/2014] [Accepted: 02/27/2015] [Indexed: 10/23/2022] Open
Abstract
We evaluated whether degrees of dysplasia may be consistently accessed in an automatic fashion, using different kinds of non-melanoma skin cancer (NMSC) as a validatory model. Namely, we compared Bowen disease, actinic keratosis, basal cell carcinoma, low-grade squamous cell carcinoma, and invasive squamous cell carcinoma. We hypothesized that characterizing the shape of nuclei may be important to consistently diagnose the aggressiveness of a skin tumor. While basal cell carcinoma is comparatively relatively benign, management of squamous cell carcinoma is controversial because of its potential to recur and intraoperative dilemma regarding choice of the margin or the depth for the excision. We provide evidence here that progressive nuclear dysplasia may be automatically estimated through the thresholded images of skin cancer and quantitative parameters estimated to provide a quasi-quantitative data, which can thenceforth guide the management of the particular cancer. For circularity, averaging more than 2500 nuclei in each group estimated the means ± SD as 0.8 ± 0.007 vs. 0.78 ± 0.0063 vs. 0.42 ± 0.014 vs. 0.63 ± 0.02 vs. 0.51 ± 0.02 (F = 318063.56, p < 0.0001, one-way analyses of variance). The mean aspect ratios were (means ± SD) 0.97 ± 0.0014 vs. 0.95 ± 0.002 vs. 0.38 ± 0.018 vs. 0.84 ± 0.0035 vs. 0.74 ± 0.019 (F = 1022631.931, p < 0.0001, one-way analyses of variance). The Feret diameters averaged over 2500 nuclei in each group were the following: 1 ± 0.0001 vs. 0.9 ± 0.002 vs. 5 ± 0.031 vs. 1.5 ± 0.01 vs. 1.9 ± 0.004 (F = 33105614.194, p < 0.0001, one-way analyses of variance). Multivariate analyses of composite parameters potentially detect aggressive variants of squamous cell carcinoma as the most dysplastic form, in comparison to locally occurring squamous cell carcinoma and basal cell carcinoma, or benign skin lesions.
Collapse
|
23
|
Korzynska A, Roszkowiak L, Pijanowska D, Kozlowski W, Markiewicz T. The influence of the microscope lamp filament colour temperature on the process of digital images of histological slides acquisition standardization. Diagn Pathol 2015; 9 Suppl 1:S13. [PMID: 25565329 PMCID: PMC4305971 DOI: 10.1186/1746-1596-9-s1-s13] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/29/2022] Open
Abstract
Background The aim of this study is to compare the digital images of the tissue biopsy captured with optical microscope using bright field technique under various light conditions. The range of colour's variation in immunohistochemically stained with 3,3'-Diaminobenzidine and Haematoxylin tissue samples is immense and coming from various sources. One of them is inadequate setting of camera's white balance to microscope's light colour temperature. Although this type of error can be easily handled during the stage of image acquisition, it can be eliminated with use of colour adjustment algorithms. The examination of the dependence of colour variation from microscope's light temperature and settings of the camera is done as an introductory research to the process of automatic colour standardization. Methods Six fields of view with empty space among the tissue samples have been selected for analysis. Each field of view has been acquired 225 times with various microscope light temperature and camera white balance settings. The fourteen randomly chosen images have been corrected and compared, with the reference image, by the following methods: Mean Square Error, Structural SIMilarity and visual assessment of viewer. Results For two types of backgrounds and two types of objects, the statistical image descriptors: range, median, mean and its standard deviation of chromaticity on a and b channels from CIELab colour space, and luminance L, and local colour variability for objects' specific area have been calculated. The results have been averaged for 6 images acquired in the same light conditions and camera settings for each sample. Conclusions The analysis of the results leads to the following conclusions: (1) the images collected with white balance setting adjusted to light colour temperature clusters in certain area of chromatic space, (2) the process of white balance correction for images collected with white balance camera settings not matched to the light temperature moves image descriptors into proper chromatic space but simultaneously the value of luminance changes. So the process of the image unification in a sense of colour fidelity can be solved in separate introductory stage before the automatic image analysis.
Collapse
|
24
|
Fixler D, Ankri R, Kaplan I, Novikov I, Hirshberg A. Diffusion Reflection: A Novel Method for Detection of Oral Cancer. J Dent Res 2014; 93:602-6. [PMID: 24695671 DOI: 10.1177/0022034514529973] [Citation(s) in RCA: 20] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/25/2013] [Accepted: 03/08/2014] [Indexed: 12/28/2022] Open
Abstract
Intraoperative detection of residual disease in oral cancer may reduce the high rate of recurrences. The aim of the present study was to evaluate the detection sensitivity of diffusion reflection (DR) measurements of bioconjugated gold nanorods (GNRs) to cancerous sites in a rat model of oral squamous cell carcinoma. We used hyperspectral spectroscopy and DR measurements of GNRs bioconjugated to slide specimens of rat tongues where squamous carcinoma was induced by 4NQO (4-nitroquinoline-N-oxide). Wistar-derived male rats were used: 6 were sacrificed at wk 32 to 37 following 4NQO administration (experimental rats), as were 2 control rats at wk 32 and 36. The detection results were compared with histopathology: 19 sites of cancerous changes were identified microscopically (11 invasive cancer and 8 carcinoma in situ [CIS]). The GNRs attached selectively to areas of carcinomatous changes with an intensity exceeding 17 intensity units at 780 nm (overall specificity, 97%; overall sensitivity, 87%) when the hyperspectral spectroscopy system was used. The resulting DR slopes of the reflected intensity showed an increase of >80% in areas of invasive cancer and an increase of >30% in the CIS sites. The resulting intensity units of the hyperspectral spectroscopy system in the invasive cancer significantly exceed those of the CIS (t test, p = .0002; Mann-Whitney, p = .0024). The results demonstrate a great potential of the direct DR scanning as a new and simple tool for detecting residual disease intraoperatively.
Collapse
Affiliation(s)
- D Fixler
- Faculty of Engineering and the Institute of Nanotechnology and Advanced Materials, Bar Ilan University, Ramat Gan, Israel
| | - R Ankri
- Faculty of Engineering and the Institute of Nanotechnology and Advanced Materials, Bar Ilan University, Ramat Gan, Israel
| | - I Kaplan
- Department of Oral Pathology and Oral Medicine, The Maurice and Gabriela Goldschleger School of Dental Medicine, Tel Aviv University, Tel Aviv, Israel
| | - I Novikov
- Biostatistical Unit, Gertner Institute for Epidemiology and Health Policy Research, Ramat Gan, Israel
| | - A Hirshberg
- Department of Oral Pathology and Oral Medicine, The Maurice and Gabriela Goldschleger School of Dental Medicine, Tel Aviv University, Tel Aviv, Israel
| |
Collapse
|
25
|
Schlichenmeyer TC, Wang M, Elfer KN, Brown JQ. Video-rate structured illumination microscopy for high-throughput imaging of large tissue areas. BIOMEDICAL OPTICS EXPRESS 2014; 5:366-77. [PMID: 24575333 PMCID: PMC3920869 DOI: 10.1364/boe.5.000366] [Citation(s) in RCA: 23] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/25/2013] [Revised: 12/27/2013] [Accepted: 12/28/2013] [Indexed: 05/21/2023]
Abstract
We report the development of a structured illumination microscopy instrument specifically designed for the requirements for high-area-throughput, optically-sectioned imaging of large, fluorescently-stained tissue specimens. The system achieves optical sectioning frame-rates of up to 33 Hz (and pixel sampling rates of up to 138.4 MHz), by combining a fast, ferroelectric spatial light modulator for pattern generation with the latest large-format, high frame-rate scientific CMOS camera technology. Using a 10X 0.45 NA objective and a 7 mm/sec scan stage, we demonstrate 4.4 cm(2)/min area-throughput rates in bright tissue-simulating phantoms, and 2 cm(2)/min area-throughput rates in thick, highly-absorbing, fluorescently-stained muscle tissue, with 1.3 μm lateral resolution. We demonstrate high-contrast, high-resolution imaging of a fluorescently-stained 30.4 cm(2) bovine muscle specimen in 15 minutes comprising 7.55 gigapixels, demonstrating the feasibility of the approach for gigapixel imaging of large tissues in short timeframes, such as would be needed for intraoperative imaging of tumor resection specimens.
Collapse
|