1
|
Kaphle A, Jayarathna S, Moktan H, Aliru M, Raghuram S, Krishnan S, Cho SH. Deep Learning-Based TEM Image Analysis for Fully Automated Detection of Gold Nanoparticles Internalized Within Tumor Cell. MICROSCOPY AND MICROANALYSIS : THE OFFICIAL JOURNAL OF MICROSCOPY SOCIETY OF AMERICA, MICROBEAM ANALYSIS SOCIETY, MICROSCOPICAL SOCIETY OF CANADA 2023; 29:1474-1487. [PMID: 37488822 PMCID: PMC10433944 DOI: 10.1093/micmic/ozad066] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 02/07/2023] [Revised: 04/28/2023] [Accepted: 05/22/2023] [Indexed: 07/26/2023]
Abstract
Transmission electron microscopy (TEM) imaging can be used for detection/localization of gold nanoparticles (GNPs) within tumor cells. However, quantitative analysis of GNP-containing cellular TEM images typically relies on conventional/thresholding-based methods, which are manual, time-consuming, and prone to human errors. In this study, therefore, deep learning (DL)-based methods were developed for fully automated detection of GNPs from cellular TEM images. Several models of "you only look once (YOLO)" v5 were implemented, with a few adjustments to enhance the model's performance by applying the transfer learning approach, adjusting the size of the input image, and choosing the best optimization algorithm. Seventy-eight original (12,040 augmented) TEM images of GNP-laden tumor cells were used for model implementation and validation. A maximum F1 score (harmonic mean of the precision and recall) of 0.982 was achieved by the best-trained models, while mean average precision was 0.989 and 0.843 at 0.50 and 0.50-0.95 intersection over union threshold, respectively. These results suggested the developed DL-based approach was capable of precisely estimating the number/position of internalized GNPs from cellular TEM images. A novel DL-based TEM image analysis tool from this study will benefit research/development efforts on GNP-based cancer therapeutics, for example, by enabling the modeling of GNP-laden tumor cells using nanometer-resolution TEM images.
Collapse
Affiliation(s)
- Amrit Kaphle
- Department of Radiation Physics, The University of Texas MD Anderson Cancer Center, Houston, TX 77030, USA
| | - Sandun Jayarathna
- Department of Radiation Physics, The University of Texas MD Anderson Cancer Center, Houston, TX 77030, USA
| | - Hem Moktan
- Department of Radiation Physics, The University of Texas MD Anderson Cancer Center, Houston, TX 77030, USA
| | - Maureen Aliru
- Department of Radiation Physics, The University of Texas MD Anderson Cancer Center, Houston, TX 77030, USA
| | - Subhiksha Raghuram
- Department of Radiation Physics, The University of Texas MD Anderson Cancer Center, Houston, TX 77030, USA
| | - Sunil Krishnan
- Vivian L. Smith Department of Neurosurgery, The University of Texas Health Science Center, Houston, TX 77030, USA
| | - Sang Hyun Cho
- Department of Radiation Physics, The University of Texas MD Anderson Cancer Center, Houston, TX 77030, USA
- Department of Imaging Physics, The University of Texas MD Anderson Cancer Center, Houston, TX 77030, USA
| |
Collapse
|
2
|
Albuquerque C, Vanneschi L, Henriques R, Castelli M, Póvoa V, Fior R, Papanikolaou N. Object detection for automatic cancer cell counting in zebrafish xenografts. PLoS One 2021; 16:e0260609. [PMID: 34843603 PMCID: PMC8629215 DOI: 10.1371/journal.pone.0260609] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/26/2021] [Accepted: 11/13/2021] [Indexed: 12/12/2022] Open
Abstract
Cell counting is a frequent task in medical research studies. However, it is often performed manually; thus, it is time-consuming and prone to human error. Even so, cell counting automation can be challenging to achieve, especially when dealing with crowded scenes and overlapping cells, assuming different shapes and sizes. In this paper, we introduce a deep learning-based cell detection and quantification methodology to automate the cell counting process in the zebrafish xenograft cancer model, an innovative technique for studying tumor biology and for personalizing medicine. First, we implemented a fine-tuned architecture based on the Faster R-CNN using the Inception ResNet V2 feature extractor. Second, we performed several adjustments to optimize the process, paying attention to constraints such as the presence of overlapped cells, the high number of objects to detect, the heterogeneity of the cells' size and shape, and the small size of the data set. This method resulted in a median error of approximately 1% of the total number of cell units. These results demonstrate the potential of our novel approach for quantifying cells in poorly labeled images. Compared to traditional Faster R-CNN, our method improved the average precision from 71% to 85% on the studied data set.
Collapse
Affiliation(s)
- Carina Albuquerque
- Nova Information Management School (NOVA IMS), Universidade Nova de Lisboa, Lisboa, Portugal
| | - Leonardo Vanneschi
- Nova Information Management School (NOVA IMS), Universidade Nova de Lisboa, Lisboa, Portugal
| | - Roberto Henriques
- Nova Information Management School (NOVA IMS), Universidade Nova de Lisboa, Lisboa, Portugal
| | - Mauro Castelli
- Nova Information Management School (NOVA IMS), Universidade Nova de Lisboa, Lisboa, Portugal
| | - Vanda Póvoa
- Computational Clinical Imaging Group, Center for the Unknown, Champalimaud Foundation, Lisboa, Portugal
| | - Rita Fior
- Computational Clinical Imaging Group, Center for the Unknown, Champalimaud Foundation, Lisboa, Portugal
| | - Nickolas Papanikolaou
- Computational Clinical Imaging Group, Center for the Unknown, Champalimaud Foundation, Lisboa, Portugal
| |
Collapse
|
3
|
Firouzian KF, Zhang T, Zhang H, Song Y, Su X, Lin F. An Image-Guided Intrascaffold Cell Assembly Technique for Accurate Printing of Heterogeneous Tissue Constructs. ACS Biomater Sci Eng 2019; 5:3499-3510. [PMID: 33405733 DOI: 10.1021/acsbiomaterials.9b00318] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/18/2022]
Abstract
For tissue engineering and regenerative medicine, creating thick and heterogeneous scaffold-based tissue constructs requires deep and precise multicellular deposition. Traditional cell seeding strategies lack the ability to create multicellular tissue constructs with high cell penetration and distribution, while emerging strategies aim to simultaneously combine cell-laden tissue segments with scaffold fabrication. Here we describe a technique that allows for three-dimensional (3D) intrascaffold cell assembly in which scaffolds are prefabricated and pretreated, followed by accurate cell distribution within the scaffold using an image-guided technique. This two-step process yields less limitation in scaffold material choice as well as additional treatments, provides accurate cell distribution, and has less potential to harm cells. The image processing technique captures a 2D geometric image of the scaffold, followed by a series of processes, mainly including grayscale transformation, threshold segmentation, and boundary extraction, to ultimately locate scaffold macropore centroids. Coupled with camera calibration data, accurate 3D cell assembly pathway plans can be made. Intrascaffold assembly parameter optimization and complex intrascaffold gradient, multidirectional, and vascular structure assembly were studied. Demonstration was also made with path planning and cell assembly experiments using NIH3T3-cell-laden hydrogels and collagen-coated poly(lactic-co-glycolic acid) (PLGA) scaffolds. Experiments with CellTracker fluorescent monitoring, live/dead staining, and phalloidin-F-actin/DAPI immunostaining and comparison with two control groups (bioink manual injection and cell suspension static surface pipetting) showed accurate cell distribution and positioning and high cell viability (>93%). The PrestoBlue assay showed obvious cell proliferation over seven culture days in vitro. This technique provides an accurate method to aid simple and complex cell colonization with variant depth within 3D-scaffold-based constructs using multiple cells. The modular method can be used with any existing printing platform and shows potential in facilitating direct spatial organization and hierarchal 3D assembly of multiple cells and/or drugs within scaffolds for further tissue engineering studies and clinical applications.
Collapse
Affiliation(s)
- Kevin F Firouzian
- Biomanufacturing Center, Department of Mechanical Engineering, Tsinghua University, Beijing 100084, China.,Biomanufacturing and Rapid Forming Technology Key Laboratory of Beijing, Department of Mechanical Engineering, Tsinghua University, Beijing 100084, China.,111 "Biomanufacturing and Engineering Living Systems" Innovation International Talents Base, Department of Mechanical Engineering, Tsinghua University, Beijing 100084, China
| | - Ting Zhang
- Biomanufacturing Center, Department of Mechanical Engineering, Tsinghua University, Beijing 100084, China.,Biomanufacturing and Rapid Forming Technology Key Laboratory of Beijing, Department of Mechanical Engineering, Tsinghua University, Beijing 100084, China.,111 "Biomanufacturing and Engineering Living Systems" Innovation International Talents Base, Department of Mechanical Engineering, Tsinghua University, Beijing 100084, China
| | - Hefeng Zhang
- Biomanufacturing Center, Department of Mechanical Engineering, Tsinghua University, Beijing 100084, China.,Biomanufacturing and Rapid Forming Technology Key Laboratory of Beijing, Department of Mechanical Engineering, Tsinghua University, Beijing 100084, China
| | - Yu Song
- Biomanufacturing Center, Department of Mechanical Engineering, Tsinghua University, Beijing 100084, China.,Biomanufacturing and Rapid Forming Technology Key Laboratory of Beijing, Department of Mechanical Engineering, Tsinghua University, Beijing 100084, China.,111 "Biomanufacturing and Engineering Living Systems" Innovation International Talents Base, Department of Mechanical Engineering, Tsinghua University, Beijing 100084, China
| | - Xiaolei Su
- Biomanufacturing Center, Department of Mechanical Engineering, Tsinghua University, Beijing 100084, China.,Biomanufacturing and Rapid Forming Technology Key Laboratory of Beijing, Department of Mechanical Engineering, Tsinghua University, Beijing 100084, China.,111 "Biomanufacturing and Engineering Living Systems" Innovation International Talents Base, Department of Mechanical Engineering, Tsinghua University, Beijing 100084, China
| | - Feng Lin
- Biomanufacturing Center, Department of Mechanical Engineering, Tsinghua University, Beijing 100084, China.,Biomanufacturing and Rapid Forming Technology Key Laboratory of Beijing, Department of Mechanical Engineering, Tsinghua University, Beijing 100084, China.,111 "Biomanufacturing and Engineering Living Systems" Innovation International Talents Base, Department of Mechanical Engineering, Tsinghua University, Beijing 100084, China
| |
Collapse
|
4
|
Allenby MC, Misener R, Panoskaltsis N, Mantalaris A. A Quantitative Three-Dimensional Image Analysis Tool for Maximal Acquisition of Spatial Heterogeneity Data. Tissue Eng Part C Methods 2017; 23:108-117. [DOI: 10.1089/ten.tec.2016.0413] [Citation(s) in RCA: 14] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/13/2022] Open
Affiliation(s)
- Mark C. Allenby
- Biological Systems Engineering Laboratory, Department of Chemical Engineering, Imperial College London, London, United Kingdom
| | - Ruth Misener
- Department of Computing, Imperial College London, London, United Kingdom
| | - Nicki Panoskaltsis
- Biological Systems Engineering Laboratory, Department of Chemical Engineering, Imperial College London, London, United Kingdom
- Department of Hematology, Imperial College London, London, United Kingdom
| | - Athanasios Mantalaris
- Biological Systems Engineering Laboratory, Department of Chemical Engineering, Imperial College London, London, United Kingdom
| |
Collapse
|
5
|
Piccinini F, Tesei A, Paganelli G, Zoli W, Bevilacqua A. Improving reliability of live/dead cell counting through automated image mosaicing. COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE 2014; 117:448-463. [PMID: 25438936 DOI: 10.1016/j.cmpb.2014.09.004] [Citation(s) in RCA: 9] [Impact Index Per Article: 0.9] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 02/24/2014] [Revised: 09/18/2014] [Accepted: 09/19/2014] [Indexed: 06/04/2023]
Abstract
Cell counting is one of the basic needs of most biological experiments. Numerous methods and systems have been studied to improve the reliability of counting. However, at present, manual cell counting performed with a hemocytometer still represents the gold standard, despite several problems limiting reproducibility and repeatability of the counts and, at the end, jeopardizing their reliability in general. We present our own approach based on image processing techniques to improve counting reliability. It works in two stages: first building a high-resolution image of the hemocytometer's grid, then counting the live and dead cells by tagging the image with flags of different colours. In particular, we introduce GridMos (http://sourceforge.net/p/gridmos), a fully-automated mosaicing method to obtain a mosaic representing the whole hemocytometer's grid. In addition to offering more significant statistics, the mosaic "freezes" the culture status, thus permitting analysis by more than one operator. Finally, the mosaic achieved can thus be tagged by using an image editor, thus markedly improving counting reliability. The experiments performed confirm the improvements brought about by the proposed counting approach in terms of both reproducibility and repeatability, also suggesting the use of a mosaic of an entire hemocytometer's grid, then labelled trough an image editor, as the best likely candidate for the new gold standard method in cell counting.
Collapse
Affiliation(s)
- Filippo Piccinini
- Advanced Research Center on Electronic Systems (ARCES) for Information and Communication Technologies "E. De Castro", University of Bologna, Italy.
| | - Anna Tesei
- Istituto Scientifico Romagnolo per lo Studio e la Cura dei Tumori (IRST) IRCCS, Meldola, FC, Italy.
| | - Giulia Paganelli
- Istituto Scientifico Romagnolo per lo Studio e la Cura dei Tumori (IRST) IRCCS, Meldola, FC, Italy.
| | - Wainer Zoli
- Istituto Scientifico Romagnolo per lo Studio e la Cura dei Tumori (IRST) IRCCS, Meldola, FC, Italy.
| | - Alessandro Bevilacqua
- Advanced Research Center on Electronic Systems (ARCES) for Information and Communication Technologies "E. De Castro", University of Bologna, Italy; Department of Computer Science and Engineering (DISI), University of Bologna, Italy.
| |
Collapse
|
6
|
Piccinini F, Pierini M, Lucarelli E, Bevilacqua A. Semi-quantitative monitoring of confluence of adherent mesenchymal stromal cells on calcium-phosphate granules by using widefield microscopy images. JOURNAL OF MATERIALS SCIENCE. MATERIALS IN MEDICINE 2014; 25:2395-2410. [PMID: 24863020 DOI: 10.1007/s10856-014-5242-0] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/10/2013] [Accepted: 05/13/2014] [Indexed: 06/03/2023]
Abstract
The analysis of cell confluence and proliferation is essential to design biomaterials and scaffolds to use as bone substitutes in clinical applications. Accordingly, several approaches have been proposed in the literature to estimate the area of the scaffold covered by cells. Nevertheless, most of the approaches rely on sophisticated equipment not employed for routine analyses, while the rest of them usually do not provide significant statistics about the cell distribution. This research aims at studying confluence and proliferation of mesenchymal stromal cells (MSC) adherent on OSPROLIFE(®), a commercial biomaterial in the form of granules. In particular, we propose a Computer Vision approach that can routinely be employed to monitor the surface of the single granules covered by cells because only a standard widefield fluorescent microscope is required. In order to acquire significant statistics data, we analyse wide-area images built by using MicroMos v2.0, an updated version of a previously published software specific for stitching brightfield and phase-contrast images manually acquired via a widefield microscope. In particular, MicroMos v2.0 permits to build accurate "mosaics" of fluorescent images, after correcting vignetting and photo-bleaching effects, providing a consistent representation of a sample region containing numerous granules. Then, our method allows to make automatically a statistically significant estimate of the percentage of the area of the single granules covered by cells. Finally, by analysing hundreds of granules at different time intervals we also obtained reliable data regarding cell proliferation, confirming that not only MSC adhere onto the OSPROLIFE(®) granules, but even proliferate over time.
Collapse
Affiliation(s)
- Filippo Piccinini
- Advanced Research Center on Electronic Systems for Information and Communication Technologies "E. De Castro" (ARCES), University of Bologna, Via Toffano 2/2, I-40125, Bologna, Italy,
| | | | | | | |
Collapse
|