1
|
Lagou MK, Argyris DG, Vodopyanov S, Gunther-Cummins L, Hardas A, Poutahidis T, Panorias C, DesMarais S, Entenberg C, Carpenter RS, Guzik H, Nishku X, Churaman J, Maryanovich M, DesMarais V, Macaluso FP, Karagiannis GS. Morphometric Analysis of the Thymic Epithelial Cell (TEC) Network Using Integrated and Orthogonal Digital Pathology Approaches. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2024:2024.03.11.584509. [PMID: 38559037 PMCID: PMC10979902 DOI: 10.1101/2024.03.11.584509] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Indexed: 04/04/2024]
Abstract
The thymus, a central primary lymphoid organ of the immune system, plays a key role in T cell development. Surprisingly, the thymus is quite neglected with regards to standardized pathology approaches and practices for assessing structure and function. Most studies use multispectral flow cytometry to define the dynamic composition of the thymus at the cell population level, but they are limited by lack of contextual insight. This knowledge gap hinders our understanding of various thymic conditions and pathologies, particularly how they affect thymic architecture, and subsequently, immune competence. Here, we introduce a digital pathology pipeline to address these challenges. Our approach can be coupled to analytical algorithms and utilizes rationalized morphometric assessments of thymic tissue, ranging from tissue-wide down to microanatomical and ultrastructural levels. This pipeline enables the quantitative assessment of putative changes and adaptations of thymic structure to stimuli, offering valuable insights into the pathophysiology of thymic disorders. This versatile pipeline can be applied to a wide range of conditions that may directly or indirectly affect thymic structure, ranging from various cytotoxic stimuli inducing acute thymic involution to autoimmune diseases, such as myasthenia gravis. Here, we demonstrate applicability of the method in a mouse model of age-dependent thymic involution, both by confirming established knowledge, and by providing novel insights on intrathymic remodeling in the aged thymus. Our orthogonal pipeline, with its high versatility and depth of analysis, promises to be a valuable and practical toolset for both basic and translational immunology laboratories investigating thymic function and disease.
Collapse
Affiliation(s)
- Maria K Lagou
- Department of Microbiology and Immunology, Albert Einstein College of Medicine, Bronx, NY, USA
- Tumor Microenvironment and Metastasis Program, Montefiore-Einstein Comprehensive Cancer Center, Bronx, NY, USA
| | - Dimitrios G Argyris
- Department of Microbiology and Immunology, Albert Einstein College of Medicine, Bronx, NY, USA
- Tumor Microenvironment and Metastasis Program, Montefiore-Einstein Comprehensive Cancer Center, Bronx, NY, USA
- Integrated Imaging Program for Cancer Research, Montefiore-Einstein Comprehensive Cancer Center, Bronx, NY, USA
| | - Stepan Vodopyanov
- Department of Microbiology and Immunology, Albert Einstein College of Medicine, Bronx, NY, USA
- Tumor Microenvironment and Metastasis Program, Montefiore-Einstein Comprehensive Cancer Center, Bronx, NY, USA
| | - Leslie Gunther-Cummins
- Gruss-Lipper Biophotonics Center, Albert Einstein College of Medicine, Bronx, NY, USA
- Analytical Imaging Facility, Albert Einstein College of Medicine, Bronx, NY, USA
- Department of Cell Biology, Albert Einstein College of Medicine, Bronx, NY, USA
- Montefiore-Einstein Comprehensive Cancer, Center, Bronx, NY, USA
| | - Alexandros Hardas
- Department of Pathobiology and Population Sciences, The Royal Veterinary College, North Mymms, Hatfield, United Kingdom
| | - Theofilos Poutahidis
- Laboratory of Pathology, School of Veterinary Medicine, Faculty of Health Sciences, Aristotle University of Thessaloniki, Thessaloniki, Greece
| | - Christos Panorias
- Division of Statistics and Operational Research, Department of Mathematics, Aristotle University of Thessaloniki, Thessaloniki, Greece
| | - Sophia DesMarais
- Department of Microbiology and Immunology, Albert Einstein College of Medicine, Bronx, NY, USA
| | - Conner Entenberg
- Department of Microbiology and Immunology, Albert Einstein College of Medicine, Bronx, NY, USA
| | - Randall S Carpenter
- Department of Cell Biology, Albert Einstein College of Medicine, Bronx, NY, USA
- Ruth L. and David S. Gottesman Institute for Stem Cell and Regenerative Medicine, Albert Einstein College of Medicine, Bronx, NY, USA
| | - Hillary Guzik
- Gruss-Lipper Biophotonics Center, Albert Einstein College of Medicine, Bronx, NY, USA
- Analytical Imaging Facility, Albert Einstein College of Medicine, Bronx, NY, USA
- Montefiore-Einstein Comprehensive Cancer, Center, Bronx, NY, USA
| | - Xheni Nishku
- Gruss-Lipper Biophotonics Center, Albert Einstein College of Medicine, Bronx, NY, USA
- Analytical Imaging Facility, Albert Einstein College of Medicine, Bronx, NY, USA
- Montefiore-Einstein Comprehensive Cancer, Center, Bronx, NY, USA
| | - Joseph Churaman
- Gruss-Lipper Biophotonics Center, Albert Einstein College of Medicine, Bronx, NY, USA
- Analytical Imaging Facility, Albert Einstein College of Medicine, Bronx, NY, USA
- Montefiore-Einstein Comprehensive Cancer, Center, Bronx, NY, USA
| | - Maria Maryanovich
- Department of Cell Biology, Albert Einstein College of Medicine, Bronx, NY, USA
- Ruth L. and David S. Gottesman Institute for Stem Cell and Regenerative Medicine, Albert Einstein College of Medicine, Bronx, NY, USA
- Cancer Dormancy and Tumor Microenvironment Institute, Montefiore-Einstein Comprehensive Cancer, Center, Bronx, NY, USA
| | - Vera DesMarais
- Gruss-Lipper Biophotonics Center, Albert Einstein College of Medicine, Bronx, NY, USA
- Analytical Imaging Facility, Albert Einstein College of Medicine, Bronx, NY, USA
- Department of Cell Biology, Albert Einstein College of Medicine, Bronx, NY, USA
- Montefiore-Einstein Comprehensive Cancer, Center, Bronx, NY, USA
| | - Frank P Macaluso
- Gruss-Lipper Biophotonics Center, Albert Einstein College of Medicine, Bronx, NY, USA
- Analytical Imaging Facility, Albert Einstein College of Medicine, Bronx, NY, USA
- Department of Cell Biology, Albert Einstein College of Medicine, Bronx, NY, USA
- Montefiore-Einstein Comprehensive Cancer, Center, Bronx, NY, USA
| | - George S Karagiannis
- Department of Microbiology and Immunology, Albert Einstein College of Medicine, Bronx, NY, USA
- Tumor Microenvironment and Metastasis Program, Montefiore-Einstein Comprehensive Cancer Center, Bronx, NY, USA
- Integrated Imaging Program for Cancer Research, Montefiore-Einstein Comprehensive Cancer Center, Bronx, NY, USA
- Gruss-Lipper Biophotonics Center, Albert Einstein College of Medicine, Bronx, NY, USA
- Cancer Dormancy and Tumor Microenvironment Institute, Montefiore-Einstein Comprehensive Cancer, Center, Bronx, NY, USA
| |
Collapse
|
2
|
Walsh CL, Berg M, West H, Holroyd NA, Walker-Samuel S, Shipley RJ. Reconstructing microvascular network skeletons from 3D images: What is the ground truth? Comput Biol Med 2024; 171:108140. [PMID: 38422956 DOI: 10.1016/j.compbiomed.2024.108140] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/18/2023] [Revised: 01/29/2024] [Accepted: 02/12/2024] [Indexed: 03/02/2024]
Abstract
Structural changes to microvascular networks are increasingly highlighted as markers of pathogenesis in a wide range of disease, e.g. Alzheimer's disease, vascular dementia and tumour growth. This has motivated the development of dedicated 3D imaging techniques, alongside the creation of computational modelling frameworks capable of using 3D reconstructed networks to simulate functional behaviours such as blood flow or transport processes. Extraction of 3D networks from imaging data broadly consists of two image processing steps: segmentation followed by skeletonisation. Much research effort has been devoted to segmentation field, and there are standard and widely-applied methodologies for creating and assessing gold standards or ground truths produced by manual annotation or automated algorithms. The Skeletonisation field, however, lacks widely applied, simple to compute metrics for the validation or optimisation of the numerous algorithms that exist to extract skeletons from binary images. This is particularly problematic as 3D imaging datasets increase in size and visual inspection becomes an insufficient validation approach. In this work, we first demonstrate the extent of the problem by applying 4 widely-used skeletonisation algorithms to 3 different imaging datasets. In doing so we show significant variability between reconstructed skeletons of the same segmented imaging dataset. Moreover, we show that such a structural variability propagates to simulated metrics such as blood flow. To mitigate this variability we introduce a new, fast and easy to compute super metric that compares the volume, connectivity, medialness, bifurcation point identification and homology of the reconstructed skeletons to the original segmented data. We then show that such a metric can be used to select the best performing skeletonisation algorithm for a given dataset, as well as to optimise its parameters. Finally, we demonstrate that the super metric can also be used to quickly identify how a particular skeletonisation algorithm could be improved, becoming a powerful tool in understanding the complex implication of small structural changes in a network.
Collapse
Affiliation(s)
- Claire L Walsh
- Department of Mechanical Engineering, University College London, United Kingdom
| | - Maxime Berg
- Department of Mechanical Engineering, University College London, United Kingdom.
| | - Hannah West
- Department of Mechanical Engineering, University College London, United Kingdom
| | - Natalie A Holroyd
- Centre for Computational Medicine, Division of Medicine, University College London, United Kingdom
| | - Simon Walker-Samuel
- Centre for Computational Medicine, Division of Medicine, University College London, United Kingdom
| | - Rebecca J Shipley
- Department of Mechanical Engineering, University College London, United Kingdom; Centre for Computational Medicine, Division of Medicine, University College London, United Kingdom
| |
Collapse
|
3
|
Bauer N, Beckmann D, Reinhardt D, Frost N, Bobe S, Erapaneedi R, Risse B, Kiefer F. Therapy-induced modulation of tumor vasculature and oxygenation in a murine glioblastoma model quantified by deep learning-based feature extraction. Sci Rep 2024; 14:2034. [PMID: 38263339 PMCID: PMC10805754 DOI: 10.1038/s41598-024-52268-0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/18/2023] [Accepted: 01/16/2024] [Indexed: 01/25/2024] Open
Abstract
Glioblastoma presents characteristically with an exuberant, poorly functional vasculature that causes malperfusion, hypoxia and necrosis. Despite limited clinical efficacy, anti-angiogenesis resulting in vascular normalization remains a promising therapeutic approach. Yet, fundamental questions concerning anti-angiogenic therapy remain unanswered, partly due to the scale and resolution gap between microscopy and clinical imaging and a lack of quantitative data readouts. To what extend does treatment lead to vessel regression or vessel normalization and does it ameliorate or aggravate hypoxia? Clearly, a better understanding of the underlying mechanisms would greatly benefit the development of desperately needed improved treatment regimens. Here, using orthotopic transplantation of Gli36 cells, a widely used murine glioma model, we present a mesoscopic approach based on light sheet fluorescence microscopic imaging of wholemount stained tumors. Deep learning-based segmentation followed by automated feature extraction allowed quantitative analyses of the entire tumor vasculature and oxygenation statuses. Unexpectedly in this model, the response to both cytotoxic and anti-angiogenic therapy was dominated by vessel normalization with little evidence for vessel regression. Equally surprising, only cytotoxic therapy resulted in a significant alleviation of hypoxia. Taken together, we provide and evaluate a quantitative workflow that addresses some of the most urgent mechanistic questions in anti-angiogenic therapy.
Collapse
Affiliation(s)
- Nadine Bauer
- European Institute for Molecular Imaging (EIMI), Multiscale Imaging Centre (MIC), University of Münster, Röntgenstr. 16, 48149, Münster, Germany
- Max Planck Institute for Molecular Biomedicine, Röntgenstr. 20, 48149, Münster, Germany
| | - Daniel Beckmann
- Institute for Geoinformatics, University of Münster, Heisenbergstr. 2, 48149, Münster, Germany
- Institute for Computer Science, University of Münster, Einsteinstraße 62, 48149, Münster, Germany
| | - Dirk Reinhardt
- European Institute for Molecular Imaging (EIMI), Multiscale Imaging Centre (MIC), University of Münster, Röntgenstr. 16, 48149, Münster, Germany
| | - Nicole Frost
- European Institute for Molecular Imaging (EIMI), Multiscale Imaging Centre (MIC), University of Münster, Röntgenstr. 16, 48149, Münster, Germany
| | - Stefanie Bobe
- European Institute for Molecular Imaging (EIMI), Multiscale Imaging Centre (MIC), University of Münster, Röntgenstr. 16, 48149, Münster, Germany
- Gerhard Domagk Institute of Pathology, University Hospital Münster, Domagkstr. 15, 48149, Münster, Germany
| | - Raghu Erapaneedi
- European Institute for Molecular Imaging (EIMI), Multiscale Imaging Centre (MIC), University of Münster, Röntgenstr. 16, 48149, Münster, Germany
- Max Planck Institute for Molecular Biomedicine, Röntgenstr. 20, 48149, Münster, Germany
| | - Benjamin Risse
- Institute for Geoinformatics, University of Münster, Heisenbergstr. 2, 48149, Münster, Germany
- Institute for Computer Science, University of Münster, Einsteinstraße 62, 48149, Münster, Germany
| | - Friedemann Kiefer
- European Institute for Molecular Imaging (EIMI), Multiscale Imaging Centre (MIC), University of Münster, Röntgenstr. 16, 48149, Münster, Germany.
- Max Planck Institute for Molecular Biomedicine, Röntgenstr. 20, 48149, Münster, Germany.
| |
Collapse
|
4
|
Gratacos G, Chakrabarti A, Ju T. Tree Recovery by Dynamic Programming. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE 2023; 45:15870-15882. [PMID: 37505999 DOI: 10.1109/tpami.2023.3299868] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 07/30/2023]
Abstract
Tree-like structures are common, naturally occurring objects that are of interest to many fields of study, such as plant science and biomedicine. Analysis of these structures is typically based on skeletons extracted from captured data, which often contain spurious cycles that need to be removed. We propose a dynamic programming algorithm for solving the NP-hard tree recovery problem formulated by (Estrada et al. 2015), which seeks a least-cost partitioning of the graph nodes that yields a directed tree. Our algorithm finds the optimal solution by iteratively contracting the graph via node-merging until the problem can be trivially solved. By carefully designing the merging sequence, our algorithm can efficiently recover optimal trees for many real-world data where (Estrada et al. 2015) only produces sub-optimal solutions. We also propose an approximate variant of dynamic programming using beam search, which can process graphs containing thousands of cycles with significantly improved optimality and efficiency compared with (Estrada et al. 2015).
Collapse
|
5
|
Alves MG, Chen GL, Kang X, Song GH. Reduced CPU Workload for Human Pose Detection with the Aid of a Low-Resolution Infrared Array Sensor on Embedded Systems. SENSORS (BASEL, SWITZERLAND) 2023; 23:9403. [PMID: 38067779 PMCID: PMC10708851 DOI: 10.3390/s23239403] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 09/11/2023] [Revised: 11/12/2023] [Accepted: 11/22/2023] [Indexed: 12/18/2023]
Abstract
Modern embedded systems have achieved relatively high processing power. They can be used for edge computing and computer vision, where data are collected and processed locally, without the need for network communication for decision-making and data analysis purposes. Face detection, face recognition, and pose detection algorithms can be executed with acceptable performance on embedded systems and are used for home security and monitoring. However, popular machine learning frameworks, such as MediaPipe, require relatively high usage of CPU while running, even when idle with no subject in the scene. Combined with the still present false detections, this wastes CPU time, elevates the power consumption and overall system temperature, and generates unnecessary data. In this study, a low-cost low-resolution infrared thermal sensor array was used to control the execution of MediaPipe's pose detection algorithm using single-board computers, which only runs when the thermal camera detects a possible subject in its field of view. A lightweight algorithm with several filtering layers was developed, which allowed the effective detection and isolation of a person in the thermal image. The resulting hybrid computer vision proved effective in reducing the average CPU workload, especially in environments with low activity, almost eliminating MediaPipe's false detections, and reaching up to 30% power saving in the best-case scenario.
Collapse
Affiliation(s)
- Marcos G. Alves
- School of Computing and Data Engineering, NingboTech University, Ningbo 315100, China; (G.-L.C.); (X.K.); (G.-H.S.)
| | | | | | | |
Collapse
|
6
|
Dang LM, Nadeem M, Nguyen TN, Park HY, Lee ON, Song HK, Moon H. VPBR: An Automatic and Low-Cost Vision-Based Biophysical Properties Recognition Pipeline for Pumpkin. PLANTS (BASEL, SWITZERLAND) 2023; 12:2647. [PMID: 37514261 PMCID: PMC10386610 DOI: 10.3390/plants12142647] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/18/2023] [Revised: 07/08/2023] [Accepted: 07/12/2023] [Indexed: 07/30/2023]
Abstract
Pumpkins are a nutritious and globally enjoyed fruit for their rich and earthy flavor. The biophysical properties of pumpkins play an important role in determining their yield. However, manual in-field techniques for monitoring these properties can be time-consuming and labor-intensive. To address this, this research introduces a novel approach that feeds high-resolution pumpkin images to train a mathematical model to automate the measurement of each pumpkin's biophysical properties. Color correction was performed on the dataset using a color-checker panel to minimize the impact of varying light conditions on the RGB images. A segmentation model was then trained to effectively recognize two fundamental components of each pumpkin: the fruit and vine. Real-life measurements of various biophysical properties, including fruit length, fruit width, stem length, stem width and fruit peel color, were computed and compared with manual measurements. The experimental results on 10 different pumpkin samples revealed that the framework obtained a small average mean absolute percentage error (MAPE) of 2.5% compared to the manual method, highlighting the potential of this approach as a faster and more efficient alternative to conventional techniques for monitoring the biophysical properties of pumpkins.
Collapse
Affiliation(s)
- L Minh Dang
- Department of Information and Communication Engineering, and Convergence Engineering for Intelligent Drone, Sejong University, Seoul 05006, Republic of Korea
| | - Muhammad Nadeem
- Department of Computer Science and Engineering, Sejong University, Seoul 05006, Republic of Korea
| | - Tan N Nguyen
- Department of Architectural Engineering, Sejong University, Seoul 05006, Republic of Korea
| | - Han Yong Park
- Department of Bioresource Engineering, Sejong University, Seoul 05006, Republic of Korea
| | - O New Lee
- Department of Bioresource Engineering, Sejong University, Seoul 05006, Republic of Korea
| | - Hyoung-Kyu Song
- Department of Information and Communication Engineering, and Convergence Engineering for Intelligent Drone, Sejong University, Seoul 05006, Republic of Korea
| | - Hyeonjoon Moon
- Department of Computer Science and Engineering, Sejong University, Seoul 05006, Republic of Korea
| |
Collapse
|
7
|
Wang T, Yamakawa Y. Edge-Supervised Linear Object Skeletonization for High-Speed Camera. SENSORS (BASEL, SWITZERLAND) 2023; 23:5721. [PMID: 37420888 DOI: 10.3390/s23125721] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/15/2023] [Revised: 06/16/2023] [Accepted: 06/17/2023] [Indexed: 07/09/2023]
Abstract
This paper presents a high-speed skeletonization algorithm for detecting the skeletons of linear objects from their binary images. The primary objective of our research is to achieve rapid extraction of the skeletons from binary images while maintaining accuracy for high-speed cameras. The proposed algorithm uses edge supervision and a branch detector to efficiently search inside the object, avoiding unnecessary computation on irrelevant pixels outside the object. Additionally, our algorithm addresses the challenge of self-intersections in linear objects with a branch detection module, which detects existing intersections and initializes new searches on emerging branches when necessary. Experiments on various binary images, such as numbers, ropes, and iron wires, demonstrated the reliability, accuracy, and efficiency of our approach. We compared the performance of our method with existing skeletonization techniques, showing its superiority in terms of speed, especially for larger image sizes.
Collapse
Affiliation(s)
- Taohan Wang
- Graduate School of Engineering, The University of Tokyo, Tokyo 113-8654, Japan
| | - Yuji Yamakawa
- Interfaculty Initiative in Information Studies, The University of Tokyo, Tokyo 113-8654, Japan
| |
Collapse
|
8
|
Ramakrishnan V, Schönmehl R, Artinger A, Winter L, Böck H, Schreml S, Gürtler F, Daza J, Schmitt VH, Mamilos A, Arbelaez P, Teufel A, Niedermair T, Topolcan O, Karlíková M, Sossalla S, Wiedenroth CB, Rupp M, Brochhausen C. 3D Visualization, Skeletonization and Branching Analysis of Blood Vessels in Angiogenesis. Int J Mol Sci 2023; 24:ijms24097714. [PMID: 37175421 PMCID: PMC10178731 DOI: 10.3390/ijms24097714] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/27/2023] [Revised: 04/20/2023] [Accepted: 04/21/2023] [Indexed: 05/15/2023] Open
Abstract
Angiogenesis is the process of new blood vessels growing from existing vasculature. Visualizing them as a three-dimensional (3D) model is a challenging, yet relevant, task as it would be of great help to researchers, pathologists, and medical doctors. A branching analysis on the 3D model would further facilitate research and diagnostic purposes. In this paper, a pipeline of vision algorithms is elaborated to visualize and analyze blood vessels in 3D from formalin-fixed paraffin-embedded (FFPE) granulation tissue sections with two different staining methods. First, a U-net neural network is used to segment blood vessels from the tissues. Second, image registration is used to align the consecutive images. Coarse registration using an image-intensity optimization technique, followed by finetuning using a neural network based on Spatial Transformers, results in an excellent alignment of images. Lastly, the corresponding segmented masks depicting the blood vessels are aligned and interpolated using the results of the image registration, resulting in a visualized 3D model. Additionally, a skeletonization algorithm is used to analyze the branching characteristics of the 3D vascular model. In summary, computer vision and deep learning is used to reconstruct, visualize and analyze a 3D vascular model from a set of parallel tissue samples. Our technique opens innovative perspectives in the pathophysiological understanding of vascular morphogenesis under different pathophysiological conditions and its potential diagnostic role.
Collapse
Affiliation(s)
- Vignesh Ramakrishnan
- Institute of Pathology, University of Regensburg, 93053 Regensburg, Germany
- Central Biobank Regensburg, University and University Hospital Regensburg, 93053 Regensburg, Germany
| | - Rebecca Schönmehl
- Institute of Pathology, University Medical Centre Mannheim, Heidelberg University, 68167 Mannheim, Germany
| | - Annalena Artinger
- Institute of Pathology, University Medical Centre Mannheim, Heidelberg University, 68167 Mannheim, Germany
| | - Lina Winter
- Institute of Pathology, University Medical Centre Mannheim, Heidelberg University, 68167 Mannheim, Germany
| | - Hendrik Böck
- Institute of Pathology, University Medical Centre Mannheim, Heidelberg University, 68167 Mannheim, Germany
| | - Stephan Schreml
- Department of Dermatology, University Medical Centre Regensburg, 93053 Regensburg, Germany
| | - Florian Gürtler
- Institute of Pathology, University of Regensburg, 93053 Regensburg, Germany
- Central Biobank Regensburg, University and University Hospital Regensburg, 93053 Regensburg, Germany
| | - Jimmy Daza
- Department of Internal Medicine II, Division of Hepatology, Medical Faculty Mannheim, Heidelberg University, 68167 Mannheim, Germany
| | - Volker H Schmitt
- Department of Cardiology, University Medical Centre, Johannes Gutenberg University of Mainz, 55131 Mainz, Germany
| | - Andreas Mamilos
- Institute of Pathology, University of Regensburg, 93053 Regensburg, Germany
- Central Biobank Regensburg, University and University Hospital Regensburg, 93053 Regensburg, Germany
| | - Pablo Arbelaez
- Center for Research and Formation in Artificial Intelligence (CinfonIA), Universidad de Los Andes, 111711 Bogota, Colombia
| | - Andreas Teufel
- Department of Internal Medicine II, Division of Hepatology, Medical Faculty Mannheim, Heidelberg University, 68167 Mannheim, Germany
| | - Tanja Niedermair
- Institute of Pathology, University of Regensburg, 93053 Regensburg, Germany
- Central Biobank Regensburg, University and University Hospital Regensburg, 93053 Regensburg, Germany
| | - Ondrej Topolcan
- Biomedical Center, Faculty of Medicine in Pilsen, Charles University, 32300 Pilsen, Czech Republic
| | - Marie Karlíková
- Biomedical Center, Faculty of Medicine in Pilsen, Charles University, 32300 Pilsen, Czech Republic
| | - Samuel Sossalla
- Department of Internal Medicine II, University Hospital Regensburg, 93053 Regensburg, Germany
| | | | - Markus Rupp
- Department of Trauma Surgery, University Medical Centre Regensburg, 93053 Regensburg, Germany
| | - Christoph Brochhausen
- Institute of Pathology, University of Regensburg, 93053 Regensburg, Germany
- Institute of Pathology, University Medical Centre Mannheim, Heidelberg University, 68167 Mannheim, Germany
| |
Collapse
|
9
|
Huang WF, Wang TN, Chuang PY, Chen HL. Development and Psychometric Evaluation of the Computer-Aided Measure of Chinese Handwriting Legibility (CAM-CHL) for School-Age Children. Am J Occup Ther 2023; 77:24024. [PMID: 36730106 DOI: 10.5014/ajot.2023.050075] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/03/2023] Open
Abstract
IMPORTANCE Handwriting legibility is the main criterion for determining whether a child has handwriting difficulties. A comprehensive assessment of handwriting legibility with sound psychometrics is essential to timely identification of handwriting difficulties and outcome measurement after handwriting interventions. OBJECTIVE To evaluate the psychometrics of the Computer-Aided Measure of Chinese Handwriting Legibility (CAM-CHL) and to investigate Chinese handwriting legibility in school-age children using the CAM-CHL. DESIGN Cross-sectional, repeated observation, test-retest. SETTING Elementary schools in Taiwan. PARTICIPANTS We recruited 25 lower-grade children for the examination of test-retest reliability, 75 children from all grade levels, and 10 senior schoolteachers for the examination of the CAM-CHL's convergent validity and the investigation of handwriting legibility. OUTCOMES AND MEASURES Children were asked to copy a set of Chinese characters as legibly as possible. We used the CAM-CHL to assess handwriting legibility in four domains: Size, Orientation, Position, and Deformation. The schoolteachers were asked to subjectively assess the handwriting legibility using a 3-point Likert-type scale. RESULTS The CAM-CHL demonstrated good to excellent test-retest reliability and acceptable random measurement error in all legibility domains. The CAM-CHL had fair to moderate convergent validity with schoolteachers' perceptions. Additionally, upper-grade children had better handwriting legibility in the Size and Position domains than lower-grade children. CONCLUSIONS AND RELEVANCE The CAM-CHL, a comprehensive and objective method of assessing Chinese handwriting legibility, has sound reliability and acceptable validity, suggesting its potential as an outcome measure for school-age children. What This Article Adds: The CAM-CHL can be used in comprehensive evaluations of Chinese handwriting legibility in school-age children. The CAM-CHL has acceptable psychometrics for use as an outcome measure.
Collapse
Affiliation(s)
- Wen-Feng Huang
- Wen-Feng Huang, BS, is PhD Candidate, School of Occupational Therapy, College of Medicine, National Taiwan University, Taipei, Taiwan
| | - Tien-Ni Wang
- Tien-Ni Wang, PhD, is Professor, School of Occupational Therapy, College of Medicine, National Taiwan University, Taipei, Taiwan, and Senior Occupational Therapist, Department of Physical Medicine and Rehabilitation, National Taiwan University Hospital, Taipei, Taiwan
| | - Po-Ya Chuang
- Po-Ya Chuang, MS, is Occupational Therapist, Tainan City Government Bureau of Education, Tainan, Taiwan
| | - Hao-Ling Chen
- Hao-Ling Chen, PhD, is Associate Professor, School of Occupational Therapy, College of Medicine, National Taiwan University, Taipei, Taiwan, and Senior Occupational Therapist, Department of Physical Medicine and Rehabilitation, National Taiwan University Hospital, Taipei, Taiwan;
| |
Collapse
|
10
|
Nadeem SA, Comellas AP, Hoffman EA, Saha PK. Airway Detection in COPD at Low-Dose CT Using Deep Learning and Multiparametric Freeze and Grow. Radiol Cardiothorac Imaging 2022; 4:e210311. [PMID: 36601453 PMCID: PMC9806731 DOI: 10.1148/ryct.210311] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/12/2021] [Revised: 09/27/2022] [Accepted: 10/27/2022] [Indexed: 06/17/2023]
Abstract
PURPOSE To present and validate a fully automated airway detection method at low-dose CT in patients with chronic obstructive pulmonary disease (COPD). MATERIALS AND METHODS In this retrospective study, deep learning (DL) and freeze-and-grow (FG) methods were optimized and applied to automatically detect airways at low-dose CT. Four data sets were used: two data sets consisting of matching standard- and low-dose CT scans from the Genetic Epidemiology of COPD (COPDGene) phase II (2014-2017) cohort (n = 2 × 236; mean age ± SD, 70 years ± 9; 123 women); one data set consisting of low-dose CT scans from the COPDGene phase III (2018-2020) cohort (n = 335; mean age ± SD, 73 years ± 8; 173 women); and one data set consisting of low-dose, anonymized CT scans from the 2003 Dutch-Belgian Randomized Lung Cancer Screening trial (n = 55) acquired by using different CT scanners. Performance measures for different methods were computed and compared by using the Wilcoxon signed rank test. RESULTS At low-dose CT, 56 294 of 62 480 (90.1%) airways of the reference total airway count (TAC) and 32 109 of 37 864 (84.8%) airways of the peripheral TAC (TACp), detected at standard-dose CT, were detected. Significant losses (P < .001) of 14 526 of 76 453 (19.0%) airways and 884 of 6908 (12.8%) airways in the TAC and 12 256 of 43 462 (28.2%) airways and 699 of 3882 (18.0%) airways in the TACp were observed, respectively, for the multiprotocol and multiscanner data without retraining. When using the automated low-dose CT method, TAC values of 347, 342, 323, and 266 and TACp values of 205, 202, 289, and 141 were observed for those who have never smoked and participants at Global Initiative for Chronic Obstructive Lung Disease stages 0, 1, and 2, respectively, which were superior to the respective values previously reported for matching groups when using a semiautomated method at standard-dose CT. CONCLUSION A low-cost, automated CT-based airway detection method was suitable for investigation of airway phenotypes at low-dose CT.Keywords: Airway, Airway Count, Airway Detection, Chronic Obstructive Pulmonary Disease, CT, Deep Learning, Generalizability, Low-Dose CT, Segmentation, Thorax, LungClinical trial registration no. NCT00608764 Supplemental material is available for this article. © RSNA, 2022.
Collapse
|
11
|
FIB-SEM tomography in catalysis and electrochemistry. Catal Today 2022. [DOI: 10.1016/j.cattod.2022.09.013] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/22/2022]
|
12
|
Strini A, Schiavi L. Euclidean Graphs as Crack Pattern Descriptors for Automated Crack Analysis in Digital Images. SENSORS (BASEL, SWITZERLAND) 2022; 22:5942. [PMID: 36015701 PMCID: PMC9414651 DOI: 10.3390/s22165942] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 07/06/2022] [Revised: 07/25/2022] [Accepted: 08/04/2022] [Indexed: 06/15/2023]
Abstract
Typical crack detection processes in digital images produce a binary-segmented image that constitutes the basis for all of the following analyses. Binary images are, however, an unsatisfactory data format for advanced crack analysis algorithms due to their sparse nature and lack of significant data structuring. Therefore, this work instead proposes a new approach based on Euclidean graphs as functional crack pattern descriptors for all post-detection analyses. Conveying both geometrical and topological information in an integrated representation, Euclidean graphs are an ideal structure for efficient crack path description, as they precisely locate the cracks on the original image and capture salient crack skeleton features. Several Euclidean graph-based algorithms for autonomous crack refining, correlation and analysis are described, with significant advantages in both their capabilities and implementation convenience over the traditional, binary image-based approach. Moreover, Euclidean graphs allow the autonomous selection of specific cracks or crack parts based on objective criteria. Well-known performance metrics, namely precision, recall, intersection over union and F1-score, have been adapted for use with Euclidean graphs. The automated generation of Euclidean graphs from binary-segmented images is also reported, enabling the application of this technique to most existing detection methods (e.g., threshold-based or neural network-based) for cracks and other curvilinear features in digital images.
Collapse
|
13
|
Mohammed AAH, Chen J. Cleanup Sketched Drawings: Deep Learning-Based Model. Appl Bionics Biomech 2022; 2022:2238077. [PMID: 35578715 PMCID: PMC9107365 DOI: 10.1155/2022/2238077] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/11/2022] [Revised: 03/07/2022] [Accepted: 03/30/2022] [Indexed: 11/22/2022] Open
Abstract
Rough drawings provide artists with a simple and efficient way to express shapes and ideas. Artists frequently use sketches to highlight their envisioned curves, using several groups' raw strokes. These rough sketches need enhancement to remove some subtle impurities and completely simplify curves over the sketched images. This research paper proposes using a fully convolutional network (FCNN) model to simplify rough raster drawings using deep learning. As input, the FCNN takes a sketch image of any size and automatically generates a high-quality simplified sketch image as output. Our model intuitively addresses the shortcomings in the rough sketch image, such as noises and unwanted background, as well as the low resolution of the rough sketch image. The FCNN model is trained by three raster image datasets, which are publicly available online. This paper demonstrates the efficiency and effectiveness of using deep learning in cleaning and improving the roughly drawn image in an automatic way. For evaluating the results, the mean squared error (MSE) metric was used. From experimental results, it was observed that an enhanced FCNN model reported better accuracy, reducing the prediction error by 0.08 percent for simplifying the rough sketch compared to the existing methods.
Collapse
Affiliation(s)
| | - Jiazhou Chen
- College of Computer Science and Technology, Zhejiang University of Technology, Hangzhou, China
| |
Collapse
|
14
|
Wang HJ, Chen LW, Lee HY, Chung YJ, Lin YT, Lee YC, Chen YC, Chen CM, Lin MW. Automated 3D Segmentation of the Aorta and Pulmonary Artery on Non-Contrast-Enhanced Chest Computed Tomography Images in Lung Cancer Patients. Diagnostics (Basel) 2022; 12:diagnostics12040967. [PMID: 35454015 PMCID: PMC9032785 DOI: 10.3390/diagnostics12040967] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/28/2022] [Revised: 04/07/2022] [Accepted: 04/09/2022] [Indexed: 12/19/2022] Open
Abstract
Pulmonary hypertension should be preoperatively evaluated for optimal surgical planning to reduce surgical risk in lung cancer patients. Preoperative measurement of vascular diameter in computed tomography (CT) images is a noninvasive prediction method for pulmonary hypertension. However, the current estimation method, 2D manual arterial diameter measurement, may yield inaccurate results owing to low tissue contrast in non-contrast-enhanced CT (NECT). Furthermore, it provides an incomplete evaluation by measuring only the diameter of the arteries rather than the volume. To provide a more complete and accurate estimation, this study proposed a novel two-stage deep learning (DL) model for 3D aortic and pulmonary artery segmentation in NECT. In the first stage, a DL model was constructed to enhance the contrast of NECT; in the second stage, two DL models then applied the enhanced images for aorta and pulmonary artery segmentation. Overall, 179 patients were divided into contrast enhancement model (n = 59), segmentation model (n = 120), and testing (n = 20) groups. The performance of the proposed model was evaluated using Dice similarity coefficient (DSC). The proposed model could achieve 0.97 ± 0.007 and 0.93 ± 0.002 DSC for aortic and pulmonary artery segmentation, respectively. The proposed model may provide 3D diameter information of the arteries before surgery, facilitating the estimation of pulmonary hypertension and supporting preoperative surgical method selection based on the predicted surgical risks.
Collapse
Affiliation(s)
- Hao-Jen Wang
- Department of Biomedical Engineering, College of Medicine and College of Engineering, National Taiwan University, Taipei 106, Taiwan; (H.-J.W.); (L.-W.C.); (Y.-J.C.); (Y.-T.L.); (Y.-C.C.)
| | - Li-Wei Chen
- Department of Biomedical Engineering, College of Medicine and College of Engineering, National Taiwan University, Taipei 106, Taiwan; (H.-J.W.); (L.-W.C.); (Y.-J.C.); (Y.-T.L.); (Y.-C.C.)
| | - Hsin-Ying Lee
- Department of Medicine, National Taiwan University, Taipei 100, Taiwan; (H.-Y.L.); (Y.-C.L.)
| | - Yu-Jung Chung
- Department of Biomedical Engineering, College of Medicine and College of Engineering, National Taiwan University, Taipei 106, Taiwan; (H.-J.W.); (L.-W.C.); (Y.-J.C.); (Y.-T.L.); (Y.-C.C.)
| | - Yan-Ting Lin
- Department of Biomedical Engineering, College of Medicine and College of Engineering, National Taiwan University, Taipei 106, Taiwan; (H.-J.W.); (L.-W.C.); (Y.-J.C.); (Y.-T.L.); (Y.-C.C.)
| | - Yi-Chieh Lee
- Department of Medicine, National Taiwan University, Taipei 100, Taiwan; (H.-Y.L.); (Y.-C.L.)
| | - Yi-Chang Chen
- Department of Biomedical Engineering, College of Medicine and College of Engineering, National Taiwan University, Taipei 106, Taiwan; (H.-J.W.); (L.-W.C.); (Y.-J.C.); (Y.-T.L.); (Y.-C.C.)
| | - Chung-Ming Chen
- Department of Biomedical Engineering, College of Medicine and College of Engineering, National Taiwan University, Taipei 106, Taiwan; (H.-J.W.); (L.-W.C.); (Y.-J.C.); (Y.-T.L.); (Y.-C.C.)
- Correspondence: (C.-M.C.); (M.-W.L.)
| | - Mong-Wei Lin
- Department of Surgery, National Taiwan University Hospital and National Taiwan University College of Medicine, Taipei 100, Taiwan
- Correspondence: (C.-M.C.); (M.-W.L.)
| |
Collapse
|
15
|
Techniques and Algorithms for Hepatic Vessel Skeletonization in Medical Images: A Survey. ENTROPY 2022; 24:e24040465. [PMID: 35455128 PMCID: PMC9031516 DOI: 10.3390/e24040465] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 02/28/2022] [Revised: 03/21/2022] [Accepted: 03/23/2022] [Indexed: 02/01/2023]
Abstract
Hepatic vessel skeletonization serves as an important means of hepatic vascular analysis and vessel segmentation. This paper presents a survey of techniques and algorithms for hepatic vessel skeletonization in medical images. We summarized the latest developments and classical approaches in this field. These methods are classified into five categories according to their methodological characteristics. The overview and brief assessment of each category are provided in the corresponding chapters, respectively. We provide a comprehensive summary among the cited publications, image modalities and datasets from various aspects, which hope to reveal the pros and cons of every method, summarize its achievements and discuss the challenges and future trends.
Collapse
|
16
|
Li L, Wang W, Chu Y. A Simple and Stable Centeredness Measure for 3D Curve Skeleton Extraction. IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS 2022; 28:1486-1499. [PMID: 32822298 DOI: 10.1109/tvcg.2020.3018483] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/11/2023]
Abstract
Existing methods for extracting 3D curve skeletons mostly suffer from the difficulty of finding the center points of 3D shapes and tedious manual adjustments of the thresholds for pruning spurious branches due to the influence of shape boundary perturbations. In this article, we present a method based on medial surfaces of 3D shapes for the convenient and fast extraction of high-quality curve skeletons. Our main contribution is a simple and stable centeredness measure. It is based on simulating fire propagation via the scheme of inside-out evolution from the interior to the boundary, differentiating it from existing methods that use the scheme of outside-in evolution from the boundary to the interior. Thus, our measure is much more localized, and it can be implemented with a high degree of parallelism. In addition, we propose measures to effectively suppress the influence of details to obtain a stable measurement, and employ minimum set covers to optimize the center points to generate compact skeletons, which enables spurious branches to be effectively excluded without the tedious work of manually adjusting thresholds. Our experiments show the superiority of our method over existing methods, including its convenient generation of clean, compact and centered curve skeletons while running much faster than state-of-the-art methods.
Collapse
|
17
|
Representing living architecture through skeleton reconstruction from point clouds. Sci Rep 2022; 12:1549. [PMID: 35091577 PMCID: PMC8799686 DOI: 10.1038/s41598-022-05194-y] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/11/2021] [Accepted: 01/06/2022] [Indexed: 11/21/2022] Open
Abstract
Living architecture, changing in structure with annual growth, requires precise, regular characterisation. However, its geometric irregularity and topological complexity make documentation using traditional methods difficult and presents challenges in creating useful models for mechanical and physiological analyses. Two kinds of living architecture are examined: historic living root bridges grown in Meghalaya, India, and contemporary ‘Baubotanik’ structures designed and grown in Germany. These structures exhibit common features, in particular network-like structures of varying complexity that result from inosculations between shoots or roots. As an answer to this modelling challenge, we present the first extensive documentation of living architecture using photogrammetry and a subsequent skeleton extraction workflow that solves two problems related to the anastomoses and varying nearby elements specific to living architecture. Photogrammetry was used as a low cost method, supplying detailed point clouds of the structures’ visible surfaces. A workflow based on voxel-thinning (using deletion templates and adjusted p-simplicity criteria) provides efficient, accurate skeletons. A volume reconstruction method is derived from the thinning process. The workflow is assessed on seven characteristics beneficial in representing living architecture in comparison with alternative skeleton extraction methods. The resulting models are ready for use in analytical tools, necessary for functional, responsible design.
Collapse
|
18
|
Landslide Trail Extraction Using Fire Extinguishing Model. REMOTE SENSING 2022. [DOI: 10.3390/rs14020308] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/10/2022]
Abstract
Landslide trails are important elements of landslide inventory maps, providing valuable information for landslide risk and hazard assessment. Compared with traditional manual mapping, skeletonization methods offer a more cost-efficient way to map landslide trails, by automatically generating centerlines from landslide polygons. However, a challenge to existing skeletonization methods is that expert knowledge and manual intervention are required to obtain a branchless skeleton, which limits the applicability of these methods. To address this problem, a new workflow for landslide trail extraction (LTE) is proposed in this study. To avoid generating redundant branches and to improve the degree of automation, two endpoints, i.e., the crown point and the toe point, of the trail were determined first, with reference to the digital elevation model. Thus, a fire extinguishing model (FEM) is proposed to generate skeletons without redundant branches. Finally, the effectiveness of the proposed method is verified, by extracting landslide trails from landslide polygons of various shapes and sizes, in two study areas. Experimental results show that, compared with the traditional grassfire model-based skeletonization method, the proposed FEM is capable of obtaining landslide trails without spurious branches. More importantly, compared with the baseline method in our previous work, the proposed LTE workflow can avoid problems including incompleteness, low centrality, and direction errors. This method requires no parameter tuning and yields excellent performance, and is thus highly valuable for practical landslide mapping.
Collapse
|
19
|
Lee S, Ha H, Bae KT, Kim S, Choi H, Lee J, Kim JH, Seo J, Choi JS, Jo YR, Kim BJ, Yang Y, Lee KT, Kim HY, Jung W. A measure of active interfaces in supported catalysts for high-temperature reactions. Chem 2021. [DOI: 10.1016/j.chempr.2021.11.024] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/03/2022]
|
20
|
Ma J, Ren X, Tsviatkou VY, Kanapelka VK. A novel fully parallel skeletonization algorithm. Pattern Anal Appl 2021. [DOI: 10.1007/s10044-021-01039-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/19/2022]
|
21
|
Immink JN, Maris JJE, Capellmann RF, Egelhaaf SU, Schurtenberger P, Stenhammar J. ArGSLab: a tool for analyzing experimental or simulated particle networks. SOFT MATTER 2021; 17:8354-8362. [PMID: 34550148 PMCID: PMC8457054 DOI: 10.1039/d1sm00692d] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 05/10/2021] [Accepted: 08/20/2021] [Indexed: 06/13/2023]
Abstract
Microscopy and particle-based simulations are both powerful techniques to study aggregated particulate matter such as colloidal gels. The data provided by these techniques often contains information on a wide array of length scales, but structural analysis methods typically focus on the local particle arrangement, even though the data also contains information about the particle network on the mesoscopic length scale. In this paper, we present a MATLAB software package for quantifying mesoscopic network structures in colloidal samples. ArGSLab (Arrested and Gelated Structures Laboratory) extracts a network backbone from the input data, which is in turn transformed into a set of nodes and links for graph theory-based analysis. The routines can process both image stacks from microscopy as well as explicit coordinate data, and thus allows quantitative comparison between simulations and experiments. ArGSLab furthermore enables the accurate analysis of microscopy data where, e.g., an extended point spread function prohibits the resolution of individual particles. We demonstrate the resulting output for example datasets from both microscopy and simulation of colloidal gels, in order to showcase the capability of ArGSLab to quantitatively analyze data from various sources. The freely available software package can be used either with a provided graphical user interface or directly as a MATLAB script.
Collapse
Affiliation(s)
- Jasper N Immink
- Condensed Matter Physics Laboratory, Heinrich-Heine-University Düsseldorf, Düsseldorf, Germany.
- Division of Physical Chemistry, Lund University, Lund, Sweden
| | - J J Erik Maris
- Inorganic Chemistry and Catalysis Group, Utrecht University, Utrecht, The Netherlands
| | - Ronja F Capellmann
- Condensed Matter Physics Laboratory, Heinrich-Heine-University Düsseldorf, Düsseldorf, Germany.
| | - Stefan U Egelhaaf
- Condensed Matter Physics Laboratory, Heinrich-Heine-University Düsseldorf, Düsseldorf, Germany.
| | - Peter Schurtenberger
- Division of Physical Chemistry, Lund University, Lund, Sweden
- Lund Institute of advanced Neutron and X-ray Science (LINXS), Lund University, Lund, Sweden
| | | |
Collapse
|
22
|
Wang J, Kosinka J, Telea A. Spline-Based Dense Medial Descriptors for Lossy Image Compression. J Imaging 2021; 7:jimaging7080153. [PMID: 34460789 PMCID: PMC8404928 DOI: 10.3390/jimaging7080153] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/30/2021] [Revised: 08/08/2021] [Accepted: 08/16/2021] [Indexed: 11/16/2022] Open
Abstract
Medial descriptors are of significant interest for image simplification, representation, manipulation, and compression. On the other hand, B-splines are well-known tools for specifying smooth curves in computer graphics and geometric design. In this paper, we integrate the two by modeling medial descriptors with stable and accurate B-splines for image compression. Representing medial descriptors with B-splines can not only greatly improve compression but is also an effective vector representation of raster images. A comprehensive evaluation shows that our Spline-based Dense Medial Descriptors (SDMD) method achieves much higher compression ratios at similar or even better quality to the well-known JPEG technique. We illustrate our approach with applications in generating super-resolution images and salient feature preserving image compression.
Collapse
Affiliation(s)
- Jieying Wang
- Faculty of Science and Engineering, University of Groningen, 9747 AG Groningen, The Netherlands;
- Correspondence:
| | - Jiří Kosinka
- Faculty of Science and Engineering, University of Groningen, 9747 AG Groningen, The Netherlands;
| | - Alexandru Telea
- Department of Information and Computing Science, Utrecht University, 3584 CC Utrecht, The Netherlands;
| |
Collapse
|
23
|
A 2D and 3D discrete bisector function based on annulus. Pattern Anal Appl 2021. [DOI: 10.1007/s10044-021-00973-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/21/2022]
|
24
|
Selbach L, Kowalski T, Gerwert K, Buchin M, Mosig A. Shape decomposition algorithms for laser capture microdissection. Algorithms Mol Biol 2021; 16:15. [PMID: 34238311 PMCID: PMC8265035 DOI: 10.1186/s13015-021-00193-6] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/03/2021] [Accepted: 06/21/2021] [Indexed: 11/30/2022] Open
Abstract
Background In the context of biomarker discovery and molecular characterization of diseases, laser capture microdissection is a highly effective approach to extract disease-specific regions from complex, heterogeneous tissue samples. For the extraction to be successful, these regions have to satisfy certain constraints in size and shape and thus have to be decomposed into feasible fragments. Results We model this problem of constrained shape decomposition as the computation of optimal feasible decompositions of simple polygons. We use a skeleton-based approach and present an algorithmic framework that allows the implementation of various feasibility criteria as well as optimization goals. Motivated by our application, we consider different constraints and examine the resulting fragmentations. We evaluate our algorithm on lung tissue samples in comparison to a heuristic decomposition approach. Our method achieved a success rate of over 95% in the microdissection and tissue yield was increased by 10–30%. Conclusion We present a novel approach for constrained shape decomposition by demonstrating its advantages for the application in the microdissection of tissue samples. In comparison to the previous decomposition approach, the proposed method considerably increases the amount of successfully dissected tissue.
Collapse
|
25
|
Jin G, Kwon O. Impact of chart image characteristics on stock price prediction with a convolutional neural network. PLoS One 2021; 16:e0253121. [PMID: 34161352 PMCID: PMC8221485 DOI: 10.1371/journal.pone.0253121] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/17/2020] [Accepted: 06/01/2021] [Indexed: 11/21/2022] Open
Abstract
Stock price prediction has long been the subject of research because of the importance of accuracy of prediction and the difficulty in forecasting. Traditionally, forecasting has involved linear models such as AR and MR or nonlinear models such as ANNs using standardized numerical data such as corporate financial data and stock price data. Due to the difficulty of securing a sufficient variety of data, researchers have recently begun using convolutional neural networks (CNNs) with stock price graph images only. However, we know little about which characteristics of stock charts affect the accuracy of predictions and to what extent. The purpose of this study is to analyze the effects of stock chart characteristics on stock price prediction via CNNs. To this end, we define the image characteristics of stock charts and identify significant differences in prediction performance for each characteristic. The results reveal that the accuracy of prediction is improved by utilizing solid lines, color, and a single image without axis marks. Based on these findings, we describe the implications of making predictions only with images, which are unstructured data, without using large amounts of standardized data. Finally, we identify issues for future research.
Collapse
Affiliation(s)
- Guangxun Jin
- Department of Management, Kyung Hee University, Seoul, South Korea
| | - Ohbyung Kwon
- School of Management, Kyung Hee University, Seoul, South Korea
| |
Collapse
|
26
|
Sands GB, Ashton JL, Trew ML, Baddeley D, Walton RD, Benoist D, Efimov IR, Smith NP, Bernus O, Smaill BH. It's clearly the heart! Optical transparency, cardiac tissue imaging, and computer modelling. PROGRESS IN BIOPHYSICS AND MOLECULAR BIOLOGY 2021; 168:18-32. [PMID: 34126113 DOI: 10.1016/j.pbiomolbio.2021.06.005] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 02/18/2021] [Revised: 05/10/2021] [Accepted: 06/07/2021] [Indexed: 12/19/2022]
Abstract
Recent developments in clearing and microscopy enable 3D imaging with cellular resolution up to the whole organ level. These methods have been used extensively in neurobiology, but their uptake in other fields has been much more limited. Application of this approach to the human heart and effective use of the data acquired present challenges of scale and complexity. Four interlinked issues need to be addressed: 1) efficient clearing and labelling of heart tissue, 2) fast microscopic imaging of human-scale samples, 3) handling and processing of multi-terabyte 3D images, and 4) extraction of structural information in computationally tractable structure-based models of cardiac function. Preliminary studies show that each of these requirements can be achieved with the appropriate application and development of existing technologies.
Collapse
Affiliation(s)
- Gregory B Sands
- Auckland Bioengineering Institute, The University of Auckland, Auckland, New Zealand.
| | - Jesse L Ashton
- Auckland Bioengineering Institute, The University of Auckland, Auckland, New Zealand
| | - Mark L Trew
- Auckland Bioengineering Institute, The University of Auckland, Auckland, New Zealand
| | - David Baddeley
- Auckland Bioengineering Institute, The University of Auckland, Auckland, New Zealand; Department of Cell Biology, Yale University, New Haven CT, 06520, USA
| | - Richard D Walton
- IHU Liryc, Fondation Bordeaux Université, Bordeaux, France; Univ. Bordeaux, Inserm, Centre de Recherche Cardio-Thoracique, U1045, 33000, Bordeaux, France
| | - David Benoist
- IHU Liryc, Fondation Bordeaux Université, Bordeaux, France; Univ. Bordeaux, Inserm, Centre de Recherche Cardio-Thoracique, U1045, 33000, Bordeaux, France
| | - Igor R Efimov
- IHU Liryc, Fondation Bordeaux Université, Bordeaux, France; Department of Biomedical Engineering, The George Washington University, Washington DC, 20052, USA
| | - Nicolas P Smith
- Auckland Bioengineering Institute, The University of Auckland, Auckland, New Zealand; Queensland University of Technology, Brisbane 4000, Australia
| | - Olivier Bernus
- IHU Liryc, Fondation Bordeaux Université, Bordeaux, France; Univ. Bordeaux, Inserm, Centre de Recherche Cardio-Thoracique, U1045, 33000, Bordeaux, France
| | - Bruce H Smaill
- Auckland Bioengineering Institute, The University of Auckland, Auckland, New Zealand
| |
Collapse
|
27
|
Saha PK, Oweis RR, Zhang X, Letuchy E, Eichenberger-Gilmore JM, Burns TL, Warren JJ, Janz KF, Torner JC, Snetselaar LG, Levy SM. Effects of fluoride intake on cortical and trabecular bone microstructure at early adulthood using multi-row detector computed tomography (MDCT). Bone 2021; 146:115882. [PMID: 33578032 PMCID: PMC8009824 DOI: 10.1016/j.bone.2021.115882] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 10/21/2020] [Revised: 01/28/2021] [Accepted: 02/07/2021] [Indexed: 11/18/2022]
Abstract
PURPOSE The aim of this study was to examine the effects of period-specific and cumulative fluoride (F) intake on bone at the levels of cortical and trabecular bone microstructural outcomes at early adulthood using emerging multi-row detector computed tomography (MDCT)-based novel techniques. METHODS Ultra-high resolution MDCT distal tibia scans were collected at age 19 visits under the Iowa Bone Development Study (IBDS), and cortical and trabecular bone microstructural outcomes were computed at the distal tibia using previously validated methods. CT scans of a tissue characterization phantom were used to calibrate CT numbers (Hounsfield units) into bone mineral density (mg/cc). Period-specific and cumulative F intakes from birth up to the age of 19 years were assessed for IBDS participants through questionnaire, and their relationships with MDCT-derived bone microstructural outcomes were examined using bivariable and multivariable analyses, adjusting for height, weight, maturity offset (years since age of peak height velocity (PHV)), physical activity (questionnaire for adolescents (PAQ-A)), healthy eating index version 2010 (HEI-2010) scores, and calcium and protein intakes. RESULTS MDCT distal tibia scans were acquired for 324 participants from among the total of 329 participants at age 19 visits. No motion artifacts were observed in any MDCT scans, and all images were successfully processed to measure cortical and trabecular bone microstructural outcomes. At early adulthood, males were observed to have stronger trabecular bone microstructural features, as well as thicker cortical bone (p < 0.01), as compared to age-similar females; however, females were found to have less cortical bone porosity as compared to males. Among participants with available F intake estimates (75 to 91% of the 324 with MDCT scans, depending on the period-specific F intake measure), no statistically significant associations were detected between any period-specific or cumulative F intake and bone microstructural outcomes of the tibia at the p < 0.01 level. Only for females, statistically suggestive associations (p < 0.05) were found between recent F intake (from 14 to 19 years) and trabecular mean plate width and trabecular thickness at the tibia. Those associations became somewhat weaker, but still statistically suggestive, for trabecular thickness in fully adjusted analysis with height, weight, PHV, calcium and protein intake, and HEI-2010 and PAQ-A scores as covariates. CONCLUSION The findings show that the effects of lifelong or period-specific F intake from combined sources for adolescents typical to the United States Midwest region are not strongly associated with bone microstructural outcomes at age 19 years. These findings are generally consistent with previously reported results of IBDS analyses, which further confirms that effects of lifelong or period-specific F intake on skeletons in early adulthood are absent or weak, even at the levels of cortical and trabecular bone microstructural details.
Collapse
Affiliation(s)
- Punam K Saha
- Department of Electrical and Computer Engineering, College of Engineering, The University of Iowa, Iowa City, IA, USA; Department of Radiology, Carver College of Medicine, The University of Iowa, Iowa City, IA, USA.
| | - Reem Reda Oweis
- Department of Preventive and Community Dentistry, College of Dentistry, Iowa City, IA, USA
| | - Xiaoliu Zhang
- Department of Electrical and Computer Engineering, College of Engineering, The University of Iowa, Iowa City, IA, USA
| | - Elena Letuchy
- Department of Epidemiology, College of Public Health, Iowa City, IA, USA
| | - Julie M Eichenberger-Gilmore
- Department of Epidemiology, College of Public Health, Iowa City, IA, USA; Formerly with Department of Preventive and Community Dentistry, College of Dentistry, Iowa City, IA, USA; Nutrition and Food Services, Iowa City VA Health Care System, Iowa City, IA, USA
| | - Trudy L Burns
- Department of Epidemiology, College of Public Health, Iowa City, IA, USA
| | - John J Warren
- Department of Preventive and Community Dentistry, College of Dentistry, Iowa City, IA, USA
| | - Kathleen F Janz
- Department of Health and Human Physiology, College of Liberal Arts and Sciences, Iowa City, IA, USA
| | - James C Torner
- Department of Epidemiology, College of Public Health, Iowa City, IA, USA
| | - Linda G Snetselaar
- Department of Epidemiology, College of Public Health, Iowa City, IA, USA
| | - Steven M Levy
- Department of Preventive and Community Dentistry, College of Dentistry, Iowa City, IA, USA; Department of Epidemiology, College of Public Health, Iowa City, IA, USA
| |
Collapse
|
28
|
Ke W, Chen J, Jiao J, Zhao G, Ye Q. SRN: Side-Output Residual Network for Object Reflection Symmetry Detection and Beyond. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS 2021; 32:1881-1895. [PMID: 32481230 DOI: 10.1109/tnnls.2020.2994325] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/11/2023]
Abstract
This article establishes a baseline for object reflection symmetry detection in natural images by releasing a new benchmark named Sym-PASCAL and proposing an end-to-end deep learning approach for reflection symmetry. Sym-PASCAL spans challenges of multiobjects, object diversity, part invisibility, and clustered backgrounds, which is far beyond those in existing data sets. The end-to-end deep learning approach, referred to as a side-output residual network (SRN), leverages the output residual units (RUs) to fit the errors between the symmetry ground truth and the side outputs of multiple stages of a trunk network. By cascading RUs from deep to shallow, SRN exploits the "flow" of errors along multiple stages to effectively matching object symmetry at different scales and suppress the clustered backgrounds. SRN is interpreted as a boosting-like algorithm, which assembles features using RUs during network forward and backward propagations. SRN is further upgraded to a multitask SRN (MT-SRN) for joint symmetry and edge detection, demonstrating its generality to image-to-mask learning tasks. Experimental results verify that the Sym-PASCAL benchmark is challenging related to real-world images, SRN achieves state-of-the-art performance, and MT-SRN has the capability to simultaneously predict edge and symmetry mask without loss of performance.
Collapse
|
29
|
A Propagated Skeleton Approach to High Throughput Screening of Neurite Outgrowth for In Vitro Parkinson's Disease Modelling. Cells 2021; 10:cells10040931. [PMID: 33920556 PMCID: PMC8072564 DOI: 10.3390/cells10040931] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/01/2021] [Revised: 04/12/2021] [Accepted: 04/13/2021] [Indexed: 11/16/2022] Open
Abstract
Neuronal models of neurodegenerative diseases such as Parkinson's Disease (PD) are extensively studied in pathological and therapeutical research with neurite outgrowth being a core feature. Screening of neurite outgrowth enables characterization of various stimuli and therapeutic effects after lesion. In this study, we describe an autonomous computational assay for a high throughput skeletonization approach allowing for quantification of neurite outgrowth in large data sets from fluorescence microscopic imaging. Development and validation of the assay was conducted with differentiated SH-SY5Y cells and primary mesencephalic dopaminergic neurons (MDN) treated with the neurotoxic lesioning compound Rotenone. Results of manual annotation using NeuronJ and automated data were shown to correlate strongly (R2-value 0.9077 for SH-SY5Y cells and R2-value 0.9297 for MDN). Pooled linear regressions of results from SH-SY5Y cell image data could be integrated into an equation formula (y=0.5410·x+1792; y=0.8789·x+0.09191 for normalized results) with y depicting automated and x depicting manual data. This automated neurite length algorithm constitutes a valuable tool for modelling of neurite outgrowth that can be easily applied to evaluate therapeutic compounds with high throughput approaches.
Collapse
|
30
|
Xue J, He K, Nie D, Adeli E, Shi Z, Lee SW, Zheng Y, Liu X, Li D, Shen D. Cascaded MultiTask 3-D Fully Convolutional Networks for Pancreas Segmentation. IEEE TRANSACTIONS ON CYBERNETICS 2021; 51:2153-2165. [PMID: 31869812 DOI: 10.1109/tcyb.2019.2955178] [Citation(s) in RCA: 18] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/10/2023]
Abstract
Automatic pancreas segmentation is crucial to the diagnostic assessment of diabetes or pancreatic cancer. However, the relatively small size of the pancreas in the upper body, as well as large variations of its location and shape in retroperitoneum, make the segmentation task challenging. To alleviate these challenges, in this article, we propose a cascaded multitask 3-D fully convolution network (FCN) to automatically segment the pancreas. Our cascaded network is composed of two parts. The first part focuses on fast locating the region of the pancreas, and the second part uses a multitask FCN with dense connections to refine the segmentation map for fine voxel-wise segmentation. In particular, our multitask FCN with dense connections is implemented to simultaneously complete tasks of the voxel-wise segmentation and skeleton extraction from the pancreas. These two tasks are complementary, that is, the extracted skeleton provides rich information about the shape and size of the pancreas in retroperitoneum, which can boost the segmentation of pancreas. The multitask FCN is also designed to share the low- and mid-level features across the tasks. A feature consistency module is further introduced to enhance the connection and fusion of different levels of feature maps. Evaluations on two pancreas datasets demonstrate the robustness of our proposed method in correctly segmenting the pancreas in various settings. Our experimental results outperform both baseline and state-of-the-art methods. Moreover, the ablation study shows that our proposed parts/modules are critical for effective multitask learning.
Collapse
|
31
|
Zhang X, Comellas AP, Regan EA, Guha I, Shibli-Rahhal A, Rubin MR, DiCamillo PA, Letuchy EM, Barr RG, Hoffman EA, Saha PK. Quantitative CT-Based Methods for Bone Microstructural Measures and Their Relationships With Vertebral Fractures in a Pilot Study on Smokers. JBMR Plus 2021; 5:e10484. [PMID: 33977202 PMCID: PMC8101620 DOI: 10.1002/jbm4.10484] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 02/14/2021] [Accepted: 02/23/2021] [Indexed: 11/05/2022] Open
Abstract
Osteoporosis causes fragile bone, and bone microstructural quality is a critical determinant of bone strength and fracture risk. This study pursues technical validation of novel CT-based methods for assessment of peripheral bone microstructure together with a human pilot study examining relationships between bone microstructure and vertebral fractures in smokers. To examine the accuracy and reproducibility of the methods, repeat ultra-high-resolution (UHR) CT and micro-CT scans of cadaveric ankle specimens were acquired. Thirty smokers from the University of Iowa COPDGene cohort were recruited at their 5-year follow-up visits. Chest CT scans, collected under the parent study, were used to assess vertebral fractures. UHR CT scans of distal tibia were acquired for this pilot study to obtain peripheral cortical and trabecular bone (Cb and Tb) measures. UHR CT-derived Tb measures, including volumetric bone mineral density (BMD), network area, transverse trabecular density, and mean plate width, showed high correlation (r > 0.901) with their micro-CT-derived values over small regions of interest (ROIs). Both Cb and Tb measures showed high reproducibility-intra-class correlation (ICC) was greater than 0.99 for all Tb measures except erosion index and greater than 0.97 for all Cb measures. Female sex was associated with lower transverse Tb density (p < 0.1), higher Tb spacing (p < 0.05), and lower cortical thickness (p < 0.001). Participants with vertebral fractures had significantly degenerated values (p < 0.05) for all Tb measures except thickness. There were no statistically significant differences for Cb measures between non-fracture and fracture groups. Vertebral fracture-group differences of Tb measures remained significant after adjustment with chronic obstructive pulmonary disease (COPD) status. Although current smokers at baseline had more fractures-81.8% versus 63.2% for former smokers-the difference was not statistically significant. This pilot cross-sectional human study demonstrates CT-based peripheral bone microstructural differences among smokers with and without vertebral fractures. © 2021 The Authors. JBMR Plus published by Wiley Periodicals, Inc. on behalf of American Society for Bone and Mineral Research. © 2021 The Authors. JBMR Plus published by Wiley Periodicals LLC on behalf of American Society for Bone and Mineral Research.
Collapse
Affiliation(s)
- Xiaoliu Zhang
- Department of Electrical and Computer Engineering, College of Engineering University of Iowa Iowa City IA USA
| | - Alejandro P Comellas
- Department of Internal Medicine, Carver College of Medicine University of Iowa Iowa City IA USA
| | - Elizabeth A Regan
- Division of Rheumatology, Department of Medicine National Jewish Health Denver CO USA
| | - Indranil Guha
- Department of Electrical and Computer Engineering, College of Engineering University of Iowa Iowa City IA USA
| | - Amal Shibli-Rahhal
- Department of Internal Medicine, Carver College of Medicine University of Iowa Iowa City IA USA
| | - Mishaela R Rubin
- Department of Clinical Medicine Columbia University New York NY USA
| | - Paul A DiCamillo
- Department of Radiology, Carver College of Medicine University of Iowa Iowa City IA USA
| | - Elena M Letuchy
- Department of Epidemiology, College of Public Health University of Iowa Iowa City IA USA
| | - R Graham Barr
- Department of Medicine Columbia University New York NY USA
| | - Eric A Hoffman
- Department of Radiology, Carver College of Medicine University of Iowa Iowa City IA USA.,Department of Biomedical Engineering, College of Engineering University of Iowa Iowa City IA USA
| | - Punam K Saha
- Department of Electrical and Computer Engineering, College of Engineering University of Iowa Iowa City IA USA.,Department of Radiology, Carver College of Medicine University of Iowa Iowa City IA USA
| |
Collapse
|
32
|
Inoue K, Kuniyoshi Y, Kagaya K, Nakajima K. Skeletonizing the Dynamics of Soft Continuum Body from Video. Soft Robot 2021; 9:201-211. [PMID: 33601962 PMCID: PMC9057898 DOI: 10.1089/soro.2020.0110] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/30/2022] Open
Abstract
Soft continuum bodies have demonstrated their effectiveness in generating flexible and adaptive functionalities by capitalizing on the rich deformability of soft material. Compared with a rigid-body robot, it is in general difficult to model and emulate the morphology dynamics of a soft continuum body. In addition, a soft continuum body potentially has an infinite degree of freedom, requiring considerable labor to manually annotate its dynamics from external sensory data such as video. In this study, we propose a novel noninvasive framework for automatically extracting the skeletal dynamics from video of a soft continuum body and show the applications and effectiveness of our framework. First, we demonstrate that our framework can extract skeletal dynamics from animal videos, which can be effectively utilized for the analysis of soft continuum body including animal motion. Next, we focus on a soft continuum arm, a commonly used platform in soft robotics, and evaluate the potential information-processing capability. Normally, to control such a high-dimensional system, it is necessary to introduce many sensors to completely capture the motion dynamics, causing the deterioration of the material's softness. We illustrate that the evaluation of the memory capacity and sensory reconstruction error enables us to verify the minimum number of sensors sufficient for fully grasping the state dynamics, which is highly useful in designing a sensor arrangement for a soft robot. Also, we release the software developed in this study as open source for biology and soft robotics communities, which contributes to automating the annotation process required for the motion analysis of soft continuum bodies.
Collapse
Affiliation(s)
- Katsuma Inoue
- Graduate School of Information Science and Technology, The University of Tokyo, Tokyo, Japan
| | - Yasuo Kuniyoshi
- Graduate School of Information Science and Technology, The University of Tokyo, Tokyo, Japan
| | - Katsushi Kagaya
- Graduate School of Information Science and Technology, The University of Tokyo, Tokyo, Japan
| | - Kohei Nakajima
- Graduate School of Information Science and Technology, The University of Tokyo, Tokyo, Japan
| |
Collapse
|
33
|
Jerripothula KR, Cai J, Lu J, Yuan J. Image Co-Skeletonization via Co-Segmentation. IEEE TRANSACTIONS ON IMAGE PROCESSING : A PUBLICATION OF THE IEEE SIGNAL PROCESSING SOCIETY 2021; 30:2784-2797. [PMID: 33523810 DOI: 10.1109/tip.2021.3054464] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/12/2023]
Abstract
Recent advances in the joint processing of a set of images have shown its advantages over individual processing. Unlike the existing works geared towards co-segmentation or co-localization, in this article, we explore a new joint processing topic: image co-skeletonization, which is defined as joint skeleton extraction of the foreground objects in an image collection. It is well known that object skeletonization in a single natural image is challenging, because there is hardly any prior knowledge available about the object present in the image. Therefore, we resort to the idea of image co-skeletonization, hoping that the commonness prior that exists across the semantically similar images can be leveraged to have such knowledge, similar to other joint processing problems such as co-segmentation. Moreover, earlier research has found that augmenting a skeletonization process with the object's shape information is highly beneficial in capturing the image context. Having made these two observations, we propose a coupled framework for co-skeletonization and co-segmentation tasks to facilitate shape information discovery for our co-skeletonization process through the co-segmentation process. While image co-skeletonization is our primary goal, the co-segmentation process might also benefit, in turn, from exploiting skeleton outputs of the co-skeletonization process as central object seeds through such a coupled framework. As a result, both can benefit from each other synergistically. For evaluating image co-skeletonization results, we also construct a novel benchmark dataset by annotating nearly 1.8 K images and dividing them into 38 semantic categories. Although the proposed idea is essentially a weakly supervised method, it can also be employed in supervised and unsupervised scenarios. Extensive experiments demonstrate that the proposed method achieves promising results in all three scenarios.
Collapse
|
34
|
Yang F, Li X, Shen J. MSB-FCN: Multi-Scale Bidirectional FCN for Object Skeleton Extraction. IEEE TRANSACTIONS ON IMAGE PROCESSING : A PUBLICATION OF THE IEEE SIGNAL PROCESSING SOCIETY 2021; 30:2301-2312. [PMID: 33226943 DOI: 10.1109/tip.2020.3038483] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/11/2023]
Abstract
The performance of state-of-the-art object skeleton detection (OSD) methods have been greatly boosted by Convolutional Neural Networks (CNNs). However, the most existing CNN-based OSD methods rely on a 'skip-layer' structure where low-level and high-level features are combined to gather multi-level contextual information. Unfortunately, as shallow features tend to be noisy and lack semantic knowledge, they will cause errors and inaccuracy. Therefore, in order to improve the accuracy of object skeleton detection, we propose a novel network architecture, the Multi-Scale Bidirectional Fully Convolutional Network (MSB-FCN), to better gather and enhance multi-scale high-level contextual information. The advantage is that only deep features are used to construct multi-scale feature representations along with a bidirectional structure for better capturing contextual knowledge. This enables the proposed MSB-FCN to learn semantic-level information from different sub-regions. Moreover, we introduce dense connections into the bidirectional structure to ensure that the learning process at each scale can directly encode information from all other scales. An attention pyramid is also integrated into our MSB-FCN to dynamically control information propagation and reduce unreliable features. Extensive experiments on various benchmarks demonstrate that the proposed MSB-FCN achieves significant improvements over the state-of-the-art algorithms.
Collapse
|
35
|
|
36
|
Wang M, Jin R, Jiang N, Liu H, Jiang S, Li K, Zhou X. Automated labeling of the airway tree in terms of lobes based on deep learning of bifurcation point detection. Med Biol Eng Comput 2020; 58:2009-2024. [PMID: 32613598 DOI: 10.1007/s11517-020-02184-y] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/26/2019] [Accepted: 05/01/2020] [Indexed: 12/19/2022]
Abstract
This paper presents an automatic lobe-based labeling of airway tree method, which can detect the bifurcation points for reconstructing and labeling the airway tree from a computed tomography image. A deep learning-based network structure is designed to identify the four key bifurcation points. Then, based on the detected bifurcation points, the entire airway tree is reconstructed by a new region-growing method. Finally, with the basic airway tree anatomy and topology knowledge, individual branches of the airway tree are classified into different categories in terms of pulmonary lobes. There are several advantages in our method such as the detection of the bifurcation points does not depend on the segmentation of airway tree and only four bifurcation points need to be manually labeled for each sample to prepare the training dataset. The segmentation of airway tree is guided by the detected points, which overcomes the difficulty of manual seed selection of conventional region-growing algorithm. In addition, the bifurcation points can help analyze the tree structure, which provides a basis for effective airway tree labeling. Experimental results show that our method is fast, stable, and the accuracy of our method is 97.85%, which is higher than that of the traditional skeleton-based method. Graphical Abstract The pipeline of our proposed lobe-based airway tree labeling method. Given a raw CT volume, a neural network structure is designed to predict major bifurcation points of airway tree. Based on the detected points, airway tree is reconstructed and labeled in terms of lobes.
Collapse
Affiliation(s)
- Manyang Wang
- School of Computer Science and Technology, Huazhong University of Science and Technology, Wuhan, Hubei, 430074, China.,Key Laboratory of Education Ministry for Image Processing and Intelligence Control, Huazhong University of Science and Technology, Wuhan, Hubei, 430074, China
| | - Renchao Jin
- School of Computer Science and Technology, Huazhong University of Science and Technology, Wuhan, Hubei, 430074, China. .,Key Laboratory of Education Ministry for Image Processing and Intelligence Control, Huazhong University of Science and Technology, Wuhan, Hubei, 430074, China.
| | - Nanchuan Jiang
- Department of Radiology, Union Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, 430022, China.,Hubei Province Key Laboratory of Molecular Imaging, Huazhong University of Science and Technology, Wuhan, 430022, China
| | - Hong Liu
- School of Computer Science and Technology, Huazhong University of Science and Technology, Wuhan, Hubei, 430074, China.,Key Laboratory of Education Ministry for Image Processing and Intelligence Control, Huazhong University of Science and Technology, Wuhan, Hubei, 430074, China
| | - Shan Jiang
- School of Computer Science and Technology, Huazhong University of Science and Technology, Wuhan, Hubei, 430074, China.,Key Laboratory of Education Ministry for Image Processing and Intelligence Control, Huazhong University of Science and Technology, Wuhan, Hubei, 430074, China
| | - Kang Li
- School of Computer Science and Technology, Huazhong University of Science and Technology, Wuhan, Hubei, 430074, China.,Key Laboratory of Education Ministry for Image Processing and Intelligence Control, Huazhong University of Science and Technology, Wuhan, Hubei, 430074, China
| | - XueXin Zhou
- School of Computer Science and Technology, Huazhong University of Science and Technology, Wuhan, Hubei, 430074, China.,Key Laboratory of Education Ministry for Image Processing and Intelligence Control, Huazhong University of Science and Technology, Wuhan, Hubei, 430074, China
| |
Collapse
|
37
|
|
38
|
Abdellah M, Guerrero NR, Lapere S, Coggan JS, Keller D, Coste B, Dagar S, Courcol JD, Markram H, Schürmann F. Interactive visualization and analysis of morphological skeletons of brain vasculature networks with VessMorphoVis. Bioinformatics 2020; 36:i534-i541. [PMID: 32657395 PMCID: PMC7355309 DOI: 10.1093/bioinformatics/btaa461] [Citation(s) in RCA: 10] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/26/2022] Open
Abstract
MOTIVATION Accurate morphological models of brain vasculature are key to modeling and simulating cerebral blood flow in realistic vascular networks. This in silico approach is fundamental to revealing the principles of neurovascular coupling. Validating those vascular morphologies entails performing certain visual analysis tasks that cannot be accomplished with generic visualization frameworks. This limitation has a substantial impact on the accuracy of the vascular models employed in the simulation. RESULTS We present VessMorphoVis, an integrated suite of toolboxes for interactive visualization and analysis of vast brain vascular networks represented by morphological graphs segmented originally from imaging or microscopy stacks. Our workflow leverages the outstanding potentials of Blender, aiming to establish an integrated, extensible and domain-specific framework capable of interactive visualization, analysis, repair, high-fidelity meshing and high-quality rendering of vascular morphologies. Based on the initial feedback of the users, we anticipate that our framework will be an essential component in vascular modeling and simulation in the future, filling a gap that is at present largely unfulfilled. AVAILABILITY AND IMPLEMENTATION VessMorphoVis is freely available under the GNU public license on Github at https://github.com/BlueBrain/VessMorphoVis. The morphology analysis, visualization, meshing and rendering modules are implemented as an add-on for Blender 2.8 based on its Python API (application programming interface). The add-on functionality is made available to users through an intuitive graphical user interface, as well as through exhaustive configuration files calling the API via a feature-rich command line interface running Blender in background mode. SUPPLEMENTARY INFORMATION Supplementary data are available at Bioinformatics online.
Collapse
Affiliation(s)
- Marwan Abdellah
- Blue Brain Project (BBP), École Polytechnique Fédérale de Lausanne (EPFL), Campus Biotech, 1202 Geneva, Switzerland
| | - Nadir Román Guerrero
- Blue Brain Project (BBP), École Polytechnique Fédérale de Lausanne (EPFL), Campus Biotech, 1202 Geneva, Switzerland
| | - Samuel Lapere
- Blue Brain Project (BBP), École Polytechnique Fédérale de Lausanne (EPFL), Campus Biotech, 1202 Geneva, Switzerland
| | - Jay S Coggan
- Blue Brain Project (BBP), École Polytechnique Fédérale de Lausanne (EPFL), Campus Biotech, 1202 Geneva, Switzerland
| | - Daniel Keller
- Blue Brain Project (BBP), École Polytechnique Fédérale de Lausanne (EPFL), Campus Biotech, 1202 Geneva, Switzerland
| | - Benoit Coste
- Blue Brain Project (BBP), École Polytechnique Fédérale de Lausanne (EPFL), Campus Biotech, 1202 Geneva, Switzerland
| | - Snigdha Dagar
- Blue Brain Project (BBP), École Polytechnique Fédérale de Lausanne (EPFL), Campus Biotech, 1202 Geneva, Switzerland
| | - Jean-Denis Courcol
- Blue Brain Project (BBP), École Polytechnique Fédérale de Lausanne (EPFL), Campus Biotech, 1202 Geneva, Switzerland
| | - Henry Markram
- Blue Brain Project (BBP), École Polytechnique Fédérale de Lausanne (EPFL), Campus Biotech, 1202 Geneva, Switzerland
| | - Felix Schürmann
- Blue Brain Project (BBP), École Polytechnique Fédérale de Lausanne (EPFL), Campus Biotech, 1202 Geneva, Switzerland
| |
Collapse
|
39
|
Liu C, Bergmeijer M, Pierrat S, Guise O. Automatic Fiber Length Measurements with a Multi-Stencil Fast Marching Method on Microscopy Images. MICROSCOPY AND MICROANALYSIS : THE OFFICIAL JOURNAL OF MICROSCOPY SOCIETY OF AMERICA, MICROBEAM ANALYSIS SOCIETY, MICROSCOPICAL SOCIETY OF CANADA 2020; 26:387-396. [PMID: 32241318 DOI: 10.1017/s1431927620001336] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/11/2023]
Abstract
Fiber length has a strong impact on the mechanical properties of composite materials. It is one of the most important quantitative features in characterizing microstructures for understanding the material performance. Studies conducted to determine fiber length distribution have primarily focused on sample preparation and fiber dispersion. However, the subsequent image analysis is frequently performed manually or semi-automatically, which either requires careful sample preparation or manual intervention in the image analysis and processing. In this article, an image processing and analysis method has been developed based on medial axis transformation via the multi-stencil fast marching method for fiber length measurements on acquired microscopy images. The developed method can be implemented fully automatically and without any user induced delays. This method offers high efficiency, sub-pixel accuracy, and excellent statistical representativity.
Collapse
Affiliation(s)
- Chanjuan Liu
- SABIC, Global Analytical Science, Coorperate T&I, Plasticslaan 1, 4612PXBergen op Zoom, The Netherlands
| | - Menno Bergmeijer
- SABIC, Global Analytical Science, Coorperate T&I, Plasticslaan 1, 4612PXBergen op Zoom, The Netherlands
| | - Sébastien Pierrat
- SABIC, Global Analytical Science, Coorperate T&I, Plasticslaan 1, 4612PXBergen op Zoom, The Netherlands
| | - Olivier Guise
- SABIC, Global Analytical Science, Coorperate T&I, Plasticslaan 1, 4612PXBergen op Zoom, The Netherlands
| |
Collapse
|
40
|
Abstract
Skeletons are well-known descriptors used for analysis and processing of 2D binary images. Recently, dense skeletons have been proposed as an extension of classical skeletons as a dual encoding for 2D grayscale and color images. Yet, their encoding power, measured by the quality and size of the encoded image, and how these metrics depend on selected encoding parameters, has not been formally evaluated. In this paper, we fill this gap with two main contributions. First, we improve the encoding power of dense skeletons by effective layer selection heuristics, a refined skeleton pixel-chain encoding, and a postprocessing compression scheme. Secondly, we propose a benchmark to assess the encoding power of dense skeletons for a wide set of natural and synthetic color and grayscale images. We use this benchmark to derive optimal parameters for dense skeletons. Our method, called Compressing Dense Medial Descriptors (CDMD), achieves higher-compression ratios at similar quality to the well-known JPEG technique and, thereby, shows that skeletons can be an interesting option for lossy image encoding.
Collapse
|
41
|
Molina-Abril H, Real P, Díaz-del-Río F. Generating (co)homological information using boundary scale. Pattern Recognit Lett 2020. [DOI: 10.1016/j.patrec.2020.02.028] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
|
42
|
Yang T, Wu Z, Chen H, Zhu Y, Li L. Quantitative 3D structural analysis of the cellular microstructure of sea urchin spines (I): Methodology. Acta Biomater 2020; 107:204-217. [PMID: 32109599 DOI: 10.1016/j.actbio.2020.02.034] [Citation(s) in RCA: 14] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/14/2019] [Revised: 02/19/2020] [Accepted: 02/21/2020] [Indexed: 11/29/2022]
Abstract
The mineralized skeletons of echinoderms are characterized by their complex, open-cell porous microstructure (also known as stereom), which exhibits vast variations in pore sizes, branch morphology, and three-dimensional (3D) organization patterns among different species. Quantitative description and analysis of these cellular structures in 3D are needed in order to understand their mechanical properties and underlying design strategies. In this paper series, we present a framework for analyzing such structures based on high-resolution 3D tomography data and utilize this framework to investigate the structural designs of stereom by using the spines from the sea urchin Heterocentrotus mamillatus as a model system. The first paper here reports the proposed cellular network analysis framework, which consists of five major steps: synchrotron-based tomography and hierarchical convolutional neural network-based reconstruction, machine learning-based segmentation, cellular network registration, feature extraction, and data representation and analysis. This framework enables the characterization of the porous stereom structures at the individual node and branch level (~10 µm), the local cellular level (~100 µm), and the global network level (~1 mm). We define and quantify multiple structural descriptors at each level, such as node connectivity, branch length and orientation, branch profile, ring structure, etc., which allows us to investigate the cellular network construction of H. mamillatus spines quantitatively. The methodology reported here could be tailored to analyze other natural or engineering open-cell porous materials for a comprehensive multiscale network representation and mechanical analysis. STATEMENT OF SIGNIFICANCE: The mechanical robustness of the biomineralized porous structures in sea urchin spines has long been recognized. However, quantitative cellular network representation and analysis of this class of natural cellular solids are still limited in the literature. This constrains our capability to fully understand the mechanical properties and design strategies in sea urchin spines and other similar echinoderms' porous skeletal structures. Combining high-resolution tomography and computer vision-based analysis, this work presents a multiscale 3D network analysis framework, which allows for extraction, registration, and quantification of sea urchin spines' complex porous structure from the individual branch and node level to the global network level. This 3D structural analysis is relevant to a diversity of research fields, such as biomineralization, skeletal biology, biomimetics, material science, etc.
Collapse
Affiliation(s)
- Ting Yang
- Department of Mechanical Engineering, Virginia Tech, Blacksburg, VA 24060, USA
| | - Ziling Wu
- Department of Electrical and Computer Engineering, Virginia Tech, Blacksburg, VA 24060, USA
| | - Hongshun Chen
- Department of Mechanical Engineering, Virginia Tech, Blacksburg, VA 24060, USA
| | - Yunhui Zhu
- Department of Electrical and Computer Engineering, Virginia Tech, Blacksburg, VA 24060, USA.
| | - Ling Li
- Department of Mechanical Engineering, Virginia Tech, Blacksburg, VA 24060, USA.
| |
Collapse
|
43
|
Morris TA, Naik J, Fibben KS, Kong X, Kiyono T, Yokomori K, Grosberg A. Striated myocyte structural integrity: Automated analysis of sarcomeric z-discs. PLoS Comput Biol 2020; 16:e1007676. [PMID: 32130207 PMCID: PMC7075639 DOI: 10.1371/journal.pcbi.1007676] [Citation(s) in RCA: 19] [Impact Index Per Article: 4.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/22/2019] [Revised: 03/16/2020] [Accepted: 01/23/2020] [Indexed: 12/31/2022] Open
Abstract
As sarcomeres produce the force necessary for contraction, assessment of sarcomere order is paramount in evaluation of cardiac and skeletal myocytes. The uniaxial force produced by sarcomeres is ideally perpendicular to their z-lines, which couple parallel myofibrils and give cardiac and skeletal myocytes their distinct striated appearance. Accordingly, sarcomere structure is often evaluated by staining for z-line proteins such as α-actinin. However, due to limitations of current analysis methods, which require manual or semi-manual handling of images, the mechanism by which sarcomere and by extension z-line architecture can impact contraction and which characteristics of z-line architecture should be used to assess striated myocytes has not been fully explored. Challenges such as isolating z-lines from regions of off-target staining that occur along immature stress fibers and cell boundaries and choosing metrics to summarize overall z-line architecture have gone largely unaddressed in previous work. While an expert can qualitatively appraise tissues, these challenges leave researchers without robust, repeatable tools to assess z-line architecture across different labs and experiments. Additionally, the criteria used by experts to evaluate sarcomeric architecture have not been well-defined. We address these challenges by providing metrics that summarize different aspects of z-line architecture that correspond to expert tissue quality assessment and demonstrate their efficacy through an examination of engineered tissues and single cells. In doing so, we have elucidated a mechanism by which highly elongated cardiomyocytes become inefficient at producing force. Unlike previous manual or semi-manual methods, characterization of z-line architecture using the metrics discussed and implemented in this work can quantitatively evaluate engineered tissues and contribute to a robust understanding of the development and mechanics of striated muscles.
Collapse
Affiliation(s)
- Tessa Altair Morris
- Center for Complex Biological Systems, University of California, Irvine, Irvine, California, United States of America
- Edwards Lifesciences Center for Advanced Cardiovascular Technology, University of California, Irvine, Irvine, California, United States of America
| | - Jasmine Naik
- Edwards Lifesciences Center for Advanced Cardiovascular Technology, University of California, Irvine, Irvine, California, United States of America
- Department of Chemical and Biomolecular Engineering, University of California, Irvine, Irvine, California, United States of America
| | - Kirby Sinclair Fibben
- Department of Biomedical Engineering, University of California, Irvine, Irvine, California, United States of America
| | - Xiangduo Kong
- Department of Biological Chemistry, School of Medicine, University of California, Irvine, Irvine, California, United States of America
| | - Tohru Kiyono
- Division of Carcinogenesis and Cancer Prevention, National Cancer Center Research Institute, Tsukiji, Chuo-ku, Tokyo, Japan
| | - Kyoko Yokomori
- Department of Biological Chemistry, School of Medicine, University of California, Irvine, Irvine, California, United States of America
| | - Anna Grosberg
- Center for Complex Biological Systems, University of California, Irvine, Irvine, California, United States of America
- Edwards Lifesciences Center for Advanced Cardiovascular Technology, University of California, Irvine, Irvine, California, United States of America
- Department of Chemical and Biomolecular Engineering, University of California, Irvine, Irvine, California, United States of America
- Department of Biomedical Engineering, University of California, Irvine, Irvine, California, United States of America
- NSF-Simons Center for Multiscale Cell Fate Research, University of California, Irvine, Irvine, California, United States of America
| |
Collapse
|
44
|
Iglesias-Cofán S, Formella A. Guided thinning. Pattern Recognit Lett 2019. [DOI: 10.1016/j.patrec.2019.08.030] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/26/2022]
|
45
|
Phellan R, Lindner T, Helle M, Falcao AX, Yasuda CL, Sokolska M, Jager RH, Forkert ND. Segmentation-Based Blood Flow Parameter Refinement in Cerebrovascular Structures Using 4-D Arterial Spin Labeling MRA. IEEE Trans Biomed Eng 2019; 67:1936-1946. [PMID: 31689181 DOI: 10.1109/tbme.2019.2951082] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/05/2022]
Abstract
OBJECTIVE Cerebrovascular diseases are one of the main global causes of death and disability in the adult population. The preferred imaging modality for the diagnostic routine is digital subtraction angiography, an invasive modality. Time-resolved three-dimensional arterial spin labeling magnetic resonance angiography (4D ASL MRA) is an alternative non-invasive modality, which captures morphological and blood flow data of the cerebrovascular system, with high spatial and temporal resolution. This work proposes advanced medical image processing methods that extract the anatomical and hemodynamic information contained in 4D ASL MRA datasets. METHODS A previously published segmentation method, which uses blood flow data to improve its accuracy, is extended to estimate blood flow parameters by fitting a mathematical model to the measured vascular signal. The estimated values are then refined using regression techniques within the cerebrovascular segmentation. The proposed method was evaluated using fifteen 4D ASL MRA phantoms, with ground-truth morphological and hemodynamic data, fifteen 4D ASL MRA datasets acquired from healthy volunteers, and two 4D ASL MRA datasets from patients with a stenosis. RESULTS The proposed method reached an average Dice similarity coefficient of 0.957 and 0.938 in the phantom and real dataset segmentation evaluations, respectively. The estimated blood flow parameter values are more similar to the ground-truth values after the refinement step, when using phantoms. A qualitative analysis showed that the refined blood flow estimation is more realistic compared to the raw hemodynamic parameters. CONCLUSION The proposed method can provide accurate segmentations and blood flow parameter estimations in the cerebrovascular system using 4D ASL MRA datasets. SIGNIFICANCE The information obtained with the proposed method can help clinicians and researchers to study the cerebrovascular system non-invasively.
Collapse
|
46
|
Bai X, Ye L, Zhu J, Zhu L, Komura T. Skeleton Filter: A Self-Symmetric Filter for Skeletonization in Noisy Text Images. IEEE TRANSACTIONS ON IMAGE PROCESSING : A PUBLICATION OF THE IEEE SIGNAL PROCESSING SOCIETY 2019; 29:1815-1826. [PMID: 31603786 DOI: 10.1109/tip.2019.2944560] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/10/2023]
Abstract
Robustly computing the skeletons of objects in natural images is difficult due to the large variations in shape boundaries and the large amount of noise in the images. Inspired by recent findings in neuroscience, we propose the Skeleton Filter, which is a novel model for skeleton extraction from natural images. The Skeleton Filter consists of a pair of oppositely oriented Gabor-like filters; by applying the Skeleton Filter in various orientations to an image at multiple resolutions and fusing the results, our system can robustly extract the skeleton even under highly noisy conditions. We evaluate the performance of our approach using challenging noisy text datasets and demonstrate that our pipeline realizes state-of-the-art performance for extracting the text skeleton. Moreover, the presence of Gabor filters in the human visual system and the simple architecture of the Skeleton Filter can help explain the strong capabilities of humans in perceiving skeletons of objects, even under dramatically noisy conditions.
Collapse
|
47
|
Buscema M, Hieber SE, Schulz G, Deyhle H, Hipp A, Beckmann F, Lobrinus JA, Saxer T, Müller B. Ex vivo evaluation of an atherosclerotic human coronary artery via histology and high-resolution hard X-ray tomography. Sci Rep 2019; 9:14348. [PMID: 31586080 PMCID: PMC6778097 DOI: 10.1038/s41598-019-50711-1] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/11/2018] [Accepted: 09/16/2019] [Indexed: 12/12/2022] Open
Abstract
Atherosclerotic arteries exhibit characteristic constrictions and substantial deviations from cylindrical shape. Therefore, determining the artery's cross-section along the centerline is challenging, although high-resolution isotropic three-dimensional data are available. Herein, we apply high-resolution computed tomography in absorption and phase to a plaque-containing human artery post-mortem, through the course of the preparation stages for histology. We identify the impact of paraffin embedding and decalcification on the artery lumen. For automatic extraction of lumen's cross-section along centerline we present a dedicated pipeline. Comparing fixated tissue before and after paraffin embedding gives rise to shape changes with lumen reduction to 50-80%. The histological slicing induces further deformations with respect to tomography. Data acquired after decalcification show debris unintentionally distributed within the vessel preventing the reliable automatic lumen segmentation. Comparing tomography of laboratory- and synchrotron-radiation-based X rays by means of joint histogram analysis leads us to conclude that advanced desktop tomography is capable of quantifying the artery's lumen as an essential input for blood flow simulations. The results indicate that the most reliable lumen quantification is achieved by imaging the non-decalcified specimen fixed in formalin, using phase contrast modality and a dedicated processing pipeline. This study focusses on a methodology to quantitatively evaluate diseased artery segments post-mortem and provides unique structural parameters on the treatment-induced local shrinkage, which will be the basis of future studies on the flow in vessels affected by constrictions.
Collapse
Affiliation(s)
- Marzia Buscema
- Biomaterials Science Center, Department of Biomedical Engineering, University of Basel, Allschwil, Switzerland
| | - Simone E Hieber
- Biomaterials Science Center, Department of Biomedical Engineering, University of Basel, Allschwil, Switzerland.
| | - Georg Schulz
- Biomaterials Science Center, Department of Biomedical Engineering, University of Basel, Allschwil, Switzerland
| | - Hans Deyhle
- Biomaterials Science Center, Department of Biomedical Engineering, University of Basel, Allschwil, Switzerland
| | - Alexander Hipp
- Institute of Materials Research, Helmholtz-Zentrum Geesthacht, Geesthacht, Germany
| | - Felix Beckmann
- Institute of Materials Research, Helmholtz-Zentrum Geesthacht, Geesthacht, Germany
| | | | - Till Saxer
- Faculty of Medicine, University of Geneva, Geneva, Switzerland
| | - Bert Müller
- Biomaterials Science Center, Department of Biomedical Engineering, University of Basel, Allschwil, Switzerland.
| |
Collapse
|
48
|
|
49
|
Vigneshwaran V, Sands GB, LeGrice IJ, Smaill BH, Smith NP. Reconstruction of coronary circulation networks: A review of methods. Microcirculation 2019; 26:e12542. [DOI: 10.1111/micc.12542] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/13/2018] [Revised: 01/25/2019] [Accepted: 02/27/2019] [Indexed: 12/12/2022]
Affiliation(s)
- Vibujithan Vigneshwaran
- Auckland Bioengineering Institute University of Auckland Auckland New Zealand
- Faculty of Engineering University of Auckland Auckland New Zealand
| | - Gregory B. Sands
- Auckland Bioengineering Institute University of Auckland Auckland New Zealand
| | - Ian J. LeGrice
- Department of Physiology University of Auckland Auckland New Zealand
| | - Bruce H. Smaill
- Auckland Bioengineering Institute University of Auckland Auckland New Zealand
| | - Nicolas P. Smith
- Auckland Bioengineering Institute University of Auckland Auckland New Zealand
- Faculty of Engineering University of Auckland Auckland New Zealand
| |
Collapse
|
50
|
Moriconi S, Zuluaga MA, Jager HR, Nachev P, Ourselin S, Cardoso MJ. Inference of Cerebrovascular Topology With Geodesic Minimum Spanning Trees. IEEE TRANSACTIONS ON MEDICAL IMAGING 2019; 38:225-239. [PMID: 30059296 PMCID: PMC6319031 DOI: 10.1109/tmi.2018.2860239] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 06/13/2018] [Accepted: 07/19/2018] [Indexed: 06/08/2023]
Abstract
A vectorial representation of the vascular network that embodies quantitative features-location, direction, scale, and bifurcations-has many potential cardio- and neuro-vascular applications. We present VTrails, an end-to-end approach to extract geodesic vascular minimum spanning trees from angiographic data by solving a connectivity-optimized anisotropic level-set over a voxel-wise tensor field representing the orientation of the underlying vasculature. Evaluating real and synthetic vascular images, we compare VTrails against the state-of-the-art ridge detectors for tubular structures by assessing the connectedness of the vesselness map and inspecting the synthesized tensor field. The inferred geodesic trees are then quantitatively evaluated within a topologically aware framework, by comparing the proposed method against popular vascular segmentation tool kits on clinical angiographies. VTrails potentials are discussed towards integrating groupwise vascular image analyses. The performance of VTrails demonstrates its versatility and usefulness also for patient-specific applications in interventional neuroradiology and vascular surgery.
Collapse
|