1
|
Hou SS, Ikegawa Y, Kwon Y, Wieckiewicz N, Houser MCQ, Lundin B, Bacskai BJ, Berezovska O, Maesako M. Recording γ-secretase activity in living mouse brains. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2024:2024.01.31.578105. [PMID: 38352497 PMCID: PMC10862803 DOI: 10.1101/2024.01.31.578105] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 07/13/2024]
Abstract
γ-Secretase plays a pivotal role in the central nervous system. Our recent development of genetically encoded Forster resonance energy transfer (FRET)-based biosensors has enabled the spatiotemporal recording of γ-secretase activity on a cell-by-cell basis in live neurons in culture. Nevertheless, how γ-secretase activity is regulated in vivo remains unclear. Here we employ the near-infrared (NIR) C99 720-670 biosensor and NIR confocal microscopy to quantitatively record γ-secretase activity in individual neurons in living mouse brains. Intriguingly, we uncovered that γ-secretase activity may influence the activity of γ-secretase in neighboring neurons, suggesting a potential "cell non-autonomous" regulation of γ-secretase in mouse brains. Given that γ-secretase plays critical roles in important biological events and various diseases, our new assay in vivo would become a new platform that enables dissecting the essential roles of γ-secretase in normal health and diseases.
Collapse
|
2
|
Moriconi S, Rodríguez-Núñez O, Gros R, Felger LA, Maragkou T, Hewer E, Pierangelo A, Novikova T, Schucht P, McKinley R. Near-real-time Mueller polarimetric image processing for neurosurgical intervention. Int J Comput Assist Radiol Surg 2024; 19:1033-1043. [PMID: 38503943 PMCID: PMC11178587 DOI: 10.1007/s11548-024-03090-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/19/2024] [Accepted: 02/27/2024] [Indexed: 03/21/2024]
Abstract
PURPOSE Wide-field imaging Mueller polarimetry is a revolutionary, label-free, and non-invasive modality for computer-aided intervention; in neurosurgery, it aims to provide visual feedback of white matter fibre bundle orientation from derived parameters. Conventionally, robust polarimetric parameters are estimated after averaging multiple measurements of intensity for each pair of probing and detected polarised light. Long multi-shot averaging, however, is not compatible with real-time in vivo imaging, and the current performance of polarimetric data processing hinders the translation to clinical practice. METHODS A learning-based denoising framework is tailored for fast, single-shot, noisy acquisitions of polarimetric intensities. Also, performance-optimised image processing tools are devised for the derivation of clinically relevant parameters. The combination recovers accurate polarimetric parameters from fast acquisitions with near-real-time performance, under the assumption of pseudo-Gaussian polarimetric acquisition noise. RESULTS The denoising framework is trained, validated, and tested on experimental data comprising tumour-free and diseased human brain samples in different conditions. Accuracy and image quality indices showed significant ( p < 0.05 ) improvements on testing data for a fast single-pass denoising versus the state-of-the-art and high polarimetric image quality standards. The computational time is reported for the end-to-end processing. CONCLUSION The end-to-end image processing achieved real-time performance for a localised field of view ( ≈ 6.5 mm 2 ). The denoised polarimetric intensities produced visibly clear directional patterns of neuronal fibre tracts in line with reference polarimetric image quality standards; directional disruption was kept in case of neoplastic lesions. The presented advances pave the way towards feasible oncological neurosurgical translations of novel, label-free, interventional feedback.
Collapse
Affiliation(s)
- Stefano Moriconi
- Support Center for Advanced Neuroimaging (SCAN), University Institute of Diagnostic and Interventional Neuroradiology, Inselspital, Bern University Hospital, University of Bern, 3010, Bern, Switzerland.
| | - Omar Rodríguez-Núñez
- Department of Neurosurgery, Inselspital, Bern University Hospital, University of Bern, 3010, Bern, Switzerland
| | - Romain Gros
- Institute of Tissue Medicine and Pathology, University of Bern, 3008, Bern, Switzerland
| | - Leonard A Felger
- Department of Neurosurgery, Inselspital, Bern University Hospital, University of Bern, 3010, Bern, Switzerland
| | - Theoni Maragkou
- Institute of Tissue Medicine and Pathology, University of Bern, 3008, Bern, Switzerland
| | - Ekkehard Hewer
- Institute of Pathology, Lausanne University Hospital, 1011, Lausanne, Switzerland
| | - Angelo Pierangelo
- LPICM, CNRS, Ecole Polytechnique, IP Paris, 91120, Palaiseau, France
| | - Tatiana Novikova
- LPICM, CNRS, Ecole Polytechnique, IP Paris, 91120, Palaiseau, France
| | - Philippe Schucht
- Department of Neurosurgery, Inselspital, Bern University Hospital, University of Bern, 3010, Bern, Switzerland
| | - Richard McKinley
- Support Center for Advanced Neuroimaging (SCAN), University Institute of Diagnostic and Interventional Neuroradiology, Inselspital, Bern University Hospital, University of Bern, 3010, Bern, Switzerland
| |
Collapse
|
3
|
Shroff H, Testa I, Jug F, Manley S. Live-cell imaging powered by computation. Nat Rev Mol Cell Biol 2024; 25:443-463. [PMID: 38378991 DOI: 10.1038/s41580-024-00702-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 01/10/2024] [Indexed: 02/22/2024]
Abstract
The proliferation of microscopy methods for live-cell imaging offers many new possibilities for users but can also be challenging to navigate. The prevailing challenge in live-cell fluorescence microscopy is capturing intra-cellular dynamics while preserving cell viability. Computational methods can help to address this challenge and are now shifting the boundaries of what is possible to capture in living systems. In this Review, we discuss these computational methods focusing on artificial intelligence-based approaches that can be layered on top of commonly used existing microscopies as well as hybrid methods that integrate computation and microscope hardware. We specifically discuss how computational approaches can improve the signal-to-noise ratio, spatial resolution, temporal resolution and multi-colour capacity of live-cell imaging.
Collapse
Affiliation(s)
- Hari Shroff
- Janelia Research Campus, Howard Hughes Medical Institute (HHMI), Ashburn, VA, USA
| | - Ilaria Testa
- Department of Applied Physics and Science for Life Laboratory, KTH Royal Institute of Technology, Stockholm, Sweden
| | - Florian Jug
- Fondazione Human Technopole (HT), Milan, Italy
| | - Suliana Manley
- Institute of Physics, School of Basic Sciences, Swiss Federal Institute of Technology Lausanne (EPFL), Lausanne, Switzerland.
| |
Collapse
|
4
|
S S, Rufus NHA. Investigation on ultrasound images for detection of fetal congenital heart defects. Biomed Phys Eng Express 2024; 10:042001. [PMID: 38781934 DOI: 10.1088/2057-1976/ad4f91] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/02/2023] [Accepted: 05/23/2024] [Indexed: 05/25/2024]
Abstract
Congenital heart defects (CHD) are one of the serious problems that arise during pregnancy. Early CHD detection reduces death rates and morbidity but is hampered by the relatively low detection rates (i.e., 60%) of current screening technology. The detection rate could be increased by supplementing ultrasound imaging with fetal ultrasound image evaluation (FUSI) using deep learning techniques. As a result, the non-invasive foetal ultrasound image has clear potential in the diagnosis of CHD and should be considered in addition to foetal echocardiography. This review paper highlights cutting-edge technologies for detecting CHD using ultrasound images, which involve pre-processing, localization, segmentation, and classification. Existing technique of preprocessing includes spatial domain filter, non-linear mean filter, transform domain filter, and denoising methods based on Convolutional Neural Network (CNN); segmentation includes thresholding-based techniques, region growing-based techniques, edge detection techniques, Artificial Neural Network (ANN) based segmentation methods, non-deep learning approaches and deep learning approaches. The paper also suggests future research directions for improving current methodologies.
Collapse
Affiliation(s)
- Satish S
- Department of Electronics and Communication Engineering, Vel Tech Rangarajan Dr Sagunthala R&D Institute of Science and Technology, Chennai-600062, Tamil Nadu, India
| | - N Herald Anantha Rufus
- Department of Electronics and Communication Engineering, Vel Tech Rangarajan Dr Sagunthala R&D Institute of Science and Technology, Chennai-600062, Tamil Nadu, India
| |
Collapse
|
5
|
Cho Y, Fakhouri F, Ballinger MN, Englert JA, Hayes D, Kolipaka A, Ghadiali SN. Magnetic Resonance Elastography and Computational Modeling Identify Heterogeneous Lung Biomechanical Properties during Cystic Fibrosis. RESEARCH SQUARE 2024:rs.3.rs-4125891. [PMID: 38562870 PMCID: PMC10984019 DOI: 10.21203/rs.3.rs-4125891/v1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 04/04/2024]
Abstract
The lung is a dynamic mechanical organ and several pulmonary disorders are characterized by heterogeneous changes in the lung's local mechanical properties (i.e. stiffness). These alterations lead to abnormal lung tissue deformation (i.e. strain) which have been shown to promote disease progression. Although heterogenous mechanical properties may be important biomarkers of disease, there is currently no non-invasive way to measure these properties for clinical diagnostic purposes. In this study, we use a magnetic resonance elastography technique to measure heterogenous distributions of the lung's shear stiffness in healthy adults and in people with Cystic Fibrosis. Additionally, computational finite element models which directly incorporate the measured heterogenous mechanical properties were developed to assess the effects on lung tissue deformation. Results indicate that consolidated lung regions in people with Cystic Fibrosis exhibited increased shear stiffness and reduced spatial heterogeneity compared to surrounding non-consolidated regions. Accounting for heterogenous lung stiffness in healthy adults did not change the globally averaged strain magnitude obtained in computational models. However, computational models that used heterogenous stiffness measurements predicted significantly more variability in local strain and higher spatial strain gradients. Finally, computational models predicted lower strain variability and spatial strain gradients in consolidated lung regions compared to non-consolidated regions. These results indicate that spatial variability in shear stiffness alters local strain and strain gradient magnitudes in people with Cystic Fibrosis. This imaged-based modeling technique therefore represents a clinically viable way to non-invasively assess lung mechanics during both health and disease.
Collapse
Affiliation(s)
| | | | | | | | - Don Hayes
- Cincinnati Children's Hospital Medical Center, University of Cincinnati College of Medicine
| | | | | |
Collapse
|
6
|
Kato S, Hotta K. Automatic enhancement preprocessing for segmentation of low quality cell images. Sci Rep 2024; 14:3619. [PMID: 38351053 PMCID: PMC10864346 DOI: 10.1038/s41598-024-53411-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/23/2023] [Accepted: 01/31/2024] [Indexed: 02/16/2024] Open
Abstract
We present a novel automatic preprocessing and ensemble learning technique for the segmentation of low-quality cell images. Capturing cells subjected to intense light is challenging due to their vulnerability to light-induced cell death. Consequently, microscopic cell images tend to be of low quality and it causes low accuracy for semantic segmentation. This problem can not be satisfactorily solved by classical image preprocessing methods. Therefore, we propose a novel approach of automatic enhancement preprocessing (AEP), which translates an input image into images that are easy to recognize by deep learning. AEP is composed of two deep neural networks, and the penultimate feature maps of the first network are employed as filters to translate an input image with low quality into images that are easily classified by deep learning. Additionally, we propose an automatic weighted ensemble learning (AWEL), which combines the multiple segmentation results. Since the second network predicts segmentation results corresponding to each translated input image, multiple segmentation results can be aggregated by automatically determining suitable weights. Experiments on two types of cell image segmentation confirmed that AEP can translate low-quality cell images into images that are easy to segment and that segmentation accuracy improves using AWEL.
Collapse
Affiliation(s)
- Sota Kato
- Department of Electrical, Information, Materials and Materials Engineering, Graduate School of Science and Engineering, Meijo University, Shiogamaguchi, Tempaku-ku, Nagoya, Aichi, 468-8502, Japan.
| | - Kazuhiro Hotta
- Department of Electrical and Electronic Engineering, Faculty of Engineering, Meijo University, Nagoya, Aichi, Japan
| |
Collapse
|
7
|
Kaur H, Saini SK, Thakur N, Juneja M. Survey of Denoising, Segmentation and Classification of Pancreatic Cancer Imaging. Curr Med Imaging 2024; 20:e150523216892. [PMID: 37189279 DOI: 10.2174/1573405620666230515090523] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/17/2022] [Revised: 03/10/2023] [Accepted: 04/03/2023] [Indexed: 05/17/2023]
Abstract
BACKGROUND Pancreatic cancer is one of the most serious problems that has taken many lives worldwide. The diagnostic procedure using the traditional approaches was manual by visually analyzing the large volumes of the dataset, making it time-consuming and prone to subjective errors. Hence the need for the computer-aided diagnosis system (CADs) emerged that comprises the machine and deep learning approaches for denoising, segmentation and classification of pancreatic cancer. INTRODUCTION There are different modalities used for the diagnosis of pancreatic cancer, such as Positron Emission Tomography/Computed Tomography (PET/CT), Magnetic Resonance Imaging (MRI), Multiparametric-MRI (Mp-MRI), Radiomics and Radio-genomics. Although these modalities gave remarkable results in diagnosis on the basis of different criteria. CT is the most commonly used modality that produces detailed and fine contrast images of internal organs of the body. However, it may also contain a certain amount of gaussian and rician noise that is necessary to be preprocessed before segmentation of the required region of interest (ROI) from the images and classification of cancer. METHOD This paper analyzes different methodologies used for the complete diagnosis of pancreatic cancer, including the denoising, segmentation and classification, along with the challenges and future scope for the diagnosis of pancreatic cancer. RESULT Various filters are used for denoising and image smoothening and filters as gaussian scale mixture process, non-local means, median filter, adaptive filter and average filter have been used more for better results. CONCLUSION In terms of segmentation, atlas based region-growing method proved to give better results as compared to the state of the art whereas, for the classification, deep learning approaches outperformed other methodologies to classify the images as cancerous and non- cancerous. These methodologies have proved that CAD systems have become a better solution to the ongoing research proposals for the detection of pancreatic cancer worldwide.
Collapse
Affiliation(s)
- Harjinder Kaur
- Department of UIET, University of Punjab, Chandigarh, 160014, India
| | | | - Niharika Thakur
- Department of UIET, University of Punjab, Chandigarh, 160014, India
| | - Mamta Juneja
- Department of UIET, University of Punjab, Chandigarh, 160014, India
| |
Collapse
|
8
|
Eftekharian M, Nodehi A, Enayatifar R. ML-DSTnet: A Novel Hybrid Model for Breast Cancer Diagnosis Improvement Based on Image Processing Using Machine Learning and Dempster-Shafer Theory. COMPUTATIONAL INTELLIGENCE AND NEUROSCIENCE 2023; 2023:7510419. [PMID: 37954096 PMCID: PMC10635746 DOI: 10.1155/2023/7510419] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 08/26/2022] [Revised: 11/18/2022] [Accepted: 04/25/2023] [Indexed: 11/14/2023]
Abstract
Medical intelligence detection systems have changed with the help of artificial intelligence and have also faced challenges. Breast cancer diagnosis and classification are part of this medical intelligence system. Early detection can lead to an increase in treatment options. On the other hand, uncertainty is a case that has always been with the decision-maker. The system's parameters cannot be accurately estimated, and the wrong decision is made. To solve this problem, we have proposed a method in this article that reduces the ignorance of the problem with the help of Dempster-Shafer theory so that we can make a better decision. This research on the MIAS dataset, based on image processing machine learning and Dempster-Shafer mathematical theory, tries to improve the diagnosis and classification of benign, malignant masses. We first determine the results of the diagnosis of mass type with MLP by using the texture feature and CNN. We combine the results of the two classifications with Dempster-Shafer theory and improve its accuracy. The obtained results show that the proposed approach has better performance than others based on evaluation criteria such as accuracy of 99.10%, sensitivity of 98.4%, and specificity of 100%.
Collapse
Affiliation(s)
- Mohsen Eftekharian
- Department of Computer Engineering, Gorgan Branch, Islamic Azad University, Gorgan, Iran
| | - Ali Nodehi
- Department of Computer Engineering, Gorgan Branch, Islamic Azad University, Gorgan, Iran
| | - Rasul Enayatifar
- Department of Computer Engineering, Firoozkooh Branch, Islamic Azad University, Firoozkooh, Iran
| |
Collapse
|
9
|
He W, Ma Y, Wang W. Rectangular Amplitude Mask-Based Auto-Focus Method with a Large Range and High Precision for a Micro-LED Wafer Defects Detection System. SENSORS (BASEL, SWITZERLAND) 2023; 23:7579. [PMID: 37688033 PMCID: PMC10490662 DOI: 10.3390/s23177579] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/28/2023] [Revised: 08/23/2023] [Accepted: 08/30/2023] [Indexed: 09/10/2023]
Abstract
Auto-focus technology plays an important role in the Micro-LED wafer defects detection system. How to accurately measure the defocus amount and the defocus direction of the Micro-LED wafer sample in a large linear range is one of the keys to realizing wafer defects detection. In this paper, a large range and high-precision auto-focus method based on a rectangular amplitude mask is proposed. A rectangular amplitude mask without a long edge is used to modulate the shape of the incident laser beams so that the spot shape distribution of the reflected laser beam on the sensor changes with the defocus amount of the wafer sample. By calculating the shape of the light spots, the defocus amount and the defocus direction can be obtained at the same time. The experimental results show that under the 20× microscopy objective, the linear range of the auto-focus system is 480 μm and the accuracy can reach 1 μm. It can be seen that the automatic focusing method proposed in this paper has the advantages of large linear range, high accuracy, and compact structure, which can meet the requirements of the Micro-LED wafer defects detection equipment.
Collapse
Affiliation(s)
- Wenjun He
- College of Opto-Electronic Engineering, Changchun University of Science and Technology, Changchun 130022, China; (Y.M.); (W.W.)
| | | | | |
Collapse
|
10
|
Chen HS, Voortman LM, van Munsteren JC, Wisse LJ, Tofig BJ, Kristiansen SB, Glashan CA, DeRuiter MC, Zeppenfeld K, Jongbloed MRM. Quantification of Large Transmural Biopsies Reveals Heterogeneity in Innervation Patterns in Chronic Myocardial Infarction. JACC Clin Electrophysiol 2023; 9:1652-1664. [PMID: 37480856 DOI: 10.1016/j.jacep.2023.04.021] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/28/2022] [Revised: 04/05/2023] [Accepted: 04/21/2023] [Indexed: 07/24/2023]
Abstract
BACKGROUND Abnormal cardiac innervation plays an important role in arrhythmogenicity after myocardial infarction (MI). Data regarding reperfusion models and innervation abnormalities in the medium to long term after MI are sparse. Histologic quantification of the small-sized cardiac nerves is challenging, and transmural analysis has not been performed. OBJECTIVES This study sought to assess cardiac innervation patterns in transmural biopsy sections in a porcine reperfusion model of MI (MI-R) using a novel method for nerve quantification. METHODS Transmural biopsy sections from 4 swine (n = 83) at 3 months after MI-R and 3 controls (n = 38) were stained with picrosirius red (fibrosis) and beta-III-tubulin (autonomic nerves). Biopsy sections were classified as infarct core, border zone, or remote zone. Each biopsy section was analyzed with a custom software pipeline, allowing calculation of nerve density and classification into innervation types at the 1 × 1-mm resolution level. Relocation of the classified squares to the original biopsy position enabled transmural quantification and innervation heterogeneity assessment. RESULTS Coexisting hyperinnervation, hypoinnervation, and denervation were present in all transmural MI-R biopsy sections. The innervation heterogeneity was greatest in the infarct core (median: 0.14; IQR: 0.12-0.15), followed by the border zone (median: 0.05; IQR: 0.04-0.07; P = 0.02) and remote zone (median: 0.02; IQR: 0.02-0.03; P < 0.0001). Only in the border zone was a positive linear relation between fibrosis and innervation heterogeneity observed (R = 0.79; P < 0.0001). CONCLUSIONS This novel method allows quantification of nerve density and heterogeneity in large transmural biopsy sections. In the chronic phase after MI-R, alternating innervation patterns were identified within the same biopsy section. Persistent innervation heterogeneity, in particular in the border zone biopsy sections, may contribute to late arrhythmogenicity.
Collapse
Affiliation(s)
- H Sophia Chen
- Department of Cardiology, Willem Einthoven Center for Cardiac Arrhythmia Research and Management, Leiden University Medical Center, Leiden, the Netherlands; Department of Anatomy and Embryology, Leiden University Medical Center, Leiden, the Netherlands
| | - Lenard M Voortman
- Department of Cell and Chemical Biology, Leiden University Medical Center, Leiden, the Netherlands
| | - J Conny van Munsteren
- Department of Anatomy and Embryology, Leiden University Medical Center, Leiden, the Netherlands
| | - Lambertus J Wisse
- Department of Anatomy and Embryology, Leiden University Medical Center, Leiden, the Netherlands
| | - Bawer J Tofig
- Department of Cardiology, Willem Einthoven Center for Cardiac Arrhythmia Research and Management, Aarhus University Hospital, Aarhus, Denmark
| | - Steen B Kristiansen
- Department of Cardiology, Willem Einthoven Center for Cardiac Arrhythmia Research and Management, Aarhus University Hospital, Aarhus, Denmark
| | - Claire A Glashan
- Department of Cardiology, Willem Einthoven Center for Cardiac Arrhythmia Research and Management, Leiden University Medical Center, Leiden, the Netherlands; Department of Anatomy and Embryology, Leiden University Medical Center, Leiden, the Netherlands
| | - Marco C DeRuiter
- Department of Anatomy and Embryology, Leiden University Medical Center, Leiden, the Netherlands
| | - Katja Zeppenfeld
- Department of Cardiology, Willem Einthoven Center for Cardiac Arrhythmia Research and Management, Leiden University Medical Center, Leiden, the Netherlands
| | - Monique R M Jongbloed
- Department of Cardiology, Willem Einthoven Center for Cardiac Arrhythmia Research and Management, Leiden University Medical Center, Leiden, the Netherlands; Department of Anatomy and Embryology, Leiden University Medical Center, Leiden, the Netherlands.
| |
Collapse
|
11
|
Xue R, Kang Y, Li W, Meng F, Wang X, Li L, Zhao W, Zhang T. Reconfigurable coaxial single-photon LIDAR based on the SPAD array. APPLIED OPTICS 2023; 62:5910-5916. [PMID: 37706942 DOI: 10.1364/ao.493000] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/12/2023] [Accepted: 07/10/2023] [Indexed: 09/15/2023]
Abstract
The single-photon avalanche diode (SPAD) array with time-to-digital converter (TDC) circuits on each pixel is an excellent candidate detector for imaging LIDAR systems. However, the low fill-factor of the SPAD array does not allow for efficient use of laser energy when directly adopted in a LIDAR system. Here, we design a reconfigurable coaxial single-photon LIDAR based on the SPAD array and diffractive optical elements (DOEs). We use the DOE and beam expander to shape the laser beam into a laser dot matrix. The total divergence angle of the DOE spot beam is strictly matched to the total field of view (FOV) angle of the SPAD array. Meanwhile, each focused beamlet is individually matched to every active area of the SPAD array detector, which increases the use of output energy about 100 times compared to the diffusion illumination system. Besides, the system uses the active area as the minimum pixel and can support sub-pixel scanning, resulting in higher resolution images. Through this coaxial structure, two different telescope systems after transceiver switching can be reconfigured for imaging targets at different distances. Based on our single-photon LIDAR system, we achieved 3D imaging of targets at 100 m and 180 m using two different telescope configurations.
Collapse
|
12
|
Dang D, Efstathiou C, Sun D, Yue H, Sastry NR, Draviam VM. Deep learning techniques and mathematical modeling allow 3D analysis of mitotic spindle dynamics. J Cell Biol 2023; 222:213913. [PMID: 36880744 PMCID: PMC9998659 DOI: 10.1083/jcb.202111094] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/22/2021] [Revised: 12/03/2022] [Accepted: 01/31/2023] [Indexed: 03/08/2023] Open
Abstract
Time-lapse microscopy movies have transformed the study of subcellular dynamics. However, manual analysis of movies can introduce bias and variability, obscuring important insights. While automation can overcome such limitations, spatial and temporal discontinuities in time-lapse movies render methods such as 3D object segmentation and tracking difficult. Here, we present SpinX, a framework for reconstructing gaps between successive image frames by combining deep learning and mathematical object modeling. By incorporating expert feedback through selective annotations, SpinX identifies subcellular structures, despite confounding neighbor-cell information, non-uniform illumination, and variable fluorophore marker intensities. The automation and continuity introduced here allows the precise 3D tracking and analysis of spindle movements with respect to the cell cortex for the first time. We demonstrate the utility of SpinX using distinct spindle markers, cell lines, microscopes, and drug treatments. In summary, SpinX provides an exciting opportunity to study spindle dynamics in a sophisticated way, creating a framework for step changes in studies using time-lapse microscopy.
Collapse
Affiliation(s)
- David Dang
- School of Biological and Behavioural Sciences, Queen Mary University of London , London, UK.,Department of Informatics, King's College London , London, UK
| | | | - Dijue Sun
- School of Biological and Behavioural Sciences, Queen Mary University of London , London, UK
| | - Haoran Yue
- School of Biological and Behavioural Sciences, Queen Mary University of London , London, UK
| | | | - Viji M Draviam
- School of Biological and Behavioural Sciences, Queen Mary University of London , London, UK
| |
Collapse
|
13
|
Podunavac I, Knežić T, Djisalov M, Omerovic N, Radovic M, Janjušević L, Stefanovic D, Panic M, Gadjanski I, Radonic V. Mammalian Cell-Growth Monitoring Based on an Impedimetric Sensor and Image Processing within a Microfluidic Platform. SENSORS (BASEL, SWITZERLAND) 2023; 23:3748. [PMID: 37050808 PMCID: PMC10099282 DOI: 10.3390/s23073748] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 03/06/2023] [Revised: 03/26/2023] [Accepted: 03/31/2023] [Indexed: 06/19/2023]
Abstract
In recent years, advancements in microfluidic and sensor technologies have led to the development of new methods for monitoring cell growth both in macro- and micro-systems. In this paper, a microfluidic (MF) platform with a microbioreactor and integrated impedimetric sensor is proposed for cell growth monitoring during the cell cultivation process in a scaled-down simulator. The impedimetric sensor with an interdigitated electrode (IDE) design was realized with inkjet printing and integrated into the custom-made MF platform, i.e., the scaled-down simulator. The proposed method, which was integrated into a simple and rapid fabrication MF system, presents an excellent candidate for the scaled-down analyses of cell growths that can be of use in, e.g., optimization of the cultivated meat bioprocess. When applied to MRC-5 cells as a model of adherent mammalian cells, the proposed sensor was able to precisely detect all phases of cell growth (the lag, exponential, stationary, and dying phases) during a 96-h cultivation period with limited available nutrients. By combining the impedimetric approach with image processing, the platform enables the real-time monitoring of biomasses and advanced control of cell growth progress in microbioreactors and scaled-down simulator systems.
Collapse
|
14
|
Hori K, Kajita S, Zhang R, Tanaka H, Ohno N. Growth origin of large-scale fiberform nanostructures in He-W co-deposition environment. Sci Rep 2023; 13:5450. [PMID: 37012277 PMCID: PMC10070440 DOI: 10.1038/s41598-023-32621-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/28/2023] [Accepted: 03/30/2023] [Indexed: 04/05/2023] Open
Abstract
When tungsten (W) is deposited with helium (He) plasma (He-W co-deposition) on W surface, enhanced growth of fiberform nanostructure (fuzz) occurs, and sometimes it grows into large-scale fuzzy nanostructures (LFNs) thicker than 0.1 mm. In this study, different numbers of mesh opening (apertures) and W plates with nanotendril bundles (NTBs), which are tens of micrometers high nanofiber bundles, were used to investigate the condition for the origin of the LFN growth. It was found that the larger the mesh opening, the larger the area where LFNs are formed and the faster the formation tends to be. On NTB samples, it was found that NTBs grew significantly when exposed to He plasma with W deposition, especially when the size of the NTB reached [Formula: see text] mm. The concentration of the He flux due to the distortion of the shape of the ion sheath is proposed as one of the reasons to explain the experimental results.
Collapse
Affiliation(s)
- Kenta Hori
- Graduate School of Enginnering, Nagoya University, Nagoya, 464-8603, Japan
| | - Shin Kajita
- Graduate School of Enginnering, Nagoya University, Nagoya, 464-8603, Japan.
- Graduate School of Frontier Sciences, The University of Tokyo, Kashiwa, Chiba, 277-8561, Japan.
| | - Rongshi Zhang
- Graduate School of Enginnering, Nagoya University, Nagoya, 464-8603, Japan
| | - Hirohiko Tanaka
- Graduate School of Enginnering, Nagoya University, Nagoya, 464-8603, Japan
- Institute of Materials and Systems for Sustainability, Nagoya University, Nagoya, 464-8603, Japan
| | - Noriyasu Ohno
- Graduate School of Enginnering, Nagoya University, Nagoya, 464-8603, Japan
- Institute of Materials and Systems for Sustainability, Nagoya University, Nagoya, 464-8603, Japan
| |
Collapse
|
15
|
Fakhouri FS, Joseph M, Ballinger M, Shukla V, Weimar D, Novak C, Ghadiali S, Kolipaka A. Magnetic Resonance Elastography (MRE) of Bleomycin-Induced Pulmonary Fibrosis in an Animal Model. Invest Radiol 2023; 58:299-306. [PMID: 36730906 PMCID: PMC10023269 DOI: 10.1097/rli.0000000000000935] [Citation(s) in RCA: 3] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/04/2023]
Abstract
BACKGROUND Idiopathic pulmonary fibrosis is responsible for 40,000 deaths annually in the United States. A hallmark of idiopathic pulmonary fibrosis is elevated collagen deposition, which alters lung stiffness. Clinically relevant ways to measure changes in lung stiffness during pulmonary fibrosis are not available, and new noninvasive imaging methods are needed to measure changes in lung mechanical properties. OBJECTIVES Magnetic resonance elastography (MRE) is an in vivo magnetic resonance imaging technique proven to detect changes in shear stiffness in different organs. This study used MRE, histology, and bronchoalveolar lavage (BAL) to study changes in the mechanical and structural properties of the lungs after bleomycin-induced pulmonary fibrosis in pigs. MATERIALS AND METHODS Pulmonary fibrosis was induced in 9 Yorkshire pigs by intratracheal instillation of 2 doses of bleomycin into the right lung only. Magnetic resonance elastography scans were performed at baseline and week 4 and week 8 postsurgery in a 1.5 T magnetic resonance imaging scanner using a spin-echo echo planar imaging sequence to measure changes in lung shear stiffness. At the time of each scan, a BAL was performed. After the final scan, whole lung tissue was removed and analyzed for histological changes. RESULTS Mean MRE-derived stiffness measurements at baseline, week 4, and week 8 for the control (left) lungs were 1.02 ± 0.27 kPa, 0.86 ± 0.29 kPa, and 0.68 ± 0.20 kPa, respectively. The ratio of the shear stiffness in the injured (right) lung to the uninjured control (left) lung at baseline, week 4, and week 8 was 0.98 ± 0.23, 1.52 ± 0.41, and 1.64 ± 0.40, respectively. High-dose animals showed increased protein in BAL fluid, elevated inflammation observed by the presence of patchy filtrates, and enhanced collagen and α-smooth muscle actin staining on histological sections. Low-dose animals and the control (left) lungs of high-dose animals did not show significant histopathological changes. CONCLUSION This study demonstrated that MRE can be used to detect changes in lung stiffness in pigs after bleomycin challenge.
Collapse
Affiliation(s)
- Faisal S. Fakhouri
- Department of Biomedical Engineering, The Ohio State University, Columbus, OH, 43210, USA
- Department of Radiology, The Ohio State University Wexner Medical Center, Columbus, OH, 43210, USA
- Department of Biomedical Technology, King Saud University, Riyadh, 12372, KSA
| | - Matthew Joseph
- Davis Heart and Lung Research Institute, The Ohio State University, Columbus, OH, 43210, USA
| | - Megan Ballinger
- Davis Heart and Lung Research Institute, The Ohio State University, Columbus, OH, 43210, USA
- Division of Pulmonary, Critical Care, and Sleep Medicine, The Ohio State University Wexner Medical Center, Columbus, OH, 43210, USA
| | - Vasudha Shukla
- Department of Biomedical Engineering, The Ohio State University, Columbus, OH, 43210, USA
| | - David Weimar
- Davis Heart and Lung Research Institute, The Ohio State University, Columbus, OH, 43210, USA
- Division of Pulmonary, Critical Care, and Sleep Medicine, The Ohio State University Wexner Medical Center, Columbus, OH, 43210, USA
| | - Caymen Novak
- Davis Heart and Lung Research Institute, The Ohio State University, Columbus, OH, 43210, USA
- Division of Pulmonary, Critical Care, and Sleep Medicine, The Ohio State University Wexner Medical Center, Columbus, OH, 43210, USA
| | - Samir Ghadiali
- Department of Biomedical Engineering, The Ohio State University, Columbus, OH, 43210, USA
- Division of Pulmonary, Critical Care, and Sleep Medicine, The Ohio State University Wexner Medical Center, Columbus, OH, 43210, USA
| | - Arunark Kolipaka
- Department of Biomedical Engineering, The Ohio State University, Columbus, OH, 43210, USA
- Department of Radiology, The Ohio State University Wexner Medical Center, Columbus, OH, 43210, USA
| |
Collapse
|
16
|
Shen J, Luo M, Liu H, Liao P, Chen H, Zhang Y. MLF-IOSC: Multi-Level Fusion Network With Independent Operation Search Cell for Low-Dose CT Denoising. IEEE TRANSACTIONS ON MEDICAL IMAGING 2023; 42:1145-1158. [PMID: 36423311 DOI: 10.1109/tmi.2022.3224396] [Citation(s) in RCA: 3] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/16/2023]
Abstract
Computed tomography (CT) is widely used in clinical medicine, and low-dose CT (LDCT) has become popular to reduce potential patient harm during CT acquisition. However, LDCT aggravates the problem of noise and artifacts in CT images, increasing diagnosis difficulty. Through deep learning, denoising CT images by artificial neural network has aroused great interest for medical imaging and has been hugely successful. We propose a framework to achieve excellent LDCT noise reduction using independent operation search cells, inspired by neural architecture search, and introduce the Laplacian to further improve image quality. Employing patch-based training, the proposed method can effectively eliminate CT image noise while retaining the original structures and details, hence significantly improving diagnosis efficiency and promoting LDCT clinical applications.
Collapse
|
17
|
Boiko DA, Kashin AS, Sorokin VR, Agaev YV, Zaytsev RG, Ananikov VP. Analyzing ionic liquid systems using real-time electron microscopy and a computational framework combining deep learning and classic computer vision techniques. J Mol Liq 2023. [DOI: 10.1016/j.molliq.2023.121407] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/11/2023]
|
18
|
Mishiba K. Fast Guided Median Filter. IEEE TRANSACTIONS ON IMAGE PROCESSING : A PUBLICATION OF THE IEEE SIGNAL PROCESSING SOCIETY 2023; PP:737-749. [PMID: 37018332 DOI: 10.1109/tip.2022.3232916] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/19/2023]
Abstract
Faster computation of a weighted median (WM) filter is impeded by the construction of a weighted histogram for every local window of data. Since the calculated weights vary for each local window, it is difficult, using a sliding window approach, to construct the weighted histogram efficiently. In this paper, we propose a novel WM filter that overcomes the difficulty of histogram construction. Our proposed method achieves real-time processing for higher resolution images and can be applied to multidimensional, multichannel, and high precision data. The weight kernel used in our WM filter is the pointwise guided filter, which is derived from the guided filter. The use of kernels based on the guided filter avoids gradient reversal artifacts and shows a higher denoising performance than the Gaussian kernel based on the color/intensity distance. The core idea of the proposed method is a formulation that allows the use of histogram updates with a sliding window approach to find the weighted median. For high precision data we propose an algorithm based on a linked list that can reduce the memory requirements of storing histograms and the computational cost of updating them. We present implementations of the proposed method that are suitable for both CPU and GPU. Experimental results show that the proposed method indeed realizes faster computation than conventional WM filters and is capable of filtering multidimensional, multichannel, and high precision data. This is an approach which is difficult to achieve with conventional methods.
Collapse
|
19
|
Göreke V. A novel method based on Wiener filter for denoising Poisson noise from medical X-Ray images. Biomed Signal Process Control 2023. [DOI: 10.1016/j.bspc.2022.104031] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
|
20
|
Zou D, Yang B. Infrared and low-light visible image fusion based on hybrid multiscale decomposition and adaptive light adjustment. OPTICS AND LASERS IN ENGINEERING 2023; 160:107268. [DOI: 10.1016/j.optlaseng.2022.107268] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 09/01/2023]
|
21
|
Gowda SB, Banu A, Salim S, Peker KA, Mohammad F. Serotonin distinctly controls behavioral states in restrained and freely moving Drosophila. iScience 2022; 26:105886. [PMID: 36654863 PMCID: PMC9840979 DOI: 10.1016/j.isci.2022.105886] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/05/2022] [Revised: 11/09/2022] [Accepted: 12/22/2022] [Indexed: 12/29/2022] Open
Abstract
When trapped in a physical restraint, animals must select an escape strategy to increase their chances of survival. After falling into an inescapable trap, they react with stereotypical behaviors that differ from those displayed in escapable situations. Such behaviors involve either a wriggling response to unlock the trap or feigning death to fend off a predator attack. The neural mechanisms that regulate animal behaviors have been well characterized for escapable situations but not for inescapable traps. We report that restrained vinegar flies exhibit alternating flailing and immobility to free themselves from the trap. We used optogenetics and intersectional genetic approaches to show that, while broader serotonin activation promotes immobility, serotonergic cells in the ventral nerve cord (VNC) regulate immobility states majorly via 5-HT7 receptors. Restrained and freely moving locomotor states are controlled by distinct mechanisms. Taken together, our study has identified serotonergic switches of the VNC that promote environment-specific adaptive behaviors.
Collapse
Affiliation(s)
- Swetha B.M. Gowda
- Division of Biological and Biomedical Sciences (BBS), College of Health & Life Sciences (CHLS), Hamad Bin Khalifa University (HBKU), Doha 34110, Qatar
| | - Ayesha Banu
- Division of Biological and Biomedical Sciences (BBS), College of Health & Life Sciences (CHLS), Hamad Bin Khalifa University (HBKU), Doha 34110, Qatar
| | - Safa Salim
- Division of Biological and Biomedical Sciences (BBS), College of Health & Life Sciences (CHLS), Hamad Bin Khalifa University (HBKU), Doha 34110, Qatar
| | | | - Farhan Mohammad
- Division of Biological and Biomedical Sciences (BBS), College of Health & Life Sciences (CHLS), Hamad Bin Khalifa University (HBKU), Doha 34110, Qatar,Corresponding author
| |
Collapse
|
22
|
Kerkaou Z, El Ansari M, Masmoudi L, Lahmyed R. Omnidirectional spatio-temporal matching based on machine learning. Soft comput 2022. [DOI: 10.1007/s00500-022-07629-0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/21/2022]
|
23
|
Zhong L, Yang Z, Tang H, Xu Y, Liu X, Shen J. Differential analysis of negative geotaxis climbing trajectories in Drosophila under different conditions. ARCHIVES OF INSECT BIOCHEMISTRY AND PHYSIOLOGY 2022; 111:e21922. [PMID: 35666567 DOI: 10.1002/arch.21922] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/20/2022] [Revised: 05/06/2022] [Accepted: 05/11/2022] [Indexed: 06/15/2023]
Abstract
The decline of Drosophila climbing behavior is one of the common phenomena of Drosophila aging. The so-called negative geotaxis refers to the natural upward climbing behavior of Drosophila melanogaster after it oscillates to the bottom of the test tube. The strength of climbing ability is regarded as the index of aging change of D. melanogaster. At present, many laboratories use the percentage of 10 fruit flies climbing a specific height in 5 s as a general indicator of the climbing ability of fruit flies. This group research index ignores the climbing performance of a single fruit fly, and the climbing height belongs to the concept of vertical distance in physics, which cannot truly and effectively reflect the concept of curve distance in the actual climbing process of fruit flies. Therefore, based on the image processing algorithm, we added an experimental method to draw the climbing trajectory of a single fruit fly. By comparing the differences in climbing behavior of fruit flies under different sex, group or single, oscillation condition or rotation inversion condition, we can find that the K-Nearest Neighbor target detection algorithm has good applicability in fruit fly climbing experiment, and the climbing ability of fruit flies decreases with age. Under the same experimental conditions, the climbing ability of female fruit flies was greater than that of male fruit flies. The climbing track length of a single fruit fly can better reflect the climbing process of a fruit fly.
Collapse
Affiliation(s)
- Lichao Zhong
- College of Artificial Intelligence, Hangzhou Dianzi University, Hangzhou, China
| | - Zhizhang Yang
- College of Artificial Intelligence, Hangzhou Dianzi University, Hangzhou, China
| | - Hao Tang
- College of Artificial Intelligence, Hangzhou Dianzi University, Hangzhou, China
| | - Yifan Xu
- College of Artificial Intelligence, Hangzhou Dianzi University, Hangzhou, China
| | - Xingyou Liu
- College of Artificial Intelligence, Hangzhou Dianzi University, Hangzhou, China
| | - Jie Shen
- College of Artificial Intelligence, Hangzhou Dianzi University, Hangzhou, China
| |
Collapse
|
24
|
An Improved U-Net Image Segmentation Method and Its Application for Metallic Grain Size Statistics. MATERIALS 2022; 15:ma15134417. [PMID: 35806543 PMCID: PMC9267311 DOI: 10.3390/ma15134417] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 05/10/2022] [Revised: 06/17/2022] [Accepted: 06/19/2022] [Indexed: 02/01/2023]
Abstract
Grain size is one of the most important parameters for metallographic microstructure analysis, which can partly determine the material performance. The measurement of grain size is based on accurate image segmentation methods, which include traditional image processing methods and emerging machine-learning-based methods. Unfortunately, traditional image processing methods can hardly segment grains correctly from metallographic images with low contrast and blurry boundaries. Moreover, the proposed machine-learning-based methods need a large dataset to train the model and can hardly deal with the segmentation challenge of complex images with fuzzy boundaries and complex structure. In this paper, an improved U-Net model is proposed to automatically accomplish image segmentation of complex metallographic images with only a small training set. The experiments on metallographic images show the significant advantage of the method, especially for the metallographic images with low contrast, a fuzzy boundary and complex structure. Compared with other deep learning methods, the improved U-Net scored higher in ACC, MIoU, Precision, and F1 indexes, among which ACC was 0.97, MIoU was 0.752, Precision was 0.98, and F1 was 0.96. The grain size was calculated based on the segmentation according to the American Society for Testing Material (ASTM) standards, producing a satisfactory result.
Collapse
|
25
|
Abbasi R, Balazs P, Marconi MA, Nicolakis D, Zala SM, Penn DJ. Capturing the songs of mice with an improved detection and classification method for ultrasonic vocalizations (BootSnap). PLoS Comput Biol 2022; 18:e1010049. [PMID: 35551265 PMCID: PMC9098080 DOI: 10.1371/journal.pcbi.1010049] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/13/2021] [Accepted: 03/22/2022] [Indexed: 12/02/2022] Open
Abstract
House mice communicate through ultrasonic vocalizations (USVs), which are above the range of human hearing (>20 kHz), and several automated methods have been developed for USV detection and classification. Here we evaluate their advantages and disadvantages in a full, systematic comparison, while also presenting a new approach. This study aims to 1) determine the most efficient USV detection tool among the existing methods, and 2) develop a classification model that is more generalizable than existing methods. In both cases, we aim to minimize the user intervention required for processing new data. We compared the performance of four detection methods in an out-of-the-box approach, pretrained DeepSqueak detector, MUPET, USVSEG, and the Automatic Mouse Ultrasound Detector (A-MUD). We also compared these methods to human visual or ‘manual’ classification (ground truth) after assessing its reliability. A-MUD and USVSEG outperformed the other methods in terms of true positive rates using default and adjusted settings, respectively, and A-MUD outperformed USVSEG when false detection rates were also considered. For automating the classification of USVs, we developed BootSnap for supervised classification, which combines bootstrapping on Gammatone Spectrograms and Convolutional Neural Networks algorithms with Snapshot ensemble learning. It successfully classified calls into 12 types, including a new class of false positives that is useful for detection refinement. BootSnap outperformed the pretrained and retrained state-of-the-art tool, and thus it is more generalizable. BootSnap is freely available for scientific use. House mice and many other species use ultrasonic vocalizations to communicate in various contexts including social and sexual interactions. These vocalizations are increasingly investigated in research on animal communication and as a phenotype for studying the genetic basis of autism and speech disorders. Because manual methods for analyzing vocalizations are extremely time consuming, automatic tools for detection and classification are needed. We evaluated the performance of the available tools for analyzing ultrasonic vocalizations, and we compared detection tools for the first time to manual methods (“ground truth”) using recordings from wild-derived and laboratory mice. For the first time, class-wise inter-observer reliability of manual labels used for ground truth are analyzed and reported. Moreover, we developed a new classification method based on ensemble deep learning that provides more generalizability than the current state-of-the-art tool (both pretrained and retrained). Our new classification method is free for scientific use.
Collapse
Affiliation(s)
- Reyhaneh Abbasi
- Acoustic Research Institute, Austrian Academy of Sciences, Vienna, Austria
- Konrad Lorenz Institute of Ethology, Department of Interdisciplinary Life Sciences, University of Veterinary Medicine, Vienna, Austria
- Vienna Doctoral School of Cognition, Behaviour and Neuroscience, University of Vienna, Vienna, Austria
- * E-mail:
| | - Peter Balazs
- Acoustic Research Institute, Austrian Academy of Sciences, Vienna, Austria
| | - Maria Adelaide Marconi
- Konrad Lorenz Institute of Ethology, Department of Interdisciplinary Life Sciences, University of Veterinary Medicine, Vienna, Austria
| | - Doris Nicolakis
- Konrad Lorenz Institute of Ethology, Department of Interdisciplinary Life Sciences, University of Veterinary Medicine, Vienna, Austria
| | - Sarah M. Zala
- Konrad Lorenz Institute of Ethology, Department of Interdisciplinary Life Sciences, University of Veterinary Medicine, Vienna, Austria
| | - Dustin J. Penn
- Konrad Lorenz Institute of Ethology, Department of Interdisciplinary Life Sciences, University of Veterinary Medicine, Vienna, Austria
| |
Collapse
|
26
|
Li Y, Zhu R, Yeh M, Qu A. Dermoscopic Image Classification with Neural Style Transfer. J Comput Graph Stat 2022. [DOI: 10.1080/10618600.2022.2061496] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/18/2022]
Affiliation(s)
| | - Ruoqing Zhu
- Department of Statistics, University of Illinois at Urbana-Champaign
| | | | - Annie Qu
- Department of Statistics, University of California, Irvine
| |
Collapse
|
27
|
Yang S, Kim K, Lee Y. Dense depth estimation from multiple 360-degree images using virtual depth. APPL INTELL 2022. [DOI: 10.1007/s10489-022-03391-w] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/02/2022]
|
28
|
Appiah O, Asante M, Hayfron-Acquah JB. Improved approximated median filter algorithm for real-time computer vision applications. JOURNAL OF KING SAUD UNIVERSITY - COMPUTER AND INFORMATION SCIENCES 2022. [DOI: 10.1016/j.jksuci.2020.04.005] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 10/24/2022]
|
29
|
Abstract
Human Activity Recognition (HAR) is the process of identifying human actions in a specific environment. Recognizing human activities from video streams is a challenging task due to problems such as background noise, partial occlusion, changes in scale, orientation, lighting, and the unstable capturing process. Such multi-dimensional and none-linear process increases the complexity, making traditional solutions inefficient in terms of several performance indicators such as accuracy, time, and memory. This paper proposes a technique to select a set of representative features that can accurately recognize human activities from video streams, while minimizing the recognition time and memory. The extracted features are projected on a canvas, which keeps the synchronization property of the spatiotemporal information. The proposed technique is developed to select the features that refer only to progression of changes. The original RGB frames are preprocessed using background subtraction to extract the subject. Then the activity pattern is extracted through the proposed Growth method. Three experiments were conducted; the first experiment was a baseline to compare the classification task using the original RGB features. The second experiment relied on classifying activities using the proposed feature-selection method. Finally, the third experiment provided a sensitivity analysis that compares between the effect of both techniques on time and memory resources. The results indicated that the proposed method outperformed original RBG feature-selection method in terms of accuracy, time, and memory requirements.
Collapse
|
30
|
Wójcicka A, Walusiak Ł, Mroczka K, Jaworek-Korjakowska JK, Oprzędkiewicz K, Wrobel Z. The Object Segmentation from the Microstructure of a FSW Dissimilar Weld. MATERIALS 2022; 15:ma15031129. [PMID: 35161074 PMCID: PMC8839914 DOI: 10.3390/ma15031129] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 12/28/2021] [Revised: 01/25/2022] [Accepted: 01/28/2022] [Indexed: 02/01/2023]
Abstract
Friction stir welding (FSW) is an environmentally friendly, solid-state welding technique. In this research work, we analyze the microstructure of a new type of FSW weld applying a two- stage framework based on image processing algorithms containing a segmentation step and microstructure analysis of objects occurring in different layers. A dual-speed tool as used to prepare the tested weld. In this paper, we present the segmentation method for recognizing areas containing particles forming bands in the microstructure of a dissimilar weld of aluminum alloys made by FSW technology. A digital analysis was performed on the images obtained using an Olympus GX51 light microscope. The image analysis process consisted of basic segmentation methods in conjunction with domain knowledge and object detection located in different layers of a weld using morphological operations and point transformations. These methods proved to be effective in the analysis of the microstructure images corrupted by noise. The segmentation parts as well as single objects were separated enough to analyze the distribution on different layers of the specimen and the variability of shape and size of the underlying microstructures, which was not possible without computer vision support.
Collapse
Affiliation(s)
- Anna Wójcicka
- Department of Automatic Control and Robotics, AGH University of Science and Technology, 30-059 Cracow, Poland; (J.K.J.-K.); (K.O.)
- Correspondence:
| | - Łukasz Walusiak
- Faculty of Architecture, Civil Engineering and Applied Arts, University of Technology, Rolna 43, 40-555 Katowice, Poland;
| | - Krzysztof Mroczka
- Faculty of Materials Engineering and Physics, Cracow University of Technology, 31-864 Cracow, Poland;
| | | | - Krzysztof Oprzędkiewicz
- Department of Automatic Control and Robotics, AGH University of Science and Technology, 30-059 Cracow, Poland; (J.K.J.-K.); (K.O.)
| | - Zygmunt Wrobel
- Institute of Biomedical Engineering, Faculty of Science and Technology, University of Silesia in Katowice, 41-205 Sosnowiec, Poland;
| |
Collapse
|
31
|
A Fast Two-Stage Bilateral Filter Using Constant Time O(1) Histogram Generation. SENSORS 2022; 22:s22030926. [PMID: 35161677 PMCID: PMC8840302 DOI: 10.3390/s22030926] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 12/27/2021] [Revised: 01/22/2022] [Accepted: 01/24/2022] [Indexed: 02/01/2023]
Abstract
Bilateral Filtering (BF) is an effective edge-preserving smoothing technique in image processing. However, an inherent problem of BF for image denoising is that it is challenging to differentiate image noise and details with the range kernel, thus often preserving both noise and edges in denoising. This letter proposes a novel Dual-Histogram BF (DHBF) method that exploits an edge-preserving noise-reduced guidance image to compute the range kernel, removing isolated noisy pixels for better denoising results. Furthermore, we approximate the spatial kernel using mean filtering based on column histogram construction to achieve constant-time filtering regardless of the kernel radius’ size and achieve better smoothing. Experimental results on multiple benchmark datasets for denoising show that the proposed DHBF outperforms other state-of-the-art BF methods.
Collapse
|
32
|
Change Target Extraction Based on Scale-Adaptive Difference Image and Morphology Filter for KOMPSAT-5. REMOTE SENSING 2022. [DOI: 10.3390/rs14020245] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
Abstract
Multitemporal synthetic aperture radar (SAR) images have been widely used for change detection and monitoring of the environment owing to their competency under all weather conditions. However, owing to speckle backgrounds and strong reflections, change detection in urban areas is challenging. In this study, to automatically extract changed objects, we developed a model that integrated change detection and object extraction in multiple Korean Multi-Purpose Satellite-5 (KOMPSAT-5) images. Initially, two arbitrary L1A-level SAR images were input into the proposed model, and after pre-processing, such as radio calibration and coordinate system processing, change detection was performed. Subsequently, the desired targets were automatically extracted from the change detection results. Finally, the model obtained images of the extraction targets and metadata, such as date and location. Noise was removed by applying scale-adaptive modification to the generated difference image during the change detection process, and the detection accuracy was improved by emphasizing the occurrence of the change. After polygonizing the pixel groups of the change detection map in the target extraction process, the morphology-based object filtering technique was applied to minimize the false detection rate. As a result of the proposed approach, the changed objects in the KOMPSAT-5 images were automatically extracted with 90% accuracy.
Collapse
|
33
|
Fakhouri F, Kannengiesser S, Pfeuffer J, Gokun Y, Kolipaka A. Free-breathing MR elastography of the lungs: An in vivo study. Magn Reson Med 2022; 87:236-248. [PMID: 34463400 PMCID: PMC8616792 DOI: 10.1002/mrm.28986] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/29/2021] [Revised: 08/04/2021] [Accepted: 08/06/2021] [Indexed: 01/03/2023]
Abstract
PURPOSE Lung stiffness alters with many diseases; therefore, several MR elastography (MRE) studies were performed earlier to investigate the stiffness of the right lung during breathhold at residual volume and total lung capacity. The aims of this study were 1) to estimate shear stiffness of the lungs using MRE under free breathing and demonstrate the measurements' repeatability and reproducibility, and 2) to compare lung stiffness under free breathing to breathhold and as a function of age and gender. METHODS Twenty-five healthy volunteers were scanned on a 1.5 Tesla MRI scanner. Spin-echo dual-density spiral and a spin-echo EPI MRE sequences were used to measure shear stiffness of the lungs during free breathing and breathhold at midpoint of tidal volume, respectively. Concordance correlation coefficient and Bland-Altman analyses were performed to determine the repeatability and reproducibility of the spin-echo dual-density spiral-derived shear stiffness. Repeated measures analyses of variances were used to investigate differences in shear stiffness between spin-echo dual-density spiral and spin-echo EPI, right and left lungs, males and females, and different age groups. RESULTS Free-breathing MRE sequence was highly repeatable and reproducible (concordance correlation coefficient > 0.86 for both lungs). Lung stiffness was significantly lower in breathhold than in free breathing (P < .001), which can be attributed to potential stress relaxation of lung parenchyma or breathhold inconsistencies. However, there was no significant difference between different age groups (P = .08). The left lung showed slightly higher stiffness values than the right lung (P = .14). There is no significant difference in lung stiffness between genders. CONCLUSION This study demonstrated the feasibility of free-breathing lung MRE with excellent repeatability and reproducibility. Stiffness changes with age and during the respiratory cycle. However, gender does not influence lungs stiffness.
Collapse
Affiliation(s)
- Faisal Fakhouri
- Department of Biomedical Engineering, The Ohio State University, Columbus, OH, 43210, USA.,Department of Radiology, The Ohio State University Wexner Medical Center, Columbus, OH, 43210, USA
| | | | - Josef Pfeuffer
- MR Application Development, Siemens Healthcare GmbH, Erlangen, Germany
| | - Yevgeniya Gokun
- Department of Biomedical Informatics, Center for Biostatistics, The Ohio State University, Columbus, OH 43210, USA
| | - Arunark Kolipaka
- Department of Biomedical Engineering, The Ohio State University, Columbus, OH, 43210, USA.,Department of Radiology, The Ohio State University Wexner Medical Center, Columbus, OH, 43210, USA
| |
Collapse
|
34
|
Tenorio-Hallé L, Thode AM, Lammers MO, Conrad AS, Kim KH. Multi-target 2D tracking method for singing humpback whales using vector sensors. THE JOURNAL OF THE ACOUSTICAL SOCIETY OF AMERICA 2022; 151:126. [PMID: 35105036 DOI: 10.1121/10.0009165] [Citation(s) in RCA: 6] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/30/2021] [Accepted: 12/06/2021] [Indexed: 06/14/2023]
Abstract
Acoustic vector sensors allow estimating the direction of travel of an acoustic wave at a single point by measuring both acoustic pressure and particle motion on orthogonal axes. In a two-dimensional plane, the location of an acoustic source can thus be determined by triangulation using the estimated azimuths from at least two vector sensors. However, when tracking multiple acoustic sources simultaneously, it becomes challenging to identify and link sequences of azimuthal measurements between sensors to their respective sources. This work illustrates how two-dimensional vector sensors, deployed off the coast of western Maui, can be used to generate azimuthal tracks from individual humpback whales singing simultaneously. Incorporating acoustic transport velocity estimates into the processing generates high-quality azimuthal tracks that can be linked between sensors by cross-correlating features of their respective azigrams, a particular time-frequency representation of sound directionality. Once the correct azimuthal track associations have been made between instruments, subsequent localization and tracking in latitude and longitude of simultaneous whales can be achieved using a minimum of two vector sensors. Two-dimensional tracks and positional uncertainties of six singing whales are presented, along with swimming speed estimates derived from a high-quality track.
Collapse
Affiliation(s)
- Ludovic Tenorio-Hallé
- Marine Physical Laboratory, Scripps Institution of Oceanography, University of California San Diego, La Jolla, California 92093-0238, USA
| | - Aaron M Thode
- Marine Physical Laboratory, Scripps Institution of Oceanography, University of California San Diego, La Jolla, California 92093-0238, USA
| | - Marc O Lammers
- Hawaiian Islands Humpback Whale National Marine Sanctuary, 726 S. Kihei Rd, Kihei, Hawaii 96753, USA
| | - Alexander S Conrad
- Greeneridge Sciences, Inc., 5266 Hollister Avenue, Suite 107, Santa Barbara, California 93111, USA
| | - Katherine H Kim
- Greeneridge Sciences, Inc., 5266 Hollister Avenue, Suite 107, Santa Barbara, California 93111, USA
| |
Collapse
|
35
|
An improved image processing scheme for automatic detection of harvested soybean seeds. JOURNAL OF FOOD MEASUREMENT AND CHARACTERIZATION 2021. [DOI: 10.1007/s11694-021-01124-0] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/25/2022]
|
36
|
Detection and Classification System for Rail Surface Defects Based on Eddy Current. SENSORS 2021; 21:s21237937. [PMID: 34883941 PMCID: PMC8659563 DOI: 10.3390/s21237937] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 09/15/2021] [Revised: 11/01/2021] [Accepted: 11/12/2021] [Indexed: 11/16/2022]
Abstract
The prospect of growth of a railway system impacts both the network size and its occupation. Due to the overloaded infrastructure, it is necessary to increase reliability by adopting fast maintenance services to reach economic and security conditions. In this context, one major problem is the excessive friction caused by the wheels. This contingency may cause ruptures with severe consequences. While eddy's current approaches are adequate to detect superficial damages in metal structures, there are still open challenges concerning automatic identification of rail defects. Herein, we propose an embedded system for online detection and location of rails defects based on eddy current. Moreover, we propose a new method to interpret eddy current signals by analyzing their wavelet transforms through a convolutional neural network. With this approach, the embedded system locates and classifies different types of anomalies, enabling an optimization of the railway maintenance plan. Field tests were performed, in which the rail anomalies were grouped in three classes: squids, weld and joints. The results showed a classification efficiency of ~98%, surpassing the most commonly used methods found in the literature.
Collapse
|
37
|
Abstract
We often take people’s ability to understand and produce line drawings for granted. But where should we draw lines, and why? We address psychological principles that underlie efficient representations of complex information in line drawings. First, 58 participants with varying degree of artistic experience produced multiple drawings of a small set of scenes by tracing contours on a digital tablet. Second, 37 independent observers ranked the drawings by how representative they are of the original photograph. Matching contours between drawings of the same scene revealed that the most consistently drawn contours tend to be drawn earlier. We generated half-images with the most- versus least-consistently drawn contours and asked 25 observers categorize the quickly presented scenes. Observers performed significantly better for the most compared to the least consistent half-images. The most consistently drawn contours were more likely to depict occlusion boundaries, whereas the least consistently drawn contours frequently depicted surface normals.
Collapse
Affiliation(s)
- Heping Sheng
- School of Medicine, Boston University, Boston, MA, United States of America
| | - John Wilder
- Department of Psychology, University of Toronto, Toronto, Canada
| | - Dirk B. Walther
- Department of Psychology, University of Toronto, Toronto, Canada
- * E-mail:
| |
Collapse
|
38
|
Ensemble Deep Learning for the Detection of COVID-19 in Unbalanced Chest X-ray Dataset. APPLIED SCIENCES-BASEL 2021. [DOI: 10.3390/app112210528] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/26/2022]
Abstract
The ongoing COVID-19 pandemic has caused devastating effects on humanity worldwide. With practical advantages and wide accessibility, chest X-rays (CXRs) play vital roles in the diagnosis of COVID-19 and the evaluation of the extent of lung damages incurred by the virus. This study aimed to leverage deep-learning-based methods toward the automated classification of COVID-19 from normal and viral pneumonia on CXRs, and the identification of indicative regions of COVID-19 biomarkers. Initially, we preprocessed and segmented the lung regions usingDeepLabV3+ method, and subsequently cropped the lung regions. The cropped lung regions were used as inputs to several deep convolutional neural networks (CNNs) for the prediction of COVID-19. The dataset was highly unbalanced; the vast majority were normal images, with a small number of COVID-19 and pneumonia images. To remedy the unbalanced distribution and to avoid biased classification results, we applied five different approaches: (i) balancing the class using weighted loss; (ii) image augmentation to add more images to minority cases; (iii) the undersampling of majority classes; (iv) the oversampling of minority classes; and (v) a hybrid resampling approach of oversampling and undersampling. The best-performing methods from each approach were combined as the ensemble classifier using two voting strategies. Finally, we used the saliency map of CNNs to identify the indicative regions of COVID-19 biomarkers which are deemed useful for interpretability. The algorithms were evaluated using the largest publicly available COVID-19 dataset. An ensemble of the top five CNNs with image augmentation achieved the highest accuracy of 99.23% and area under curve (AUC) of 99.97%, surpassing the results of previous studies.
Collapse
|
39
|
Huang J, Günther B, Achterhold K, Dierolf M, Pfeiffer F. Simultaneous two-color X-ray absorption spectroscopy using Laue crystals at an inverse-compton scattering X-ray facility. JOURNAL OF SYNCHROTRON RADIATION 2021; 28:1874-1880. [PMID: 34738942 PMCID: PMC8570203 DOI: 10.1107/s1600577521009437] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 06/08/2021] [Accepted: 09/09/2021] [Indexed: 06/13/2023]
Abstract
X-ray absorption spectroscopy (XAS) is an element-selective technique that provides electronic and structural information of materials and reveals the essential mechanisms of the reactions involved. However, the technique is typically conducted at synchrotrons and usually only probes one element at a time. In this paper, a simultaneous two-color XAS setup at a laboratory-scale synchrotron facility is proposed based on inverse Compton scattering (ICS) at the Munich Compact Light Source (MuCLS), which is based on inverse Compton scattering (ICS). The setup utilizes two silicon crystals in a Laue geometry. A proof-of-principle experiment is presented where both silver (Ag) and palladium (Pd) K-edge X-ray absorption near-edge structure spectra were simultaneously measured. The simplicity of the setup facilitates its migration to other ICS facilities or maybe to other X-ray sources (e.g. a bending-magnet beamline). Such a setup has the potential to study reaction mechanisms and synergistic effects of chemical systems containing multiple elements of interest, such as a bimetallic catalyst system.
Collapse
Affiliation(s)
- Juanjuan Huang
- Chair of Biomedical Physics, Department of Physics, School of Natural Sciences, Technical University of Munich, 85748 Garching, Germany
- Munich Institute of Biomedical Engineering, Technical University of Munich, 85748 Garching, Germany
| | - Benedikt Günther
- Chair of Biomedical Physics, Department of Physics, School of Natural Sciences, Technical University of Munich, 85748 Garching, Germany
- Munich Institute of Biomedical Engineering, Technical University of Munich, 85748 Garching, Germany
| | - Klaus Achterhold
- Chair of Biomedical Physics, Department of Physics, School of Natural Sciences, Technical University of Munich, 85748 Garching, Germany
- Munich Institute of Biomedical Engineering, Technical University of Munich, 85748 Garching, Germany
| | - Martin Dierolf
- Chair of Biomedical Physics, Department of Physics, School of Natural Sciences, Technical University of Munich, 85748 Garching, Germany
- Munich Institute of Biomedical Engineering, Technical University of Munich, 85748 Garching, Germany
| | - Franz Pfeiffer
- Chair of Biomedical Physics, Department of Physics, School of Natural Sciences, Technical University of Munich, 85748 Garching, Germany
- Munich Institute of Biomedical Engineering, Technical University of Munich, 85748 Garching, Germany
- Department of Diagnostic and Interventional Radiology, School of Medicine, Klinikum Rechts der Isar, Technical University of Munich, 81675 München, Germany
- Institute for Advanced Study, Technical University of Munich, 85748 Garching, Germany
| |
Collapse
|
40
|
Bielecki A, Śmigielski P. Three-Dimensional Outdoor Analysis of Single Synthetic Building Structures by an Unmanned Flying Agent Using Monocular Vision. SENSORS 2021; 21:s21217270. [PMID: 34770577 PMCID: PMC8587298 DOI: 10.3390/s21217270] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 07/25/2021] [Revised: 09/22/2021] [Accepted: 10/27/2021] [Indexed: 11/16/2022]
Abstract
An algorithm designed for analysis and understanding a 3D urban-type environment by an autonomous flying agent, equipped only with a monocular vision, is presented. The algorithm is hierarchical and is based on the structural representation of the analyzed scene. Firstly, the robot observes the scene from a high altitude to build a 2D representation of a single object and a graph representation of the 2D scene. The 3D representation of each object arises as a consequence of the robot’s actions, as a result of which it projects the object’s solid on different planes. The robot assigns the obtained representations to the corresponding vertex of the created graph. The algorithm was tested by using the embodied robot operating on the real scene. The tests showed that the robot equipped with the algorithm was able not only to localize the predefined object, but also to perform safe, collision-free maneuvers close to the structures in the scene.
Collapse
Affiliation(s)
- Andrzej Bielecki
- Institute of Computer Science, Faculty of Exact and Natural Sciences, Pedagogical University in Kraków, Podchorążych 2, 30-084 Kraków, Poland
- Correspondence: or
| | | |
Collapse
|
41
|
Gao Q, Liu X, Wang H, Wu P, Jin M, Wei R, Wang W, Niu Z, Zhao S, Li F. Optimization of 4D flow MRI velocity field in the aorta with divergence-free smoothing. Med Biol Eng Comput 2021; 59:2237-2252. [PMID: 34528164 DOI: 10.1007/s11517-021-02417-8] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/11/2020] [Accepted: 07/14/2021] [Indexed: 10/20/2022]
Abstract
Divergence-free smoothing with wall treatment (DFSwt) method is proposed for processing with four-dimensional (4D) flow magnetic resonance imaging (MRI) data of blood flows to enhance the quality of flow field with physical constraints. The new method satisfies the no-slip wall boundary condition and applies wall function of velocity profile for better estimating the velocity gradient in the near-wall region, and consequently improved wall shear stress (WSS) calculation against the issue of coarse resolution of 4D flow MRI. In the first testing case, blood flow field obtained from 4D flow MRI is well smoothed by DFSwt method. A great consistency is observed between the post-processed 4D flow MRI data and the computational fluid dynamics (CFD) data in the interested velocity field. WSS has an apparent improvement due to the proposed near-wall treatment with special wall function comparing to the result from original 4D flow MRI data or the DFS-processed data with no wall function. The other five cases also show the same performance that smoothed velocity field and improved WSS estimation are achieved on 4D flow MRI data optimized by DFSwt. The improvements will benefit the study of hemodynamics regarding the determination of location or the potential possibility of lesions.
Collapse
Affiliation(s)
- Qi Gao
- School of Aeronautics and Astronautics, Zhejiang University, Yuquan Campus, 38 Zheda Road, Xihu District, Hangzhou, 310027, China.
| | - Xingli Liu
- Hangzhou Shengshi Technology Co., Ltd., Hangzhou, China
| | - Hongping Wang
- The State Key Laboratory of Nonlinear Mechanics, Institute of Mechanics, Chinese Academy of Sciences, Beijing, China
| | - Peng Wu
- Artificial Organ Technology Lab, Bio-manufacturing Research Centre, School of Mechanical and Electric Engineering, Soochow University, Suzhou, China
| | - Mansu Jin
- Hangzhou Shengshi Technology Co., Ltd., Hangzhou, China
| | - RunJie Wei
- Hangzhou Shengshi Technology Co., Ltd., Hangzhou, China
| | - Wei Wang
- Department of Structural Heart Disease, Chinese Academy of Medical Sciences & Fuwai Hospital; State Key Laboratory of Cardiovascular Disease, Peking Union Medical College, 167 Beilishi Road, Xicheng District, 100037, Beijing, China
| | - Zhaozhuo Niu
- Cardiac Surgery, Qingdao Municipal Hospital, Qingdao, China
| | - Shihua Zhao
- Department of Magnetic Resonance Imaging, Chinese Academy of Medical Sciences & Fuwai Hospital, Peking Union Medical College, 167 Beilishi Road, Xicheng District, 100037, Beijing, China.
| | - Fei Li
- Department of Structural Heart Disease, Chinese Academy of Medical Sciences & Fuwai Hospital; State Key Laboratory of Cardiovascular Disease, Peking Union Medical College, 167 Beilishi Road, Xicheng District, 100037, Beijing, China. .,Department of Cardiac Surgery, Peking University First Hospital, Beijing, China.
| |
Collapse
|
42
|
Khare S, Kaushik P. Speckle filtering of ultrasonic images using weighted nuclear norm minimization in wavelet domain. Biomed Signal Process Control 2021. [DOI: 10.1016/j.bspc.2021.102997] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/24/2022]
|
43
|
Dilna KT, Jude Hemanth D. Novel image enhancement approaches for despeckling in ultrasound images for fibroid detection in human uterus. OPEN COMPUTER SCIENCE 2021. [DOI: 10.1515/comp-2020-0140] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/15/2022] Open
Abstract
Abstract
Ultrasonography is an extensively used medical imaging technique for multiple reasons. It works on the basic theory of echoes from the tissues under consideration. However, the occurrence of signal dependent noise such as speckle destroys utility of ultrasound images. Speckle noise is subject to the composition of image tissue and parameters of image. It reduces the effectiveness of many image processing steps and decreases human perception of fine details form ultrasound images. In many medical image processing methods, despeckling is used as the preprocessing step before segmentation and feature extraction. Many speckle reduction filters are proposed but while combining many techniques some speckle diagnostic information should be preserved. Removal of speckle noise from ultrasound image by preserving edges and added features is a great challenging task in ultrasound image restoration. This paper aims at a comprehensive description and comparison of reduction of speckle noise of ultrasound fibroid image. Many filters are applied on ultrasound scanned images and the performance is marked in terms of some statistical measures. Even though several despeckling filters are there for speckle reduction, all are not good for ultrasound scanned images. A comparison of quality measures such as mean square error, peak signal-to-noise ratio, and signal-to-noise ratio is done in ultrasound images in despeckling.
Collapse
Affiliation(s)
- Kaitheri Thacharedath Dilna
- Department of ECE, Karunya Institute of Technology and Sciences , Coimbatore , India
- Department of ECE, College of Engineering and Technology , Payyanur , India
| | | |
Collapse
|
44
|
Masked face recognition with convolutional neural networks and local binary patterns. APPL INTELL 2021; 52:5497-5512. [PMID: 34764616 PMCID: PMC8363871 DOI: 10.1007/s10489-021-02728-1] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 07/26/2021] [Indexed: 11/27/2022]
Abstract
Face recognition is one of the most common biometric authentication methods as its feasibility while convenient use. Recently, the COVID-19 pandemic is dramatically spreading throughout the world, which seriously leads to negative impacts on people’s health and economy. Wearing masks in public settings is an effective way to prevent viruses from spreading. However, masked face recognition is a highly challenging task due to the lack of facial feature information. In this paper, we propose a method that takes advantage of the combination of deep learning and Local Binary Pattern (LBP) features to recognize the masked face by utilizing RetinaFace, a joint extra-supervised and self-supervised multi-task learning face detector that can deal with various scales of faces, as a fast yet effective encoder. In addition, we extract local binary pattern features from masked face’s eye, forehead and eyebow areas and combine them with features learnt from RetinaFace into a unified framework for recognizing masked faces. In addition, we collected a dataset named COMASK20 from 300 subjects at our institution. In the experiment, we compared our proposed system with several state of the art face recognition methods on the published Essex dataset and our self-collected dataset COMASK20. With the recognition results of 87% f1-score on the COMASK20 dataset and 98% f1-score on the Essex dataset, these demonstrated that our proposed system outperforms Dlib and InsightFace, which has shown the effectiveness and suitability of the proposed method. The COMASK20 dataset is available on https://github.com/tuminguyen/COMASK20 for research purposes.
Collapse
|
45
|
Juneja M, Kaur Saini S, Kaul S, Acharjee R, Thakur N, Jindal P. Denoising of magnetic resonance imaging using Bayes shrinkage based fused wavelet transform and autoencoder based deep learning approach. Biomed Signal Process Control 2021. [DOI: 10.1016/j.bspc.2021.102844] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/21/2022]
|
46
|
Fan T, Wang G, Li Y, Wang Z, Wang H. A Multi-Scale Information Fusion Level Set for Breast Tumor Segmentation. JOURNAL OF MEDICAL IMAGING AND HEALTH INFORMATICS 2021. [DOI: 10.1166/jmihi.2021.3635] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/23/2022]
Abstract
Purpose: Mammography is considered an effective method of examination in early breast cancer screening. Massive work by distinguished researchers of breast segmentation has been proposed. However, due to the blurry boundaries of the breast tumor, the variability of its shape
and the overlap with surrounding tissue, the breast tumor’s accurate segmentation still is a challenge. Methods: In this paper, we proposed a novel level set model which based on the optimized local region driven gradient enhanced level set model (OLR-GCV) to segment tumor within
a region of interest (ROI) in a mammogram. Firstly, Noise, labels and artifacts are removed from breast images. The ROI is then obtained using the intuitionistic fuzzy C-means method. Finally, we used OLR-GCV method to accurately segment the breast tumor. The OLR-GCV model combines regional
information, enhanced edge information and optimized Laplacian of Gaussian (LOG) energy term. The regional and enhanced edge information are used to capture local, global and gradient information of breast images. The optimized Laplacian of Gaussian (LOG) energy term is introduced in the energy
functional to further optimize edge information to improve segmentation accuracy. Results: We evaluated our method on the MIAS and DDSM datasets. It yielded a Dice value of 96.86% on the former and 95.51% on the latter. Our method proposed achieves higher accuracy of segmentation than
other State-of-the-art Methods. Conclusions: Our method has better segmentation performance, and can be used in clinical practice.
Collapse
Affiliation(s)
- Tongle Fan
- College of Electronic and Information Engineering, Hebei University, Baoding, Hebei 071002, China
| | - Guanglei Wang
- College of Electronic and Information Engineering, Hebei University, Baoding, Hebei 071002, China
| | - Yan Li
- College of Electronic and Information Engineering, Hebei University, Baoding, Hebei 071002, China
| | - Zhongyang Wang
- Affiliated Hospital of Hebei University, Banding, Hebei 071002, China
| | - Hongrui Wang
- College of Electronic and Information Engineering, Hebei University, Baoding, Hebei 071002, China
| |
Collapse
|
47
|
Naik VN, Gamad RS, Bansod PP. Effect of Despeckling Filters on the Segmentation of Ultrasound Common Carotid Artery Images. Biomed J 2021; 45:686-695. [PMID: 34273550 PMCID: PMC9486865 DOI: 10.1016/j.bj.2021.07.002] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/10/2016] [Revised: 06/12/2021] [Accepted: 07/07/2021] [Indexed: 11/22/2022] Open
Abstract
Background Carotid intima-media thickness (IMT) measured in B-mode ultrasound image is an important indicator of Atherosclerosis disease. Speckle noise inherently present in ultrasounds’ thereby degrades the visual evaluation and limits the automated segmentation performance. The objective of this study is to investigate the effects of three despeckle filters on the segmentation of carotid IMT in ultrasound image. Methods Automated segmentation of IMT is achieved by utilizing fast fuzzy c-mean clustering and distance-regularized level set without re-initialization techniques. Manual segmentation has been done by an experienced radiologist. The performances of median, hybrid median and improved adaptive complex diffusion (IACDF) filters are examined and a quantitative and qualitative comparison among these filters has been reported on 151 DICOM images. Bland–Altman plots were used to compare IMT results of these filters. Furthermore, performances of above three filters are evaluated under different noise levels by individually adding speckle and salt and pepper noise in ten randomly selected images from 151 DICOM dataset. Plots between noise and quality evaluation metric parameters are used to compare de-noising performance of these filters. Results The average processing time per image of proposed IMT measurement technique without-filter and with filter is approx 15.39 s max. Conclusion It is shown that the median filter (window 5 × 5) measures better than hybrid median and IACDF filters. Finally, concluded that de-noising of ultrasound image before segmentation procedure certainly improves segmentation accuracy. Furthermore, it is observed that these filters do not impose serious computational burden and entail moderate processing time.
Collapse
Affiliation(s)
- Vaishali Narendra Naik
- Electronics and Communication Engineering, Shri Govindram Sakseria Institute of Technology and Science, (M.P), India.
| | - R S Gamad
- Electronics and Instrumentation Engineering, Shri Govindram Sakseria Institute of Technology and Science, 23 Park Road, Indore, 452003, (M.P), India.
| | - P P Bansod
- Electronics and Instrumentation Engineering, Shri Govindram Sakseria Institute of Technology and Science, 23 Park Road, Indore, 452003, (M.P), India.
| |
Collapse
|
48
|
Abstract
Detecting buildings from high-resolution satellite imagery is beneficial in mapping, environmental preparation, disaster management, military planning, urban planning and research purposes. Differentiating buildings from the images is possible however, it may be a time-consuming or complicated process. Therefore, the high-resolution imagery from satellites needs to be automated to detect the buildings. Additionally, buildings exhibit several different characteristics, and their appearance in these images is unplanned. Moreover, buildings in the metropolitan environment are typically crowded and complicated. Therefore, it is challenging to identify the building and hard to locate them. To resolve this situation, a novel probabilistic method has been suggested using local features and probabilistic approaches. A local feature extraction technique was implemented, which was used to calculate the probability density function. The locations in the image were represented as joint probability distributions and were used to estimate their probability distribution function (pdf). The density of building locations in the image was extracted. Kernel density distribution was also used to find the density flow for different metropolitan cities such as Sydney (Australia), Tokyo (Japan), and Mumbai (India), which is useful for distribution intensity and pattern of facility point f interest (POI). The purpose system can detect buildings/rooftops and to test our system, we choose some crops with panchromatic high-resolution satellite images from Australia and our results looks promising with high efficiency and minimal computational time for feature extraction. We were able to detect buildings with shadows and building without shadows in 0.4468 (seconds) and 0.5126 (seconds) respectively.
Collapse
|
49
|
Lee KH, Choi ST, Lee GY, Ha YJ, Choi SI. Method for Diagnosing the Bone Marrow Edema of Sacroiliac Joint in Patients with Axial Spondyloarthritis Using Magnetic Resonance Image Analysis Based on Deep Learning. Diagnostics (Basel) 2021; 11:diagnostics11071156. [PMID: 34202607 PMCID: PMC8303557 DOI: 10.3390/diagnostics11071156] [Citation(s) in RCA: 19] [Impact Index Per Article: 6.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/08/2021] [Revised: 06/11/2021] [Accepted: 06/18/2021] [Indexed: 11/17/2022] Open
Abstract
Axial spondyloarthritis (axSpA) is a chronic inflammatory disease of the sacroiliac joints. In this study, we develop a method for detecting bone marrow edema by magnetic resonance (MR) imaging of the sacroiliac joints and a deep-learning network. A total of 815 MR images of the sacroiliac joints were obtained from 60 patients diagnosed with axSpA and 19 healthy subjects. Gadolinium-enhanced fat-suppressed T1-weighted oblique coronal images were used for deep learning. Active sacroiliitis was defined as bone marrow edema, and the following processes were performed: setting the region of interest (ROI) and normalizing it to a size suitable for input to a deep-learning network, determining bone marrow edema using a convolutional-neural-network-based deep-learning network for individual MR images, and determining sacroiliac arthritis in subject examinations based on the classification results of individual MR images. About 70% of the patients and normal subjects were randomly selected for the training dataset, and the remaining 30% formed the test dataset. This process was repeated five times to calculate the average classification rate of the five-fold sets. The gradient-weighted class activation mapping method was used to validate the classification results. In the performance analysis of the ResNet18-based classification network for individual MR images, use of the ROI showed excellent detection performance of bone marrow edema with 93.55 ± 2.19% accuracy, 92.87 ± 1.27% recall, and 94.69 ± 3.03% precision. The overall performance was additionally improved using a median filter to reflect the context information. Finally, active sacroiliitis was diagnosed in individual subjects with 96.06 ± 2.83% accuracy, 100% recall, and 94.84 ± 3.73% precision. This is a pilot study to diagnose bone marrow edema by deep learning based on MR images, and the results suggest that MR analysis using deep learning can be a useful complementary means for clinicians to diagnose bone marrow edema.
Collapse
Affiliation(s)
- Kang Hee Lee
- Department of Computer Science and Engineering, Dankook University, Yongin-si 16890, Korea;
| | - Sang Tae Choi
- Division of Rheumatology, Department of Internal Medicine, Chung-Ang University College of Medicine, Seoul 06973, Korea;
| | - Guen Young Lee
- Department of Radiology, Chung-Ang University College of Medicine, Seoul 06973, Korea;
| | - You Jung Ha
- Division of Rheumatology, Department of Internal Medicine, Seoul National University Bundang Hospital, Yongin-si 13620, Korea;
| | - Sang-Il Choi
- Department of Computer Engineering, Dankook University, Yongin-si 16890, Korea
- Correspondence: ; Tel.: +82-31-8005-3657
| |
Collapse
|
50
|
Convolutional neural network with median layers for denoising salt-and-pepper contaminations. Neurocomputing 2021. [DOI: 10.1016/j.neucom.2021.02.010] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/19/2022]
|