1
|
Bharadwaj S, Prasad S, Almekkawy M. An Upgraded Siamese Neural Network for Motion Tracking in Ultrasound Image Sequences. IEEE TRANSACTIONS ON ULTRASONICS, FERROELECTRICS, AND FREQUENCY CONTROL 2021; 68:3515-3527. [PMID: 34232873 DOI: 10.1109/tuffc.2021.3095299] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/28/2023]
Abstract
Deep learning is heavily being borrowed to solve problems in medical imaging applications, and Siamese neural networks are the front runners of motion tracking. In this article, we propose to upgrade one such Siamese architecture-based neural network for robust and accurate landmark tracking in ultrasound images to improve the quality of image-guided radiation therapy. Although several researchers have improved the Siamese architecture-based networks with sophisticated detection modules and by incorporating transfer learning, the inherent assumptions of the constant position model and the missing motion model remain unaddressed limitations. In our proposed model, we overcome these limitations by introducing two modules into the original architecture. We employ a reference template update to resolve the constant position model and a linear Kalman filter (LKF) to address the missing motion model. Moreover, we demonstrate that the proposed architecture provides promising results without transfer learning. The proposed model was submitted to an open challenge organized by MICCAI and was evaluated exhaustively on the Liver US Tracking (CLUST) 2D dataset. Experimental results proved that the proposed model tracked the landmarks with promising accuracy. Furthermore, we also induced synthetic occlusions to perform a qualitative analysis of the proposed approach. The evaluations were performed on the training set of the CLUST 2D dataset. The proposed method outperformed the original Siamese architecture by a significant margin.
Collapse
|
2
|
Ge Z, Gao Y, So HKH, Lam EY. Event-based laser speckle correlation for micro motion estimation. OPTICS LETTERS 2021; 46:3885-3888. [PMID: 34388766 DOI: 10.1364/ol.430419] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/29/2021] [Accepted: 07/13/2021] [Indexed: 06/13/2023]
Abstract
Micro motion estimation has important applications in various fields such as microfluidic particle detection and biomedical cell imaging. Conventional methods analyze the motion from intensity images captured using frame-based imaging sensors such as the complementary metal-oxide semiconductor (CMOS) and the charge-coupled device (CCD). Recently, event-based sensors have evolved with the special capability to record asynchronous light changes with high dynamic range, high temporal resolution, low latency, and no motion blur. In this Letter, we explore the potential of using the event sensor to estimate the micro motion based on the laser speckle correlation technique.
Collapse
|
3
|
Ge Z, Meng N, Song L, Lam EY. Dynamic laser speckle analysis using the event sensor. APPLIED OPTICS 2021; 60:172-178. [PMID: 33362087 DOI: 10.1364/ao.412601] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/14/2020] [Accepted: 12/02/2020] [Indexed: 06/12/2023]
Abstract
Dynamic laser speckle analysis (DLSA) can obtain useful information about the scene dynamics. Traditional implementations use intensity-based imaging sensors such as a complementary metal oxide semiconductor and charge-coupled device to capture time-varying intensity frames. We use an event sensor that measures pixel-wise asynchronous brightness changes to record speckle pattern sequences. Our approach takes advantage of the low latency and high contrast sensitivity of the event sensor to implement DLSA with high temporal resolution. We also propose two evaluation metrics designed especially for event data. Comparison experiments are conducted in identical conditions to demonstrate the feasibility of our proposed approach.
Collapse
|
4
|
Demidov V, Matveev LA, Demidova O, Matveyev AL, Zaitsev VY, Flueraru C, Vitkin IA. Analysis of low-scattering regions in optical coherence tomography: applications to neurography and lymphangiography. BIOMEDICAL OPTICS EXPRESS 2019; 10:4207-4219. [PMID: 31453005 PMCID: PMC6701530 DOI: 10.1364/boe.10.004207] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/12/2019] [Revised: 06/24/2019] [Accepted: 07/17/2019] [Indexed: 05/19/2023]
Abstract
Analysis of semi-transparent low scattering biological structures in optical coherence tomography (OCT) has been actively pursued in the context of lymphatic imaging, with most approaches relying on the relative absence of signal as a means of detection. Here we present an alternate methodology based on spatial speckle statistics, utilizing the similarity of a distribution of given voxel intensities to the power distribution function of pure noise, to visualize the low-scattering biological structures of interest. In a human tumor xenograft murine model, we show that these correspond to lymphatic vessels and nerves; extensive histopathologic validation studies are reported to unequivocally establish this correspondence. The emerging possibility of OCT lymphangiography and neurography is novel and potentially impactful (especially the latter), although further methodology refinement is needed to distinguish between the visualized lymphatics and nerves.
Collapse
Affiliation(s)
- Valentin Demidov
- Department of Medical Biophysics, University of Toronto, 101 College St., Toronto, M5G 1L7, Canada
| | - Lev A. Matveev
- Institute of Applied Physics Russian Academy of Sciences, 46 Ulyanov Street, Nizhniy Novgorod, 603950, Russia
| | - Olga Demidova
- Department of Arts and Science, Seneca College, 1750 Finch Avenue East, Toronto, M2J 2X5, Canada
| | - Alexander L. Matveyev
- Institute of Applied Physics Russian Academy of Sciences, 46 Ulyanov Street, Nizhniy Novgorod, 603950, Russia
| | - Vladimir Y. Zaitsev
- Institute of Applied Physics Russian Academy of Sciences, 46 Ulyanov Street, Nizhniy Novgorod, 603950, Russia
| | - Costel Flueraru
- National Research Council Canada, Information Communication Technology, 1200 Montreal Rd, Ottawa, K1A0R6, Canada
| | - I. Alex Vitkin
- Department of Medical Biophysics, University of Toronto, 101 College St., Toronto, M5G 1L7, Canada
- University Health Network, Princess Margaret Cancer Centre, 610 University Ave, Toronto, M5G 2C1, Canada
- University of Toronto, Department of Radiation Oncology, 150 College St, Toronto, M5S 3E2, Canada
| |
Collapse
|