1
|
Grube S, Latus S, Behrendt F, Riabova O, Neidhardt M, Schlaefer A. Needle tracking in low-resolution ultrasound volumes using deep learning. Int J Comput Assist Radiol Surg 2024:10.1007/s11548-024-03234-8. [PMID: 39002100 DOI: 10.1007/s11548-024-03234-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/12/2024] [Accepted: 07/03/2024] [Indexed: 07/15/2024]
Abstract
PURPOSE Clinical needle insertion into tissue, commonly assisted by 2D ultrasound imaging for real-time navigation, faces the challenge of precise needle and probe alignment to reduce out-of-plane movement. Recent studies investigate 3D ultrasound imaging together with deep learning to overcome this problem, focusing on acquiring high-resolution images to create optimal conditions for needle tip detection. However, high-resolution also requires a lot of time for image acquisition and processing, which limits the real-time capability. Therefore, we aim to maximize the US volume rate with the trade-off of low image resolution. We propose a deep learning approach to directly extract the 3D needle tip position from sparsely sampled US volumes. METHODS We design an experimental setup with a robot inserting a needle into water and chicken liver tissue. In contrast to manual annotation, we assess the needle tip position from the known robot pose. During insertion, we acquire a large data set of low-resolution volumes using a 16 × 16 element matrix transducer with a volume rate of 4 Hz. We compare the performance of our deep learning approach with conventional needle segmentation. RESULTS Our experiments in water and liver show that deep learning outperforms the conventional approach while achieving sub-millimeter accuracy. We achieve mean position errors of 0.54 mm in water and 1.54 mm in liver for deep learning. CONCLUSION Our study underlines the strengths of deep learning to predict the 3D needle positions from low-resolution ultrasound volumes. This is an important milestone for real-time needle navigation, simplifying the alignment of needle and ultrasound probe and enabling a 3D motion analysis.
Collapse
Affiliation(s)
- Sarah Grube
- Institute of Medical Technology and Intelligent Systems, Hamburg University of Technology, Hamburg, Germany.
| | - Sarah Latus
- Institute of Medical Technology and Intelligent Systems, Hamburg University of Technology, Hamburg, Germany
| | - Finn Behrendt
- Institute of Medical Technology and Intelligent Systems, Hamburg University of Technology, Hamburg, Germany
| | - Oleksandra Riabova
- Institute of Medical Technology and Intelligent Systems, Hamburg University of Technology, Hamburg, Germany
| | - Maximilian Neidhardt
- Institute of Medical Technology and Intelligent Systems, Hamburg University of Technology, Hamburg, Germany
| | - Alexander Schlaefer
- Institute of Medical Technology and Intelligent Systems, Hamburg University of Technology, Hamburg, Germany
| |
Collapse
|
2
|
Yuan Y, Zhao Y, Xiao Y, Jin J, Feng N, Shen Y. Optimization of reconstruction time of ultrasound computed tomography with a piecewise homogeneous region-based refract-ray model. ULTRASONICS 2023; 127:106837. [PMID: 36075161 DOI: 10.1016/j.ultras.2022.106837] [Citation(s) in RCA: 3] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/20/2021] [Revised: 08/17/2022] [Accepted: 08/29/2022] [Indexed: 06/15/2023]
Abstract
In this article, a novel ultrasound computed tomography (USCT) reconstruction algorithm for breast imaging is proposed. This algorithm is based on an ultrasound propagation model, the refract-ray model (RRM). In this model, the field of imaging is assumed as piecewise homogenous and is divided into several regions. The ultrasound propagation paths are considered polylines that only refract at the borders of the regions. The edge information is provided by B-mode imaging. Both simulations and experiments are implemented to validate the proposed algorithm. Compared with the traditional bent-ray model (BRM), the time of reconstructions using RRM decreases by over 90 %. In simulations, the imaging qualities for RRM and BRM are comparable, in terms of the root mean square error, the Tenengrad value, and the deformation of digital phantom. In the experiments, a cylindrical agar phantom is imaged using a customized imaging system. When imaging using RRM, the estimate of the phantom radius is about 0.1 mm in error, while it is about 0.3 mm in error using BRM. Moreover, the Tenengrad value of the result using RRM is much higher than that using BRM (9.76 compared to 0.79). The results show that the proposed algorithm can better delineate the phantom within a water bath. In future work, further experimental work is required to validate the method for improving imaging quality under breast-mimicking imaging conditions.
Collapse
Affiliation(s)
- Yu Yuan
- Control Theory and Engineering, School of Astronautics, Harbin Institute of Technology, PR China
| | - Yue Zhao
- Control Theory and Engineering, School of Astronautics, Harbin Institute of Technology, PR China.
| | - Yang Xiao
- Control Theory and Engineering, School of Astronautics, Harbin Institute of Technology, PR China
| | - Jing Jin
- Control Theory and Engineering, School of Astronautics, Harbin Institute of Technology, PR China
| | - Naizhang Feng
- Shenzhen Engineering Lab for Medical Intelligent Wireless Ultrasonic Imaging Technology, Harbin Institute of Technology, PR China
| | - Yi Shen
- Shenzhen Engineering Lab for Medical Intelligent Wireless Ultrasonic Imaging Technology, Harbin Institute of Technology, PR China
| |
Collapse
|
3
|
Yang H, Shan C, Kolen AF, de With PHN. Medical instrument detection in ultrasound: a review. Artif Intell Rev 2022. [DOI: 10.1007/s10462-022-10287-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/02/2022]
Abstract
AbstractMedical instrument detection is essential for computer-assisted interventions, since it facilitates clinicians to find instruments efficiently with a better interpretation, thereby improving clinical outcomes. This article reviews image-based medical instrument detection methods for ultrasound-guided (US-guided) operations. Literature is selected based on an exhaustive search in different sources, including Google Scholar, PubMed, and Scopus. We first discuss the key clinical applications of medical instrument detection in the US, including delivering regional anesthesia, biopsy taking, prostate brachytherapy, and catheterization. Then, we present a comprehensive review of instrument detection methodologies, including non-machine-learning and machine-learning methods. The conventional non-machine-learning methods were extensively studied before the era of machine learning methods. The principal issues and potential research directions for future studies are summarized for the computer-assisted intervention community. In conclusion, although promising results have been obtained by the current (non-) machine learning methods for different clinical applications, thorough clinical validations are still required.
Collapse
|
4
|
Zhao Y, Lu Y, Lu X, Jin J, Tao L, Chen X. Biopsy Needle Segmentation using Deep Networks on inhomogeneous Ultrasound Images. ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2022; 2022:553-556. [PMID: 36086307 DOI: 10.1109/embc48229.2022.9871059] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/15/2023]
Abstract
In minimally invasive interventional surgery, ultrasound imaging is usually used to provide real-time feedback in order to obtain the best diagnostic results or realize treatment plans, so how to accurately obtain the position of the medical biopsy needle is a problem worthy of study. 2D ultrasound simulation images containing the medical biopsy needle are generated, and our images background is from the real breast ultrasound image. Based on the deep learning network, the images containing the medical biopsy needle are used to analyze the effectiveness of different networks for needle localization for the purpose of returning needle positions in non-uniform ultrasound images. The results show that attention U-Net performed best and can accurately reflect the real position of the medical biopsy needle. The IoU and Precision can reach 90.19% and 96.25%, and the Angular Error is 0.40°. Clinical Relevance- Based on the deep network, for 2D ultrasound images containing medical biopsy needle, the localization precision can reach 96.25% and the Angular Error is 0.40°.
Collapse
|
5
|
Yazdani L, Bhatt M, Rafati I, Tang A, Cloutier G. The Revisited Frequency-Shift Method for Shear Wave Attenuation Computation and Imaging. IEEE TRANSACTIONS ON ULTRASONICS, FERROELECTRICS, AND FREQUENCY CONTROL 2022; 69:2061-2074. [PMID: 35404815 DOI: 10.1109/tuffc.2022.3166448] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/14/2023]
Abstract
Ultrasound (US) shear wave (SW) elastography has been widely studied and implemented on clinical systems to assess the elasticity of living organs. Imaging of SW attenuation reflecting viscous properties of tissues has received less attention. A revisited frequency shift (R-FS) method is proposed to improve the robustness of SW attenuation imaging. Performances are compared with the FS method that we originally proposed and with the two-point frequency shift (2P-FS) and attenuation measuring US SW elastography (AMUSE) methods. In the proposed R-FS method, the shape parameter of the gamma distribution fitting SW spectra is assumed to vary with distance, in contrast to FS. Second, an adaptive random sample consensus (A-RANSAC) line fitting method is used to prevent outlier attenuation values in the presence of noise. Validation was made on ten simulated phantoms with two viscosities (0.5 and 2 Pa [Formula: see text]) and different noise levels (15 to -5 dB), two experimental homogeneous gel phantoms, and six in vivo liver acquisitions on awake ducks (including three normal and three fatty duck livers). According to the conducted experiments, R-FS revealed mean reductions in coefficients of variation (CV) of 62.6% on simulations, 62.5% with phantoms, and 62.3% in vivo compared with FS. Corresponding reductions compared with 2P-FS were 45.4%, 77.1%, and 62.0%, respectively. Reductions in normalized root-mean-square errors for simulations were 63.9% and 48.7% with respect to FS and 2P-FS, respectively.
Collapse
|
6
|
Dan Y, Tao J, Zhou D. Multi-Model Adaptation Learning With Possibilistic Clustering Assumption for EEG-Based Emotion Recognition. Front Neurosci 2022; 16:855421. [PMID: 35600616 PMCID: PMC9114636 DOI: 10.3389/fnins.2022.855421] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/15/2022] [Accepted: 02/25/2022] [Indexed: 11/15/2022] Open
Abstract
In machine learning community, graph-based semi-supervised learning (GSSL) approaches have attracted more extensive research due to their elegant mathematical formulation and good performance. However, one of the reasons affecting the performance of the GSSL method is that the training data and test data need to be independently identically distributed (IID); any individual user may show a completely different encephalogram (EEG) data in the same situation. The EEG data may be non-IID. In addition, noise/outlier sensitiveness still exist in GSSL approaches. To these ends, we propose in this paper a novel clustering method based on structure risk minimization model, called multi-model adaptation learning with possibilistic clustering assumption for EEG-based emotion recognition (MA-PCA). It can effectively minimize the influence from the noise/outlier samples based on different EEG-based data distribution in some reproduced kernel Hilbert space. Our main ideas are as follows: (1) reducing the negative impact of noise/outlier patterns through fuzzy entropy regularization, (2) considering the training data and test data are IID and non-IID to obtain a better performance by multi-model adaptation learning, and (3) the algorithm implementation and convergence theorem are also given. A large number of experiments and deep analysis on real DEAP datasets and SEED datasets was carried out. The results show that the MA-PCA method has superior or comparable robustness and generalization performance to EEG-based emotion recognition.
Collapse
Affiliation(s)
- Yufang Dan
- Institute of Artificial Intelligence Application, Ningbo Polytechnic, Ningbo, China
- Key Laboratory of 3D Printing Equipment and Manufacturing in Colleges and Universities of Fujian Province, Fujian, China
| | - Jianwen Tao
- Institute of Artificial Intelligence Application, Ningbo Polytechnic, Ningbo, China
| | - Di Zhou
- Industrial Technological Institute of Intelligent Manufacturing, Sichuan University of Arts and Science, Dazhou, China
| |
Collapse
|
7
|
Automatic and accurate needle detection in 2D ultrasound during robot-assisted needle insertion process. Int J Comput Assist Radiol Surg 2021; 17:295-303. [PMID: 34677747 DOI: 10.1007/s11548-021-02519-6] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/01/2021] [Accepted: 10/05/2021] [Indexed: 10/20/2022]
Abstract
PURPOSE Robot-assisted needle insertion guided by 2D ultrasound (US) can effectively improve the accuracy and success rate of clinical puncture. To this end, automatic and accurate needle-tracking methods are important for monitoring puncture processes, avoiding the needle deviating from the intended path, and reducing the risk of injury to surrounding tissues. This work aims to develop a framework for automatic and accurate detection of an inserted needle in 2D US image during the insertion process. METHODS We propose a novel convolutional neural network architecture comprising of a two-channel encoder and single-channel decoder for needle segmentation using needle motion information extracted from two adjacent US image frames. Based on the novel network, we further propose an automatic needle detection framework. According to the prediction result of the previous frame, a region of interest of the needle in the US image was extracted and fed into the proposed network to achieve finer and faster continuous needle localization. RESULTS The performance of our method was evaluated based on 1000 pairs of US images extracted from robot-assisted needle insertions on freshly excised bovine and porcine tissues. The needle segmentation network achieved 99.7% accuracy, 86.2% precision, 89.1% recall, and an F1-score of 0.87. The needle detection framework successfully localized the needle with a mean tip error of 0.45 ± 0.33 mm and a mean orientation error of 0.42° ± 0.34° and achieved a total processing time of 50 ms per image. CONCLUSION The proposed framework demonstrated the capability to realize robust, accurate, and real-time needle localization during robot-assisted needle insertion processes. It has a promising application in tracking the needle and ensuring the safety of robotic-assisted automatic puncture during challenging US-guided minimally invasive procedures.
Collapse
|
8
|
Wijata A, Andrzejewski J, Pyciński B. An Automatic Biopsy Needle Detection and Segmentation on Ultrasound Images Using a Convolutional Neural Network. ULTRASONIC IMAGING 2021; 43:262-272. [PMID: 34180737 DOI: 10.1177/01617346211025267] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/13/2023]
Abstract
Needle visualization in the ultrasound image is essential to successfully perform the ultrasound-guided core needle biopsy. Automatic needle detection can significantly reduce the procedure time, false-negative rate, and highly improve the diagnosis. In this paper, we present a CNN-based, fully automatic method for detection of core needle in 2D ultrasound images. Adaptive moment estimation optimizer is proposed as CNN architecture. Radon transform is applied to locate the needle. The network's model was trained and tested on the total of 619 2D images from 91 cases of breast cancer. The model has achieved an average weighted intersection over union (the weighted Jaccard Index) of 0.986, F1 Score of 0.768, and angle RMSE of 3.73°. The obtained results exceed the other solutions by at least 0.27 and 7° in case of F1 score and angle RMSE, respectively. Finally, the needle is detected in a single frame averagely in 21.6 ms on a modern PC.
Collapse
Affiliation(s)
- Agata Wijata
- Faculty of Biomedical Engineering, Silesian University of Technology, Zabrze, Poland
| | - Jacek Andrzejewski
- Faculty of Biomedical Engineering, Silesian University of Technology, Zabrze, Poland
| | - Bartłomiej Pyciński
- Faculty of Biomedical Engineering, Silesian University of Technology, Zabrze, Poland
| |
Collapse
|
9
|
Yang H, Shan C, Kolen AF, de With PHN. Efficient Medical Instrument Detection in 3D Volumetric Ultrasound Data. IEEE Trans Biomed Eng 2021; 68:1034-1043. [PMID: 32746017 DOI: 10.1109/tbme.2020.2999729] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/09/2022]
Abstract
Ultrasound-guided procedures have been applied in many clinical therapies, such as cardiac catheterization and regional anesthesia. Medical instrument detection in 3D Ultrasound (US) is highly desired, but the existing approaches are far from real-time performance. Our objective is to investigate an efficient instrument detection method in 3D US for practical clinical use. We propose a novel Multi-dimensional Mixed Network for efficient instrument detection in 3D US, which extracts the discriminating features at 3D full-image level by a 3D encoder, and then applies a specially designed dimension reduction block to reduce the spatial complexity of the feature maps by projecting from 3D space into 2D space. A 2D decoder is adopted to detect the instrument along the specified axes. By projecting the predicted 2D outputs, the instrument is detected or visualized in the 3D volume. Furthermore, to enable the network to better learn the discriminative information, we propose a multi-level loss function to capture both pixel- and image-level differences. We carried out extensive experiments on two datasets for two tasks: (1) catheter detection for cardiac RF-ablation and (2) needle detection for regional anesthesia. Our experiments show that our proposed method achieves a detection error of 2-3 voxels with an efficiency of about 0.12 sec per 3D US volume. The proposed method is 3-8 times faster than the state-of-the-art methods, leading to real-time performance. The results show that our proposed method has significant clinical value for real-time 3D US-guided intervention.
Collapse
|
10
|
Zhang Y, He X, Tian Z, Jeong JJ, Lei Y, Wang T, Zeng Q, Jani AB, Curran WJ, Patel P, Liu T, Yang X. Multi-Needle Detection in 3D Ultrasound Images Using Unsupervised Order-Graph Regularized Sparse Dictionary Learning. IEEE TRANSACTIONS ON MEDICAL IMAGING 2020; 39:2302-2315. [PMID: 31985414 PMCID: PMC7370243 DOI: 10.1109/tmi.2020.2968770] [Citation(s) in RCA: 16] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/10/2023]
Abstract
Accurate and automatic multi-needle detection in three-dimensional (3D) ultrasound (US) is a key step of treatment planning for US-guided brachytherapy. However, most current studies are concentrated on single-needle detection by only using a small number of images with a needle, regardless of the massive database of US images without needles. In this paper, we propose a workflow for multi-needle detection by considering the images without needles as auxiliary. Concretely, we train position-specific dictionaries on 3D overlapping patches of auxiliary images, where we develop an enhanced sparse dictionary learning method by integrating spatial continuity of 3D US, dubbed order-graph regularized dictionary learning. Using the learned dictionaries, target images are reconstructed to obtain residual pixels which are then clustered in every slice to yield centers. With the obtained centers, regions of interest (ROIs) are constructed via seeking cylinders. Finally, we detect needles by using the random sample consensus algorithm per ROI and then locate the tips by finding the sharp intensity drops along the detected axis for every needle. Extensive experiments were conducted on a phantom dataset and a prostate dataset of 70/21 patients without/with needles. Visualization and quantitative results show the effectiveness of our proposed workflow. Specifically, our method can correctly detect 95% of needles with a tip location error of 1.01 mm on the prostate dataset. This technique provides accurate multi-needle detection for US-guided HDR prostate brachytherapy, facilitating the clinical workflow.
Collapse
|
11
|
Zhang M, Wang H, Li J, Gao H. Learned sketches for frequency estimation. Inf Sci (N Y) 2020. [DOI: 10.1016/j.ins.2019.08.045] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/26/2022]
|
12
|
Gillies DJ, Awad J, Rodgers JR, Edirisinghe C, Cool DW, Kakani N, Fenster A. Three-dimensional therapy needle applicator segmentation for ultrasound-guided focal liver ablation. Med Phys 2019; 46:2646-2658. [PMID: 30994191 DOI: 10.1002/mp.13548] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/14/2018] [Revised: 03/06/2019] [Accepted: 03/28/2019] [Indexed: 12/19/2022] Open
Abstract
PURPOSE Minimally invasive procedures, such as microwave ablation, are becoming first-line treatment options for early-stage liver cancer due to lower complication rates and shorter recovery times than conventional surgical techniques. Although these procedures are promising, one reason preventing widespread adoption is inadequate local tumor ablation leading to observations of higher local cancer recurrence compared to conventional procedures. Poor ablation coverage has been associated with two-dimensional (2D) ultrasound (US) guidance of the therapy needle applicators and has stimulated investigation into the use of three-dimensional (3D) US imaging for these procedures. We have developed a supervised 3D US needle applicator segmentation algorithm using a single user input to augment the addition of 3D US to the current focal liver tumor ablation workflow with the goals of identifying and improving needle applicator localization efficiency. METHODS The algorithm is initialized by creating a spherical search space of line segments around a manually chosen seed point that is selected by a user on the needle applicator visualized in a 3D US image. The most probable trajectory is chosen by maximizing the count and intensity of threshold voxels along a line segment and is filtered using the Otsu method to determine the tip location. Homogeneous tissue mimicking phantom images containing needle applicators were used to optimize the parameters of the algorithm prior to a four-user investigation on retrospective 3D US images of patients who underwent microwave ablation for liver cancer. Trajectory, axis localization, and tip errors were computed based on comparisons to manual segmentations in 3D US images. RESULTS Segmentation of needle applicators in ten phantom 3D US images was optimized to median (Q1, Q3) trajectory, axis, and tip errors of 2.1 (1.1, 3.6)°, 1.3 (0.8, 2.1) mm, and 1.3 (0.7, 2.5) mm, respectively, with a mean ± SD segmentation computation time of 0.246 ± 0.007 s. Use of the segmentation method with a 16 in vivo 3D US patient dataset resulted in median (Q1, Q3) trajectory, axis, and tip errors of 4.5 (2.4, 5.2)°, 1.9 (1.7, 2.1) mm, and 5.1 (2.2, 5.9) mm based on all users. CONCLUSIONS Segmentation of needle applicators in 3D US images during minimally invasive liver cancer therapeutic procedures could provide a utility that enables enhanced needle applicator guidance, placement verification, and improved clinical workflow. A semi-automated 3D US needle applicator segmentation algorithm used in vivo demonstrated localization of the visualized trajectory and tip with less than 5° and 5.2 mm errors, respectively, in less than 0.31 s. This offers the ability to assess and adjust needle applicator placements intraoperatively to potentially decrease the observed liver cancer recurrence rates associated with current ablation procedures. Although optimized for deep and oblique angle needle applicator insertions, this proposed workflow has the potential to be altered for a variety of image-guided minimally invasive procedures to improve localization and verification of therapy needle applicators intraoperatively.
Collapse
Affiliation(s)
- Derek J Gillies
- Department of Medical Biophysics, Western University, London, ON, N6A 3K7, Canada.,Robarts Research Institute, Western University, London, ON, N6A 3K7, Canada
| | - Joseph Awad
- Centre for Imaging Technology Commercialization, London, ON, N6G 4X8, Canada
| | - Jessica R Rodgers
- Robarts Research Institute, Western University, London, ON, N6A 3K7, Canada.,School of Biomedical Engineering, Western University, London, ON, N6A 3K7, Canada
| | | | - Derek W Cool
- Department of Medical Imaging, Western University, London, ON, N6A 3K7, Canada
| | - Nirmal Kakani
- Department of Radiology, Manchester Royal Infirmary, Manchester, M13 9WL, UK
| | - Aaron Fenster
- Department of Medical Biophysics, Western University, London, ON, N6A 3K7, Canada.,Robarts Research Institute, Western University, London, ON, N6A 3K7, Canada.,Centre for Imaging Technology Commercialization, London, ON, N6G 4X8, Canada.,School of Biomedical Engineering, Western University, London, ON, N6A 3K7, Canada.,Department of Medical Imaging, Western University, London, ON, N6A 3K7, Canada
| |
Collapse
|
13
|
Fathy A, Kassem AM. Antlion optimizer-ANFIS load frequency control for multi-interconnected plants comprising photovoltaic and wind turbine. ISA TRANSACTIONS 2019; 87:282-296. [PMID: 30538040 DOI: 10.1016/j.isatra.2018.11.035] [Citation(s) in RCA: 14] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/30/2018] [Revised: 11/23/2018] [Accepted: 11/26/2018] [Indexed: 06/09/2023]
Abstract
This paper proposes optimal load frequency control (LFC) designed by Adaptive Neuro Fuzzy Inference System (ANFIS) trained via antlion optimizer (ALO) for multi-interconnected system comprising renewable energy sources (RESs). Two systems are modeled and investigated; the first one has two plants of grid connected photovoltaic (PV) system with maximum power point tracker (MPPT) and thermal plant while the second comprises four plants of thermal, wind turbine and grid connected PV systems. ALO is employed to get the optimal gains of Proportional-Integral (PI) controller such that the integral time absolute error (ITAE) of frequency and tie line power deviations is minimized. The input and output of the optimized PI controller are used to train the ANFIS-LFC with Gaussian surface membership functions. Different load disturbances are studied and the results are compared with other reported approaches. The obtained results confirmed the accuracy and reliability of the proposed approach in designing LFC for multi-interconnected power systems.
Collapse
Affiliation(s)
- Ahmed Fathy
- Electrical Engineering Department, Faculty of Engineering, Jouf University, Al-Jouf, Saudi Arabia; Electrical Power & Machine Department, Faculty of Engineering, Zagazig University, Zagazig, Egypt.
| | - Ahmed M Kassem
- Electrical Engineering Department, Faculty of Engineering, Sohag University, Sohag, Egypt
| |
Collapse
|
14
|
Zhao Y, Wang J, Yan F, Shen Y. Adaptive sliding mode fault-tolerant control for type-2 fuzzy systems with distributed delays. Inf Sci (N Y) 2019. [DOI: 10.1016/j.ins.2018.09.002] [Citation(s) in RCA: 130] [Impact Index Per Article: 26.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
|
15
|
Lian B, Zhang Q, Li J. Sliding mode control and sampling rate strategy for Networked control systems with packet disordering via Markov chain prediction. ISA TRANSACTIONS 2018; 83:1-12. [PMID: 30144979 DOI: 10.1016/j.isatra.2018.08.009] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/11/2017] [Revised: 05/09/2018] [Accepted: 08/10/2018] [Indexed: 06/08/2023]
Abstract
This paper investigates sliding mode control combined with sampling rate control for networked control systems subject to packet disordering via Markov chain prediction. The main objectives of the proposed method are to predict the probability of the occurrence of packet disordering when packet disordering is unknown in the networks, to control sampling rate to restrain heavy packet disordering, and to stabilize the Markovian jump system with variable parameters by sliding mode techniques. Firstly, an argument system with sampling rate and a plant state is established. Then, the Networked control system based on Markov chain probability prediction and statistical analysis of this probability is modeled as a Markovian jump system with two Markov chains. Next, sliding mode controller is designed to stabilize the dynamic Markovian jump system. Finally, experiments are conducted to illustrate the effectiveness and benefits of proposed method.
Collapse
Affiliation(s)
- Bosen Lian
- Institute of Systems Science, Northeastern University, Shenyang, Liaoning province, 110004, PR China
| | - Qingling Zhang
- Institute of Systems Science, Northeastern University, Shenyang, Liaoning province, 110004, PR China; State Key Laboratory of Synthetical Automation for Process Industries, Northeastern University, Shenyang, Liaoning province, 110004, PR China.
| | - Jinna Li
- School of Information and Control Engineering, Liaoning Shihua University, Shenyang, Liaoning province, 113001, PR China; International Joint Research Laboratory of Integrated Automation, Northeastern University, Shenyang, Liaoning province, 110004, PR China
| |
Collapse
|
16
|
Daoud MI, Alshalalfah AL, Ait Mohamed O, Alazrai R. A hybrid camera- and ultrasound-based approach for needle localization and tracking using a 3D motorized curvilinear ultrasound probe. Med Image Anal 2018; 50:145-166. [PMID: 30336383 DOI: 10.1016/j.media.2018.09.006] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/04/2018] [Revised: 08/11/2018] [Accepted: 09/25/2018] [Indexed: 10/28/2022]
Abstract
Three-dimensional (3D) motorized curvilinear ultrasound probes provide an effective, low-cost tool to guide needle interventions, but localizing and tracking the needle in 3D ultrasound volumes is often challenging. In this study, a new method is introduced to localize and track the needle using 3D motorized curvilinear ultrasound probes. In particular, a low-cost camera mounted on the probe is employed to estimate the needle axis. The camera-estimated axis is used to identify a volume of interest (VOI) in the ultrasound volume that enables high needle visibility. This VOI is analyzed using local phase analysis and the random sample consensus algorithm to refine the camera-estimated needle axis. The needle tip is determined by searching the localized needle axis using a probabilistic approach. Dynamic needle tracking in a sequence of 3D ultrasound volumes is enabled by iteratively applying a Kalman filter to estimate the VOI that includes the needle in the successive ultrasound volume and limiting the localization analysis to this VOI. A series of ex vivo animal experiments are conducted to evaluate the accuracy of needle localization and tracking. The results show that the proposed method can localize the needle in individual ultrasound volumes with maximum error rates of 0.7 mm for the needle axis, 1.7° for the needle angle, and 1.2 mm for the needle tip. Moreover, the proposed method can track the needle in a sequence of ultrasound volumes with maximum error rates of 1.0 mm for the needle axis, 2.0° for the needle angle, and 1.7 mm for the needle tip. These results suggest the feasibility of applying the proposed method to localize and track the needle using 3D motorized curvilinear ultrasound probes.
Collapse
Affiliation(s)
- Mohammad I Daoud
- Department of Computer Engineering, German Jordanian University, Amman, Jordan.
| | | | - Otmane Ait Mohamed
- Department of Electrical and Computer Engineering, Concordia University, Montreal, Quebec, Canada
| | - Rami Alazrai
- Department of Computer Engineering, German Jordanian University, Amman, Jordan
| |
Collapse
|
17
|
Ning T, Jin H. A cloud based improved method for multi-objective flexible job-shop scheduling problem. JOURNAL OF INTELLIGENT & FUZZY SYSTEMS 2018. [DOI: 10.3233/jifs-171391] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/15/2022]
Affiliation(s)
- Tao Ning
- Institute of Software, Dalian Jiaotong University, Dalian, China
- Institute of Systems Engineering, Dalian University of Technology, Dalian, China
| | - Hua Jin
- Institute of Software, Dalian Jiaotong University, Dalian, China
| |
Collapse
|
18
|
Cheng J, Chang XH, Park JH, Li H, Wang H. Fuzzy-model-based H∞ control for discrete-time switched systems with quantized feedback and unreliable links. Inf Sci (N Y) 2018. [DOI: 10.1016/j.ins.2018.01.021] [Citation(s) in RCA: 44] [Impact Index Per Article: 7.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/28/2022]
|
19
|
Beigi P, Rohling R, Salcudean SE, Ng GC. CASPER: computer-aided segmentation of imperceptible motion-a learning-based tracking of an invisible needle in ultrasound. Int J Comput Assist Radiol Surg 2017. [PMID: 28647883 DOI: 10.1007/s11548-017-1631-4] [Citation(s) in RCA: 6] [Impact Index Per Article: 0.9] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/19/2022]
Abstract
PURPOSE This paper presents a new micro-motion-based approach to track a needle in ultrasound images captured by a handheld transducer. METHODS We propose a novel learning-based framework to track a handheld needle by detecting microscale variations of motion dynamics over time. The current state of the art on using motion analysis for needle detection uses absolute motion and hence work well only when the transducer is static. We have introduced and evaluated novel spatiotemporal and spectral features, obtained from the phase image, in a self-supervised tracking framework to improve the detection accuracy in the subsequent frames using incremental training. Our proposed tracking method involves volumetric feature selection and differential flow analysis to incorporate the neighboring pixels and mitigate the effects of the subtle tremor motion of a handheld transducer. To evaluate the detection accuracy, the method is tested on porcine tissue in-vivo, during the needle insertion in the biceps femoris muscle. RESULTS Experimental results show the mean, standard deviation and root-mean-square errors of [Formula: see text], [Formula: see text] and [Formula: see text] in the insertion angle, and 0.82, 1.21, 1.47 mm, in the needle tip, respectively. CONCLUSIONS Compared to the appearance-based detection approaches, the proposed method is especially suitable for needles with ultrasonic characteristics that are imperceptible in the static image and to the naked eye.
Collapse
Affiliation(s)
- Parmida Beigi
- Electrical and Computer Engineering Department, University of British Columbia, Vancouver, BC, Canada.
| | - Robert Rohling
- Electrical and Computer Engineering Department and Mechanical Engineering Department, University of British Columbia, Vancouver, BC, Canada
| | - Septimiu E Salcudean
- Electrical and Computer Engineering Department, University of British Columbia, Vancouver, BC, Canada
| | - Gary C Ng
- Philips Ultrasound, Bothell, WA, USA
| |
Collapse
|
20
|
Scholten HJ, Pourtaherian A, Mihajlovic N, Korsten HHM, A. Bouwman R. Improving needle tip identification during ultrasound-guided procedures in anaesthetic practice. Anaesthesia 2017; 72:889-904. [DOI: 10.1111/anae.13921] [Citation(s) in RCA: 45] [Impact Index Per Article: 6.4] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 03/23/2017] [Indexed: 12/16/2022]
Affiliation(s)
- H. J. Scholten
- Department of Anaesthesiology; Intensive Care and Pain Medicine; Catharina Hospital; Eindhoven the Netherlands
| | - A. Pourtaherian
- Department of Electrical Engineering; Eindhoven University of Technology; Eindhoven the Netherlands
| | | | - H. H. M. Korsten
- Department of Anaesthesiology; Intensive Care and Pain Medicine; Catharina Hospital; Eindhoven the Netherlands
- Department of Electrical Engineering; Eindhoven University of Technology; Eindhoven the Netherlands
| | - R. A. Bouwman
- Department of Anaesthesiology; Intensive Care and Pain Medicine; Catharina Hospital; Eindhoven the Netherlands
- Department of Electrical Engineering; Eindhoven University of Technology; Eindhoven the Netherlands
| |
Collapse
|
21
|
Garnon J, Koch G, Tsoumakidou G, Caudrelier J, Chari B, Cazzato RL, Gangi A. Ultrasound-Guided Biopsies of Bone Lesions Without Cortical Disruption Using Fusion Imaging and Needle Tracking: Proof of Concept. Cardiovasc Intervent Radiol 2017; 40:1267-1273. [PMID: 28357575 DOI: 10.1007/s00270-017-1638-9] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.1] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 02/01/2017] [Accepted: 03/22/2017] [Indexed: 01/14/2023]
Abstract
OBJECTIVE To assess the technical feasibility and safety of combined fusion imaging and needle tracking under ultrasound guidance to target bone lesions without cortical disruption. MATERIALS AND METHODS Between January 2016 and March 2016, seven patients underwent US-guided biopsy of bone lesions without cortical disruption. Targeted bone lesions were measuring more than 1.5 cm with a thin cortex, a trans-osseous pathway not exceeding 2 cm and without any adjacent vulnerable structures. First three procedures were performed in the CT suite to aid the needle tracking where necessary (group 1), the remaining four procedures were performed in the US suite (group 2). In group 1, deviation from the real position of the bone trocar (estimated on CT) was compared to the virtual position (estimated on the fusion CT-US images). In both group, procedure data and histopathological results were collected, and compared to the suspected diagnosis and follow-up. RESULTS Mean procedure duration was 44 min. Total number of synchronisation points for combined fusion imaging were 3.3 on average. In group 1, mean deviation between the virtual and real CT coordinates was 5.3 mm on average. All biopsies yielded adequate quality analysable bone sample. Histopathological analysis revealed malignancy in three cases, non-specific inflammation in two cases, and normal bone in two cases. The four benign results were confirmed as true negative results. There were no immediate or post-procedural complications. CONCLUSION The use of combined fusion imaging and needle tracking ultrasound guidance to target bone lesions without cortical disruption seems technically feasible, provided the patient and lesion selection is appropriate.
Collapse
Affiliation(s)
- Julien Garnon
- Department of Interventional Radiology, Hopitaux universitaires de Strasbourg, 1, Place de l'Hopital, 67096, Strasbourg Cedex, France.
| | - Guillaume Koch
- Department of Interventional Radiology, Hopitaux universitaires de Strasbourg, 1, Place de l'Hopital, 67096, Strasbourg Cedex, France
| | - Georgia Tsoumakidou
- Department of Interventional Radiology, Hopitaux universitaires de Strasbourg, 1, Place de l'Hopital, 67096, Strasbourg Cedex, France
| | - Jean Caudrelier
- Department of Interventional Radiology, Hopitaux universitaires de Strasbourg, 1, Place de l'Hopital, 67096, Strasbourg Cedex, France
| | - Basavaraj Chari
- Oxford University Hospitals, Nuffield Orthopaedic Centre, Oxford, UK
| | - Roberto Luigi Cazzato
- Department of Interventional Radiology, Hopitaux universitaires de Strasbourg, 1, Place de l'Hopital, 67096, Strasbourg Cedex, France
| | - Afshin Gangi
- Department of Interventional Radiology, Hopitaux universitaires de Strasbourg, 1, Place de l'Hopital, 67096, Strasbourg Cedex, France
| |
Collapse
|