1
|
Al-Tahhan FE, Fares ME. An accurate paradigm for denoising degraded ultrasound images based on artificial intelligence systems. Microsc Res Tech 2024. [PMID: 39145424 DOI: 10.1002/jemt.24675] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/07/2024] [Revised: 07/20/2024] [Accepted: 07/26/2024] [Indexed: 08/16/2024]
Abstract
Ultrasound images are susceptible to various forms of quality degradation that negatively impact diagnosis. Common degradations include speckle noise, Gaussian noise, salt and pepper noise, and blurring. This research proposes an accurate ultrasound image denoising strategy based on firstly detecting the noise type, then, suitable denoising methods can be applied for each corruption. The technique depends on convolutional neural networks to categorize the type of noise affecting an input ultrasound image. Pre-trained convolutional neural network models including GoogleNet, VGG-19, AlexNet and AlexNet-support vector machine (SVM) are developed and trained to perform this classification. A dataset of 782 numerically generated ultrasound images across different diseases and noise types is utilized for model training and evaluation. Results show AlexNet-SVM achieves the highest accuracy of 99.2% in classifying noise types. The results indicate that, the present technique is considered one of the top-performing models is then applied to real ultrasound images with different noise corruptions to demonstrate efficacy of the proposed detect-then-denoise system. RESEARCH HIGHLIGHTS: Proposes an accurate ultrasound image denoising strategy based on detecting noise type first. Uses pre-trained convolutional neural networks to categorize noise type in input images. Evaluates GoogleNet, VGG-19, AlexNet, and AlexNet-support vector machine (SVM) models on a dataset of 782 synthetic ultrasound images. AlexNet-SVM achieves highest accuracy of 99.2% in classifying noise types. Demonstrates efficacy of the proposed detect-then-denoise system on real ultrasound images.
Collapse
Affiliation(s)
- F E Al-Tahhan
- Department of Mathematics, Faculty of Science, Mansoura University, Mansoura, Egypt
| | - M E Fares
- Department of Mathematics, Faculty of Science, Mansoura University, Mansoura, Egypt
| |
Collapse
|
2
|
Du H, Zhang X, Zhang Y, Zhang F, Lin L, Huang T. A review of robot-assisted ultrasound examination: Systems and technology. Int J Med Robot 2024; 20:e2660. [PMID: 38978325 DOI: 10.1002/rcs.2660] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/28/2024] [Revised: 06/01/2024] [Accepted: 06/29/2024] [Indexed: 07/10/2024]
Abstract
BACKGROUND At present, the number and overall level of ultrasound (US) doctors cannot meet the medical needs, and the medical ultrasound robots will largely solve the shortage of medical resources. METHODS According to the degree of automation, the handheld, semi-automatic and automatic ultrasound examination robot systems are summarised. Ultrasound scanning path planning and robot control are the keys to ensure that the robot systems can obtain high-quality images. Therefore, the ultrasound scanning path planning and control methods are summarised. The research progress and future trends are discussed. RESULTS A variety of ultrasound robot systems have been applied to various medical works. With the continuous improvement of automation, the systems provide high-quality ultrasound images and image guidance for clinicians. CONCLUSION Although the development of medical ultrasound robot still faces challenges, with the continuous progress of robot technology and communication technology, medical ultrasound robot will have great development potential and broad application space.
Collapse
Affiliation(s)
- Haiyan Du
- Key Laboratory of Advanced Manufacturing and Intelligent Technology, Harbin University of Science and Technology, Harbin, China
| | - Xinran Zhang
- Key Laboratory of Advanced Manufacturing and Intelligent Technology, Harbin University of Science and Technology, Harbin, China
| | - Yongde Zhang
- Key Laboratory of Advanced Manufacturing and Intelligent Technology, Harbin University of Science and Technology, Harbin, China
| | - Fujun Zhang
- Department of Minimally Invasive Interventional Therapy, Sun Yat-sen University Cancer Center, Guangzhou, China
| | - Letao Lin
- Department of Minimally Invasive Interventional Therapy, Sun Yat-sen University Cancer Center, Guangzhou, China
| | - Tao Huang
- Department of Minimally Invasive Interventional Therapy, Sun Yat-sen University Cancer Center, Guangzhou, China
| |
Collapse
|
3
|
Yang L, Duan S, Zhang Y, Hao L, Wang S, Zou Z, Hu Y, Chen S, Hu Y, Zhang L. Feasibility and Safety of Percutaneous Puncture Guided by a 5G-Based Telerobotic Ultrasound System: An Experimental Study. Cardiovasc Intervent Radiol 2024; 47:812-819. [PMID: 38592415 DOI: 10.1007/s00270-024-03681-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 10/05/2023] [Accepted: 01/31/2024] [Indexed: 04/10/2024]
Abstract
PURPOSE To evaluate the feasibility and safety of percutaneous puncture guided by a 5th generation mobile communication technology (5G)-based telerobotic ultrasound system in phantom and animal experiments. MATERIALS AND METHODS In the phantom experiment, 10 simulated lesions were punctured, once at each of two angles for each lesion, under the guidance of a telerobotic ultrasound system and ultrasound-guided freehand puncture. Student's t test was used to compare the two methods in terms of puncture accuracy, total operation duration, and puncture duration. In the animal experiment, under the guidance of the telerobotic ultrasound system, an 18G puncture needle was used to puncture 3 target steel beads in the liver, right kidney, and right gluteal muscle, respectively. The animal experiment had no freehand ultrasound-guided control group. After puncture, a CT scan was performed to verify the position of the puncture needle in relation to the target, and the complications and puncture duration, etc., were recorded. RESULTS In the phantom experiment, the mean accuracies of puncture under telerobotic ultrasound guidance and conventional ultrasound guidance were 1.8 ± 0.3 mm and 1.6 ± 0.3 mm (P = 0.09), respectively; therefore, there was no significant difference in the accuracy of the two guide methods. In the animal experiment, the first-attempt puncture success (the needle tip close to the target) rate was 93%. Polypnea occurred during one puncture. No other intraoperative or postoperative complications were observed. CONCLUSION Puncture guided by a 5G-based telerobotic ultrasound system has shown good feasibility and safety in phantom and animal experiments.
Collapse
Affiliation(s)
- Lanling Yang
- Zhengzhou University People's Hospital, Henan Provincial People's Hospital, Zhengzhou, 450003, Henan, China
| | - Shaobo Duan
- Henan Provincial People's Hospital, Zhengzhou University People's Hospital, Henan University People's Hospital, Zhengzhou, 450003, Henan, China
- Department of Ultrasound, Henan Key Laboratory for Ultrasound Molecular Imaging and Artificial Intelligence Medicine, Henan Provincial People's Hospital, Zhengzhou University People's Hospital, Henan University People's Hospital, No.7, Weiwu Road, Jinshui District, Zhengzhou, 450003, Henan, China
| | - Ye Zhang
- Henan Provincial People's Hospital, Zhengzhou University People's Hospital, Henan University People's Hospital, Zhengzhou, 450003, Henan, China
| | - Liuwei Hao
- Henan Provincial People's Hospital, Zhengzhou University People's Hospital, Henan University People's Hospital, Zhengzhou, 450003, Henan, China
| | - Shuaiyang Wang
- Henan Provincial People's Hospital, Zhengzhou University People's Hospital, Henan University People's Hospital, Zhengzhou, 450003, Henan, China
| | - Zhi Zou
- Henan Provincial People's Hospital, Zhengzhou University People's Hospital, Henan University People's Hospital, Zhengzhou, 450003, Henan, China
| | - Yanshan Hu
- Zhengzhou University People's Hospital, Henan Provincial People's Hospital, Zhengzhou, 450003, Henan, China
| | - Si Chen
- Zhengzhou University People's Hospital, Henan Provincial People's Hospital, Zhengzhou, 450003, Henan, China
| | - Yiwen Hu
- Henan University People's Hospital, Henan Provincial People's Hospital, Zhengzhou, 450003, Henan, China
| | - Lianzhong Zhang
- Henan Provincial People's Hospital, Zhengzhou University People's Hospital, Henan University People's Hospital, Zhengzhou, 450003, Henan, China.
- Department of Rehabilitation, Henan Rehabilitation Clinical Medicine Research Center, Henan Provincial People's Hospital, Zhengzhou University People's Hospital, Henan University People's Hospital, Zhengzhou, 450003, Henan, China.
- Department of Ultrasound, Henan Key Laboratory for Ultrasound Molecular Imaging and Artificial Intelligence Medicine, Henan Provincial People's Hospital, Zhengzhou University People's Hospital, Henan University People's Hospital, No.7, Weiwu Road, Jinshui District, Zhengzhou, 450003, Henan, China.
| |
Collapse
|
4
|
Ochitwa Z, Fotouhi R, Adams SJ, Noguera Cundar AP, Obaid H. MSK-TIM: A Telerobotic Ultrasound System for Assessing the Musculoskeletal System. SENSORS (BASEL, SWITZERLAND) 2024; 24:2368. [PMID: 38610578 PMCID: PMC11013981 DOI: 10.3390/s24072368] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/23/2024] [Revised: 03/21/2024] [Accepted: 04/04/2024] [Indexed: 04/14/2024]
Abstract
The aim of this paper is to investigate technological advancements made to a robotic tele-ultrasound system for musculoskeletal imaging, the MSK-TIM (Musculoskeletal Telerobotic Imaging Machine). The hardware was enhanced with a force feedback sensor and a new controller was introduced. Software improvements were developed which allowed the operator to access ultrasound functions such as focus, depth, gain, zoom, color, and power Doppler controls. The device was equipped with Wi-Fi network capability which allowed the master and slave stations to be positioned in different locations. A trial assessing the system to scan the wrist was conducted with twelve participants, for a total of twenty-four arms. Both the participants and radiologist reported their experience. The images obtained were determined to be of satisfactory quality for diagnosis. The system improvements resulted in a better user and patient experience for the radiologist and participants. Latency with the VPN configuration was similar to the WLAN in our experiments. This research explores several technologies in medical telerobotics and provides insight into how they should be used in future. This study provides evidence to support larger-scale trials of the MSK-TIM for musculoskeletal imaging.
Collapse
Affiliation(s)
- Zachary Ochitwa
- Department of Mechanical Engineering, University of Saskatchewan, Saskatoon, SK S7N 5A9, Canada; (Z.O.); (A.P.N.C.)
| | - Reza Fotouhi
- Department of Mechanical Engineering, University of Saskatchewan, Saskatoon, SK S7N 5A9, Canada; (Z.O.); (A.P.N.C.)
| | - Scott J. Adams
- Department of Medical Imaging, University of Saskatchewan, Saskatoon, SK S7N 0W8, Canada; (S.J.A.); (H.O.)
| | - Adriana Paola Noguera Cundar
- Department of Mechanical Engineering, University of Saskatchewan, Saskatoon, SK S7N 5A9, Canada; (Z.O.); (A.P.N.C.)
| | - Haron Obaid
- Department of Medical Imaging, University of Saskatchewan, Saskatoon, SK S7N 0W8, Canada; (S.J.A.); (H.O.)
| |
Collapse
|
5
|
Zhang YQ, Sun LP, He T, Guo LH, Liu H, Xu G, Zhao H, Wang Q, Wang J, Yang KF, Song GC, Zhou BY, Xu HX, Zhao CK. A 5G-based telerobotic ultrasound system provides qualified abdominal ultrasound services for patients on a rural island: a prospective and comparative study of 401 patients. Abdom Radiol (NY) 2024; 49:942-957. [PMID: 38102443 DOI: 10.1007/s00261-023-04123-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/20/2023] [Revised: 11/01/2023] [Accepted: 11/03/2023] [Indexed: 12/17/2023]
Abstract
PURPOSE To explore the feasibility of a 5G-based telerobotic ultrasound (US) system for providing qualified abdominal US services on a rural island. METHODS This prospective study involved two medical centers (the tele-radiologist site's hospital and the patient site's hospital) separated by 72 km. Patients underwent 5G-based telerobotic US by tele-radiologists and conventional US by on-site radiologists from September 2020 to March 2021. The clinical feasibility and diagnostic performance of the 5G-based telerobotic abdominal US examination were assessed based on safety, duration, image quality, diagnostic findings, and questionnaires. RESULTS A total of 401 patients (217 women and 184 men; mean age, 54.96 ± 15.43 years) were enrolled. A total of 90.1% of patients indicated no discomfort with the telerobotic US examination. For the examination duration, telerobotic US took longer than conventional US (12.54 ± 3.20 min vs. 7.23 ± 2.10 min, p = 0.001). For image quality scores, the results of the two methods were similar (4.54 ± 0.63 vs. 4.57 ± 0.61, p = 0.112). No significant differences were found between the two methods in measurements for the aorta, portal vein, gallbladder, kidney (longitudinal diameter), prostate, and uterus; however, telerobotic US underestimated the transverse diameter of the kidney (p < 0.05). A total of 504 positive results, including 31 different diseases, were detected. Among them, 455 cases were identified by the two methods; 17 cases were identified by telerobotic US only; and 32 cases were identified by conventional US only. There was good consistency in the diagnosis of 29 types of disease between the two methods (κ = 0.773-1.000). Furthermore, more than 90% of patients accepted the telerobotic US examination and agreed to pay additional fees in future. CONCLUSION The 5G-based telerobotic US system can expand access to abdominal US services for patients in rural areas, thereby reducing health care disparities.
Collapse
Affiliation(s)
- Ya-Qin Zhang
- Department of Medical Ultrasound, Center of Minimally Invasive Treatment for Tumor, Shanghai Tenth People's Hospital, School of Medicine, Tongji University, Shanghai, 200072, China
- Shanghai Engineering Research Center of Ultrasound Diagnosis and Treatment, Shanghai, 200072, China
- Department of Ultrasound, Zhongshan Hospital, Institute of Ultrasound in Medicine and Engineering, Fudan University, Shanghai, 200032, China
| | - Li-Ping Sun
- Department of Medical Ultrasound, Center of Minimally Invasive Treatment for Tumor, Shanghai Tenth People's Hospital, School of Medicine, Tongji University, Shanghai, 200072, China
- Shanghai Engineering Research Center of Ultrasound Diagnosis and Treatment, Shanghai, 200072, China
| | - Tian He
- Department of Medical Ultrasound, Center of Minimally Invasive Treatment for Tumor, Shanghai Tenth People's Hospital, School of Medicine, Tongji University, Shanghai, 200072, China
- Shanghai Engineering Research Center of Ultrasound Diagnosis and Treatment, Shanghai, 200072, China
| | - Le-Hang Guo
- Department of Medical Ultrasound, Center of Minimally Invasive Treatment for Tumor, Shanghai Tenth People's Hospital, School of Medicine, Tongji University, Shanghai, 200072, China
- Shanghai Engineering Research Center of Ultrasound Diagnosis and Treatment, Shanghai, 200072, China
| | - Hui Liu
- Department of Medical Ultrasound, Center of Minimally Invasive Treatment for Tumor, Shanghai Tenth People's Hospital, School of Medicine, Tongji University, Shanghai, 200072, China
- Shanghai Engineering Research Center of Ultrasound Diagnosis and Treatment, Shanghai, 200072, China
| | - Guang Xu
- Department of Medical Ultrasound, Center of Minimally Invasive Treatment for Tumor, Shanghai Tenth People's Hospital, School of Medicine, Tongji University, Shanghai, 200072, China
- Shanghai Engineering Research Center of Ultrasound Diagnosis and Treatment, Shanghai, 200072, China
| | - Hui Zhao
- Department of Medical Ultrasound, Center of Minimally Invasive Treatment for Tumor, Shanghai Tenth People's Hospital, School of Medicine, Tongji University, Shanghai, 200072, China
- Shanghai Engineering Research Center of Ultrasound Diagnosis and Treatment, Shanghai, 200072, China
| | - Qiao Wang
- Department of Medical Ultrasound, Center of Minimally Invasive Treatment for Tumor, Shanghai Tenth People's Hospital, School of Medicine, Tongji University, Shanghai, 200072, China
- Shanghai Engineering Research Center of Ultrasound Diagnosis and Treatment, Shanghai, 200072, China
| | - Jing Wang
- Department of Medical Ultrasound, Center of Minimally Invasive Treatment for Tumor, Shanghai Tenth People's Hospital, School of Medicine, Tongji University, Shanghai, 200072, China
- Shanghai Engineering Research Center of Ultrasound Diagnosis and Treatment, Shanghai, 200072, China
| | - Kai-Feng Yang
- Department of Medical Ultrasound, Shanghai Tenth People's Hospital Chongming Branch, Shanghai, 200072, China
| | - Guo-Chao Song
- Department of Medical Ultrasound, Shanghai Tenth People's Hospital Chongming Branch, Shanghai, 200072, China
| | - Bo-Yang Zhou
- Department of Ultrasound, Zhongshan Hospital, Institute of Ultrasound in Medicine and Engineering, Fudan University, Shanghai, 200032, China
| | - Hui-Xiong Xu
- Department of Ultrasound, Zhongshan Hospital, Institute of Ultrasound in Medicine and Engineering, Fudan University, Shanghai, 200032, China.
| | - Chong-Ke Zhao
- Department of Ultrasound, Zhongshan Hospital, Institute of Ultrasound in Medicine and Engineering, Fudan University, Shanghai, 200032, China.
| |
Collapse
|
6
|
Song L, Li Q, Sai Z, Sun K, Chen W, Zhang H, Wang Y, Jiao Z, Ni X. A Multimodal Point Cloud-Based Method for Tumor Localization in Robotic Ultrasound-Guided Radiotherapy. Technol Cancer Res Treat 2024; 23:15330338241273149. [PMID: 39155658 DOI: 10.1177/15330338241273149] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 08/20/2024] Open
Abstract
Objectives: Part of the tumor localization methods in radiotherapy have poor real-time performance and may generate additional radiation. We propose a multimodal point cloud-based method for tumor localization in robotic ultrasound-guided radiotherapy, which only irradiates computed tomography (CT) during radiotherapy planning to avoid additional radiation. Methods: The tumor position was determined using the CT point cloud, and the red green blue depth (RGBD) point cloud was used to determine body surface scanning location corresponding to the tumor location. The relationship between the CT point cloud and RGBD point cloud was established through multi-modal point cloud registration. The point cloud was then used for robot tumor localization through coordinate transformation between camera and robot. Results: The maximum mean absolute error of the tumor location in the X, Y, and Z directions of the robot coordinate system were 0.781, 1.334, and 1.490 mm, respectively. The average point-to-point translation mean absolute error between the actual and predicted positions of the localization points was 1.847 mm. The maximum error in the random positioning experiment was 1.77 mm. Conclusion: The proposed method is radiation free and has real-time performance, with tumor localization accuracy that meets the requirements of radiotherapy. The proposed method, which potentially reduces the risks associated with radiation exposure while ensuring efficient and accurate tumor localization, represents a promising advancement in the field of radiotherapy.
Collapse
Affiliation(s)
- Lintao Song
- Department of Radiotherapy, The Affiliated Changzhou NO.2 People's Hospital of Nanjing Medical University, Changzhou, China
- Jiangsu Province Engineering Research Center of Medical Physics, Changzhou, China
- Center for Medical Physics, Nanjing Medical University, Changzhou, China
| | - Qixuan Li
- Department of Radiotherapy, The Affiliated Changzhou NO.2 People's Hospital of Nanjing Medical University, Changzhou, China
- Jiangsu Province Engineering Research Center of Medical Physics, Changzhou, China
- Center for Medical Physics, Nanjing Medical University, Changzhou, China
- School of Microelectronics and Control Engineering, Changzhou University, Changzhou, China
| | - Zhang Sai
- Department of Radiotherapy, The Affiliated Changzhou NO.2 People's Hospital of Nanjing Medical University, Changzhou, China
- Jiangsu Province Engineering Research Center of Medical Physics, Changzhou, China
- Center for Medical Physics, Nanjing Medical University, Changzhou, China
| | - Kangkang Sun
- Department of Radiotherapy, The Affiliated Changzhou NO.2 People's Hospital of Nanjing Medical University, Changzhou, China
- Jiangsu Province Engineering Research Center of Medical Physics, Changzhou, China
- Center for Medical Physics, Nanjing Medical University, Changzhou, China
- School of Computer and Artificial Intelligence, Changzhou University, Changzhou, China
| | - Wei Chen
- Department of Radiotherapy, The Affiliated Changzhou NO.2 People's Hospital of Nanjing Medical University, Changzhou, China
- Jiangsu Province Engineering Research Center of Medical Physics, Changzhou, China
- Center for Medical Physics, Nanjing Medical University, Changzhou, China
- School of Computer and Artificial Intelligence, Changzhou University, Changzhou, China
| | - Heng Zhang
- Department of Radiotherapy, The Affiliated Changzhou NO.2 People's Hospital of Nanjing Medical University, Changzhou, China
- Jiangsu Province Engineering Research Center of Medical Physics, Changzhou, China
- Center for Medical Physics, Nanjing Medical University, Changzhou, China
| | - Yibo Wang
- Department of Radiotherapy, The Affiliated Changzhou NO.2 People's Hospital of Nanjing Medical University, Changzhou, China
- Jiangsu Province Engineering Research Center of Medical Physics, Changzhou, China
- Center for Medical Physics, Nanjing Medical University, Changzhou, China
| | - Zhuqing Jiao
- School of Microelectronics and Control Engineering, Changzhou University, Changzhou, China
- School of Computer and Artificial Intelligence, Changzhou University, Changzhou, China
| | - Xinye Ni
- Department of Radiotherapy, The Affiliated Changzhou NO.2 People's Hospital of Nanjing Medical University, Changzhou, China
- Jiangsu Province Engineering Research Center of Medical Physics, Changzhou, China
- Center for Medical Physics, Nanjing Medical University, Changzhou, China
| |
Collapse
|
7
|
Zhang Y, Luo Y, Qiu L, Lu Q, Lu X. Remote ultrasound real‐time consultation and quality control system. INTERNATIONAL JOURNAL OF IMAGING SYSTEMS AND TECHNOLOGY 2024; 34. [DOI: 10.1002/ima.22969] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/18/2023] [Accepted: 09/06/2023] [Indexed: 08/12/2024]
Abstract
AbstractUltrasound examination is widely used, but there are problems such as difficulties in quality control and unbalanced distribution of ultrasound resources in primary hospitals. In this article, a novel remote ultrasound real‐time consultation and quality control system was developed. The system uses advanced information science technology, medical image acquisition equipment, audio and video coding and decoding technology, combined User Datagram Protocol (UDP) and Transmission Control Protocol (TCP) transfer protocols, server cluster design technology. It realizes remote real‐time medical consultation and quality control between the doctors in the consulation center and doctors in the ultrasound examination room. The image similarity, transmission delay, and efficiency of ultrasound treatment were tested. System test data show that the quality of ultrasound images transmitted to the consultation center is the same as the quality of the original ultrasound images, the distortion is less than 1%, and the audio and video transmission delay is less than 0.2 s. The system significantly improves the efficiency and quality of ultrasound diagnosis and treatment through its high interactivity, and can also help improve the level of ultrasound diagnosis and treatment in primary hospitals.
Collapse
Affiliation(s)
- Yong Zhang
- Department of Medical Ultrasound Sichuan University West China Hospital Chengdu China
| | - Yan Luo
- Department of Medical Ultrasound Sichuan University West China Hospital Chengdu China
| | - Li Qiu
- Department of Medical Ultrasound Sichuan University West China Hospital Chengdu China
| | - Qiang Lu
- Department of Medical Ultrasound Sichuan University West China Hospital Chengdu China
| | - Xiao Lu
- Department of Medical Ultrasound Sichuan University West China Hospital Chengdu China
| |
Collapse
|
8
|
Zhao X, Yang C, Lyu Y, Xu Y, Han Z, Zhao H. Tissue ultrasound imaging based on wavelet correlation analysis and pulse-inversion technique. Technol Health Care 2024; 32:31-53. [PMID: 37781821 DOI: 10.3233/thc-220403] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/03/2023]
Abstract
BACKGROUND Pulse-inversion-based tissue harmonic imaging has been utilized for many years because it can effectively eliminate the harmonic leakage and produce low side-lobe. However, the pulse inversion method is sensitive to imaging object movements, which may result in motion artifacts. Spatial resolution and contrast were limited. OBJECTIVE To improve ultrasound image quality by a new pulse-inversion-based tissue harmonic imaging technique. METHODS Continuous wavelet transform is applied to investigate the correlation between mother wavelet and the received echoes from two opposite pulses. To get a better correlation, a novel mother wavelet named 'tissue wavelet' is designed based on the Khokhlov-Zabolotskaya- Kuznetsov (KZK) wave equation. Radio frequency data were obtained from open Ultrasonix SonixTouch imaging system. Experiments were carried on ultrasonic tissue phantom, human carotid artery and human liver. RESULTS The average improvement of lateral spatial resolution is 49.52% compared to pulse-inversion-based tissue second-harmonic Imaging (PIHI). Contrast ratio (CR) and contrast-to-noise ratio (CNR) increased by 5.55 dB and 1.40 dB over PIHI. Tissue wavelet performs better than Mexh and Morl wavelet in lateral spatial resolution, CR, and CNR. CONCLUSION The proposed technique effectively improves the imaging quality in lateral spatial resolution, CR, and CNR.
Collapse
Affiliation(s)
- Xiaoyan Zhao
- Department of Information Engineering, School of Information Science and Technology, Qingdao University of Science and Technology, Tsingtao, Shandong, China
| | - Cuiyun Yang
- Department of Information Engineering, School of Information Science and Technology, Qingdao University of Science and Technology, Tsingtao, Shandong, China
| | - Yuchao Lyu
- Department of Information Engineering, School of Information Science and Technology, Qingdao University of Science and Technology, Tsingtao, Shandong, China
| | - Yinghao Xu
- Department of Information Engineering, School of Information Science and Technology, Qingdao University of Science and Technology, Tsingtao, Shandong, China
| | - Zhihui Han
- Department of Biomedical Engineering, School of Instrument Science and Opto-electronics Engineering, Hefei University of Technology, Hefei, Anhui, China
| | - Haien Zhao
- Orthopedic Department of the Second Hospital, Air Force Military Medical University, Xi'an, Shaanxi, China
| |
Collapse
|
9
|
Kumar A, Kempski Leadingham KM, Kerensky MJ, Sankar S, Thakor NV, Manbachi A. Visualizing tactile feedback: an overview of current technologies with a focus on ultrasound elastography. FRONTIERS IN MEDICAL TECHNOLOGY 2023; 5:1238129. [PMID: 37854637 PMCID: PMC10579802 DOI: 10.3389/fmedt.2023.1238129] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/10/2023] [Accepted: 09/14/2023] [Indexed: 10/20/2023] Open
Abstract
Tissue elasticity remains an essential biomarker of health and is indicative of irregularities such as tumors or infection. The timely detection of such abnormalities is crucial for the prevention of disease progression and complications that arise from late-stage illnesses. However, at both the bedside and the operating table, there is a distinct lack of tactile feedback for deep-seated tissue. As surgical techniques advance toward remote or minimally invasive options to reduce infection risk and hasten healing time, surgeons lose the ability to manually palpate tissue. Furthermore, palpation of deep structures results in decreased accuracy, with the additional barrier of needing years of experience for adequate confidence of diagnoses. This review delves into the current modalities used to fulfill the clinical need of quantifying physical touch. It covers research efforts involving tactile sensing for remote or minimally invasive surgeries, as well as the potential of ultrasound elastography to further this field with non-invasive real-time imaging of the organ's biomechanical properties. Elastography monitors tissue response to acoustic or mechanical energy and reconstructs an image representative of the elastic profile in the region of interest. This intuitive visualization of tissue elasticity surpasses the tactile information provided by sensors currently used to augment or supplement manual palpation. Focusing on common ultrasound elastography modalities, we evaluate various sensing mechanisms used for measuring tactile information and describe their emerging use in clinical settings where palpation is insufficient or restricted. With the ongoing advancements in ultrasound technology, particularly the emergence of micromachined ultrasound transducers, these devices hold great potential in facilitating early detection of tissue abnormalities and providing an objective measure of patient health.
Collapse
Affiliation(s)
- Avisha Kumar
- Department of Electrical and Computer Engineering, Johns Hopkins University, Baltimore, MD, United States
- HEPIUS Innovation Lab, Johns Hopkins University School of Medicine, Baltimore, MD, United States
| | - Kelley M. Kempski Leadingham
- HEPIUS Innovation Lab, Johns Hopkins University School of Medicine, Baltimore, MD, United States
- Department of Neurosurgery, Johns Hopkins University School of Medicine, Baltimore, MD, United States
| | - Max J. Kerensky
- Department of Electrical and Computer Engineering, Johns Hopkins University, Baltimore, MD, United States
- HEPIUS Innovation Lab, Johns Hopkins University School of Medicine, Baltimore, MD, United States
| | - Sriramana Sankar
- Department of Biomedical Engineering, Johns Hopkins University School of Medicine, Baltimore, MD, United States
| | - Nitish V. Thakor
- Department of Electrical and Computer Engineering, Johns Hopkins University, Baltimore, MD, United States
- Department of Biomedical Engineering, Johns Hopkins University School of Medicine, Baltimore, MD, United States
| | - Amir Manbachi
- Department of Electrical and Computer Engineering, Johns Hopkins University, Baltimore, MD, United States
- HEPIUS Innovation Lab, Johns Hopkins University School of Medicine, Baltimore, MD, United States
- Department of Neurosurgery, Johns Hopkins University School of Medicine, Baltimore, MD, United States
- Department of Biomedical Engineering, Johns Hopkins University School of Medicine, Baltimore, MD, United States
- Department of Mechanical Engineering, Johns Hopkins University, Baltimore, MD, United States
- Department of Anesthesiology and Critical Care Medicine, Johns Hopkins University School of Medicine, Baltimore, MD, United States
| |
Collapse
|
10
|
Zhang B, Cong H, Shen Y, Sun M. Visual Perception and Convolutional Neural Network-Based Robotic Autonomous Lung Ultrasound Scanning Localization System. IEEE TRANSACTIONS ON ULTRASONICS, FERROELECTRICS, AND FREQUENCY CONTROL 2023; 70:961-974. [PMID: 37015119 DOI: 10.1109/tuffc.2023.3263514] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/19/2023]
Abstract
Under the situation of severe COVID-19 epidemic, lung ultrasound (LUS) has been proved to be an effective and convenient method to diagnose and evaluate the extent of respiratory disease. However, the traditional clinical ultrasound (US) scanning requires doctors not only to be in close contact with patients but also to have rich experience. In order to alleviate the shortage of medical resources and reduce the work stress and risk of infection for doctors, we propose a visual perception and convolutional neural network (CNN)-based robotic autonomous LUS scanning localization system to realize scanned target recognition, probe pose solution and movement, and the acquisition of US images. The LUS scanned targets are identified through the target segmentation and localization algorithm based on the improved CNN, which is using the depth camera to collect the image information; furthermore, the method based on multiscale compensation normal vector is used to solve the attitude of the probe; finally, a position control strategy based on force feedback is designed to optimize the position and attitude of the probe, which can not only obtain high-quality US images but also ensure the safety of patients and the system. The results of human LUS scanning experiment verify the accuracy and feasibility of the system. The positioning accuracy of the scanned targets is 15.63 ± 0.18 mm, and the distance accuracy and rotation angle accuracy of the probe position calculation are 6.38 ± 0.25 mm and 8.60° ±2.29° , respectively. More importantly, the obtained high-quality US images can clearly capture the main pathological features of the lung. The system is expected to be applied in clinical practice.
Collapse
|
11
|
Fu J, Li W, Peng X, Du J, Ouyang A, Wang Q, Chen X. MDRANet: A multiscale dense residual attention network for magnetic resonance and nuclear medicine image fusion. Biomed Signal Process Control 2023. [DOI: 10.1016/j.bspc.2022.104382] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/11/2022]
|
12
|
Abstract
The erratic modern world introduces challenges to all sectors of societies and potentially introduces additional inequality. One possibility to decrease the educational inequality is to provide remote access to facilities that enable learning and training. A similar approach of remote resource usage can be utilized in resource-poor situations where the required equipment is available at other premises. The concept of Industry 5.0 (i5.0) focuses on a human-centric approach, enabling technologies to concentrate on human–machine interaction and emphasizing the importance of societal values. This paper introduces a novel robotics teleoperation platform supported by the i5.0. The platform reduces inequality and allows usage and learning of robotics remotely independently of time and location. The platform is based on digital twins with bi-directional data transmission between the physical and digital counterparts. The proposed system allows teleoperation, remote programming, and near real-time monitoring of controlled robots, robot time scheduling, and social interaction between users. The system design and implementation are described in detail, followed by experimental results.
Collapse
|
13
|
Chai HH, Ye RZ, Xiong LF, Xu ZN, Chen X, Xu LJ, Hu X, Jiang LF, Peng CZ. Successful Use of a 5G-Based Robot-Assisted Remote Ultrasound System in a Care Center for Disabled Patients in Rural China. Front Public Health 2022; 10:915071. [PMID: 35923952 PMCID: PMC9339711 DOI: 10.3389/fpubh.2022.915071] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/07/2022] [Accepted: 06/22/2022] [Indexed: 12/07/2022] Open
Abstract
Background Disability has become a global population health challenge. Due to difficulties in self-care or independent living, patients with disability mainly live in community-based care centers or institutions for long-term care. Nonetheless, these settings often lack basic medical resources, such as ultrasonography. Thus, remote ultrasonic robot technology for clinical applications across wide regions is imperative. To date, few experiences of remote diagnostic systems in rural care centers have been reported. Objective To assess the feasibility of a fifth-generation cellular technology (5G)-based robot-assisted remote ultrasound system in a care center for disabled patients in rural China. Methods Patients underwent remote robot-assisted and bedside ultrasound examinations of the liver, gallbladder, spleen, and kidneys. We compared the diagnostic consistency and differences between the two modalities and evaluated the examination duration, image quality, and safety. Results Forty-nine patients were included (21 men; mean age: 61.0 ± 19.0 [range: 19-91] years). Thirty-nine and ten had positive and negative results, respectively; 67 lesions were detected. Comparing the methods, 41 and 8 patients had consistent and inconsistent diagnoses, respectively. The McNemar and kappa values were 0.727 and 0.601, respectively. The mean duration of remote and bedside examinations was 12.2 ± 4.5 (range: 5-26) min and 7.5 ± 1.8 (range: 5-13) min (p < 0.001), respectively. The median image score for original images on the patient side and transmitted images on the doctor side was 5 points (interquartile range: [IQR]: 4.7-5.0) and 4.7 points (IQR: 4.5-5.0) (p = 0.176), respectively. No obvious complications from the examination were reported. Conclusions A 5G-based robot-assisted remote ultrasound system is feasible and has comparable diagnostic efficiency to traditional bedside ultrasound. This system may provide a unique solution for basic ultrasound diagnostic services in primary healthcare settings.
Collapse
Affiliation(s)
- Hui-hui Chai
- Department of Medical Ultrasound, Shanghai Tenth People' Hospital, Tongji University School of Medicine, Shanghai, China
| | - Rui-zhong Ye
- Emergency and Critical Care Center, Department of Ultrasound Medicine, Zhejiang Provincial People's Hospital (Affiliated People's Hospital, Hangzhou Medical College), Hangzhou, China
| | - Lin-fei Xiong
- Department of Engineering, BGI Life Science Research Institution, Shenzhen, China
| | - Zi-ning Xu
- Emergency and Critical Care Center, Department of Ultrasound Medicine, Zhejiang Provincial People's Hospital (Affiliated People's Hospital, Hangzhou Medical College), Hangzhou, China
| | - Xuan Chen
- Department of Engineering, BGI Life Science Research Institution, Shenzhen, China
| | - Li-juan Xu
- Department of General Practice, Yuanshu Disabled Care Center, Huzhou, China
| | - Xin Hu
- Department of General Practice, Yuanshu Disabled Care Center, Huzhou, China
| | - Lian-feng Jiang
- Department of General Practice, Yuanshu Disabled Care Center, Huzhou, China
| | - Cheng-zhong Peng
- Department of Medical Ultrasound, Shanghai Tenth People' Hospital, Tongji University School of Medicine, Shanghai, China
- Ultrasound Research and Education Institute, Clinical Research Center for Interventional Medicine, Tongji University School of Medicine, Shanghai, China
- Shanghai Engineering Research Center of Ultrasound Diagnosis and Treatment, Shanghai, China
| |
Collapse
|
14
|
Zhang YQ, Yin HH, He T, Guo LH, Zhao CK, Xu HX. Clinical application of a 5G-based telerobotic ultrasound system for thyroid examination on a rural island: a prospective study. Endocrine 2022; 76:620-634. [PMID: 35182363 PMCID: PMC8857403 DOI: 10.1007/s12020-022-03011-0] [Citation(s) in RCA: 6] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 11/09/2021] [Accepted: 01/29/2022] [Indexed: 12/16/2022]
Abstract
PURPOSE To evaluate the feasibility of a 5G-based telerobotic ultrasound (US) system for thyroid examination on a rural island. METHODS From September 2020 to March 2021, this prospectively study enrolled a total of 139 patients (average age, 58.6 ± 12.7 years) included 33 males and 106 females, who underwent 5G-based telerobotic thyroid US examination by a tele-doctor at Shanghai Tenth People's Hospital and a conventional thyroid US examination at Chongming Second People's Hospital 84 km away. The clinical feasibility of 5G-based telerobotic US for thyroid examination were evaluated in terms of safety, duration, US image quality, diagnostic results, and questionnaire survey. RESULTS 92.8% of patients had no examination-related complaints. The average duration of the 5G-based telerobotic US examination was similar as that of conventional US examination (5.57 ± 2.20 min vs. 5.23 ± 2.1 min, P = 0.164). The image quality of telerobotic US correlated well with that of conventional US (4.63 ± 0.60 vs. 4.65 ± 0.61, P = 0.102). There was no significant difference between two types of US examination methods for the diameter measurement of the thyroid, cervical lymph nodes, and thyroid nodules. Two lymphadenopathies and 20 diffuse thyroid diseases were detected in two types of US methods. 124 thyroid nodules were detected by telerobotic US and 127 thyroid nodules were detected by conventional US. Among them, 122 were the same thyroid nodules. In addition, there were good consistency in the US features (component, echogenicity, shape, and calcification) and ACR TI-RADS category of the same thyroid nodules between telerobotic and conventional US examinations (ICC = 0.788-0.863). 85.6% of patients accepted the telerobotic US, and 87.1% were willing to pay extra fee for the telerobotic US. CONCLUSION The 5G-based telerobotic US system can be a routine diagnostic tool for thyroid examination for patients on a rural island.
Collapse
Affiliation(s)
- Ya-Qin Zhang
- Department of Medical Ultrasound, Center of Minimally Invasive Treatment for Tumor, Shanghai Tenth People's Hospital, School of Medicine, Tongji University, Shanghai, China
- Ultrasound Research and Education Institute, Clinical Research Center for Interventional Medicine, School of Medicine, Tongji University, Shanghai, China
- Shanghai Engineering Research Center of Ultrasound Diagnosis and Treatment, Shanghai, China
- National Clinical Research Center for Interventional Medicine, Shanghai, China
| | - Hao-Hao Yin
- Department of Medical Ultrasound, Center of Minimally Invasive Treatment for Tumor, Shanghai Tenth People's Hospital, School of Medicine, Tongji University, Shanghai, China
- Ultrasound Research and Education Institute, Clinical Research Center for Interventional Medicine, School of Medicine, Tongji University, Shanghai, China
- Shanghai Engineering Research Center of Ultrasound Diagnosis and Treatment, Shanghai, China
- National Clinical Research Center for Interventional Medicine, Shanghai, China
| | - Tian He
- Department of Medical Ultrasound, Center of Minimally Invasive Treatment for Tumor, Shanghai Tenth People's Hospital, School of Medicine, Tongji University, Shanghai, China
- Ultrasound Research and Education Institute, Clinical Research Center for Interventional Medicine, School of Medicine, Tongji University, Shanghai, China
- Shanghai Engineering Research Center of Ultrasound Diagnosis and Treatment, Shanghai, China
- National Clinical Research Center for Interventional Medicine, Shanghai, China
| | - Le-Hang Guo
- Department of Medical Ultrasound, Center of Minimally Invasive Treatment for Tumor, Shanghai Tenth People's Hospital, School of Medicine, Tongji University, Shanghai, China
- Ultrasound Research and Education Institute, Clinical Research Center for Interventional Medicine, School of Medicine, Tongji University, Shanghai, China
- Shanghai Engineering Research Center of Ultrasound Diagnosis and Treatment, Shanghai, China
- National Clinical Research Center for Interventional Medicine, Shanghai, China
- Department of Medical Ultrasound, Shanghai Tenth People's Hospital Chongming Branch, Shanghai, China
| | - Chong-Ke Zhao
- Department of Medical Ultrasound, Center of Minimally Invasive Treatment for Tumor, Shanghai Tenth People's Hospital, School of Medicine, Tongji University, Shanghai, China.
- Ultrasound Research and Education Institute, Clinical Research Center for Interventional Medicine, School of Medicine, Tongji University, Shanghai, China.
- Shanghai Engineering Research Center of Ultrasound Diagnosis and Treatment, Shanghai, China.
- National Clinical Research Center for Interventional Medicine, Shanghai, China.
- Department of Ultrasound, Zhongshan Hospital, Fudan University, Shanghai, China.
| | - Hui-Xiong Xu
- Department of Medical Ultrasound, Center of Minimally Invasive Treatment for Tumor, Shanghai Tenth People's Hospital, School of Medicine, Tongji University, Shanghai, China.
- Ultrasound Research and Education Institute, Clinical Research Center for Interventional Medicine, School of Medicine, Tongji University, Shanghai, China.
- Shanghai Engineering Research Center of Ultrasound Diagnosis and Treatment, Shanghai, China.
- National Clinical Research Center for Interventional Medicine, Shanghai, China.
- Department of Ultrasound, Zhongshan Hospital, Fudan University, Shanghai, China.
| |
Collapse
|
15
|
Li T, Meng X, Tavakoli M. Dual Mode pHRI- teleHRI Control System with a Hybrid Admittance-Force Controller for Ultrasound Imaging. SENSORS (BASEL, SWITZERLAND) 2022; 22:4025. [PMID: 35684646 PMCID: PMC9185235 DOI: 10.3390/s22114025] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 05/04/2022] [Revised: 05/21/2022] [Accepted: 05/25/2022] [Indexed: 12/04/2022]
Abstract
The COVID-19 pandemic has brought unprecedented extreme pressure on the medical system due to the physical distance policy, especially for procedures such as ultrasound (US) imaging, which are usually carried out in person. Tele-operation systems are a promising way to avoid physical human-robot interaction (pHRI). However, the system usually requires another robot on the remote doctor side to provide haptic feedback, which makes it expensive and complex. To reduce the cost and system complexity, in this paper, we present a low-cost, easy-to-use, dual-mode pHRI-teleHRI control system with a custom-designed hybrid admittance-force controller for US imaging. The proposed system requires only a tracking camera rather than a sophisticated robot on the remote side. An audio feedback is designed for replacing haptic feedback on the remote side, and its sufficiency is experimentally verified. The experimental results indicate that the designed hybrid controller can significantly improve the task performance in both modes. Furthermore, the proposed system enables the user to conduct US imaging while complying with the physical distance policy, and allows them to seamlessly switch modes from one to another in an online manner. The novel system can be easily adapted to other medical applications beyond the pandemic, such as tele-healthcare, palpation, and auscultation.
Collapse
Affiliation(s)
- Teng Li
- Department of Electrical and Computer Engineering, University of Alberta, Edmonton, AB T6G 1H9, Canada;
| | - Xiao Meng
- Department of Mechanical Engineering, University of Alberta, Edmonton, AB T6G 1H9, Canada;
| | - Mahdi Tavakoli
- Department of Electrical and Computer Engineering, University of Alberta, Edmonton, AB T6G 1H9, Canada;
| |
Collapse
|