1
|
Wang X, Huang J, Chatzakou M, Medijainen K, Toomela A, Nõmm S, Ruzhansky M. LSTM-CNN: An efficient diagnostic network for Parkinson's disease utilizing dynamic handwriting analysis. Comput Methods Programs Biomed 2024; 247:108066. [PMID: 38364361 DOI: 10.1016/j.cmpb.2024.108066] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/04/2023] [Revised: 01/30/2024] [Accepted: 02/07/2024] [Indexed: 02/18/2024]
Abstract
BACKGROUND AND OBJECTIVES Dynamic handwriting analysis, due to its noninvasive and readily accessible nature, has emerged as a vital adjunctive method for the early diagnosis of Parkinson's disease (PD). An essential step involves analysing subtle variations in signals to quantify PD dysgraphia. Although previous studies have explored extracting features from the overall signal, they may ignore the potential importance of local signal segments. In this study, we propose a lightweight network architecture to analyse dynamic handwriting signal segments of patients and present visual diagnostic results, providing an efficient diagnostic method. METHODS To analyse subtle variations in handwriting, we investigate time-dependent patterns in local representation of handwriting signals. Specifically, we segment the handwriting signal into fixed-length sequential segments and design a compact one-dimensional (1D) hybrid network to extract discriminative temporal features for classifying each local segment. Finally, the category of the handwriting signal is fully diagnosed through a majority voting scheme. RESULTS The proposed method achieves impressive diagnostic performance on the new DraWritePD dataset (with an accuracy of 96.2%, sensitivity of 94.5% and specificity of 97.3%) and the well-established PaHaW dataset (with an accuracy of 90.7%, sensitivity of 94.3% and specificity of 87.5%). Moreover, the network architecture stands out for its excellent lightweight design, occupying a mere 0.084M parameters, with only 0.59M floating-point operations. It also exhibits nearly real-time CPU inference performance, with the inference time for a single handwriting signal ranging from 0.106 to 0.220 s. CONCLUSIONS We present a series of experiments with extensive analysis, which systematically demonstrate the effectiveness and efficiency of the proposed method in quantifying dysgraphia for a precise diagnosis of PD.
Collapse
Affiliation(s)
- Xuechao Wang
- Department of Mathematics: Analysis, Logic and Discrete Mathematics, Ghent University, Ghent, Belgium.
| | - Junqing Huang
- Department of Mathematics: Analysis, Logic and Discrete Mathematics, Ghent University, Ghent, Belgium
| | - Marianna Chatzakou
- Department of Mathematics: Analysis, Logic and Discrete Mathematics, Ghent University, Ghent, Belgium
| | - Kadri Medijainen
- Institute of Sport Sciences and Physiotherapy, University of Tartu, Puusepa 8, Tartu 51014, Estonia
| | - Aaro Toomela
- School of Natural Sciences and Health, Tallinn University, Narva mnt. 25, 10120, Tallinn, Estonia
| | - Sven Nõmm
- Department of Software Science, Faculty of Information Technology, Tallinn University of Technology, Akadeemia tee 15 a, 12618, Tallinn, Estonia
| | - Michael Ruzhansky
- Department of Mathematics: Analysis, Logic and Discrete Mathematics, Ghent University, Ghent, Belgium; School of Mathematical Sciences, Queen Mary University of London, Mile End Road, London E1 4NS, United Kingdom
| |
Collapse
|
2
|
Ito H, Uragami N, Miyazaki T, Shimamura Y, Ikeda H, Nishikawa Y, Onimaru M, Matsuo K, Isozaki M, Yang W, Issha K, Kimura S, Kawamura M, Yokoyama N, Kushima M, Inoue H. Determination of esophageal squamous cell carcinoma and gastric adenocarcinoma on raw tissue using Raman spectroscopy. World J Gastroenterol 2023; 29:3145-3156. [PMID: 37346148 PMCID: PMC10280800 DOI: 10.3748/wjg.v29.i20.3145] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 12/12/2022] [Revised: 04/10/2023] [Accepted: 04/27/2023] [Indexed: 05/26/2023] Open
Abstract
BACKGROUND Cancer detection is a global research focus, and novel, rapid, and label-free techniques are being developed for routine clinical practice. This has led to the development of new tools and techniques from the bench side to routine clinical practice. In this study, we present a method that uses Raman spectroscopy (RS) to detect cancer in unstained formalin-fixed, resected specimens of the esophagus and stomach. Our method can record a clear Raman-scattered light spectrum in these specimens, confirming that the Raman-scattered light spectrum changes because of the histological differences in the mucosal tissue.
AIM To evaluate the use of Raman-scattered light spectrum for detecting endoscop-ically resected specimens of esophageal squamous cell carcinoma (SCC) and gastric adenocarcinoma (AC).
METHODS We created a Raman device that is suitable for observing living tissues, and attempted to acquire Raman-scattered light spectra in endoscopically resected specimens of six esophageal tissues and 12 gastric tissues. We evaluated formalin-fixed tissues using this technique and captured shifts at multiple locations based on feasibility, ranging from six to 19 locations 200 microns apart in the vertical and horizontal directions. Furthermore, a correlation between the obtained Raman scattered light spectra and histopathological diagnosis was performed.
RESULTS We successfully obtained Raman scattered light spectra from all six esophageal and 12 gastric specimens. After data capture, the tissue specimens were sent for histopathological analysis for further processing because RS is a label-free methodology that does not cause tissue destruction or alterations. Based on data analysis of molecular-level substrates, we established cut-off values for the diagnosis of esophageal SCC and gastric AC. By analyzing specific Raman shifts, we developed an algorithm to identify the range of esophageal SCC and gastric AC with an accuracy close to that of histopathological diagnoses.
CONCLUSION Our technique provides qualitative information for real-time morphological diagnosis. However, further in vivo evaluations require an excitation light source with low human toxicity and large amounts of data for validation.
Collapse
Affiliation(s)
- Hiroaki Ito
- Digestive Disease Center, Showa University Koto Toyosu Hospital, Tokyo 135-8577, Japan
| | - Naoyuki Uragami
- Digestive Disease Center, Showa University Koto Toyosu Hospital, Tokyo 135-8577, Japan
| | | | - Yuto Shimamura
- Digestive Disease Center, Showa University Koto Toyosu Hospital, Tokyo 135-8577, Japan
| | - Haruo Ikeda
- Digestive Disease Center, Showa University Koto Toyosu Hospital, Tokyo 135-8577, Japan
| | - Yohei Nishikawa
- Digestive Disease Center, Showa University Koto Toyosu Hospital, Tokyo 135-8577, Japan
| | - Manabu Onimaru
- Digestive Disease Center, Showa University Koto Toyosu Hospital, Tokyo 135-8577, Japan
| | - Kai Matsuo
- Digestive Disease Center, Showa University Koto Toyosu Hospital, Tokyo 135-8577, Japan
| | - Masayuki Isozaki
- Digestive Disease Center, Showa University Koto Toyosu Hospital, Tokyo 135-8577, Japan
| | - William Yang
- Bay Spec Inc., San Jose, CA 95131, United States
| | - Kenji Issha
- Fuji Technical Research Inc., Yokohama 220-6215, Japan
| | - Satoshi Kimura
- Department of Laboratory Medicine and Central Clinical Laboratory, Showa University Northern Yokohama Hospital, Yokohama 224-8503, Japan
| | - Machiko Kawamura
- Department of Hematology, Saitama Cancer Center, Inamachi 362-0806, Japan
| | - Noboru Yokoyama
- Digestive Disease Center, Showa University Koto Toyosu Hospital, Tokyo 135-8577, Japan
| | - Miki Kushima
- Department of Pathology, Showa University Koto Toyosu Hospital, Tokyo 135-8577, Japan
| | - Haruhiro Inoue
- Digestive Disease Center, Showa University Koto Toyosu Hospital, Tokyo 135-8577, Japan
| |
Collapse
|
3
|
He Z, Yuan Z, An P, Zhao J, Du B. MFB-LANN: A lightweight and updatable myocardial infarction diagnosis system based on convolutional neural networks and active learning. Comput Methods Programs Biomed 2021; 210:106379. [PMID: 34517182 DOI: 10.1016/j.cmpb.2021.106379] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/16/2021] [Accepted: 08/24/2021] [Indexed: 05/13/2023]
Abstract
BACKGROUND AND OBJECTIVES 12 leads electrocardiogram (ECG) are widely used to diagnose myocardial infarction (MI). Generally, the symptoms of MI can be reflected by waveforms in the heartbeat, and the contribution of different ECG leads to different types of MI is different. Therefore, it is significant to use the heartbeat waveform features and the lead relationship features for multi-category MI diagnosis. Moreover, the challenge of individual differences and lightweight algorithms also need to be further resolved and explored in the ECG automatic diagnosis system. METHODS This paper presents a lightweight MI diagnosis system named multi-feature-branch lead attention neural network (MFB-LANN) via 12 leads ECG signals. It is designed based on the characteristics of the ECG lead. Specifically, 12 independent feature branches correspond to different leads, and each branch contains different convolutional layers to extract features in the heartbeat, then a novel attention module is developed named lead attention mechanism (LAM) to assign different weights to each feature branch. Finally all the weighted feature branches are fused for classification. Furthermore, to overcome individual differences, patient-specific scheme and active learning (AL) are used to train and update the model iteratively. RESULTS Experimental results based on Physikalisch-Technische Bundesanstalt (PTB) database shows that the MFB-LANN achieved satisfactory results with accuracy of 99.63% based on 5-fold cross validation under the intra-patient scheme. The patient-specific experiment yielded an average accuracy of 96.99% compared to the state-of-the-art. By contrast, the model achieved acceptable results on the hybrid database (PTB and PTB-XL), especially achieving 94.19% accuracy after the update. Moreover, the system can complete the update process and real-time diagnosis on the ARM Cortex-A72 platform. CONCLUSIONS Experiments show that the proposed method for MI diagnosis has more obvious advantages compared to other recent methods, and it has great potential to be applied to the mobile medical field.
Collapse
Affiliation(s)
- Ziyang He
- School of Computer Science, Wuhan University, Wuhan 430072, China
| | - Zhiyong Yuan
- School of Computer Science, Wuhan University, Wuhan 430072, China.
| | - Panfeng An
- School of Computer Science, Wuhan University, Wuhan 430072, China
| | - Jianhui Zhao
- School of Computer Science, Wuhan University, Wuhan 430072, China
| | - Bo Du
- School of Computer Science, Wuhan University, Wuhan 430072, China
| |
Collapse
|
4
|
Sircan-Kucuksayan A, Yaprak N, Derin AT, Ozbudak İH, Turhan M, Canpolat M. Noninvasive assessment of oral lesions using elastic light single-scattering spectroscopy: a pilot study. Eur Arch Otorhinolaryngol 2020; 277:1467-1472. [PMID: 32016524 DOI: 10.1007/s00405-020-05824-z] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/26/2019] [Accepted: 01/22/2020] [Indexed: 11/28/2022]
Abstract
PURPOSE In the present study, we investigated the potential application of elastic light single-scattering spectroscopy (ELSSS) as a noninvasive, adjunctive tool to differentiate between malignant and benign oral lesions in vivo. METHODS ELSSS spectra were acquired from 52 oral lesions of 47 patients prior to surgical biopsy using a single optical fiber probe. The sign of the spectral slope was used as a diagnostic parameter and was compared to the histopathology findings to obtain sensitivity and specificity of the ELSSS system in differentiating between benign and malignant tissues. RESULTS The sign of the spectral slope was positive for the benign tissues and negative for the malignant tissues. Nine malignant lesions and one high-grade dysplasia were correctly classified as cancerous. Six out of the ten low-grade dysplasia were correctly classified as cancerous, and four of them were misclassified as benign. Thirty benign lesions were correctly classified as benign, and two were misclassified as malignant. Our results indicate that the sign of the spectral slope enables the differentiation between malignant and benign oral lesions with a sensitivity of 80% and specificity of 94%. CONCLUSIONS ELSSS has the potential to be developed as an adjunctive screening tool in the noninvasive evaluation of oral lesions in vivo. This new diagnostic system may reduce the number of unnecessary biopsies.
Collapse
Affiliation(s)
| | - Neslihan Yaprak
- Department of Otolaryngology-Head and Neck Surgery, School of Medicine, Akdeniz University, Dumlupınar Boulevard 07058 Campus, Antalya, Turkey.
| | - Alper Tunga Derin
- Department of Otolaryngology-Head and Neck Surgery, School of Medicine, Akdeniz University, Dumlupınar Boulevard 07058 Campus, Antalya, Turkey
| | - İrem Hicran Ozbudak
- Department of Pathology, School of Medicine, Akdeniz University, Antalya, Turkey
| | - Murat Turhan
- Department of Otolaryngology-Head and Neck Surgery, School of Medicine, Akdeniz University, Dumlupınar Boulevard 07058 Campus, Antalya, Turkey
| | - Murat Canpolat
- Department of Biophysics, School of Medicine, Akdeniz University, Antalya, Turkey
| |
Collapse
|
5
|
Mathieu MC, Toullec A, Benoit C, Berry R, Validire P, Beaumel P, Vincent Y, Maroun P, Vielh P, Alchab L, Farcy R, Moniz-Koum H, Fontaine-Aupart MP, Delaloge S, Balleyguier C. Preclinical ex vivo evaluation of the diagnostic performance of a new device for in situ label-free fluorescence spectral analysis of breast masses. Eur Radiol 2018; 28:2507-2515. [PMID: 29305733 DOI: 10.1007/s00330-017-5228-7] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/18/2017] [Revised: 11/07/2017] [Accepted: 11/30/2017] [Indexed: 10/18/2022]
Abstract
OBJECTIVES To assess the diagnostic performance of a new device for in situ label-free fluorescence spectral analysis of breast masses in freshly removed surgical specimens, in preparation for its clinical development. METHODS Sixty-four breast masses from consenting patients who had undergone either a lumpectomy or a mastectomy were included. Label-free fluorescence spectral acquisitions were obtained with a 25G fibre-containing needle inserted into the mass. Data from benign and malignant masses were compared to establish the most discriminating thresholds and measurement algorithms. Accuracy was verified using the bootstrap method. RESULTS The final histological examination revealed 44 invasive carcinomas and 20 benign lesions. The maximum intensity of fluorescence signal was discriminant between benign and malignant masses (p < .0001) whatever their sizes. Statistical analysis indicated that choosing five random measurements per mass was the best compromise to obtain high sensitivity and high negative predictive value with the fewest measurements. Thus, malignant tumours were identified with a mean sensitivity, specificity, negative and positive predictive value of 98.8%, 85.4%, 97.2% and 93.5%, respectively. CONCLUSION This new in situ tissue autofluorescence evaluation device allows accurate discrimination between benign and malignant breast masses and deserves clinical development. KEY POINTS • A new device allows in situ label-free fluorescence analysis of ex vivo breast masses • Maximum fluorescence intensity discriminates benign from malignant masses (p < .0001) • Five random measurements allow a high negative predictive value (97.2%).
Collapse
Affiliation(s)
| | - Alexis Toullec
- Institut des Sciences Moléculaires d'Orsay (ISMO), CNRS, Univ. Paris-Sud, Université Paris-Saclay, F-91405, Orsay, France
| | - Charlotte Benoit
- Nodea Medical, 1 mail du Pr Georges Mathé, 94800, Villejuif, France
| | - Richard Berry
- Institut Mutualiste Montsouris, 42 Boulevard Jourdan, 75014, Paris, France
| | - Pierre Validire
- Institut Mutualiste Montsouris, 42 Boulevard Jourdan, 75014, Paris, France
| | - Pauline Beaumel
- Nodea Medical, 1 mail du Pr Georges Mathé, 94800, Villejuif, France
| | - Yves Vincent
- Hôpital Privé d'Antony, 1 Rue Velpeau, 92160, Antony, France
| | - Pierre Maroun
- Gustave Roussy, 114 rue Edouard Vaillant, 94805, Villejuif, France
| | - Philippe Vielh
- Gustave Roussy, 114 rue Edouard Vaillant, 94805, Villejuif, France
| | - Lama Alchab
- Institut des Sciences Moléculaires d'Orsay (ISMO), CNRS, Univ. Paris-Sud, Université Paris-Saclay, F-91405, Orsay, France
| | - René Farcy
- Laboratoire Aimé Cotton, Université Paris-Sud, ENS Cachan, CNRS, Université Paris-Saclay, 91405, Orsay Cedex, France
| | | | - Marie-Pierre Fontaine-Aupart
- Institut des Sciences Moléculaires d'Orsay (ISMO), CNRS, Univ. Paris-Sud, Université Paris-Saclay, F-91405, Orsay, France
| | - Suzette Delaloge
- Gustave Roussy, 114 rue Edouard Vaillant, 94805, Villejuif, France
| | | |
Collapse
|
6
|
Sharma N, Takeshita N, Ho KY. Raman Spectroscopy for the Endoscopic Diagnosis of Esophageal, Gastric, and Colonic Diseases. Clin Endosc 2016; 49:404-407. [PMID: 27653440 PMCID: PMC5066404 DOI: 10.5946/ce.2016.100] [Citation(s) in RCA: 24] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 07/14/2016] [Revised: 08/23/2016] [Accepted: 08/24/2016] [Indexed: 12/14/2022] Open
Abstract
Globally white-light endoscopy with biopsy sampling is the gold standard diagnostic modality for esophageal, gastric, and colonic pathologies. However, there is overwhelming evidence to highlight the deficiencies of an approach based predominantly on eyeball visualization. Biopsy sampling is also problematic due in part to excessive sampling and hence attendant cost. Various innovations are currently taking place in the endoscopic domain to aid operators in diagnosis forming. These include narrow band imaging which aims to enhance the surface anatomy and vasculature, and confocal laser endomicroscopy which provides real time histological information. However, both of these tools are limited by the skill of the operator and the extensive learning curve associated with their use. There is a gap therefore for a new form of technology that relies solely on an objective measure of disease and reduces the need for biopsy sampling. Raman spectroscopy (RS) is a potential platform that aims to satisfy these criteria. It enables a fingerprint capture of tissue in relation to the protein, DNA, and lipid content. This focused review highlights the strong potential for the use of RS during endoscopic gastroenterological examination.
Collapse
Affiliation(s)
- Neel Sharma
- Division of Gastroenterology and Hepatology, National University Health System, Singapore
| | - Nobuyoshi Takeshita
- Division of Gastroenterology and Hepatology, National University Health System, Singapore
| | - Khek Yu Ho
- Division of Gastroenterology and Hepatology, National University Health System, Singapore
| |
Collapse
|