1
|
Lai CL, Karmakar R, Mukundan A, Natarajan RK, Lu SC, Wang CY, Wang HC. Advancing hyperspectral imaging and machine learning tools toward clinical adoption in tissue diagnostics: A comprehensive review. APL Bioeng 2024; 8:041504. [PMID: 39660034 PMCID: PMC11629177 DOI: 10.1063/5.0240444] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/25/2024] [Accepted: 11/19/2024] [Indexed: 12/12/2024] Open
Abstract
Hyperspectral imaging (HSI) has become an evident transformative apparatus in medical diagnostics. The review aims to appraise the present advancement and challenges in HSI for medical applications. It features a variety of medical applications namely diagnosing diabetic retinopathy, neurodegenerative diseases like Parkinson's and Alzheimer's, which illustrates its effectiveness in early diagnosis, early caries detection in periodontal disease, and dermatology by detecting skin cancer. Regardless of these advances, the challenges exist within every aspect that limits its broader clinical adoption. It has various constraints including difficulties with technology related to the complexity of the HSI system and needing specialist training, which may act as a drawback to its clinical settings. This article pertains to potential challenges expressed in medical applications and probable solutions to overcome these constraints. Successful companies that perform advanced solutions with HSI in terms of medical applications are being emphasized in this study to signal the high level of interest in medical diagnosis for systems to incorporate machine learning ML and artificial intelligence AI to foster precision diagnosis and standardized clinical workflow. This advancement signifies progressive possibilities of HSI in real-time clinical assessments. In conclusion despite HSI has been presented as a significant advanced medical imaging tool, addressing its limitations and probable solutions is for broader clinical adoption.
Collapse
Affiliation(s)
| | - Riya Karmakar
- Department of Mechanical Engineering, National Chung Cheng University, 168, University Road, Min Hsiung, Chiayi City 62102, Taiwan
| | - Arvind Mukundan
- Department of Mechanical Engineering, National Chung Cheng University, 168, University Road, Min Hsiung, Chiayi City 62102, Taiwan
| | - Ragul Kumar Natarajan
- Department of Biotechnology, Karpagam Academy of Higher Education, Salem - Kochi Hwy, Eachanari, Coimbatore, Tamil Nadu 641021, India
| | - Song-Cun Lu
- Department of Mechanical Engineering, National Chung Cheng University, 168, University Road, Min Hsiung, Chiayi City 62102, Taiwan
| | - Cheng-Yi Wang
- Department of Gastroenterology, Kaohsiung Armed Forces General Hospital, 2, Zhongzheng 1st. Rd., Kaohsiung City 80284, Taiwan
| | - Hsiang-Chen Wang
- Department of Mechanical Engineering, National Chung Cheng University, 168, University Road, Min Hsiung, Chiayi City 62102, Taiwan
| |
Collapse
|
2
|
Livecchi TT, Jacques SL, Subhash HM, Pierce MC. Hyperspectral imaging with deep learning for quantification of tissue hemoglobin, melanin, and scattering. JOURNAL OF BIOMEDICAL OPTICS 2024; 29:093507. [PMID: 39247058 PMCID: PMC11378079 DOI: 10.1117/1.jbo.29.9.093507] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 04/04/2024] [Revised: 08/20/2024] [Accepted: 08/20/2024] [Indexed: 09/10/2024]
Abstract
Significance Hyperspectral cameras capture spectral information at each pixel in an image. Acquired spectra can be analyzed to estimate quantities of absorbing and scattering components, but the use of traditional fitting algorithms over megapixel images can be computationally intensive. Deep learning algorithms can be trained to rapidly analyze spectral data and can potentially process hyperspectral camera data in real time. Aim A hyperspectral camera was used to capture 1216 × 1936 pixel wide-field reflectance images of in vivo human tissue at 205 wavelength bands from 420 to 830 nm. Approach The optical properties of oxyhemoglobin, deoxyhemoglobin, melanin, and scattering were used with multi-layer Monte Carlo models to generate simulated diffuse reflectance spectra for 24,000 random combinations of physiologically relevant tissue components. These spectra were then used to train an artificial neural network (ANN) to predict tissue component concentrations from an input reflectance spectrum. Results The ANN achieved low root mean square errors in a test set of 6000 independent simulated diffuse reflectance spectra while calculating concentration values more than 4000× faster than a conventional iterative least squares approach. Conclusions In vivo finger occlusion and gingival abrasion studies demonstrate the ability of this approach to rapidly generate high-resolution images of tissue component concentrations from a hyperspectral dataset acquired from human subjects.
Collapse
Affiliation(s)
- Thomas T Livecchi
- Rutgers, The State University of New Jersey, Department of Biomedical Engineering, Piscataway, New Jersey, United States
- Colgate-Palmolive Company, Global Technology and Design Center, Piscataway, New Jersey, United States
| | - Steven L Jacques
- University of Washington, Department of Bioengineering, Seattle, Washington, United States
| | - Hrebesh M Subhash
- Colgate-Palmolive Company, Global Technology and Design Center, Piscataway, New Jersey, United States
| | - Mark C Pierce
- Rutgers, The State University of New Jersey, Department of Biomedical Engineering, Piscataway, New Jersey, United States
| |
Collapse
|
3
|
He Q, Li W, Shi Y, Yu Y, Geng W, Sun Z, Wang RK. SpeCamX: mobile app that turns unmodified smartphones into multispectral imagers. BIOMEDICAL OPTICS EXPRESS 2023; 14:4929-4946. [PMID: 37791269 PMCID: PMC10545193 DOI: 10.1364/boe.497602] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/08/2023] [Revised: 08/13/2023] [Accepted: 08/14/2023] [Indexed: 10/05/2023]
Abstract
We present the development of SpeCamX, a mobile application that enables an unmodified smartphone into a multispectral imager. Multispectral imaging provides detailed spectral information about objects or scenes, but its accessibility has been limited due to its specialized requirements for the device. SpeCamX overcomes this limitation by utilizing the RGB photographs captured by smartphones and converting them into multispectral images spanning a range of 420 to 680 nm without a need for internal modifications or external attachments. The app also includes plugin functions for extracting medical information from the resulting multispectral data cube. In a clinical study, SpeCamX was used to implement an augmented smartphone bilirubinometer, predicting blood bilirubin levels (BBL) with superior performance in accuracy, efficiency and stability compared to default smartphone cameras. This innovative technology democratizes multispectral imaging, making it accessible to a wider audience and opening new possibilities for both medical and non-medical applications.
Collapse
Affiliation(s)
- Qinghua He
- Changchun Institute of Optics, Fine Mechanics and Physics, Chinese Academy of Science, Changchun, Jilin 130033, China
- Department of Bioengineering, University of Washington, Seattle, Washington 98105, USA
| | - Wanyu Li
- Department of Hepatobiliary and pancreatic Medicine, The first Hospital of Jilin University NO.71 Xinmin Street, Changchun, Jilin 130021, China
| | - Yaping Shi
- Department of Bioengineering, University of Washington, Seattle, Washington 98105, USA
| | - Yi Yu
- Changchun Institute of Optics, Fine Mechanics and Physics, Chinese Academy of Science, Changchun, Jilin 130033, China
| | - Wenqian Geng
- Department of Hepatobiliary and pancreatic Medicine, The first Hospital of Jilin University NO.71 Xinmin Street, Changchun, Jilin 130021, China
| | - Zhiyuan Sun
- Changchun Institute of Optics, Fine Mechanics and Physics, Chinese Academy of Science, Changchun, Jilin 130033, China
| | - Ruikang K Wang
- Department of Bioengineering, University of Washington, Seattle, Washington 98105, USA
- Department of Ophthalmology, University of Washington, Seattle, Washington 98109, USA
| |
Collapse
|
4
|
Shafi I, Fatima A, Afzal H, Díez IDLT, Lipari V, Breñosa J, Ashraf I. A Comprehensive Review of Recent Advances in Artificial Intelligence for Dentistry E-Health. Diagnostics (Basel) 2023; 13:2196. [PMID: 37443594 DOI: 10.3390/diagnostics13132196] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/18/2023] [Revised: 06/14/2023] [Accepted: 06/23/2023] [Indexed: 07/15/2023] Open
Abstract
Artificial intelligence has made substantial progress in medicine. Automated dental imaging interpretation is one of the most prolific areas of research using AI. X-ray and infrared imaging systems have enabled dental clinicians to identify dental diseases since the 1950s. However, the manual process of dental disease assessment is tedious and error-prone when diagnosed by inexperienced dentists. Thus, researchers have employed different advanced computer vision techniques, and machine- and deep-learning models for dental disease diagnoses using X-ray and near-infrared imagery. Despite the notable development of AI in dentistry, certain factors affect the performance of the proposed approaches, including limited data availability, imbalanced classes, and lack of transparency and interpretability. Hence, it is of utmost importance for the research community to formulate suitable approaches, considering the existing challenges and leveraging findings from the existing studies. Based on an extensive literature review, this survey provides a brief overview of X-ray and near-infrared imaging systems. Additionally, a comprehensive insight into challenges faced by researchers in the dental domain has been brought forth in this survey. The article further offers an amalgamative assessment of both performances and methods evaluated on public benchmarks and concludes with ethical considerations and future research avenues.
Collapse
Affiliation(s)
- Imran Shafi
- College of Electrical and Mechanical Engineering, National University of Sciences and Technology (NUST), Islamabad 44000, Pakistan
| | - Anum Fatima
- National Centre for Robotics, National University of Sciences and Technology (NUST), Islamabad 44000, Pakistan
| | - Hammad Afzal
- Military College of Signals (MCS), National University of Sciences and Technology (NUST), Islamabad 44000, Pakistan
| | - Isabel de la Torre Díez
- Department of Signal Theory and Communications and Telematic Engineering, University of Valladolid, Paseo de Belén 15, 47011 Valladolid, Spain
| | - Vivian Lipari
- Research Unit in Food Technologies, Agro-Food Industries and Nutrition, Universidad Europea del Atlántico, Isabel Torres 21, 39011 Santander, Spain
- Research Unit in Food Technologies, Agro-Food Industries and Nutrition, Universidad Internacional Iberoamericana, Campeche 24560, Mexico
- Research Unit in Food Technologies, Agro-Food Industries and Nutrition, Fundación Universitaria Internacional de Colombia, Bogotá 111311, Colombia
| | - Jose Breñosa
- Research Unit in Food Technologies, Agro-Food Industries and Nutrition, Universidad Europea del Atlántico, Isabel Torres 21, 39011 Santander, Spain
- Universidade Internacional do Cuanza, Cuito EN250, Bié, Angola
- Research Unit in Food Technologies, Agro-Food Industries and Nutrition, Universidad Internacional Iberoamericana Arecibo, Puerto Rico, PR 00613, USA
| | - Imran Ashraf
- Department of Information and Communication Engineering, Yeungnam University, Gyeongsan 38541, Republic of Korea
| |
Collapse
|
5
|
Urban BE, Subhash HM, Kilpatrick-Liverman L. Measuring changes in blood volume fraction during induced gingivitis of healthy and unhealthy populations using hyperspectral spatial frequency domain imaging: a clinical study. Sci Rep 2022; 12:18357. [PMID: 36319677 PMCID: PMC9626635 DOI: 10.1038/s41598-022-23115-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/04/2022] [Accepted: 10/25/2022] [Indexed: 12/31/2022] Open
Abstract
This investigation aimed to quantitatively measure the changes in inflammation of subjects with healthy and unhealthy gums during a period of induced gingivitis. A total of 30 subjects (15 healthy, 15 with gum inflammation) were enlisted and given oral exams by a dental hygienist. Baseline measurements were acquired before a 3-week period of oral hygiene abstinence. The lobene modified gingival index scoring was used for inflammation scoring and hyperspectral spatial frequency domain imaging was used to quantitatively measure oxy- and deoxygenated blood volume fraction at two time points: at Baseline and after 3 weeks of oral hygiene abstinence. We found that abstaining from oral hygiene causes a near proportional increase in oxygenated and deoxygenated blood volume fraction for healthy individuals. For individuals who started the study with mild to moderate gingivitis, increases in blood volume were mainly due to deoxygenated blood.
Collapse
Affiliation(s)
- Ben E. Urban
- grid.418753.c0000 0004 4685 452XGlobal Technology and Design Center, Colgate Palmolive Technology Center Campus, Piscataway, NJ 08854 USA
| | - Hrebesh M. Subhash
- grid.418753.c0000 0004 4685 452XGlobal Technology and Design Center, Colgate Palmolive Technology Center Campus, Piscataway, NJ 08854 USA
| | - LaTonya Kilpatrick-Liverman
- grid.418753.c0000 0004 4685 452XGlobal Technology and Design Center, Colgate Palmolive Technology Center Campus, Piscataway, NJ 08854 USA
| |
Collapse
|