1
|
Takamatsu T, Fukushima R, Sato K, Umezawa M, Yokota H, Soga K, Hernandez-Guedes A, Callico GM, Takemura H. Development of a visible to 1600 nm hyperspectral imaging rigid-scope system using supercontinuum light and an acousto-optic tunable filter. OPTICS EXPRESS 2024; 32:16090-16102. [PMID: 38859246 DOI: 10.1364/oe.515747] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/15/2023] [Accepted: 03/22/2024] [Indexed: 06/12/2024]
Abstract
In this study, we developed a rigid-scope system that can perform hyperspectral imaging (HSI) between visible and 1600 nm wavelengths using a supercontinuum light source and an acousto-optic tunable filter to emit specific wavelengths. The system optical performance was verified, and the classification ability was investigated. Consequently, it was demonstrated that HSI (490-1600 nm) could be performed. In addition, seven different targets could be classified by the neural network with an accuracy of 99.6%, recall of 93.7%, and specificity of 99.1% when the wavelength range of over 1000 nm (OTN) was extracted from HSI data as train data.
Collapse
|
2
|
Pruitt K, Rathgeb A, Gahan JC, Johnson BA, Strand DW, Fei B. A dual-camera hyperspectral laparoscopic imaging system. PROCEEDINGS OF SPIE--THE INTERNATIONAL SOCIETY FOR OPTICAL ENGINEERING 2024; 12831:1283107. [PMID: 38708175 PMCID: PMC11069412 DOI: 10.1117/12.3005893] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/07/2024]
Abstract
Minimally invasive surgery (MIS) has expanded broadly in the field of abdominal and pelvic surgery. However, there are still prevalent issues surrounding intracorporeal surgery, such as iatrogenic injury, anastomotic leakage, or the presence of positive tumor margins after resection. Current approaches to address these issues and advance laparoscopic imaging techniques often involve fluorescence imaging agents, such as indocyanine green (ICG), to improve visualization, but these have drawbacks. Hyperspectral imaging (HSI) is an emerging optical imaging modality that takes advantage of spectral characteristics of different tissues. Various applications include tissue classification and digital pathology. In this study, we developed a dual-camera system for high-speed hyperspectral imaging. This includes the development of a custom application interface and corresponding hardware setup. Characterization of the system was performed, including spectral accuracy and spatial resolution, showing little sacrifice in speed for the approximate doubling of the covered spectral range, with our system acquiring 29 spectral images from 460-850 nm. Reference color tiles with various reflectance profiles were imaged and a RMSE of 3.56 ± 1.36% was achieved. Sub-millimeter resolution was shown at 7 cm working distance for both hyperspectral cameras. Finally, we image ex vivo tissues, including porcine stomach, liver, intestine, and kidney with our system and use a high-resolution, radiometrically calibrated spectrometer for comparison and evaluation of spectral fidelity. The dual-camera hyperspectral laparoscopic imaging system can have immediate applications in various surgeries.
Collapse
Affiliation(s)
- Kelden Pruitt
- Center for Imaging and Surgical Innovation, University of Texas at Dallas, Richardson, TX
- Department of Bioengineering, University of Texas at Dallas, Richardson, TX
| | - Armand Rathgeb
- Center for Imaging and Surgical Innovation, University of Texas at Dallas, Richardson, TX
- Department of Bioengineering, University of Texas at Dallas, Richardson, TX
| | - Jeffrey C. Gahan
- Department of Urology, University of Texas Southwestern Medical Center, Dallas, TX
| | - Brett A. Johnson
- Department of Urology, University of Texas Southwestern Medical Center, Dallas, TX
| | - Douglas W. Strand
- Department of Urology, University of Texas Southwestern Medical Center, Dallas, TX
| | - Baowei Fei
- Center for Imaging and Surgical Innovation, University of Texas at Dallas, Richardson, TX
- Department of Bioengineering, University of Texas at Dallas, Richardson, TX
- Department of Radiology, University of Texas Southwestern Medical Center, Dallas, TX
| |
Collapse
|
3
|
Mori A, Umezawa M, Okubo K, Kamiya T, Kamimura M, Ohtani N, Soga K. Visualization of hydrocarbon chain length and degree of saturation of fatty acids in mouse livers by combining near-infrared hyperspectral imaging and machine learning. Sci Rep 2023; 13:20555. [PMID: 37996472 PMCID: PMC10667523 DOI: 10.1038/s41598-023-47565-z] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/13/2023] [Accepted: 11/15/2023] [Indexed: 11/25/2023] Open
Abstract
Fatty acids play various physiological roles owing to their diverse structural characteristics, such as hydrocarbon chain length (HCL) and degree of saturation (DS). Although the distribution of fatty acids in biological tissues is associated with lipid metabolism, in situ imaging tools are still lacking for HCL and DS. Here, we introduce a framework of near-infrared (1000-1400 nm) hyperspectral label-free imaging with machine learning analysis of the fatty acid HCL and DS distribution in the liver at each pixel, in addition to the previously reported total lipid content. The training data of 16 typical fatty acids were obtained by gas chromatography from liver samples of mice fed with various diets. A two-dimensional mapping of these two parameters was successfully performed. Furthermore, the HCL/DS plot exhibited characteristic clustering among the different diet groups. Visualization of fatty acid distribution would provide insights for revealing the pathophysiological conditions of liver diseases and metabolism.
Collapse
Affiliation(s)
- Akino Mori
- Department of Materials Science and Technology, Faculty of Advanced Engineering, Tokyo University of Science, 6-3-1 Niijuku, Katsushika, Tokyo, 125-8585, Japan
| | - Masakazu Umezawa
- Department of Materials Science and Technology, Faculty of Advanced Engineering, Tokyo University of Science, 6-3-1 Niijuku, Katsushika, Tokyo, 125-8585, Japan.
| | - Kyohei Okubo
- Department of Materials Science and Technology, Faculty of Advanced Engineering, Tokyo University of Science, 6-3-1 Niijuku, Katsushika, Tokyo, 125-8585, Japan
| | - Tomonori Kamiya
- Department of Pathophysiology, Graduate School of Medicine, Osaka Metropolitan University, 1-4-3 Asahi-machi, Abeno-ku, Osaka, 545-8585, Japan
| | - Masao Kamimura
- Department of Materials Science and Technology, Faculty of Advanced Engineering, Tokyo University of Science, 6-3-1 Niijuku, Katsushika, Tokyo, 125-8585, Japan
| | - Naoko Ohtani
- Department of Pathophysiology, Graduate School of Medicine, Osaka Metropolitan University, 1-4-3 Asahi-machi, Abeno-ku, Osaka, 545-8585, Japan
| | - Kohei Soga
- Department of Materials Science and Technology, Faculty of Advanced Engineering, Tokyo University of Science, 6-3-1 Niijuku, Katsushika, Tokyo, 125-8585, Japan.
| |
Collapse
|
4
|
Mitsui T, Mori A, Takamatsu T, Kadota T, Sato K, Fukushima R, Okubo K, Umezawa M, Takemura H, Yokota H, Kuwata T, Kinoshita T, Ikematsu H, Yano T, Maeda S, Soga K. Evaluating the identification of the extent of gastric cancer by over-1000 nm near-infrared hyperspectral imaging using surgical specimens. JOURNAL OF BIOMEDICAL OPTICS 2023; 28:086001. [PMID: 37614567 PMCID: PMC10442660 DOI: 10.1117/1.jbo.28.8.086001] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 04/11/2023] [Revised: 07/22/2023] [Accepted: 08/02/2023] [Indexed: 08/25/2023]
Abstract
Significance Determining the extent of gastric cancer (GC) is necessary for evaluating the gastrectomy margin for GC. Additionally, determining the extent of the GC that is not exposed to the mucosal surface remains difficult. However, near-infrared (NIR) can penetrate mucosal tissues highly efficiently. Aim We investigated the ability of near-infrared hyperspectral imaging (NIR-HSI) to identify GC areas, including exposed and unexposed using surgical specimens, and explored the identifiable characteristics of the GC. Approach Our study examined 10 patients with diagnosed GC who underwent surgery between 2020 and 2021. Specimen images were captured using NIR-HSI. For the specimens, the exposed area was defined as an area wherein the cancer was exposed on the surface, the unexposed area as an area wherein the cancer was present although the surface was covered by normal tissue, and the normal area as an area wherein the cancer was absent. We estimated the GC (including the exposed and unexposed areas) and normal areas using a support vector machine, which is a machine-learning method for classification. The prediction accuracy of the GC region in every area and normal region was evaluated. Additionally, the tumor thicknesses of the GC were pathologically measured, and their differences in identifiable and unidentifiable areas were compared using NIR-HSI. Results The average prediction accuracy of the GC regions combined with both areas was 77.2%; with exposed and unexposed areas was 79.7% and 68.5%, respectively; and with normal regions was 79.7%. Additionally, the areas identified as cancerous had a tumor thickness of > 2 mm . Conclusions NIR-HSI identified the GC regions with high rates. As a feature, the exposed and unexposed areas with tumor thicknesses of > 2 mm were identified using NIR-HSI.
Collapse
Affiliation(s)
- Tomohiro Mitsui
- National Cancer Center Hospital East, Department of Gastroenterology and Endoscopy, Kashiwa, Japan
- Yokohama City University Graduate School of Medicine, Department of Gastroenterology, Yokohama, Japan
| | - Akino Mori
- Tokyo University of Science, Department of Materials Science and Technology, Tokyo, Japan
| | - Toshihiro Takamatsu
- National Cancer Center, Exploratory Oncology Research and Clinical Trial Center, Chiba, Japan
- Tokyo University of Science, Research Institute for Biomedical Sciences, Chiba, Japan
| | - Tomohiro Kadota
- National Cancer Center Hospital East, Department of Gastroenterology and Endoscopy, Kashiwa, Japan
| | - Konosuke Sato
- Tokyo University of Science, Department of Materials Science and Technology, Tokyo, Japan
| | - Ryodai Fukushima
- Tokyo University of Science, Department of Mechanical Engineering, Chiba, Japan
| | - Kyohei Okubo
- Tokyo University of Science, Department of Materials Science and Technology, Tokyo, Japan
| | - Masakazu Umezawa
- Tokyo University of Science, Department of Materials Science and Technology, Tokyo, Japan
| | - Hiroshi Takemura
- Tokyo University of Science, Research Institute for Biomedical Sciences, Chiba, Japan
- Tokyo University of Science, Department of Mechanical Engineering, Chiba, Japan
| | - Hideo Yokota
- RIKEN Center for Advanced Photonics, Saitama, Japan
| | - Takeshi Kuwata
- National Cancer Center Hospital East, Department of Pathology and Clinical Laboratories, Kashiwa, Japan
| | - Takahiro Kinoshita
- National Cancer Center Hospital East, Department of Gastric Surgery, Chiba, Japan
| | - Hiroaki Ikematsu
- National Cancer Center Hospital East, Department of Gastroenterology and Endoscopy, Kashiwa, Japan
- National Cancer Center, Exploratory Oncology Research and Clinical Trial Center, Chiba, Japan
| | - Tomonori Yano
- National Cancer Center Hospital East, Department of Gastroenterology and Endoscopy, Kashiwa, Japan
| | - Shin Maeda
- Yokohama City University Graduate School of Medicine, Department of Gastroenterology, Yokohama, Japan
| | - Kohei Soga
- Tokyo University of Science, Department of Materials Science and Technology, Tokyo, Japan
- Tokyo University of Science, Research Institute for Biomedical Sciences, Chiba, Japan
| |
Collapse
|
5
|
Pruitt K, Johnson B, Gahan J, Ma L, Fei B. A High-Speed Hyperspectral Laparoscopic Imaging System. PROCEEDINGS OF SPIE--THE INTERNATIONAL SOCIETY FOR OPTICAL ENGINEERING 2023; 12466:1246608. [PMID: 38524190 PMCID: PMC10961180 DOI: 10.1117/12.2653922] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 03/26/2024]
Abstract
Minimally invasive surgery (MIS) has expanded broadly in the field of abdominal and pelvic surgery. Laparoscopic and robotic surgery has improved surgeon ergonomics, instrument precision, operative time, and postoperative recovery across various abdominal procedures. The goal of this study is to establish the feasibility of implementing high-speed hyperspectral imaging into a standard laparoscopic setup and exploring its benefit to common intracorporeal procedures. A hyperspectral laparoscopic imaging system was constructed using a customized hyperspectral camera alongside a standard rigid laparoscope and was validated for both spectral and spatial accuracy. Demosaicing methods were investigated for improved full-resolution visualization. Hyperspectral cameras with different spectral ranges were considered and compared with one another alongside two different light sources to determine the most effective configuration. Finally, different porcine tissues were imaged ex-vivo to test the capabilities of the system and spectral footprints of the various tissues were extracted. The tissue was also imaged in a phantom to simulate the system's use in MIS. The results demonstrated a hyperspectral laparoscopic imaging system that could provide quantitative, diagnostic information while not disrupting normal workflow nor adding excessive weight to the laparoscopic setup. The high-speed hyperspectral laparoscopic imaging system can have immediate applications in image-guided surgery.
Collapse
Affiliation(s)
- Kelden Pruitt
- Department of Bioengineering, University of Texas at Dallas, Richardson, TX
- Center for Imaging and Surgical Innovation, University of Texas at Dallas, Richardson, TX
| | - Brett Johnson
- University of Texas Southwestern Medical Center, Department of Urology, Dallas, TX
| | - Jeffrey Gahan
- University of Texas Southwestern Medical Center, Department of Urology, Dallas, TX
| | - Ling Ma
- Department of Bioengineering, University of Texas at Dallas, Richardson, TX
- Center for Imaging and Surgical Innovation, University of Texas at Dallas, Richardson, TX
| | - Baowei Fei
- Department of Bioengineering, University of Texas at Dallas, Richardson, TX
- Center for Imaging and Surgical Innovation, University of Texas at Dallas, Richardson, TX
- University of Texas Southwestern Medical Center, Department of Radiology, Dallas, TX
| |
Collapse
|