1
|
Leon R, Fabelo H, Ortega S, Cruz-Guerrero IA, Campos-Delgado DU, Szolna A, Piñeiro JF, Espino C, O'Shanahan AJ, Hernandez M, Carrera D, Bisshopp S, Sosa C, Balea-Fernandez FJ, Morera J, Clavo B, Callico GM. Hyperspectral imaging benchmark based on machine learning for intraoperative brain tumour detection. NPJ Precis Oncol 2023; 7:119. [PMID: 37964078 PMCID: PMC10646050 DOI: 10.1038/s41698-023-00475-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/08/2023] [Accepted: 10/24/2023] [Indexed: 11/16/2023] Open
Abstract
Brain surgery is one of the most common and effective treatments for brain tumour. However, neurosurgeons face the challenge of determining the boundaries of the tumour to achieve maximum resection, while avoiding damage to normal tissue that may cause neurological sequelae to patients. Hyperspectral (HS) imaging (HSI) has shown remarkable results as a diagnostic tool for tumour detection in different medical applications. In this work, we demonstrate, with a robust k-fold cross-validation approach, that HSI combined with the proposed processing framework is a promising intraoperative tool for in-vivo identification and delineation of brain tumours, including both primary (high-grade and low-grade) and secondary tumours. Analysis of the in-vivo brain database, consisting of 61 HS images from 34 different patients, achieve a highest median macro F1-Score result of 70.2 ± 7.9% on the test set using both spectral and spatial information. Here, we provide a benchmark based on machine learning for further developments in the field of in-vivo brain tumour detection and delineation using hyperspectral imaging to be used as a real-time decision support tool during neurosurgical workflows.
Collapse
Affiliation(s)
- Raquel Leon
- Research Institute for Applied Microelectronics, University of Las Palmas de Gran Canaria, Las Palmas de Gran Canaria, Spain.
| | - Himar Fabelo
- Research Institute for Applied Microelectronics, University of Las Palmas de Gran Canaria, Las Palmas de Gran Canaria, Spain.
- Fundación Canaria Instituto de Investigación Sanitaria de Canarias (FIISC), Las Palmas de Gran Canaria, Spain.
| | - Samuel Ortega
- Research Institute for Applied Microelectronics, University of Las Palmas de Gran Canaria, Las Palmas de Gran Canaria, Spain
- Nofima, Norwegian Institute of Food Fisheries and Aquaculture Research, Tromsø, Norway
| | - Ines A Cruz-Guerrero
- Facultad de Ciencias, Universidad Autónoma de San Luis Potosí, San Luis Potosí, México
- Department of Biostatistics and Informatics, Colorado School of Public Health, University of Colorado Anschutz Medical Campus, Aurora, Colorado, USA
- Department of Pediatric Plastic and Reconstructive Surgery, Children's Hospital Colorado, Aurora, Colorado, USA
| | - Daniel Ulises Campos-Delgado
- Facultad de Ciencias, Universidad Autónoma de San Luis Potosí, San Luis Potosí, México
- Instituto de Investigación en Comunicación Óptica, Universidad Autónoma de San Luis Potosí, San Luis Potosí, México
| | - Adam Szolna
- Department of Neurosurgery, University Hospital Doctor Negrin of Gran Canaria, Las Palmas de Gran Canaria, Spain
| | - Juan F Piñeiro
- Instituto de Investigación en Comunicación Óptica, Universidad Autónoma de San Luis Potosí, San Luis Potosí, México
| | - Carlos Espino
- Department of Neurosurgery, University Hospital Doctor Negrin of Gran Canaria, Las Palmas de Gran Canaria, Spain
| | - Aruma J O'Shanahan
- Department of Neurosurgery, University Hospital Doctor Negrin of Gran Canaria, Las Palmas de Gran Canaria, Spain
| | - Maria Hernandez
- Department of Neurosurgery, University Hospital Doctor Negrin of Gran Canaria, Las Palmas de Gran Canaria, Spain
| | - David Carrera
- Department of Neurosurgery, University Hospital Doctor Negrin of Gran Canaria, Las Palmas de Gran Canaria, Spain
| | - Sara Bisshopp
- Department of Neurosurgery, University Hospital Doctor Negrin of Gran Canaria, Las Palmas de Gran Canaria, Spain
| | - Coralia Sosa
- Department of Neurosurgery, University Hospital Doctor Negrin of Gran Canaria, Las Palmas de Gran Canaria, Spain
| | - Francisco J Balea-Fernandez
- Research Institute for Applied Microelectronics, University of Las Palmas de Gran Canaria, Las Palmas de Gran Canaria, Spain
- Department of Psychology, Sociology and Social Work, University of Las Palmas de Gran Canaria, Las Palmas de Gran Canaria, Spain
| | - Jesus Morera
- Department of Neurosurgery, University Hospital Doctor Negrin of Gran Canaria, Las Palmas de Gran Canaria, Spain
| | - Bernardino Clavo
- Fundación Canaria Instituto de Investigación Sanitaria de Canarias (FIISC), Las Palmas de Gran Canaria, Spain
- Research Unit, University Hospital Doctor Negrin of Gran Canaria, Las Palmas de Gran Canaria, Spain
| | - Gustavo M Callico
- Research Institute for Applied Microelectronics, University of Las Palmas de Gran Canaria, Las Palmas de Gran Canaria, Spain
| |
Collapse
|
2
|
Ma KF, Nijboer TS, Kleiss SF, El Moumni M, Bokkers RPH, Schuurmann RCL, de Vries JPPM. Determination of Changes in Tissue Perfusion at Home with Hyperspectral and Thermal Imaging in the First Six Weeks after Endovascular Therapy in Patients with Peripheral Arterial Disease. Diagnostics (Basel) 2022; 12:2489. [PMID: 36292181 PMCID: PMC9600062 DOI: 10.3390/diagnostics12102489] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/08/2022] [Revised: 10/07/2022] [Accepted: 10/10/2022] [Indexed: 12/24/2022] Open
Abstract
The aims of this study were to assess changes in tissue perfusion up to 6 weeks after endovascular therapy (EVT), in hospital and at home, and to determine differences in tissue perfusion between patients with and without clinical improvement or good angiographic result. This single-center prospective cohort study included patients undergoing EVT for Rutherford stages two to six. Hyperspectral and thermal imaging were performed at the dorsal and plantar sides of the foot. These measurements consisted of a baseline measurement pre-EVT, and six follow-up measurements obtained at 1 and 4 h and 6 weeks in hospital, and 1 day, 7 days, and 14 days at home. Clinical improvement was defined as a decrease of one or more Rutherford class or decrease in the wound surface area and a good angiographic result was accomplished when a Transatlantic Inter-Society Consensus for the Management of PAD II C or D lesion was treated and uninterrupted flow continued in at least one below-the-knee artery in continuation with the inframalleolar arteries. The study included 34 patients with 41 treated limbs. Deoxyhemoglobin values were lower 1 h post-EVT compared with baseline and increased over time up to 6 weeks post-EVT. Significant differences in deoxyhemoglobin levels at 7 and 14 days post-EVT were determined between patients with and without clinical or angiographic success. This prospective pilot study shows the feasibility of hyperspectral imaging and thermal imaging post-EVT at home, which may decrease the need for hospital visits.
Collapse
Affiliation(s)
- Kirsten F. Ma
- Division of Vascular Surgery, Department of Surgery, University of Groningen, University Medical Center Groningen, 9713 GZ Groningen, The Netherlands
| | - Thomas S. Nijboer
- Division of Vascular Surgery, Department of Surgery, University of Groningen, University Medical Center Groningen, 9713 GZ Groningen, The Netherlands
| | - Simone F. Kleiss
- Division of Vascular Surgery, Department of Surgery, University of Groningen, University Medical Center Groningen, 9713 GZ Groningen, The Netherlands
| | - Mostafa El Moumni
- Division of Trauma Surgery, Department of Surgery, University of Groningen, University Medical Center Groningen, 9712 CP Groningen, The Netherlands
| | - Reinoud P. H. Bokkers
- Department of Radiology, Medical Imaging Center, University of Groningen, University Medical Center Groningen, 9712 CP Groningen, The Netherlands
| | - Richte C. L. Schuurmann
- Division of Vascular Surgery, Department of Surgery, University of Groningen, University Medical Center Groningen, 9713 GZ Groningen, The Netherlands
| | - Jean-Paul P. M. de Vries
- Division of Vascular Surgery, Department of Surgery, University of Groningen, University Medical Center Groningen, 9713 GZ Groningen, The Netherlands
| |
Collapse
|
3
|
Leon R, Fabelo H, Ortega S, Piñeiro JF, Szolna A, Hernandez M, Espino C, O'Shanahan AJ, Carrera D, Bisshopp S, Sosa C, Marquez M, Morera J, Clavo B, Callico GM. VNIR-NIR hyperspectral imaging fusion targeting intraoperative brain cancer detection. Sci Rep 2021; 11:19696. [PMID: 34608237 PMCID: PMC8490425 DOI: 10.1038/s41598-021-99220-0] [Citation(s) in RCA: 9] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/06/2021] [Accepted: 09/16/2021] [Indexed: 12/25/2022] Open
Abstract
Currently, intraoperative guidance tools used for brain tumor resection assistance during surgery have several limitations. Hyperspectral (HS) imaging is arising as a novel imaging technique that could offer new capabilities to delineate brain tumor tissue in surgical-time. However, the HS acquisition systems have some limitations regarding spatial and spectral resolution depending on the spectral range to be captured. Image fusion techniques combine information from different sensors to obtain an HS cube with improved spatial and spectral resolution. This paper describes the contributions to HS image fusion using two push-broom HS cameras, covering the visual and near-infrared (VNIR) [400–1000 nm] and near-infrared (NIR) [900–1700 nm] spectral ranges, which are integrated into an intraoperative HS acquisition system developed to delineate brain tumor tissue during neurosurgical procedures. Both HS images were registered using intensity-based and feature-based techniques with different geometric transformations to perform the HS image fusion, obtaining an HS cube with wide spectral range [435–1638 nm]. Four HS datasets were captured to verify the image registration and the fusion process. Moreover, segmentation and classification methods were evaluated to compare the performance results between the use of the VNIR and NIR data, independently, with respect to the fused data. The results reveal that the proposed methodology for fusing VNIR–NIR data improves the classification results up to 21% of accuracy with respect to the use of each data modality independently, depending on the targeted classification problem.
Collapse
Affiliation(s)
- Raquel Leon
- Institute for Applied Microelectronics, University of Las Palmas de Gran Canaria, 35017, Las Palmas de Gran Canaria, Spain.
| | - Himar Fabelo
- Institute for Applied Microelectronics, University of Las Palmas de Gran Canaria, 35017, Las Palmas de Gran Canaria, Spain.
| | - Samuel Ortega
- Institute for Applied Microelectronics, University of Las Palmas de Gran Canaria, 35017, Las Palmas de Gran Canaria, Spain.,Nofima, Norwegian Institute of Food Fisheries and Aquaculture Research, Muninbakken 9-13, Breivika, 6122, NO-9291, Tromsø, Norway
| | - Juan F Piñeiro
- Department of Neurosurgery, Instituto de Investigación Sanitaria de Canarias (IISC), University Hospital Doctor Negrin of Gran Canaria, Barranco de la Ballena S/N, 35010, Las Palmas de Gran Canaria, Spain
| | - Adam Szolna
- Department of Neurosurgery, Instituto de Investigación Sanitaria de Canarias (IISC), University Hospital Doctor Negrin of Gran Canaria, Barranco de la Ballena S/N, 35010, Las Palmas de Gran Canaria, Spain
| | - Maria Hernandez
- Department of Neurosurgery, Instituto de Investigación Sanitaria de Canarias (IISC), University Hospital Doctor Negrin of Gran Canaria, Barranco de la Ballena S/N, 35010, Las Palmas de Gran Canaria, Spain
| | - Carlos Espino
- Department of Neurosurgery, Instituto de Investigación Sanitaria de Canarias (IISC), University Hospital Doctor Negrin of Gran Canaria, Barranco de la Ballena S/N, 35010, Las Palmas de Gran Canaria, Spain
| | - Aruma J O'Shanahan
- Department of Neurosurgery, Instituto de Investigación Sanitaria de Canarias (IISC), University Hospital Doctor Negrin of Gran Canaria, Barranco de la Ballena S/N, 35010, Las Palmas de Gran Canaria, Spain
| | - David Carrera
- Department of Neurosurgery, Instituto de Investigación Sanitaria de Canarias (IISC), University Hospital Doctor Negrin of Gran Canaria, Barranco de la Ballena S/N, 35010, Las Palmas de Gran Canaria, Spain
| | - Sara Bisshopp
- Department of Neurosurgery, Instituto de Investigación Sanitaria de Canarias (IISC), University Hospital Doctor Negrin of Gran Canaria, Barranco de la Ballena S/N, 35010, Las Palmas de Gran Canaria, Spain
| | - Coralia Sosa
- Department of Neurosurgery, Instituto de Investigación Sanitaria de Canarias (IISC), University Hospital Doctor Negrin of Gran Canaria, Barranco de la Ballena S/N, 35010, Las Palmas de Gran Canaria, Spain
| | - Mariano Marquez
- Department of Neurosurgery, Instituto de Investigación Sanitaria de Canarias (IISC), University Hospital Doctor Negrin of Gran Canaria, Barranco de la Ballena S/N, 35010, Las Palmas de Gran Canaria, Spain
| | - Jesus Morera
- Department of Neurosurgery, Instituto de Investigación Sanitaria de Canarias (IISC), University Hospital Doctor Negrin of Gran Canaria, Barranco de la Ballena S/N, 35010, Las Palmas de Gran Canaria, Spain
| | - Bernardino Clavo
- Research Unit, Instituto de Investigación Sanitaria de Canarias (IISC), University Hospital Doctor Negrin of Gran Canaria, Barranco de la Ballena S/N, 35010, Las Palmas de Gran Canaria, Spain
| | - Gustavo M Callico
- Institute for Applied Microelectronics, University of Las Palmas de Gran Canaria, 35017, Las Palmas de Gran Canaria, Spain.
| |
Collapse
|