Proof-of-concept of a multimodal laparoscope for simultaneous NIR/gamma/visible imaging using wavelength division multiplexing

The realization of medical devices for precision surgery - development and implementation of 'stop-and-go' imaging technologies

INTRODUCTION

Surgery and biomedical imaging encompass a big share of the medical-device market. The ever-mounting demand for precision surgery has driven the integration of these two into the field of image-guided surgery. A key-question herein is how imaging modalities can guide the surgical decision-making process. Through performance-based design, chemists, engineers, and doctors need to build a bridge between imaging technologies and surgical challenges.

AREAS-COVERED

This perspective article highlights the complementary nature between the technological design of an image-guidance modality and the type of procedure performed. The specific roles of the involved professionals, imaging technologies, and surgical indications are addressed.

EXPERT-OPINION

Molecular-image-guided surgery has the potential to advance pre-, intra- and post-operative tissue characterization. To achieve this, surgeons need the access to well-designed indication-specific chemical-agents and detection modalities. Hereby, some technologies stimulate exploration ('go'), while others stimulate caution ('stop'). However, failing to adequately address the indication-specific needs rises the risk of incorrect tool employment and sub-optimal surgical performance. Therefore, besides the availability of new technologies, market growth is highly dependent on the practical nature and impact on real-life clinical care. While urology currently takes the lead in the widespread implementation of image-guidance technologies, the topic is generic and its popularity spreads rapidly within surgical oncology.

Development of a visible to 1600 nm hyperspectral imaging rigid-scope system using supercontinuum light and an acousto-optic tunable filter

In this study, we developed a rigid-scope system that can perform hyperspectral imaging (HSI) between visible and 1600 nm wavelengths using a supercontinuum light source and an acousto-optic tunable filter to emit specific wavelengths. The system optical performance was verified, and the classification ability was investigated. Consequently, it was demonstrated that HSI (490-1600 nm) could be performed. In addition, seven different targets could be classified by the neural network with an accuracy of 99.6%, recall of 93.7%, and specificity of 99.1% when the wavelength range of over 1000 nm (OTN) was extracted from HSI data as train data.

Intraoperative Gamma Cameras: A Review of Development in the Last Decade and Future Outlook

Portable gamma cameras suitable for intraoperative imaging are in active development and testing. These cameras utilise a range of collimation, detection, and readout architectures, each of which can have significant and interacting impacts on the performance of the system as a whole. In this review, we provide an analysis of intraoperative gamma camera development over the past decade. The designs and performance of 17 imaging systems are compared in depth. We discuss where recent technological developments have had the greatest impact, identify emerging technological and scientific requirements, and predict future research directions. This is a comprehensive review of the current and emerging state-of-the-art as more devices enter clinical practice.

A High-Speed Hyperspectral Laparoscopic Imaging System

Minimally invasive surgery (MIS) has expanded broadly in the field of abdominal and pelvic surgery. Laparoscopic and robotic surgery has improved surgeon ergonomics, instrument precision, operative time, and postoperative recovery across various abdominal procedures. The goal of this study is to establish the feasibility of implementing high-speed hyperspectral imaging into a standard laparoscopic setup and exploring its benefit to common intracorporeal procedures. A hyperspectral laparoscopic imaging system was constructed using a customized hyperspectral camera alongside a standard rigid laparoscope and was validated for both spectral and spatial accuracy. Demosaicing methods were investigated for improved full-resolution visualization. Hyperspectral cameras with different spectral ranges were considered and compared with one another alongside two different light sources to determine the most effective configuration. Finally, different porcine tissues were imaged ex-vivo to test the capabilities of the system and spectral footprints of the various tissues were extracted. The tissue was also imaged in a phantom to simulate the system's use in MIS. The results demonstrated a hyperspectral laparoscopic imaging system that could provide quantitative, diagnostic information while not disrupting normal workflow nor adding excessive weight to the laparoscopic setup. The high-speed hyperspectral laparoscopic imaging system can have immediate applications in image-guided surgery.

A Brief History of Nuclear Medicine Physics, Instrumentation, and Data Sciences in Korea

We review the history of nuclear medicine physics, instrumentation, and data sciences in Korea to commemorate the 60^th anniversary of the Korean Society of Nuclear Medicine. In the 1970s and 1980s, the development of SPECT, nuclear stethoscope, and bone densitometry systems, as well as kidney and cardiac image analysis technology, marked the beginning of nuclear medicine physics and engineering in Korea. With the introduction of PET and cyclotron in Korea in 1994, nuclear medicine imaging research was further activated. With the support of large-scale government projects, the development of gamma camera, SPECT, and PET systems was carried out. Exploiting the use of PET scanners in conjunction with cyclotrons, extensive studies on myocardial blood flow quantification and brain image analysis were also actively pursued. In 2005, Korea's first domestic cyclotron succeeded in producing radioactive isotopes, and the cyclotron was provided to six universities and university hospitals, thereby facilitating the nationwide supply of PET radiopharmaceuticals. Since the late 2000s, research on PET/MRI has been actively conducted, and the advanced research results of Korean scientists in the fields of silicon photomultiplier PET and simultaneous PET/MRI have attracted significant attention from the academic community. Currently, Korean researchers are actively involved in endeavors to solve a variety of complex problems in nuclear medicine using artificial intelligence and deep learning technologies.

How molecular imaging will enable robotic precision surgery : The role of artificial intelligence, augmented reality, and navigation

Molecular imaging is one of the pillars of precision surgery. Its applications range from early diagnostics to therapy planning, execution, and the accurate assessment of outcomes. In particular, molecular imaging solutions are in high demand in minimally invasive surgical strategies, such as the substantially increasing field of robotic surgery. This review aims at connecting the molecular imaging and nuclear medicine community to the rapidly expanding armory of surgical medical devices. Such devices entail technologies ranging from artificial intelligence and computer-aided visualization technologies (software) to innovative molecular imaging modalities and surgical navigation (hardware). We discuss technologies based on their role at different steps of the surgical workflow, i.e., from surgical decision and planning, over to target localization and excision guidance, all the way to (back table) surgical verification. This provides a glimpse of how innovations from the technology fields can realize an exciting future for the molecular imaging and surgery communities.

Over 1000 nm Near-Infrared Multispectral Imaging System for Laparoscopic In Vivo Imaging

In this study, a laparoscopic imaging device and a light source able to select wavelengths by bandpass filters were developed to perform multispectral imaging (MSI) using over 1000 nm near-infrared (OTN-NIR) on regions under a laparoscope. Subsequently, MSI (wavelengths: 1000-1400 nm) was performed using the built device on nine live mice before and after tumor implantation. The normal and tumor pixels captured within the mice were used as teaching data sets, and the tumor-implanted mice data were classified using a neural network applied following a leave-one-out cross-validation procedure. The system provided a specificity of 89.5%, a sensitivity of 53.5%, and an accuracy of 87.8% for subcutaneous tumor discrimination. Aggregated true-positive (TP) pixels were confirmed in all tumor-implanted mice, which indicated that the laparoscopic OTN-NIR MSI could potentially be applied in vivo for classifying target lesions such as cancer in deep tissues.

SiPM-based gamma detector with a central GRIN lens for a visible/NIRF/gamma multi-modal laparoscope

Intraoperative imaging has been studied using conventional devices such as near infrared (NIR) optical probes and gamma probes. However, these devices have limited depth penetration and spatial resolution. In a previous study, we realized a multi-modal endoscopic system. However, charge-coupled device (CCD)-based gamma imaging required long acquisition times and lacked gamma energy information. A silicon photomultiplier (SiPM)-based gamma detector is implemented in a multi-modal laparoscope herein. A gradient index (GRIN) lens and CCD are used to transfer and readout visible and NIR photons. The feasibility of in-vivo sentinel lymph node (SLN) mapping was successfully performed with the proposed system.

Energy spread estimation of radioactive oxygen ion beams using optical imaging

Radioactive ion (RI) beams combined with in-beam positron emission tomography enable accurate in situ beam range verification in heavy ion therapy. However, the energy spread of the radioactive beams generated as secondary beams is wider than that of conventional stable heavy ion beams which causes Bragg peak region and distal falloff region broadening. Therefore, the energy spread of the RI beams should be measured carefully for their quality control. Here, we proposed an optical imaging technique for the energy spread estimation of radioactive oxygen ion beams. A polymethyl methacrylate phantom (10.0 × 10.0 × 9.9 cm3) was irradiated with an 15O beam (mean energy = 247.7 MeV u−1, standard deviation = 6.8 MeV u−1) in the Heavy Ion Medical Accelerator in Chiba. Three different momentum acceptances of 1%, 2% and 4% were used to get energy spreads of 1.9 MeV u−1, 3.4 MeV u−1 and 5.5 MeV u−1, respectively. The in-beam luminescence light and offline beam Cerenkov light images were acquired with an optical system consisting of a lens and a cooled charge-coupled device camera. To estimate the energy spread of the 15O ion beams, we proposed three optical parameters: (1) distal-50% falloff length of the prompt luminescence signals; (2) full-width at half maximum of the Cerenkov light signals in the beam direction; and (3) positional difference between the peaks of the Cerenkov light and the luminescence signals. These parameters estimated the energy spread with the respective mean squared errors of 2.52 × 10−3 MeV u−1, 5.91 × 10−3 MeV u−1, and 0.182 MeV u−1. The distal-50% falloff length of the luminescence signals provided the lowest mean squared error among the optical parameters. From the findings, we concluded optical imaging using luminescence and Cerenkov light signals offers an accurate energy spread estimation of 15O ion beams. In the future, the proposed optical parameters will be used for energy spread estimation of other RI beams as well as stable ion beams.

Sentinel lymph node biopsy for lung cancer

Sentinel lymph node biopsy is a technique to identify the first lymph node (or nodes) draining a tumor. The underlying principle is that as the first site of cancer spread, evaluation of the sentinel node will be most predictive for wider nodal involvement. The introduction of sentinel node biopsy revolutionized the surgical management of cutaneous melanoma and breast cancer, becoming a key component in the management of such patients. For over 20 years, thoracic surgeons have similarly worked to apply this technique to lung cancer but have thus far not had the same impact on lung surgery. In this review, we will summarize the ongoing discussions on the role of sentinel node biopsy in lung cancer, the methods for identifying the sentinel node, and the techniques for evaluating the sentinel node specimen. We will also highlight some of the pressing questions investigators should consider when designing a trial for sentinel node mapping. This will clarify the current status of sentinel node biopsy in lung cancer and thus highlight important future directions for research.

Extending the Hybrid Surgical Guidance Concept With Freehand Fluorescence Tomography

Within image-guided surgery, 'hybrid' guidance technologies have been used to integrate the complementary features of radioactive guidance and fluorescence guidance. Here, we explore how the generation of a novel freehand fluorescence (fhFluo) imaging approach complements freehand SPECT (fhSPECT) in a hybrid setup. Near-infrared optical tracking was used to register the position and the orientation of a hybrid opto-nuclear detection probe while recording its readings. Dedicated look-up table models were used for 3D reconstruction. In phantom and excised tissue settings (i.e., flat-surface human skin explants), fhSPECT and fhFluo were investigated for image resolution and in-tissue signal penetration. Finally, the combined potential of these freehand technologies was evaluated on prostate and lymph node specimens of prostate cancer patients receiving prostatectomy and sentinel lymph node dissection (tracers: indocyanine green (ICG) +^99m Tc-nanocolloid or ICG-^99mTc-nanocolloid). After hardware and software integration, the hybrid setup created 3D nuclear and fluorescence tomography scans. The imaging resolution of fhFluo (1 mm) was superior to that of fhSPECT (6 mm). Fluorescence modalities were confined to a maximum depth of 0.5 cm, while nuclear modalities were usable at all evaluated depths (<2 cm). Both fhSPECT and fhFluo enabled augmented- and virtual-reality navigation toward segmented image hotspots, including relative hotspot quantification with an accuracy of 3.9% and 4.1%. Imaging in surgical specimens confirmed these trends (fhSPECT: in-depth detectability, low resolution, and fhFluo: superior resolution, superficial detectability). Overall, when radioactive and fluorescent tracer signatures are used, fhFluo has complementary value to fhSPECT. Combined the freehand technologies render a unique hybrid imaging and navigation modality.

Characterization and validation of multimodal annihilation-gamma/near-infrared/visible laparoscopic system

Minimally invasive robotic surgery using fluorescence-guided images with a video laparoscope has been widely used because of its advantages of small incision, fast recovery time, and efficiency. However, the penetration depth limitation of fluorescence is a disadvantage caused by the absorption and scattering in tissues and blood cells. If this limitation can be overcome by additional imaging modalities, the surgical procedure can be quite efficient and precise. High-energy annihilation-gamma photons have a stronger penetration capability than visible and fluorescence photons. To characterize and validate a multimodal annihilation-gamma/near-infrared (NIR)/visible laparoscopic imaging system, an internal detector composed of an annihilation-gamma detector and an optical system was assembled inside a surgical stainless pipe with an outer diameter of 15.8 mm and an external detector with a dimension of 100  ×  100  mm2 placed at the opposite side of the internal detector. Integrated images of 511-keV gamma rays, NIR fluorescence, and visible light were obtained simultaneously. The 511-keV gamma image could be clearly seen with the acquisition of 5 s, while NIR and visible images could be presented in real time. This multimodal system has the potential for improving the surgery time and the quality of patient care.