3D endoscope system using DOE projector

Enhancing endoscopic measurement: validating a quantitative method for polyp size and location estimation in upper gastrointestinal endoscopy

BACKGROUND

Accurate measurement of polyps size is crucial in predicting malignancy, planning relevant intervention strategies and surveillance schedules. Endoscopists' visual estimations can lack precision. This study builds on our prior research, with the aim to evaluate a recently developed quantitative method to measure the polyp size and location accurately during a simulated endoscopy session.

METHODS

The quantitative method merges information about endoscopic positions obtained from an electromagnetic tracking sensor, with corresponding points on the images of the segmented polyp border. This yields real-scale 3D coordinates of the border of the polyp. By utilising the sensor, positions of any anatomical landmarks are attainable, enabling the estimation of a polyp's location relative to them. To verify the method's reliability and accuracy, simulated endoscopies were conducted in pig stomachs, where polyps were artificially created and assessed in a test-retest manner. The polyp measurements were subsequently compared against clipper measurements.

RESULTS

The average size of the fifteen polyps evaluated was approximately 12 ± 4.3 mm, ranging from 5 to 20 mm. The test-retest reliability, measured by the Intraclass Correlation Coefficient (ICC) for polyp size estimation, demonstrated an absolute agreement of 0.991 (95% CI 0.973-0.997, p < 0.05). Bland & Altman analysis revealed a mean estimation difference of - 0.17 mm (- 2.03%) for polyp size and, a mean difference of - 0.4 mm (- 0.21%) for polyp location. Both differences were statistically non-significant (p > 0.05). When comparing the proposed method with calliper measurements, the Bland & Altman plots showed 95% of size estimation differences between - 1.4 and 1.8 mm (- 13 to 17.4%) which was not significant (p > 0.05).

CONCLUSIONS

The proposed method of measurements of polyp size and location was found to be highly accurate, offering great potential for clinical implementation to improve polyp assessment. This level of performance represents a notable improvement over visual estimation technique used in clinical practice.

Fast Multichannel Inverse Design through Augmented Partial Factorization

Computer-automated design and discovery have led to high-performance nanophotonic devices with diverse functionalities. However, massively multichannel systems such as metasurfaces controlling many incident angles and photonic-circuit components coupling many waveguide modes still present a challenge. Conventional methods require Min forward simulations and Min adjoint simulations-2Min simulations in total-to compute the objective function and its gradient for a design involving the response to Min input channels. Here, we develop a formalism that uses the recently proposed augmented partial factorization method to obtain both the objective function and its gradient for a massively multichannel system in a single or a few simulations, achieving over 2 orders of magnitude speedup and reduced memory usage. We use this method to inverse design a metasurface beam splitter that separates the incident light to the target diffraction orders for all incident angles of interest, a key component of the dot projector for 3D sensing. This formalism enables efficient inverse design for a wide range of multichannel optical systems.

Optical Measurement of Ligament Strain: Opportunities and Limitations for Intraoperative Application

A feasible and precise method to measure ligament strain during surgical interventions could significantly enhance the quality of ligament reconstructions. However, all existing scientific approaches to measure in vivo ligament strain possess at least one significant disadvantage, such as the impairment of the anatomical structure. Seeking a more advantageous method, this paper proposes defining medical and technical requirements for a non-destructive, optical measurement technique. Furthermore, we offer a comprehensive review of current optical endoscopic techniques which could potentially be suitable for in vivo ligament strain measurement, along with the most suitable optical measurement techniques. The most promising options are rated based on the defined explicit and implicit requirements. Three methods were identified as promising candidates for a precise optical measurement of the alteration of a ligaments strain: confocal chromatic imaging, shearography, and digital image correlation.

Simultaneous shape and camera-projector parameter estimation for 3D endoscopic system using CNN-based grid-oneshot scan

For effective in situ endoscopic diagnosis and treatment, measurement of polyp sizes is important. For this purpose, 3D endoscopic systems have been researched. Among such systems, an active stereo technique, which projects a special pattern wherein each feature is coded, is a promising approach because of simplicity and high precision. However, previous works of this approach have problems. First, the quality of 3D reconstruction depended on the stabilities of feature extraction from the images captured by the endoscope camera. Second, due to the limited pattern projection area, the reconstructed region was relatively small. In this Letter, the authors propose a learning-based technique using convolutional neural networks to solve the first problem and an extended bundle adjustment technique, which integrates multiple shapes into a consistent single shape, to address the second. The effectiveness of the proposed techniques compared to previous techniques was evaluated experimentally.

A Miniature Binocular Endoscope with Local Feature Matching and Stereo Matching for 3D Measurement and 3D Reconstruction

As the traditional single camera endoscope can only provide clear images without 3D measurement and 3D reconstruction, a miniature binocular endoscope based on the principle of binocular stereoscopic vision to implement 3D measurement and 3D reconstruction in tight and restricted spaces is presented. In order to realize the exact matching of points of interest in the left and right images, a novel construction method of the weighted orthogonal-symmetric local binary pattern (WOS-LBP) descriptor is presented. Then a stereo matching algorithm based on Gaussian-weighted AD-Census transform and improved cross-based adaptive regions is studied to realize 3D reconstruction for real scenes. In the algorithm, we adjust determination criterions of adaptive regions for edge and discontinuous areas in particular and as well extract mismatched pixels caused by occlusion through image entropy and region-growing algorithm. This paper develops a binocular endoscope with an external diameter of 3.17 mm and the above algorithms are applied in it. The endoscope contains two CMOS cameras and four fiber optics for illumination. Three conclusions are drawn from experiments: (1) the proposed descriptor has good rotation invariance, distinctiveness and robustness to light change as well as noises; (2) the proposed stereo matching algorithm has a mean relative error of 8.48% for Middlebury standard pairs of images and compared with several classical stereo matching algorithms, our algorithm performs better in edge and discontinuous areas; (3) the mean relative error of length measurement is 3.22%, and the endoscope can be utilized to measure and reconstruct real scenes effectively.

A structured light laser probe for gastrointestinal polyp size measurement: a preliminary comparative study

BACKGROUND AND STUDY AIMS

 Polyp size measurement is an important diagnostic step during gastrointestinal endoscopy, and is mainly performed by visual inspection. However, lack of depth perception and objective reference points are acknowledged factors contributing to measurement errors in polyp size. In this paper, we describe the proof-of-concept of a polyp measurement device based on structured light technology for future endoscopes.

PATIENTS AND METHODS

 Measurement accuracy, time, user confidence, and satisfaction were evaluated for polyp size assessment by (a) visual inspection, (b) open biopsy forceps of known size, (c) ruled snare, and (d) structured light probe, for a total of 392 independent polyp measurements in ex vivo porcine stomachs.

RESULTS

 Visual assessment resulted in a median estimation error of 2.2 mm, IQR = 2.6 mm. The proposed probe can reduce the error to 1.5 mm, IQR = 1.67 mm ( P  = 0.002, 95 %CI) and its performance was found to be statistically similar to using forceps for reference ( P  = 0.81, 95 %CI) or ruled snare ( P  = 0.99, 95 %CI), while not occluding the tool channel. Timing performance with the probe was measured to be on average 54.75 seconds per polyp. This was significantly slower than visual assessment (20.7 seconds per polyp, P  = 0.005, 95 %CI) but not significantly different from using a snare (68.5 seconds per polyp, P  = 0.73, 95 %CI). However, the probe's timing performance was partly due to lens cleaning problems in our preliminary design. Reported average satisfaction on a 0 - 10 range was highest for the proposed probe (7.92), visual assessment (7.01), and reference forceps (7.82), while significantly lower for snare users with a score of 4.42 ( P  = 0.035, 95 %CI).

CONCLUSIONS

 The common practice of visual assessment of polyp size was found to be significantly less accurate than tool-based assessment, but easy to carry out. The proposed technology offers an accuracy on par with using a reference tool or ruled snare with the same satisfaction levels of visual assessment and without occluding the tool channel. Further study will improve the design to reduce the operating time by integrating the probe within the scope tip.