Multispectral time-of-flight imaging using light-emitting diodes

Nanosecond pulsed CMOS LED for all-silicon time-of-flight ranging

Light detection and ranging (LIDAR) is a widely used technique for measuring distance. With recent advancements in integrated photonics, there is a growing interest in miniaturizing LIDAR systems through on-chip photonic devices, but a LIDAR light source compatible with current integrated circuit technology remains elusive. In this letter, we report a pulsed CMOS LED based on native Si, which spectrally overlaps with Si detectors' responsivity and can produce optical pulses as short as 1.6 ns. A LIDAR prototype is built by incorporating this LED and a Si single-photon avalanche diode (SPAD). By utilizing time-correlated single-photon counting (TCSPC) to measure the time-of-flight (ToF) of reflected optical pulses, our LIDAR successfully estimated the distance of targets located approximately 30 cm away with sub-centimeter resolution, approaching the Cramér-Rao lower bound set by the pulse width and instrument jitter. Additionally, our LIDAR is capable of generating depth images of natural targets. This all-Si LIDAR demonstrates the feasibility of integrated distance sensors on a single photonic chip.

Visualising varnish removal for conservation of paintings by fluorescence lifetime imaging (FLIM)

The removal of varnish from the surface is a key step in painting conservation. Varnish removal is traditionally monitored by examining the painting surface under ultraviolet illumination. We show here that by imaging the fluorescence lifetime instead, much better contrast, sensitivity, and specificity can be achieved. For this purpose, we developed a lightweight (4.8 kg) portable instrument for macroscopic fluorescence lifetime imaging (FLIM). It is based on a time-correlated single-photon avalanche diode (SPAD) camera to acquire the FLIM images and a pulsed 440 nm diode laser to excite the varnish fluorescence. A historical model painting was examined to demonstrate the capabilities of the system. We found that the FLIM images provided information on the distribution of the varnish on the painting surface with greater sensitivity, specificity, and contrast compared to the traditional ultraviolet illumination photography. The distribution of the varnish and other painting materials was assessed using FLIM during and after varnish removal with different solvent application methods. Monitoring of the varnish removal process between successive solvent applications by a swab revealed an evolving image contrast as a function of the cleaning progress. FLIM of dammar and mastic resin varnishes identified characteristic changes to their fluorescence lifetimes depending on their ageing conditions. Thus, FLIM has a potential to become a powerful and versatile tool to visualise varnish removal from paintings.

Graphical Abstract

Multispectral Image under Tissue Classification Algorithm in Screening of Cervical Cancer

The objectives of this study were to improve the efficiency and accuracy of early clinical diagnosis of cervical cancer and to explore the application of tissue classification algorithm combined with multispectral imaging in screening of cervical cancer. 50 patients with suspected cervical cancer were selected. Firstly, the multispectral imaging technology was used to collect the multispectral images of the cervical tissues of 50 patients under the conventional white light waveband, the narrowband green light waveband, and the narrowband blue light waveband. Secondly, the collected multispectral images were fused, and then the tissue classification algorithm was used to segment the diseased area according to the difference between the cervical tissues without lesions and the cervical tissues with lesions. The difference in the contrast and other characteristics of the multiband spectrum fusion image would segment the diseased area, which was compared with the results of the disease examination. The average gradient, standard deviation (SD), and image entropy were adopted to evaluate the image quality, and the sensitivity and specificity were selected to evaluate the clinical application value of discussed method. The fused spectral image was compared with the image without lesions, it was found that there was a clear difference, and the fused multispectral image showed a contrast of 0.7549, which was also higher than that before fusion (0.4716), showing statistical difference (P < 0.05). The average gradient, SD, and image entropy of the multispectral image assisted by the tissue classification algorithm were 2.0765, 65.2579, and 4.974, respectively, showing statistical difference (P < 0.05). Compared with the three reported indicators, the values of the algorithm in this study were higher. The sensitivity and specificity of the multispectral image with the tissue classification algorithm were 85.3% and 70.8%, respectively, which were both greater than those of the image without the algorithm. It showed that the multispectral image assisted by tissue classification algorithm can effectively screen the cervical cancer and can quickly, efficiently, and safely segment the cervical tissue from the lesion area and the nonlesion area. The segmentation result was the same as that of the doctor's disease examination, indicating that it showed high clinical application value. This provided an effective reference for the clinical application of multispectral imaging technology assisted by tissue classification algorithm in the early screening and diagnosis of cervical cancer.

Combining time of flight and photometric stereo imaging for 3D reconstruction of discontinuous scenes

Time of flight and photometric stereo are two three-dimensional (3D) imaging techniques with complementary properties, where the former can achieve depth accuracy in discontinuous scenes, and the latter can reconstruct surfaces of objects with fine depth details and high spatial resolution. In this work, we demonstrate the surface reconstruction of complex 3D fields with discontinuity between objects by combining the two imaging methods. Using commercial LEDs, a single-photon avalanche diode camera, and a mobile phone device, high resolution of surface reconstruction is achieved with a RMS error of 6% for an object auto-selected from a scene imaged at a distance of 50 cm.

Direct integration of micro-LEDs and a SPAD detector on a silicon CMOS chip for data communications and time-of-flight ranging

We present integration of singulated micron-sized light emitting diodes (micro-LEDs) directly onto a silicon CMOS drive chip using a transfer printing method. An 8x8 micro-LED device array with individual control over each pixel is demonstrated with modulation bandwidths up to 50 MHz, limited by the large modulation depth of the driver chip. The 2 kHz frame rate CMOS driver also incorporates a Single Photon Avalanche Diode device thus allowing detection and transmission functionality on a single integrated chip. Visible light communications at data rates up to 1 Mbps, and time-of-flight ranging with cm-scale resolution are demonstrated using this hybrid integrated system.