Optoacoustic mesoscopy for biomedicine

Impact of skin tone on photoacoustic oximetry and tools to minimize bias

The major optical absorbers in tissue are melanin and oxy/deoxy-hemoglobin, but the impact of skin tone and pigmentation on biomedical optics is still not completely understood or adequately addressed. Melanin largely governs skin tone with higher melanin concentration in subjects with darker skin tones. Recently, there has been extensive debate on the bias of pulse oximeters when used with darker subjects. Photoacoustic (PA) imaging can measure oxygen saturation similarly as pulse oximeters and could have value in studying this bias. More importantly, it can deconvolute the signal from the skin and underlying tissue. Here, we studied the impact of skin tone on PA signal generation, depth penetration, and oximetry. Our results show that subjects with darker skin tones exhibit significantly higher PA signal at the skin surface, reduced penetration depth, and lower oxygen saturation compared to subjects with lighter skin tones. We then suggest a simple way to compensate for these signal differences.

Optoacoustic Imaging And Potential Applications Of Raster-Scan Optoacoustic Mesoscopy In Dermatology

Optoacoustic imaging (OAI) is a hybrid imaging modality that integrates the benefits of optical contrast and ultrasound detection. Raster-scan optoacoustic mesoscopy (RSOM) is an emerging OAI method that provides information about several dermatological conditions' structural, functional, and molecular features. We searched PubMed and Google Scholar databases through September 2021 for articles relevant to OAI in the English language. This review contains 32 studies and other relevant literature. Several studies indicate that RSOM is helpful in inflammatory skin conditions such as psoriasis and eczema, especially as it allows more accurate quantification of inflammation-related alterations such as changes to the dermal vasculature. In psoriasis, RSOM can provide objective early diagnosis and monitoring of disease activity and treatment efficacy. Multispectral RSOM, a method in which skin is lightened at more than a single wavelength, is beneficial in diagnosing and monitoring hypoxia-associated conditions, such as systemic sclerosis and chronic wounds. OAI techniques can visualize the pathological vascularization of skin cancers and quantify their oxygenation status which helps differentiate them from normal skin. Also, they can measure the depth of malignant melanoma and detect the metastatic spread of melanoma cells to sentinel lymph nodes. As demonstrated in this article, there is a large spectrum of potential applications of OAI imaging, especially RSOM, in diagnosing, treating, and managing skin diseases.

In Vivo Three-Dimensional Raster Scan Optoacoustic Mesoscopy Using Frequency Domain Inversion

Optoacoustic signals are typically reconstructed into images using inversion algorithms applied in the time-domain. However, time-domain reconstructions can be computationally intensive and therefore slow when large amounts of raw data are collected from an optoacoustic scan. Here we considered a fast weighted ω-k (FWOK) algorithm operating in the frequency domain to accelerate the inversion in raster-scan optoacoustic mesoscopy (RSOM), while seamlessly incorporating impulse response correction with minimum computational burden. We investigated the FWOK performance with RSOM measurements from phantoms and mice in vivo and obtained 360-fold speed improvement over inversions based on the back-projection algorithm in the time-domain. This previously unexplored inversion of in vivo optoacoustic data with impulse response correction in frequency domain reconstructions points to a promising strategy of accelerating optoacoustic imaging computations, toward video-rate tomography.

Dual Ultrasound and Photoacoustic Tracking of Magnetically Driven Micromotors: From In Vitro to In Vivo

The fast evolution of medical micro- and nanorobots in the endeavor to perform non-invasive medical operations in living organisms has boosted the use of diverse medical imaging techniques in the last years. Among those techniques, photoacoustic imaging (PAI), considered a functional technique, has shown to be promising for the visualization of micromotors in deep tissue with high spatiotemporal resolution as it possesses the molecular specificity of optical methods and the penetration depth of ultrasound. However, the precise maneuvering and function's control of medical micromotors, in particular in living organisms, require both anatomical and functional imaging feedback. Therefore, herein, the use of high-frequency ultrasound and PAI is reported to obtain anatomical and molecular information, respectively, of magnetically-driven micromotors in vitro and under ex vivo tissues. Furthermore, the steerability of the micromotors is demonstrated by the action of an external magnetic field into the uterus and bladder of living mice in real-time, being able to discriminate the micromotors' signal from one of the endogenous chromophores by multispectral analysis. Finally, the successful loading and release of a model cargo by the micromotors toward non-invasive in vivo medical interventions is demonstrated.

Single pixel imaging at megahertz switching rates via cyclic Hadamard masks

Optical imaging is commonly performed with either a camera and wide-field illumination or with a single detector and a scanning collimated beam; unfortunately, these options do not exist at all wavelengths. Single-pixel imaging offers an alternative that can be performed with a single detector and wide-field illumination, potentially enabling imaging applications in which the detection and illumination technologies are immature. However, single-pixel imaging currently suffers from low imaging rates owing to its reliance on configurable spatial light modulators, generally limited to 22 kHz rates. We develop an approach for rapid single-pixel imaging which relies on cyclic patterns coded onto a spinning mask and demonstrate it for in vivo imaging of C. elegans worms. Spatial modulation rates of up to 2.4 MHz, imaging rates of up to 72 fps, and image-reconstruction times of down to 1.5 ms are reported, enabling real-time visualization of dynamic objects.

Recent Advances in Photoacoustic Tomography

Photoacoustic tomography (PAT) that integrates the molecular contrast of optical imaging with the high spatial resolution of ultrasound imaging in deep tissue has widespread applications in basic biological science, preclinical research, and clinical trials. Recently, tremendous progress has been made in PAT regarding technical innovations, preclinical applications, and clinical translations. Here, we selectively review the recent progresses and advances in PAT, including the development of advanced PAT systems for small-animal and human imaging, newly engineered optical probes for molecular imaging, broad-spectrum PAT for label-free imaging of biological tissues, high-throughput snapshot photoacoustic topography, and integration of machine learning for image reconstruction and processing. We envision that PAT will have further technical developments and more impactful applications in biomedicine.

Optoacoustic imaging in endocrinology and metabolism

Imaging is an essential tool in research, diagnostics and the management of endocrine disorders. Ultrasonography, nuclear medicine techniques, MRI, CT and optical methods are already used for applications in endocrinology. Optoacoustic imaging, also termed photoacoustic imaging, is emerging as a method for visualizing endocrine physiology and disease at different scales of detail: microscopic, mesoscopic and macroscopic. Optoacoustic contrast arises from endogenous light absorbers, such as oxygenated and deoxygenated haemoglobin, lipids and water, or exogenous contrast agents, and reveals tissue vasculature, perfusion, oxygenation, metabolic activity and inflammation. The development of high-performance optoacoustic scanners for use in humans has given rise to a variety of clinical investigations, which complement the use of the technology in preclinical research. Here, we review key progress with optoacoustic imaging technology as it relates to applications in endocrinology; for example, to visualize thyroid morphology and function, and the microvasculature in diabetes mellitus or adipose tissue metabolism, with particular focus on multispectral optoacoustic tomography and raster-scan optoacoustic mesoscopy. We explain the merits of optoacoustic microscopy and focus on mid-infrared optoacoustic microscopy, which enables label-free imaging of metabolites in cells and tissues. We showcase current optoacoustic applications within endocrinology and discuss the potential of these technologies to advance research and clinical practice.

Progress of clinical translation of handheld and semi-handheld photoacoustic imaging

Photoacoustic imaging (PAI), featuring rich contrast, high spatial/temporal resolution and deep penetration, is one of the fastest-growing biomedical imaging technology over the last decade. To date, numbers of handheld and semi-handheld photoacoustic imaging devices have been reported with corresponding potential clinical applications. Here, we summarize emerged handheld and semi-handheld systems in terms of photoacoustic computed tomography (PACT), optoacoustic mesoscopy (OAMes), and photoacoustic microscopy (PAM). We will discuss each modality in three aspects: laser delivery, scanning protocol, and acoustic detection. Besides new technical developments, we also review the associated clinical studies, and the advantages/disadvantages of these new techniques. In the end, we propose the challenges and perspectives of miniaturized PAI in the future.

A method for the calibration of wideband ultrasonic sensors for optoacoustics

A method for calibration of ultrasonic sensors for optoacoustics that provides both frequency response and sensitivity is presented. In order to obtain the bandwidth and the frequency response of an uncalibrated sensor, a point source with broadband spectra generated by a laser-induced bubble on a copper wire submerged in water is employed. On the other hand, the sensitivity measurement relies on the spatial symmetry of the pressure pulse and on a calibrated transducer. Therefore, two sensors are employed to detect the pressure pulse at the same distance from the source. The symmetry of the acoustic field that arrives at both transducers is adjusted and verified by means of an optical interferometer that provides a null signal when the copper wire is placed at the right position. The method is tested on the characterization of a thin-film polymeric piezoelectric transducer with a cylindrical focused shape.

Photoacoustic Mouse Brain Imaging Using an Optical Fabry-Pérot Interferometric Ultrasound Sensor

Photoacoustic (PA, or optoacoustic, OA) mesoscopy is a powerful tool for mouse cerebral imaging, which offers high resolution three-dimensional (3D) images with optical absorption contrast inside the optically turbid brain. The image quality of a PA mesoscope relies on the ultrasonic transducer which detects the PA signals. An all-optical ultrasound sensor based on a Fabry-Pérot (FP) polymer cavity has the following advantages: broadband frequency response, wide angular coverage and small footprint. Here, we present 3D PA mesoscope for mouse brain imaging using such an optical sensor. A heating laser was used to stabilize the sensor's cavity length during the imaging process. To acquire data for a 3D angiogram of the mouse brain, the sensor was mounted on a translation stage and raster scanned. 3D images of the mouse brain vasculature were reconstructed which showed cerebrovascular structure up to a depth of 8 mm with high quality. Imaging segmentation and dual wavelength imaging were performed to demonstrate the potential of the system in preclinical brain research.

Optoacoustic imaging of the skin

Optoacoustic (OA, photoacoustic) imaging capitalizes on the synergistic combination of light excitation and ultrasound detection to empower biological and clinical investigations with rich optical contrast while effectively bridging the gap between micro and macroscopic imaging realms. State-of-the-art OA embodiments consistently provide images at micron-scale resolution through superficial tissue layers by means of focused illumination that can be smoothly exchanged for acoustic-resolution images at diffuse light depths of several millimetres to centimetres via ultrasound beamforming or tomographic reconstruction. Taken together, this unique multi-scale imaging capacity opens unprecedented capabilities for high-resolution in vivo interrogations of the skin at scalable depths. Moreover, diverse anatomical and functional information is retrieved via dynamic mapping of endogenous chromophores such as haemoglobin, melanin, lipids, collagen, water and others. This, along with the use of non-ionizing radiation, facilitates a clinical translation of the OA modalities. We review recent progress in OA imaging of the skin in preclinical and clinical studies exploiting the rich contrast provided by endogenous substances in tissues. The imaging capabilities of existing approaches are discussed in the context of initial translational studies on skin cancer, inflammatory skin diseases, wounds and other conditions.

Noninvasive visualization of electrical conductivity in tissues at the micrometer scale

Despite its importance in regulating cellular or tissue function, electrical conductivity can only be visualized in tissue indirectly as voltage potentials using fluorescent techniques, or directly with radio waves. These either requires invasive procedures like genetic modification or suffers from limited resolution. Here, we introduce radio-frequency thermoacoustic mesoscopy (RThAM) for the noninvasive imaging of conductivity by exploiting the direct absorption of near-field ultrashort radio-frequency pulses to stimulate the emission of broadband ultrasound waves. Detection of ultrasound rather than radio waves enables micrometer-scale resolutions, over several millimeters of tissue depth. We confirm an imaging resolution of <30 μm in phantoms and demonstrate microscopic imaging of conductivity correlating to physical structures in 1- and 512-cell zebrafish embryos, as well as larvae. These results support RThAM as a promising method for high-resolution, label-free assessment of conductivity in tissues.

Optoacoustic Imaging in Inflammation

Optoacoustic or photoacoustic imaging (OAI/PAI) is a technology which enables non-invasive visualization of laser-illuminated tissue by the detection of acoustic signals. The combination of "light in" and "sound out" offers unprecedented scalability with a high penetration depth and resolution. The wide range of biomedical applications makes this technology a versatile tool for preclinical and clinical research. Particularly when imaging inflammation, the technology offers advantages over current clinical methods to diagnose, stage, and monitor physiological and pathophysiological processes. This review discusses the clinical perspective of using OAI in the context of imaging inflammation as well as in current and emerging translational applications.

Axial accuracy and signal enhancement in acoustic-resolution photoacoustic microscopy by laser jitter effect correction and pulse energy compensation

In recent years, photoacoustic imaging has found vast applications in biomedical imaging. Photoacoustic imaging has high optical contrast and high ultrasound resolution allowing deep tissue non-invasive imaging beyond the optical diffusion limit. Q-switched lasers are extensively used in photoacoustic imaging due to the availability of high energy and short laser pulses, which are essential for high-resolution photoacoustic imaging. In most cases, this type of light source suffers from pulse peak-power energy variations and timing jitter noise, resulting in uncertainty in the output power and arrival time of the laser pulses. These problems cause intensity degradation and temporal displacement of generated photoacoustic signals which in turn deteriorate the quality of the acquired photoacoustic images. In this study, we used a high-speed data acquisition system in combination with a fast photodetector and a software-based approach to capture laser pulses precisely in order to reduce the effect of timing jitter and normalization of the photoacoustic signals based on pulse peak-powers simultaneously. In the experiments, maximum axial accuracy enhancement of 14 µm was achieved in maximum-amplitude projected images on XZ and YZ planes with ±13.5 ns laser timing jitter. Furthermore, photoacoustic signal enhancement of 77% was obtained for 75% laser pulses peak-power stability.

Label-free high frame rate imaging of circulating blood clots using a dual modal ultrasound and photoacoustic system

Deep vein thrombosis (DVT) is a disorder when a blood clot (thrombus) is formed in one of the deep veins. These clots detach from the original sites and circulate in the blood stream at high velocities. Diagnosing these blood clots at an early stage is necessary to decide the treatment strategy. For label-free, in vivo, and real-time detection, high framerate photoacoustic imaging can be used. In this work, a dual modal clinical ultrasound and photoacoustic (PA) system is used for the high framerate PA imaging of circulating blood clots in blood at linear velocities up to 107 cm/sec. Blood clot had 1.4 times higher signal-to-noise ratio (SNR) in the static mode and 1.3 times higher SNR compared to blood PA signal in the flow experiments. This work demonstrates that fast-moving circulating blood clots are easy to recognize against the background PA signal and may aid in early diagnosis.

Improvement in resolution of fiber-laser photoacoustic tomography based on a virtual-point concept

In this study, a virtual-point concept was introduced into fiber-laser photoacoustic tomography to improve the elevational image resolution. The flexible fiber laser was bent into an arc shape to conform to the ultrasound wavefront, which formed an ultrasound focus at the center of the arc. The synthetic aperture focusing technique was utilized to reconstruct the images; as a result, the elevational resolution particularly within the out-of-focus region was considerably improved compared to the resolution of an image retrieved by multiplexing the PA time-resolved signals with sound velocity. The all-optical fiber-laser photoacoustic tomography system with a high spatial resolution has potential for various applications, including biomedical research and preclinical/clinical diagnosis.

Imaging of photoacoustic-mediated permeabilization of giant unilamellar vesicles (GUVs)

Target delivery of large foreign materials to cells requires transient permeabilization of the cell membrane without toxicity. Giant unilamellar vesicles (GUVs) mimic the phospholipid bilayer of the cell membrane and are also useful drug delivery vehicles. Controlled increase of the permeability of GUVs is a delicate balance between sufficient perturbation for the delivery of the GUV contents and damage to the vesicles. Here we show that photoacoustic waves can promote the release of FITC-dextran or GFP from GUVs without damage. Real-time interferometric imaging offers the first movies of photoacoustic wave propagation and interaction with GUVs. The photoacoustic waves are seen as mostly compressive half-cycle pulses with peak pressures of ~ 1 MPa and spatial extent FWHM ~ 36 µm. At a repetition rate of 10 Hz, they enable the release of 25% of the FITC-dextran content of GUVs in 15 min. Such photoacoustic waves may enable non-invasive targeted release of GUVs and cell transfection over large volumes of tissues in just a few minutes.

LV-GAN: A deep learning approach for limited-view optoacoustic imaging based on hybrid datasets

The optoacoustic imaging (OAI) methods are rapidly evolving for resolving optical contrast in medical imaging applications. In practice, measurement strategies are commonly implemented under limited-view conditions due to oversized image objectives or system design limitations. Data acquired by limited-view detection may impart artifacts and distortions in reconstructed optoacoustic (OA) images. We propose a hybrid data-driven deep learning approach based on generative adversarial network (GAN), termed as LV-GAN, to efficiently recover high quality images from limited-view OA images. Trained on both simulation and experiment data, LV-GAN is found capable of achieving high recovery accuracy even under limited detection angles less than 60^° . The feasibility of LV-GAN for artifact removal in biological applications was validated by ex vivo experiments based on two different OAI systems, suggesting high potential of a ubiquitous use of LV-GAN to optimize image quality or system design for different scanners and application scenarios.

Real-time interleaved spectroscopic photoacoustic and ultrasound (PAUS) scanning with simultaneous fluence compensation and motion correction

For over two decades photoacoustic imaging has been tested clinically, but successful human trials have been limited. To enable quantitative clinical spectroscopy, the fundamental issues of wavelength-dependent fluence variations and inter-wavelength motion must be overcome. Here we propose a real-time, spectroscopic photoacoustic/ultrasound (PAUS) imaging approach using a compact, 1-kHz rate wavelength-tunable laser. Instead of illuminating tissue over a large area, the fiber-optic delivery system surrounding an US array sequentially scans a narrow laser beam, with partial PA image reconstruction for each laser pulse. The final image is then formed by coherently summing partial images. This scheme enables (i) automatic compensation for wavelength-dependent fluence variations in spectroscopic PA imaging and (ii) motion correction of spectroscopic PA frames using US speckle tracking in real-time systems. The 50-Hz video rate PAUS system is demonstrated in vivo using a murine model of labelled drug delivery.

Photoacoustic Tomography Opening New Paradigms in Biomedical Imaging

After the emergence of the ultrasound, X-ray CT, PET, and MRI, photoacoustic tomography (PAT) is now in the phase of its exponential growth, with its expected full maturation being another form of mainstream clinical imaging modality. By combining the high contrast benefit of optical imaging and the high-resolution deep imaging capability of ultrasound, PAT can provide unprecedented anatomical image contrasts at clinically relevant depths as well as enable the use of a variety of functional and molecular imaging information, which is not possible with conventional imaging modalities. With these strengths, PAT has achieved numerous breakthroughs in various biomedical applications and also provided new technical platforms that may be able to resolve unmet issues in clinics. In this chapter, we provide an overview of the development of PAT technology for several major biomedical applications and provide an approximate projection of the future of PAT.

Another decade of photoacoustic imaging

Photoacoustic imaging - a hybrid biomedical imaging modality finding its way to clinical practices. Although the photoacoustic phenomenon was known more than a century back, only in the last two decades it has been widely researched and used for biomedical imaging applications. In this review we focus on the development and progress of the technology in the last decade (2010-2020). From becoming more and more user friendly, cheaper in cost, portable in size, photoacoustic imaging promises a wide range of applications, if translated to clinic. The growth of photoacoustic community is steady, and with several new directions researchers are exploring, it is inevitable that photoacoustic imaging will one day establish itself as a regular imaging system in the clinical practices.

Convolutional neural network for resolution enhancement and noise reduction in acoustic resolution photoacoustic microscopy

In acoustic resolution photoacoustic microscopy (AR-PAM), a high numerical aperture focused ultrasound transducer (UST) is used for deep tissue high resolution photoacoustic imaging. There is a significant degradation of lateral resolution in the out-of-focus region. Improvement in out-of-focus resolution without degrading the image quality remains a challenge. In this work, we propose a deep learning-based method to improve the resolution of AR-PAM images, especially at the out of focus plane. A modified fully dense U-Net based architecture was trained on simulated AR-PAM images. Applying the trained model on experimental images showed that the variation in resolution is ∼10% across the entire imaging depth (∼4 mm) in the deep learning-based method, compared to ∼180% variation in the original PAM images. Performance of the trained network on in vivo rat vasculature imaging further validated that noise-free, high resolution images can be obtained using this method.

Portable and Affordable Light Source-Based Photoacoustic Tomography

Photoacoustic imaging is a hybrid imaging modality that offers the advantages of optical (spectroscopic contrast) and ultrasound imaging (scalable spatial resolution and imaging depth). This promising modality has shown excellent potential in a wide range of preclinical and clinical imaging and sensing applications. Even though photoacoustic imaging technology has matured in research settings, its clinical translation is not happening at the expected pace. One of the main reasons for this is the requirement of bulky and expensive pulsed lasers for excitation. To accelerate the clinical translation of photoacoustic imaging and explore its potential in resource-limited settings, it is of paramount importance to develop portable and affordable light sources that can be used as the excitation light source. In this review, we focus on the following aspects: (1) the basic theory of photoacoustic imaging; (2) inexpensive light sources and different implementations; and (3) important preclinical and clinical applications, demonstrated using affordable light source-based photoacoustics. The main focus will be on laser diodes and light-emitting diodes as they have demonstrated promise in photoacoustic tomography-the key technological developments in these areas will be thoroughly reviewed. We believe that this review will be a useful opus for both the beginners and experts in the field of biomedical photoacoustic imaging.

Three-dimensional optoacoustic imaging of nailfold capillaries in systemic sclerosis and its potential for disease differentiation using deep learning

The autoimmune disease systemic sclerosis (SSc) causes microvascular changes that can be easily observed cutaneously at the finger nailfold. Optoacoustic imaging (OAI), a combination of optical and ultrasound imaging, specifically raster-scanning optoacoustic mesoscopy (RSOM), offers a non-invasive high-resolution 3D visualization of capillaries allowing for a better view of microvascular changes and an extraction of volumetric measures. In this study, nailfold capillaries of patients with SSc and healthy controls are imaged and compared with each other for the first time using OAI. The nailfolds of 23 patients with SSc and 19 controls were imaged using RSOM. The acquired images were qualitatively compared to images from state-of-the-art imaging tools for SSc, dermoscopy and high magnification capillaroscopy. The vascular volume in the nailfold capillaries were computed from the RSOM images. The vascular volumes differ significantly between both cohorts (0.216 ± 0.085 mm³ and 0.337 ± 0.110 mm³; p < 0.0005). In addition, an artificial neural network was trained to automatically differentiate nailfold images from both cohorts to further assess whether OAI is sensitive enough to visualize anatomical differences in the capillaries between the two cohorts. Using transfer learning, the model classifies images with an area under the ROC curve of 0.897, and a sensitivity of 0.783 and specificity of 0.895. In conclusion, this study demonstrates the capabilities of RSOM as an imaging tool for SSc and establishes it as a modality that facilitates more in-depth studies into the disease mechanisms and progression.

Medical Imaging of Microrobots: Toward In Vivo Applications

Medical microrobots (MRs) have been demonstrated for a variety of non-invasive biomedical applications, such as tissue engineering, drug delivery, and assisted fertilization, among others. However, most of these demonstrations have been carried out in in vitro settings and under optical microscopy, being significantly different from the clinical practice. Thus, medical imaging techniques are required for localizing and tracking such tiny therapeutic machines when used in medical-relevant applications. This review aims at analyzing the state of the art of microrobots imaging by critically discussing the potentialities and limitations of the techniques employed in this field. Moreover, the physics and the working principle behind each analyzed imaging strategy, the spatiotemporal resolution, and the penetration depth are thoroughly discussed. The paper deals with the suitability of each imaging technique for tracking single or swarms of MRs and discusses the scenarios where contrast or imaging agent's inclusion is required, either to absorb, emit, or reflect a determined physical signal detected by an external system. Finally, the review highlights the existing challenges and perspective solutions which could be promising for future in vivo applications.

A submicrometre silicon-on-insulator resonator for ultrasound detection

Ultrasound detectors use high-frequency sound waves to image objects and measure distances, but the resolution of these readings is limited by the physical dimensions of the detecting element. Point-like broadband ultrasound detection can greatly increase the resolution of ultrasonography and optoacoustic (photoacoustic) imaging^1,2, but current ultrasound detectors, such as those used for medical imaging, cannot be miniaturized sufficiently. Piezoelectric transducers lose sensitivity quadratically with size reduction³, and optical microring resonators⁴ and Fabry-Pérot etalons⁵ cannot adequately confine light to dimensions smaller than about 50 micrometres. Micromachining methods have been used to generate arrays of capacitive⁶ and piezoelectric⁷ transducers, but with bandwidths of only a few megahertz and dimensions exceeding 70 micrometres. Here we use the widely available silicon-on-insulator technology to develop a miniaturized ultrasound detector, with a sensing area of only 220 nanometres by 500 nanometres. The silicon-on-insulator-based optical resonator design provides per-area sensitivity that is 1,000 times higher than that of microring resonators and 100,000,000 times better than that of piezoelectric detectors. Our design also enables an ultrawide detection bandwidth, reaching 230 megahertz at -6 decibels. In addition to making the detectors suitable for manufacture in very dense arrays, we show that the submicrometre sensing area enables super-resolution detection and imaging performance. We demonstrate imaging of features 50 times smaller than the wavelength of ultrasound detected. Our detector enables ultra-miniaturization of ultrasound readings, enabling ultrasound imaging at a resolution comparable to that achieved with optical microscopy, and potentially enabling the development of very dense ultrasound arrays on a silicon chip.

Full-frequency correction of spatial impulse response in back-projection scheme using space-variant filtering for optoacoustic mesoscopy

The fidelity and quality of reconstructed images in optoacoustic mesoscopy (OPAM) can be significantly improved by considering the spatial impulse response (SIR) of the employed focused transducer into reconstruction. However, the traditional method fully taking the SIR into account can hardly meet the data-intensive requirements of high resolution OPAM because of excessive memory and time consumption. Herein, a modified back-projection method using a space-variant filter for full-frequency correction of the SIR is presented, and applied to the OPAM system with a sphere-focused transducer. The proposed method can readily manage the large datasets of the OPAM and effectively reduce the extra time consumption. The performance of the proposed method is showcased by simulations and experiments of phantoms and biological tissue. The results demonstrate that the modified back-projection method exhibits better image fidelity, resolution and contrast compared to the common and weighted back-projection methods that are not or not fully accounting for the SIR.

Construction of a novel bispecific fusion protein to enhance targeting for pancreatic cancer imaging

Early detection and diagnosis are the most important endeavors for reducing associated morbidity and mortality of pancreatic ductal adenocarcinoma (PDAC). Developing molecular imaging probes that can specifically and effectively target cancer-associated biological pathways is one of the key points for sensitive and accurate diagnosis for PDAC. Herein, a small-sized, bispecific fusion protein constructed by genetic fusion of different binding domains of antibodies, termed Bi50, with enhanced targeting effect for PDAC is reported. Bi50 has excellent bispecific targeting for vascular endothelial growth factor (VEGF) and epidermal growth factor receptor (EGFR) simultaneously in vitro and in vivo. Additionally, Bi50 shows increased intratumoral permeability and enrichment characteristics in the tumor than the control protein, which is constructed directly connecting two individual Fabs. Moreover, Bi50 can not only target areas rich in vasculature but also bind with affinity to tumor parenchymal cells, achieving "multilevel" targeting effect. Our work demonstrates that the bispecific fusion protein Bi50 has great potential as an efficient, targeted molecular imaging probe.

Wide-field monitoring and real-time local recording of microvascular networks on small animals with a dual-raster-scanned photoacoustic microscope

Photoacoustic microscopy (PAM) provides a new method for the imaging of small-animals with high-contrast and deep-penetration. However, the established PAM systems have suffered from a limited field-of-view or imaging speed, which are difficult to both monitor wide-field activity of organ and record real-time change of local tissue. Here, we reported a dual-raster-scanned photoacoustic microscope (DRS-PAM) that integrates a two-dimensional motorized translation stage for large field-of-view imaging and a two-axis fast galvanometer scanner for real-time imaging. The DRS-PAM provides a flexible transition from wide-field monitoring the vasculature of organs to real-time imaging of local dynamics. To test the performance of DRS-PAM, clear characterization of angiogenesis and functional detail was illustrated, hemodynamic activities of vasculature in cerebral cortex of a mouse were investigated. Furthermore, response of tumor to treatment were successfully monitored during treatment. The experimental results demonstrate the DRS-PAM holds the great potential for biomedical research of basic biology.

Electrothermal-MEMS-induced nonlinear distortion correction in photoacoustic laparoscopy

Micro-electro-mechanical systems (MEMS) scanner has significant advantages of miniature size, fast response and high stability, which is particularly applicable to photoacoustic laparoscopy (PAL). However, tilt angle-voltage curve of electrothermal MEMS shows a nonlinear character, which leads to inevitable nonlinear distortion in photoacoustic imaging. To overcome this problem, a nonlinear distortion correction was developed for the high-resolution forward-scanning electrothermal-MEMS-based PAL. The adaptive resampling method (ARM) was introduced to adaptively calibrate the projection of non-uniform scanning region to match the uniform scanning region. The correction performed low time complexity and high portability owing to the adaptive capacity of distortion decomposition in the reconstruction of physical models. Compared with the sample structure, phantom experiments demonstrated that the distortion was calibrated in all directions and the corrected image provided up to 96.82% high structural similarity in local subset. Furthermore, ARM was applied to imaging the abdominal cavity of rat and the vascular morphology was corrected in real-time display within a delay less than 2 seconds. All these results demonstrated that the nonlinear distortion correction possessed timely and effective correction in PAL, which suggested that it had the potential to employ to any other electrothermal-MEMS-based photoacoustic imaging systems for accurate and quantitative functional imaging.

Rapid functional optoacoustic micro-angiography in a burst mode

Optoacoustic microscopy (OAM) can image intrinsic optical absorption contrast at depths of several millimeters where state-of-the-art optical microscopy techniques fail due to intense light scattering in living tissues. Yet, wide adoption of OAM in biology and medicine is hindered by slow image acquisition speed, small field of view (FOV), and/or lack of spectral differentiation capacity of common system implementations. We report on a rapid acquisition functional optoacoustic micro-angiography approach that employs a burst-mode laser triggering scheme to simultaneously acquire multi-wavelength 3D images over an extended FOV covering ${50}\;{\rm mm} \times {50}\;{\rm mm}$50mm×50mm in a single mechanical overfly scan, attaining 28 µm and 14 µm resolution in lateral and axial dimensions, respectively. Owing to an ultrawideband low-noise design featuring a spherically focused polyvinylidene difluoride transducer, we demonstrate imaging of human skin and underlying vasculature at up to 3.8 mm depth when using per-pulse laser energies of only 25 µJ without employing signal averaging. Overall, the developed system greatly enhances performance and usability of OAM for dermatologic and micro-angiographic studies.

Photothermally tunable Fabry-Pérot fiber interferometer for photoacoustic mesoscopy

An optical fiber based Fabry-Pérot interferometer whose resonant wavelength can be dynamically tuned was designed and realized for photoacoustic mesoscopy. The optical path length (OPL) of the Fabry-Pérot cavity can be modulated by a photothermal heating process, which was achieved by adjusting the power of a 650 nm heating laser. The optical heating process can effectively change the thickness and refractive index of the polymer spacer of the sensor cavity. The robustness of the sensor can be greatly improved by proper packaging. The interferometer was interrogated by a relatively cheap wavelength-fixed 1550 nm laser for broadband and sensitive ultrasound detection, eliminating the requirement for an expensive tunable interrogation laser. The sensing module was then integrated into a photoacoustic mesoscopic imaging system. Two phantom imaging experiments and an ex vivo imaging experiment demonstrated the capability of such a miniature sensor. The interferometer has an acoustic detection bandwidth of up to 30 MHz and a noise equivalent pressure of 40 mPa/Hz^1/2 (i.e., 220 Pa over the full detection bandwidth). The new tuning mechanism and the batch-production compatibility of the sensor holds promises for commercialization and parallelized detection.

Spatial heterogeneity of oxygenation and haemodynamics in breast cancer resolved in vivo by conical multispectral optoacoustic mesoscopy

The characteristics of tumour development and metastasis relate not only to genomic heterogeneity but also to spatial heterogeneity, associated with variations in the intratumoural arrangement of cell populations, vascular morphology and oxygen and nutrient supply. While optical (photonic) microscopy is commonly employed to visualize the tumour microenvironment, it assesses only a few hundred cubic microns of tissue. Therefore, it is not suitable for investigating biological processes at the level of the entire tumour, which can be at least four orders of magnitude larger. In this study, we aimed to extend optical visualization and resolve spatial heterogeneity throughout the entire tumour volume. We developed an optoacoustic (photoacoustic) mesoscope adapted to solid tumour imaging and, in a pilot study, offer the first insights into cancer optical contrast heterogeneity in vivo at an unprecedented resolution of <50 μm throughout the entire tumour mass. Using spectral methods, we resolve unknown patterns of oxygenation, vasculature and perfusion in three types of breast cancer and showcase different levels of structural and functional organization. To our knowledge, these results are the most detailed insights of optical signatures reported throughout entire tumours in vivo, and they position optoacoustic mesoscopy as a unique investigational tool linking microscopic and macroscopic observations.

High-speed dual-view photoacoustic imaging pen

Today, photoacoustic imaging (PAI) is widely used to study diseases in the skin, brain, cardiovascular, and other parts. However, these studies are often carried out using physiological slices or model animals, which indicate that many PAI techniques can only be used in the laboratory. In order to promote the transformation of PAI into clinical applications or, more specifically, to extend the application of photoacoustic (PA) microscopy to areas such as the oral cavity, throat, cervix, and abdominal viscera which are difficult to detect with conventional PA microscopy systems, a PAI pen was developed. The PAI pen can be handheld and can perform forward detection and lateral detection. The imaging area is a 2.4 mm diameter circular area. In addition, it can provide a high-speed imaging mode of four frames per second and a high-resolution imaging mode of 0.25 frames per second to meet the different needs of clinical users. In this Letter, the performance of the PAI pen was tested by imaging the phantom and the human oral cavity. The experimental results prove that the PAI pen can clearly image the microvessels of the oral cavity, which indicates that it has the same imaging capability for other similar areas and has a good prospect for assisting the diagnosis of related diseases.

High resolution, label-free photoacoustic imaging of live chicken embryo developing in bioengineered eggshell

Chicken embryos have been proven to be an attractive vertebrate model for biomedical research. They have helped in making significant contributions for advancements in various fields like developmental biology, cancer research and cardiovascular studies. However, a non-invasive, label-free method of imaging live chicken embryo at high resolution still needs to be developed and optimized. In this work, we have shown the potential of photoacoustic tomography (PAT) for imaging live chicken embryos cultured in bioengineered eggshells. Laser pulses at wavelengths of 532 and 740 nm were used for attaining cross-sectional images of chicken embryos at different developmental stages. Cross-sections along different depths were imaged to gain knowledge of the relative depth of different vessels and organs. Due to high optical absorption of vasculature and embryonic eye, images with good optical contrast could be acquired using this method. We have thus reported a label-free method of performing cross-sectional imaging of chicken embryos at high resolution demonstrating the capacity of PAT as a promising tool for avian embryo imaging.

Nanoparticle-based Cell Trackers for Biomedical Applications

The continuous or real-time tracking of biological processes using biocompatible contrast agents over a certain period of time is vital for precise diagnosis and treatment, such as monitoring tissue regeneration after stem cell transplantation, understanding the genesis, development, invasion and metastasis of cancer and so on. The rationally designed nanoparticles, including aggregation-induced emission (AIE) dots, inorganic quantum dots (QDs), nanodiamonds, superparamagnetic iron oxide nanoparticles (SPIONs), and semiconducting polymer nanoparticles (SPNs), have been explored to meet this urgent need. In this review, the development and application of these nanoparticle-based cell trackers for a variety of imaging technologies, including fluorescence imaging, photoacoustic imaging, magnetic resonance imaging, magnetic particle imaging, positron emission tomography and single photon emission computing tomography are discussed in detail. Moreover, the further therapeutic treatments using multi-functional trackers endowed with photodynamic and photothermal modalities are also introduced to provide a comprehensive perspective in this promising research field.

Photoacoustic imaging depth comparison at 532-, 800-, and 1064-nm wavelengths: Monte Carlo simulation and experimental validation

Photoacoustic imaging (PAI) provides high-resolution and high-optical-contrast imaging beyond optical diffusion limit. Further improvement in imaging depth has been achieved by using near-infrared window-I (NIR-I, 700 to 900 nm) for illumination, due to lower scattering and absorption by tissues in this wavelength range. Recently, near-infrared window-II (NIR-II, 900 to 1700 nm) has been explored for PAI. We studied the imaging depths in biological tissues for different illumination wavelengths in visible, NIR-I, and NIR-II regions using Monte Carlo (MC) simulations and validated with experimental results. MC simulations were done to compute fluence in tissue, absorbance in blood vessel, and in a spherical absorber (mimicking sentinel lymph node) embedded at different depths in breast tissue. Photoacoustic tomography and acoustic resolution photoacoustic microscopy experiments were conducted to validate the MC results. We demonstrate that maximum imaging depth is achieved by wavelengths in NIR-I window (∼800  nm) when the energy density deposited is same for all wavelengths. However, illumination using wavelengths around 1064 nm (NIR-II window) gives the maximum imaging depth when the energy density deposited is proportional to maximum permissible exposure (MPE) at corresponding wavelength. These results show that it is the higher MPE of NIR-II window that helps in increasing the PAI depth for chromophores embedded in breast tissue.

Determination of cell nucleus-to-cytoplasmic ratio using imaging flow cytometry and a combined ultrasound and photoacoustic technique: a comparison study

While the nucleus-to-cytoplasmic (N:C) ratio has traditionally been used for assessing cell malignancy, most N:C measurement techniques are time-consuming and performed on thin histological sections, which prohibit assessment of three-dimensional cell structure. A combined ultrahigh frequency ultrasound (US) and photoacoustic (PA) technique was used to assess the size and N:C ratio of cultured cancer cells in three dimensions (3D). The diameters of the cells and their stained nuclei were obtained by fitting the power spectrum of backscattered US pulses and emitted PA waves, respectively, to well-established theoretical models. For comparison, an imaging flow cytometer (IFC) was also used to determine the two-dimensional cell and nucleus sizes from large cell populations using brightfield and fluorescence images, respectively. An N:C ratio was calculated for each cell using the quotient of the measured nucleus diameter and the total cell diameter. The mean N:C ratios calculated using the sound-based approach were 0.68, 0.66, and 0.54 for MCF-7, PC-3, and MDA-MB-231 cells, respectively, and were in good agreement with the corresponding values of 0.68, 0.67, and 0.68 obtained using the IFC. The combined US and PA technique, which assesses cellular N:C ratio in 3D, has potential applications in the detection of circulating tumor cells in liquid biopsies.

Non-invasive imaging in dermatology and the unique potential of raster-scan optoacoustic mesoscopy

In recent years, several non‐invasive imaging methods have been introduced to facilitate diagnostics and therapy monitoring in dermatology. The microscopic imaging methods are restricted in their penetration depth, while the mesoscopic methods probe deeper but provide only morphological, not functional, information. ‘Raster‐scan optoacoustic mesoscopy’ (RSOM), an emerging new imaging technique, combines deep penetration with contrast based on light absorption, which provides morphological, molecular and functional information. Here, we compare the capabilities and limitations of currently available dermatological imaging methods and highlight the principles and unique abilities of RSOM. We illustrate the clinical potential of RSOM, in particular for non‐invasive diagnosis and monitoring of inflammatory and oncological skin diseases.