1
|
Płotka S, Szczepański T, Szenejko P, Korzeniowski P, Calvo JR, Khalil A, Shamshirsaz A, Brawura-Biskupski-Samaha R, Išgum I, Sánchez CI, Sitek A. Real-time placental vessel segmentation in fetoscopic laser surgery for Twin-to-Twin Transfusion Syndrome. Med Image Anal 2024; 99:103330. [PMID: 39260033 DOI: 10.1016/j.media.2024.103330] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/04/2023] [Revised: 06/07/2024] [Accepted: 08/27/2024] [Indexed: 09/13/2024]
Abstract
Twin-to-Twin Transfusion Syndrome (TTTS) is a rare condition that affects about 15% of monochorionic pregnancies, in which identical twins share a single placenta. Fetoscopic laser photocoagulation (FLP) is the standard treatment for TTTS, which significantly improves the survival of fetuses. The aim of FLP is to identify abnormal connections between blood vessels and to laser ablate them in order to equalize blood supply to both fetuses. However, performing fetoscopic surgery is challenging due to limited visibility, a narrow field of view, and significant variability among patients and domains. In order to enhance the visualization of placental vessels during surgery, we propose TTTSNet, a network architecture designed for real-time and accurate placental vessel segmentation. Our network architecture incorporates a novel channel attention module and multi-scale feature fusion module to precisely segment tiny placental vessels. To address the challenges posed by FLP-specific fiberscope and amniotic sac-based artifacts, we employed novel data augmentation techniques. These techniques simulate various artifacts, including laser pointer, amniotic sac particles, and structural and optical fiber artifacts. By incorporating these simulated artifacts during training, our network architecture demonstrated robust generalizability. We trained TTTSNet on a publicly available dataset of 2060 video frames from 18 independent fetoscopic procedures and evaluated it on a multi-center external dataset of 24 in-vivo procedures with a total of 2348 video frames. Our method achieved significant performance improvements compared to state-of-the-art methods, with a mean Intersection over Union of 78.26% for all placental vessels and 73.35% for a subset of tiny placental vessels. Moreover, our method achieved 172 and 152 frames per second on an A100 GPU, and Clara AGX, respectively. This potentially opens the door to real-time application during surgical procedures. The code is publicly available at https://github.com/SanoScience/TTTSNet.
Collapse
Affiliation(s)
- Szymon Płotka
- Sano Centre for Computational Medicine, Cracow, Poland; Informatics Institute, University of Amsterdam, Amsterdam, The Netherlands; Department of Biomedical Engineering and Physics, Amsterdam University Medical Center, University of Amsterdam, Amsterdam, The Netherlands
| | | | - Paula Szenejko
- First Department of Obstetrics and Gynecology, The University Center for Women and Newborn Health, Medical University of Warsaw, Warsaw, Poland
| | | | - Jesús Rodriguez Calvo
- Fetal Medicine Unit, Obstetrics and Gynecology Division, Complutense University of Madrid, Madrid, Spain
| | - Asma Khalil
- Fetal Medicine Unit, Saint George's Hospital, University of London, London, United Kingdom
| | - Alireza Shamshirsaz
- Maternal Fetal Care Center, Boston Children's Hospital, Boston, MA, United States of America; Harvard Medical School, Boston, MA, United States of America
| | | | - Ivana Išgum
- Informatics Institute, University of Amsterdam, Amsterdam, The Netherlands; Department of Biomedical Engineering and Physics, Amsterdam University Medical Center, University of Amsterdam, Amsterdam, The Netherlands; Department of Radiology and Nuclear Medicine, Amsterdam University Medical Center, University of Amsterdam, Amsterdam, The Netherlands
| | - Clara I Sánchez
- Informatics Institute, University of Amsterdam, Amsterdam, The Netherlands; Department of Biomedical Engineering and Physics, Amsterdam University Medical Center, University of Amsterdam, Amsterdam, The Netherlands
| | - Arkadiusz Sitek
- Harvard Medical School, Boston, MA, United States of America; Center for Advanced Medical Computing and Simulation, Massachusetts General Hospital, Boston, MA, United States of America.
| |
Collapse
|
2
|
Miluski P, Markowski K, Kochanowicz M, Łodziński M, Pisarski WA, Pisarska J, Kuwik M, Leśniak M, Dorosz D, Żmojda J, Ragiń T, Dorosz J. Broadband Profiled Eye-Safe Emission of LMA Silica Fiber Doped with Tm 3+/Ho 3+ Ions. MATERIALS (BASEL, SWITZERLAND) 2023; 16:7679. [PMID: 38138821 PMCID: PMC10744985 DOI: 10.3390/ma16247679] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/17/2023] [Revised: 12/13/2023] [Accepted: 12/15/2023] [Indexed: 12/24/2023]
Abstract
LMA (Large Mode Area) optical fibers are presently under active investigation to explore their potential for generating laser action or broadband emission directly within the optical fiber structure. Additionally, a wide mode profile significantly reduces the power distribution density in the fiber cross-section, minimizing the power density, photodegradation, or thermal damage. Multi-stage deposition in the MCVD-CDT system was used to obtain the structural doping profile of the LMA fiber multi-ring core doped with Tm3+ and Tm3+/Ho3+ layer profiles. The low alumina content (Al2O3: 0.03wt%) results in low refractive index modification. The maximum concentrations of the lanthanide oxides were Tm2O3: 0.18wt % and Ho2O3: 0.15wt%. The double-clad construction of optical fiber with emission spectra in the eye-safe spectral range of (1.55-2.10 µm). The calculated LP01 Mode Field Diameter (MFD) was 69.7 µm (@ 2000 nm, and 1/e of maximum intensity), which confirms LMA fundamental mode guiding conditions. The FWHM and λmax vs. fiber length are presented and analyzed as a luminescence profile modification. The proposed structured optical fiber with a ring core can be used in new broadband optical radiation source designs.
Collapse
Affiliation(s)
- Piotr Miluski
- Faculty of Electrical Engineering, Bialystok University of Technology, Wiejska 45D Street, 15-351 Bialystok, Poland; (K.M.); (M.K.); (J.Ż.); (T.R.); (J.D.)
| | - Krzysztof Markowski
- Faculty of Electrical Engineering, Bialystok University of Technology, Wiejska 45D Street, 15-351 Bialystok, Poland; (K.M.); (M.K.); (J.Ż.); (T.R.); (J.D.)
| | - Marcin Kochanowicz
- Faculty of Electrical Engineering, Bialystok University of Technology, Wiejska 45D Street, 15-351 Bialystok, Poland; (K.M.); (M.K.); (J.Ż.); (T.R.); (J.D.)
| | - Marek Łodziński
- Faculty of Geology, Geophysics and Environment Protection, AGH University of Science and Technology, 30 Mickiewicza Av., 30-059 Krakow, Poland;
| | - Wojciech A. Pisarski
- Institute of Chemistry, University of Silesia, 9 Szkolna Street, 40-007 Katowice, Poland; (W.A.P.); (J.P.); (M.K.)
| | - Joanna Pisarska
- Institute of Chemistry, University of Silesia, 9 Szkolna Street, 40-007 Katowice, Poland; (W.A.P.); (J.P.); (M.K.)
| | - Marta Kuwik
- Institute of Chemistry, University of Silesia, 9 Szkolna Street, 40-007 Katowice, Poland; (W.A.P.); (J.P.); (M.K.)
| | - Magdalena Leśniak
- Faculty of Materials Science and Ceramics, AGH University of Science and Technology, 30 Mickiewicza Av., 30-059 Krakow, Poland; (M.L.); (D.D.)
| | - Dominik Dorosz
- Faculty of Materials Science and Ceramics, AGH University of Science and Technology, 30 Mickiewicza Av., 30-059 Krakow, Poland; (M.L.); (D.D.)
| | - Jacek Żmojda
- Faculty of Electrical Engineering, Bialystok University of Technology, Wiejska 45D Street, 15-351 Bialystok, Poland; (K.M.); (M.K.); (J.Ż.); (T.R.); (J.D.)
| | - Tomasz Ragiń
- Faculty of Electrical Engineering, Bialystok University of Technology, Wiejska 45D Street, 15-351 Bialystok, Poland; (K.M.); (M.K.); (J.Ż.); (T.R.); (J.D.)
| | - Jan Dorosz
- Faculty of Electrical Engineering, Bialystok University of Technology, Wiejska 45D Street, 15-351 Bialystok, Poland; (K.M.); (M.K.); (J.Ż.); (T.R.); (J.D.)
| |
Collapse
|
3
|
Ritt G. Laser Safety-What Is the Laser Hazard Distance for an Electro-Optical Imaging System? SENSORS (BASEL, SWITZERLAND) 2023; 23:7033. [PMID: 37631570 PMCID: PMC10460010 DOI: 10.3390/s23167033] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/03/2023] [Revised: 08/03/2023] [Accepted: 08/04/2023] [Indexed: 08/27/2023]
Abstract
Laser safety is an important topic. Everybody working with lasers has to follow the long-established occupational safety rules to prevent people from eye damage by accidental irradiation. These rules comprise, for example, the calculation of the Maximum Permissible Exposure (MPE), as well as the corresponding laser hazard distance, the so-called Nominal Ocular Hazard Distance (NOHD). At exposure levels below the MPE, laser eye dazzling may occur and is described by a quite new concept, leading to definitions such as the Maximum Dazzle Exposure (MDE) and to its corresponding Nominal Ocular Dazzle Distance (NODD). In earlier work, we defined exposure limits for sensors corresponding to those for the human eye: The Maximum Permissible Exposure for a Sensor, MPES, and the Maximum Dazzle Exposure for a Sensor, MDES. In this publication, we report on our continuative work concerning the laser hazard distances arising from these exposure limits. In contrast to the human eye, unexpected results occur for electro-optical imaging systems: For laser irradiances exceeding the exposure limit, MPES, it can happen that the laser hazard zone does not extend directly from the laser source, but only from a specific distance to it. This means that some scenarios are possible where an electro-optical imaging sensor may be in danger of getting damaged within a certain distance to the laser source but is safe from damage when located close to the laser source. This is in contrast to laser eye safety, where it is assumed that the laser hazard zone always extends directly from the laser source. Furthermore, we provide closed-form equations in order to estimate laser hazard distances related to the damaging and dazzling of the electro-optical imaging systems.
Collapse
Affiliation(s)
- Gunnar Ritt
- Fraunhofer IOSB, Gutleuthausstr. 1, 76275 Ettlingen, Germany
| |
Collapse
|
4
|
Schwarz B, Ritt G, Eberle B. Estimation of Lens Stray Light with Regard to the Incapacitation of Imaging Sensors-Part 2: Validation. SENSORS (BASEL, SWITZERLAND) 2022; 22:9447. [PMID: 36502145 PMCID: PMC9738133 DOI: 10.3390/s22239447] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 11/03/2022] [Revised: 12/01/2022] [Accepted: 12/01/2022] [Indexed: 06/17/2023]
Abstract
Recently, we developed a simple theoretical model for the estimation of the irradiance distribution at the focal plane of commercial off-the-shelf (COTS) camera lenses in case of laser illumination. The purpose of such a model is to predict the incapacitation of imaging sensors when irradiated by laser light. The model is based on closed-form equations that comprise mainly standard parameters of the laser dazzle scenario and those of the main devices involved (laser source, camera lens and imaging sensor). However, the model also includes three non-standard parameters, which describe the scattering of light within the camera lens. In previous work, we have performed measurements to derive these typically unknown scatter parameters for a collection of camera lenses of the Double-Gauss type. In this publication, we compare calculations based on our theoretical model and the measured scatter parameters with the outcome of stray light simulations performed with the optical design software FRED in order to validate the reliability of our theoretical model and of the derived scatter parameters.
Collapse
Affiliation(s)
| | - Gunnar Ritt
- Fraunhofer IOSB, Gutleuthausstr. 1, 76275 Ettlingen, Germany
| | | |
Collapse
|
5
|
Crocherie A, Pond J, Gomez FD, Channon K, Fantoni F. Micro to macro scale simulation coupling for stray light analysis. OPTICS EXPRESS 2021; 29:37639-37652. [PMID: 34808832 DOI: 10.1364/oe.436244] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/07/2021] [Accepted: 10/18/2021] [Indexed: 06/13/2023]
Abstract
Stray light in an optical system is unwanted parasitic light that may degrade performance. It can originate from different sources and may lead to different problems in the optical system such as fogging, ghost images for imagers, or inaccurate measurements for time of flight applications. One of the root causes is the reflectivity of the sensor itself. In this paper we present a new optical simulation methodology to analyze the stray light contribution due to the sensor reflectivity by coupling electromagnetic simulation (to calculate the pixels' bidirectional reflectance distribution function, also named BRDF) and ray-tracing simulation (for stray light analysis of the camera module). With this simulation flow we have been able to reproduce qualitatively red ghost images observed on different sensors in our laboratory.
Collapse
|
6
|
Ge K, Guo D, Ma X, Xu Z, Hayat A, Li S, Zhai T. Large-Area Biocompatible Random Laser for Wearable Applications. NANOMATERIALS (BASEL, SWITZERLAND) 2021; 11:1809. [PMID: 34361195 PMCID: PMC8308224 DOI: 10.3390/nano11071809] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 06/14/2021] [Revised: 07/09/2021] [Accepted: 07/09/2021] [Indexed: 12/17/2022]
Abstract
Recently, wearable sensor technology has drawn attention to many health-related appliances due to its varied existing optical, electrical, and mechanical applications. Similarly, we have designed a simple and cheap lift-off fabrication technique for the realization of large-area biocompatible random lasers to customize wearable sensors. A large-area random microcavity comprises a matrix element polymethyl methacrylate (PMMA) in which rhodamine B (RhB, which acts as a gain medium) and gold nanorods (Au NRs, which offer plasmonic feedback) are incorporated via a spin-coating technique. In regards to the respective random lasing device residing on a heterogenous film (area > 100 cm2), upon optical excitation, coherent random lasing with a narrow linewidth (~0.4 nm) at a low threshold (~23 μJ/cm2 per pulse) was successfully attained. Here, we maneuvered the mechanical flexibility of the device to modify the spacing between the feedback agents (Au NRs), which tuned the average wavelength from 612.6 to 624 nm under bending while being a recoverable process. Moreover, the flexible film can potentially be used on human skin such as the finger to serve as a motion and relative-humidity sensor. This work demonstrates a designable and simple method to fabricate a large-area biocompatible random laser for wearable sensing.
Collapse
Affiliation(s)
- Kun Ge
- Faculty of Science, College of Physics and Optoelectronics, Beijing University of Technology, Beijing 100124, China; (K.G.); (D.G.); (X.M.); (Z.X.); (A.H.)
| | - Dan Guo
- Faculty of Science, College of Physics and Optoelectronics, Beijing University of Technology, Beijing 100124, China; (K.G.); (D.G.); (X.M.); (Z.X.); (A.H.)
| | - Xiaojie Ma
- Faculty of Science, College of Physics and Optoelectronics, Beijing University of Technology, Beijing 100124, China; (K.G.); (D.G.); (X.M.); (Z.X.); (A.H.)
| | - Zhiyang Xu
- Faculty of Science, College of Physics and Optoelectronics, Beijing University of Technology, Beijing 100124, China; (K.G.); (D.G.); (X.M.); (Z.X.); (A.H.)
| | - Anwer Hayat
- Faculty of Science, College of Physics and Optoelectronics, Beijing University of Technology, Beijing 100124, China; (K.G.); (D.G.); (X.M.); (Z.X.); (A.H.)
| | - Songtao Li
- Department of Mathematics & Physics, North China Electric Power University, Baoding 071000, China;
| | - Tianrui Zhai
- Faculty of Science, College of Physics and Optoelectronics, Beijing University of Technology, Beijing 100124, China; (K.G.); (D.G.); (X.M.); (Z.X.); (A.H.)
| |
Collapse
|
7
|
Correction: Ritt, G. Laser Safety Calculations for Imaging Sensors. Sensors 2019, 19, 3765. SENSORS 2021; 21:s21061959. [PMID: 33804290 PMCID: PMC8001126 DOI: 10.3390/s21061959] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Track Full Text] [Download PDF] [Subscribe] [Scholar Register] [Received: 07/30/2020] [Accepted: 12/28/2020] [Indexed: 11/21/2022]
|
8
|
Ritt G, Schwarz B, Eberle B. Estimation of Lens Stray Light with Regard to the Incapacitation of Imaging Sensors. SENSORS (BASEL, SWITZERLAND) 2020; 20:s20216308. [PMID: 33167524 PMCID: PMC7663958 DOI: 10.3390/s20216308] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 09/23/2020] [Revised: 10/29/2020] [Accepted: 11/02/2020] [Indexed: 06/11/2023]
Abstract
We present our efforts on estimating light scattering characteristics from commercial off-the-shelf (COTS) camera lenses in order to deduce thereof a set of generic scattering parameters valid for a specific lens class (double Gauss lenses). In previous investigations, we developed a simplified theoretical light scattering model to estimate the irradiance distribution in the focal plane of a camera lens. This theoretical model is based on a 3-parameter bidirectional scattering distribution function (BSDF), which describes light scattering from rough surfaces of the optical elements. Ordinarily, the three scatter parameters of the BSDF are not known for COTS camera lenses, which makes it necessary to assess them by own experiments. Besides the experimental setup and the measurement process, we present in detail the subsequent data exploitation. From measurements on seven COTS camera lenses, we deduced a generic set of scatter parameters. For a deeper analysis, the results of our measurements have also been compared with the output of an optical engineering software. Together with our theoretical model, now stray light calculations can be accomplished even then, when specific scatter parameters are not available from elsewhere. In addition, the light scattering analyses also allow considering the glare vulnerability of optical systems in terms of laser safety.
Collapse
|