Improved polarimetric analysis of human skin through stitching: advantages, limitations, and applications in dermatology

Polarimetry is a powerful tool for the analysis of the optical properties of materials and systems, such as human skin. However, in many polarimetric setups, the field of view is limited to a few square centimeters. In these cases, it is possible to resort to stitching techniques, which involve combining multiple Mueller matrix measurements obtained from different overlapping regions of the sample. In this paper, we propose a stitching technique for polarimetric data and discuss its advantages and limitations. We also describe the potential of image stitching for improving the accuracy and robustness ofin vivopolarimetry in the presence of random patient movement. We conducted our research using a diverse set of samples which included porcine skin, human skin from arms and fingers, cold cuts of chicken and gelatine, alongside synthetically created sample data. Our results demonstrate the effectiveness of this technique for the application in dermatology. Each additionalin vivomeasurement enhances the field of view by approximately one third, thereby considerably augmenting the total observation area. We show that stitching enables for the polarimetric assessment of large skin patches which is useful for the diagnosis of inflammatory skin diseases.

Optimization of Thyroid Volume Determination by Stitched 3D-Ultrasound Data Sets in Patients with Structural Thyroid Disease

Ultrasound (US) is the most important imaging method for the assessment of structural disorders of the thyroid. A precise volume determination is relevant for therapy planning and outcome monitoring. However, the accuracy of 2D-US is limited, especially in cases of organ enlargements and deformations. Software-based "stitching" of separately acquired 3D-US data revealed precise volume determination in thyroid phantoms. The purpose of this study is to investigate the feasibility and accuracy of 3D-US stitching in patients with structural thyroid disease. A total of 31 patients from the clinical routine were involved, receiving conventional 2D-US (conUS), sensor-navigated 3D-US (3DsnUS), mechanically-swept 3D-US (3DmsUS), and I-124-PET/CT as reference standard. Regarding 3DsnUS and 3DmsUS, separately acquired 3D-US images (per thyroid lobe) were merged to one comprehensive data set. Subsequently, anatomical correctness of the stitching process was analysed via secondary image fusion with the I-124-PET images. Volumetric determinations were conducted by the ellipsoid model (EM) on conUS and CT, and manually drawn segmental contouring (MC) on 3DsnUS, 3DmsUS, CT, and I-124-PET/CT. Mean volume of the thyroid glands was 44.1 ± 25.8 mL (I-124-PET-MC = reference). Highly significant correlations (all p < 0.0001) were observed for conUS-EM (r = 0.892), 3DsnUS-MC (r = 0.988), 3DmsUS-MC (r = 0.978), CT-EM (0.956), and CT-MC (0.986), respectively. The mean volume differences (standard deviations, limits of agreement) in comparison with the reference were -10.50 mL (±11.56 mL, -33.62 to 12.24), -3.74 mL (±3.74 mL, -11.39 to 3.78), and 0.62 mL (±4.79 mL, -8.78 to 10.01) for conUS-EM, 3DsnUS-MC, and 3DmsUS-MC, respectively. Stitched 3D-US data sets of the thyroid enable accurate volumetric determination even in enlarged and deformed organs. The main limitation of high time expenditure may be overcome by artificial intelligence approaches.

Enhanced Low-Velocity Impact Properties for Resin Film Infusion-Manufactured Composites by Flow-Control Approach

The optimization of the mechanical properties of composite materials has been a challenge since these materials were first used, especially in aeronautics. Reduced energy consumption, safety and reliability are mandatory to achieve a sustainable use of composite materials. The mechanical properties of composites are closely related to the amount of defects in the materials. Voids are known as one of the most important defect sources in resin film infusion (RFI)-manufactured composites. Minimizing the defect content leads to maximized mechanical properties and lightweight design. In this paper, a novel methodology based on computer vision is applied to control the impregnation velocity, reduce the void content and enhance the impact properties. Optimized drop-impact properties were found once the impregnation velocity was analyzed and optimized. Its application in both conventional and stitching-reinforced composites concludes with an improvement in the damage threshold load, peak force and damaged area. Although stitching tends to generate additional voids and reduces in-plane properties, the reduction in the damaged area means a positive balance in the mechanical properties. At the same time, the novel methodology provides the RFI process with a noticeable level of automation and control. Consequently, the industrial interest and the range of applications of this process are enhanced.

Marker-less assessment of the geometric error of fused cone-beam computed tomography images of the foot constructed using stitching software

BACKGROUND

Image noise, object repositioning, initial manual image alignment, and stitching of different volumes, i.e. anatomical regions may all affect the stitching error of fused cone-beam computed tomography (CBCT) images.

PURPOSE

To determine the geometric error of fused CBCT images of the hindfoot, lower leg, and forefoot after using stitching software, based on a marker-less validation method.

MATERIAL AND METHODS

CBCT images of the hindfoot, lower leg, and forefoot were acquired multiple times on a Planmed Verity scanner with and without repositioning the leg between acquisitions. Prototype stitching software was used to stitch hindfoot-forefoot volumes and hindfoot-lower leg volumes. Stitching error was determined via registration and by calculating the displacement of the tibia, first metatarsal, or proximal phalanges, with respect to the calcaneus, compared to their position on conventional CT.

RESULTS

Overall total translation and rotation errors were 1.22 ± 0.62 mm (range 0.43-3.07 mm) and 1.27° ± 0.53° (range 0.29°-2.88°). Lower leg translation was smaller compared to forefoot translation (P < 0.001). No statistical difference was observed between lower leg and forefoot rotation errors (P = 0.186). Cadaver repositioning between acquisitions resulted in larger rotation errors (P < 0.05). Cadaver repositioning did not affect translation errors (P = 0.768).

CONCLUSION

Geometric error of fused CBCT images can be quantified using a marker-less validation method. Stitching of hindfoot volumes with forefoot and lower leg volumes induces translation and rotation errors of up to approximately 3 mm and 3°. Translation errors are larger in hindfoot-forefoot stitches compared to hindfoot-lower leg stitches.

Documenting Paintings with Gigapixel Photography

Digital photographic capture of pictorial artworks with gigapixel resolution (around 1000 megapixels or greater) is a novel technique that is beginning to be used by some important international museums as a means of documentation, analysis, and dissemination of their masterpieces. This line of research is extremely interesting, not only for art curators and scholars but also for the general public. The results can be disseminated through online virtual museum displays, offering a detailed interactive visualization. These virtual visualizations allow the viewer to delve into the artwork in such a way that it is possible to zoom in and observe those details, which would be negligible to the naked eye in a real visit. Therefore, this kind of virtual visualization using gigapixel images has become an essential tool to enhance cultural heritage and to make it accessible to everyone. Since today’s professional digital cameras provide images of around 40 megapixels, obtaining gigapixel images requires some special capture and editing techniques. This article describes a series of photographic methodologies and equipment, developed by the team of researchers, that have been put into practice to achieve a very high level of detail and chromatic fidelity, in the documentation and dissemination of pictorial artworks. The result of this research work consisted in the gigapixel documentation of several masterpieces of the Museo de Bellas Artes of Valencia, one of the main art galleries in Spain. The results will be disseminated through the Internet, as will be shown with some examples.

Semi-automatic stitching of filamentous structures in image stacks from serial-section electron tomography

We present a software-assisted workflow for the alignment and matching of filamentous structures across a three-dimensional (3D) stack of serial images. This is achieved by combining automatic methods, visual validation, and interactive correction. After the computation of an initial automatic matching, the user can continuously improve the result by interactively correcting landmarks or matches of filaments. Supported by a visual quality assessment of regions that have been already inspected, this allows a trade-off between quality and manual labour. The software tool was developed in an interdisciplinary collaboration between computer scientists and cell biologists to investigate cell division by quantitative 3D analysis of microtubules (MTs) in both mitotic and meiotic spindles. For this, each spindle is cut into a series of semi-thick physical sections, of which electron tomograms are acquired. The serial tomograms are then stitched and non-rigidly aligned to allow tracing and connecting of MTs across tomogram boundaries. In practice, automatic stitching alone provides only an incomplete solution, because large physical distortions and a low signal-to-noise ratio often cause experimental difficulties. To derive 3D models of spindles despite dealing with imperfect data related to sample preparation and subsequent data collection, semi-automatic validation and correction is required to remove stitching mistakes. However, due to the large number of MTs in spindles (up to 30k) and their resulting dense spatial arrangement, a naive inspection of each MT is too time-consuming. Furthermore, an interactive visualisation of the full image stack is hampered by the size of the data (up to 100 GB). Here, we present a specialised, interactive, semi-automatic solution that considers all requirements for large-scale stitching of filamentous structures in serial-section image stacks. To the best of our knowledge, it is the only currently available tool which is able to process data of the type and size presented here. The key to our solution is a careful design of the visualisation and interaction tools for each processing step to guarantee real-time response, and an optimised workflow that efficiently guides the user through datasets. The final solution presented here is the result of an iterative process with tight feedback loops between the involved computer scientists and cell biologists. LAY DESCRIPTION: Electron tomography of biological samples is used for a three-dimensional (3D) reconstruction of filamentous structures, such as microtubules (MTs) in mitotic and meiotic spindles. Large-scale electron tomography can be applied to increase the reconstructed volume for the visualisation of full spindles. For this, each spindle is cut into a series of semi-thick physical sections, from which electron tomograms are acquired. The serial tomograms are then stitched and non-rigidly aligned to allow tracing and connecting of MTs across tomogram boundaries. Previously, we presented fully automatic approaches for this 3D reconstruction pipeline. However, large volumes often suffer from imperfections (ie physical distortions) caused by the image acquisition process, making it difficult to apply fully automatic approaches for matching and stitching of numerous tomograms. Therefore, we developed an interactive, semi-automatic solution that considers all requirements for large-scale stitching of microtubules in image stacks of consecutive sections. We achieved this by combining automatic methods, visual validation and interactive error correction, thus allowing the user to continuously improve the result by interactively correcting landmarks or matches of filaments. We present large-scale reconstructions of spindles in which the automatic workflow failed and where different steps of manual corrections were needed. Our approach is also applicable to other biological samples showing 3D distributions of MTs in a number of different cellular contexts.

Mechanical Performance of Unstitched and Silk Fiber-Stitched Woven Kenaf Fiber-Reinforced Epoxy Composites

Fiber composites are known to have poor through-thickness mechanical properties due to the absence of a Z-direction binder. This issue is more critical with the use of natural fibers due to their low strength compared to synthetic fibers. Stitching is a through-thickness toughening method that is used to introduce fibers in the Z-direction, which will result in better through-thickness mechanical properties. This research was carried out to determine the mechanical properties of unstitched and silk fiber-stitched woven kenaf-reinforced epoxy composites. The woven kenaf mat was stitched with silk fiber using a commercial sewing machine. The specimens were fabricated using a hand lay-up method. Three specimens were fabricated, one unstitched and two silk-stitched with deferent stitching orientations. The results show that the stitched specimens have comparable in-plane mechanical properties to the unstitched specimens. For the tensile mechanical test, stitched specimens show similar and 17.1% higher tensile strength compared to the unstitched specimens. The flexural mechanical test results show around a 9% decrease in the flexural strength for the stitched specimens. On the other hand, the Izod impact mechanical test results show a significant improvement of 33% for the stitched specimens, which means that stitching has successfully improved the out-of-plane mechanical properties. The outcome of this research indicates that the stitched specimens have better mechanical performance compared to the unstitched specimens and that the decrease in the flexural strength is insignificant in contrast with the remarkable enhancement in the impact strength.

Exploiting Multi-Level Parallelism for Stitching Very Large Microscopy Images

Due to the limited field of view of the microscopes, acquisitions of macroscopic specimens require many parallel image stacks to cover the whole volume of interest. Overlapping regions are introduced among stacks in order to make it possible automatic alignment by means of a 3D stitching tool. Since state-of-the-art microscopes coupled with chemical clearing procedures can generate 3D images whose size exceeds the Terabyte, parallelization is required to keep stitching time within acceptable limits. In the present paper we discuss how multi-level parallelization reduces the execution times of TeraStitcher, a tool designed to deal with very large images. Two algorithms performing dataset partition for efficient parallelization in a transparent way are presented together with experimental results proving the effectiveness of the approach that achieves a speedup close to 300×, when both coarse- and fine-grained parallelism are exploited. Multi-level parallelization of TeraStitcher led to a significant reduction of processing times with no changes in the user interface, and with no additional effort required for the maintenance of code.

A novel method for complex three-dimensional evaluation of intraoral scanner accuracy

AIMS

The aim of this study was to compare two existing methods and one novel method for measuring the distortion of three-dimensional (3D) models created with complete-arch digital impressions, and to assess the accuracy of different scan patterns using these methods.

MATERIALS AND METHODS

Maxillary and mandibular models were imaged with the PlanScan intraoral scanner using four different scan patterns. Accuracy and distortion were assessed by comparing the master scans with the intraoral scans using the following three methods: 1) Mean surface deviation was measured after complete arch superimposition; 2) 28 points were selected identically on the experimental and on the master reference models, and the deviation between identical points was assessed after superimposition over the complete arch; 3) In the case of the novel technique, the superimposition was made only at the scanning origin, and after that the 28 points were compared.

RESULTS

Significant differences were found between the three different methods, regardless of the arch and pattern. The overall mean deviation between identical points when the models were aligned at the scanning origin was the highest, and the mean deviation between the non-identical values was the lowest. The novel method revealed local tooth-wise differences between the scan patterns as well as a pattern of amplified model error extending away from the scan origin.

CONCLUSIONS

The novel method better detects the cumulative deviation of stitching errors in complete arch intraoral scans and is suitable to investigate the effect of scanning pattern in a very sensitive manner.

Automatic intraoperative stitching of nonoverlapping cone-beam CT acquisitions

PURPOSE

Cone-beam computed tomography (CBCT) is one of the primary imaging modalities in radiation therapy, dentistry, and orthopedic interventions. While CBCT provides crucial intraoperative information, it is bounded by a limited imaging volume, resulting in reduced effectiveness. This paper introduces an approach allowing real-time intraoperative stitching of overlapping and nonoverlapping CBCT volumes to enable 3D measurements on large anatomical structures.

METHODS

A CBCT-capable mobile C-arm is augmented with a red-green-blue-depth (RGBD) camera. An offline cocalibration of the two imaging modalities results in coregistered video, infrared, and x-ray views of the surgical scene. Then, automatic stitching of multiple small, nonoverlapping CBCT volumes is possible by recovering the relative motion of the C-arm with respect to the patient based on the camera observations. We propose three methods to recover the relative pose: RGB-based tracking of visual markers that are placed near the surgical site, RGBD-based simultaneous localization and mapping (SLAM) of the surgical scene which incorporates both color and depth information for pose estimation, and surface tracking of the patient using only depth data provided by the RGBD sensor.

RESULTS

On an animal cadaver, we show stitching errors as low as 0.33, 0.91, and 1.72 mm when the visual marker, RGBD SLAM, and surface data are used for tracking, respectively.

CONCLUSIONS

The proposed method overcomes one of the major limitations of CBCT C-arm systems by integrating vision-based tracking and expanding the imaging volume without any intraoperative use of calibration grids or external tracking systems. We believe this solution to be most appropriate for 3D intraoperative verification of several orthopedic procedures.

Primary wound closure of diabetic foot ulcers by debridement and stitching

OBJECTIVE

The role of stitching in healing diabetic foot ulcers (DFUs) has little attention, with few reports published on the technique. This study aimed to report on the role of stitching in healing of neuropathic DFUs.

METHOD

This comparative study was between patients with diabetes with neuropathic foot ulcers who had undergone wound stitching and those on conventional wound care. The study was carried in Jabir Abu Eliz Diabetic Center Khartoum (JADC) during between January 1 2011 and January 1 2013. All patients presented with neuropathic diabetic septic foot on the plantar aspect or extending up the leg were included. Initial surgical sharp debridement under intravenous broad spectrum antibiotics was performed and oral antibiotics were given 3 days later after the results of the bacterial culture were received. Regular wound debridement was performed with the aim of pairing the wound edges for stitching. Primary closure was performed when the wound was clean from any necrotic tissues and partial closure when the wound was still oozy to secure drainage and avoid splaying of the wound edges. All patients were using either crutches or wheel chair initially until any sepsis cleared and then proper off-loading by shoes purpose made in our centre.

RESULTS

A 160 patients with neuropathic DFUs that needed debridement and frequent dressing changes as outpatients were included. Both groups had the same tap water wound dressing either daily, every other day or every two days according to the wound progress. Absorbent dressings and negative pressure wound therapy (NPWT) were unavailable. Half of the patients (n=80) had debridement, frequent dressing change using tap water throughout the period of study (group 1) while the rest (n=80) in addition to wound debridement underwent stitching of their wounds (group 2). Complete healing was achieved in 46 patients in Group 1 (57.5%) compared with 19 patients (23%) in group 2 (p=0.001). The average number of dressings used was 19 in stitch group compared with 30 in the non-stitch group (p=0.000). The average duration of healing in stitch group was 2.9 months compared with 5.7 months in non-stitch group (p=0.000).

CONCLUSION

Stitching of neuropathic DFUs reduced the duration of wound healing and the frequency of wound dressing change.

Increasing the field of view in grating based X-ray phase contrast imaging using stitched gratings

Grating based X-ray differential phase contrast imaging (DPCI) allows for high contrast imaging of materials with similar absorption characteristics. In the last years' publications, small animals or parts of the human body like breast, hand, joints or blood vessels have been studied. Larger objects could not be investigated due to the restricted field of view limited by the available grating area. In this paper, we report on a new stitching method to increase the grating area significantly: individual gratings are merged on a carrier substrate. Whereas the grating fabrication process is based on the LIGA technology (X-ray lithography and electroplating) different cutting and joining methods have been evaluated. First imaging results using a 2×2 stitched analyzer grating in a Talbot-Lau interferometer have been generated using a conventional polychromatic X-ray source. The image quality and analysis confirm the high potential of the stitching method to increase the field of view considerably.

Intraoperative on-the-fly organ-mosaicking for laparoscopic surgery

The goal of computer-assisted surgery is to provide the surgeon with guidance during an intervention, e.g., using augmented reality. To display preoperative data, soft tissue deformations that occur during surgery have to be taken into consideration. Laparoscopic sensors, such as stereo endoscopes, can be used to create a three-dimensional reconstruction of stereo frames for registration. Due to the small field of view and the homogeneous structure of tissue, reconstructing just one frame, in general, will not provide enough detail to register preoperative data, since every frame only contains a part of an organ surface. A correct assignment to the preoperative model is possible only if the patch geometry can be unambiguously matched to a part of the preoperative surface. We propose and evaluate a system that combines multiple smaller reconstructions from different viewpoints to segment and reconstruct a large model of an organ. Using graphics processing unit-based methods, we achieved four frames per second. We evaluated the system with in silico, phantom, ex vivo, and in vivo (porcine) data, using different methods for estimating the camera pose (optical tracking, iterative closest point, and a combination). The results indicate that the proposed method is promising for on-the-fly organ reconstruction and registration.