The forensic holodeck - Recommendations after 8 years of experience for additional equipment to document VR applications

FATAL: A Forensic AuTopsy Annotation tooL for digital recording of autopsy findings

The findings from forensic autopsies, where cause of death must be established and reported to legal authorities, are reported in paper-based formats. Practitioners are required to map 3D injury findings to 2D space. Here, we design and describe a digital Forensic AuTopsy Annotation tooL (FATAL), that can be used by practitioners to record systematically detailed autopsy findings onto an interactive 3D body model. We employ a user-centred design process involving an expert forensic medicine team. We describe the iteration process and the final functionality determined, based on in-depth analyses of forensic clinical workflows, and feedback on the types of complex cases confronting practitioners. FATAL functions include freehand drawing, a layer system for injury categorisation, trajectory plotting, surface area markings, and point-of-interest marking. Relevant external images, such as investigative report or autopsy photographs, can be loaded into the FATAL tool and assigned to individual annotations. The application streamlines workflows, supports template-driven documentation, and collates all forensic data into a single interface. Findings from the digital tool can be exported to a 2D report (PDF). We highlight the advancements in accuracy, efficiency, and reproducibility afforded by a digital tool for forensic autopsy documentation. Potential applications in forensic medical examinations beyond autopsies are described, along with specific areas for extension, such as supporting touch screen and pen inputs, export for 3D printing models and extending the tool's compatibility with custom 3D body models.

The role of a digital twin in supporting criminal investigations - a case report about a possible abuse

As part of a comprehensive analysis, this case report presents a possible case of child maltreatment that can serve as a basis for forensic and medical examiner investigations. This case concerns the death of an infant who was approximately two months old. During a routine examination by the pediatrician at the end of May 2021, the child was found to have a normal head circumference of 31 cm. No other abnormalities were noted. On June 19, 2021, the child died, and an autopsy revealed a head circumference of 44 cm and a subdural hematoma as the cause of death. Questions arose as to who might have abused the child and when. The only evidence was a low-quality cell phone video taken by the child's parents on June 13, 2021, six days before the child's death, in which the child could be seen lying on a pillow. It was necessary to determine whether the child in this video already had an unnatural head circumference. This study presents a novel workflow that demonstrates how to analyze and deal with low quality video to answer questions like the above. The workflow demonstrates the creation of 3D scenes from digital image and video material. These 3D scenes can be used for object measurement and to support forensic and medical investigations. In the present case, where only low quality smartphone images were available, the presented workflow was used to create a 3D scene of the child lying on the pillow. In this 3D scene, it was possible to determine the child's head circumference. These measurements support the findings of the medical examiner (dated June 24, 2021) and confirm the suspicion that possible child abuse had already taken place on June 13, 2021. The innovative approach makes it possible to identify evidence of possible abuse based on a specific point in time, in this case the child's private footage. It also demonstrates the potential of 3D scene reconstruction in complex forensic and medical scenarios.

A Virtual, 3D Multimodal Approach to Victim and Crime Scene Reconstruction

In the last two decades, forensic pathology and crime scene investigations have seen a rapid increase in examination tools due to the implementation of several imaging techniques, e.g., CT and MR scanning, surface scanning and photogrammetry. These tools encompass relatively simple visualization tools to powerful instruments for performing virtual 3D crime scene reconstructions. A multi-modality and multiscale approach to a crime scene, where 3D models of victims and the crime scene are combined, offers several advantages. A permanent documentation of all evidence in a single 3D environment can be used during the investigation phases (e.g., for testing hypotheses) or during the court procedures (e.g., to visualize the scene and the victim in a more intuitive manner). Advanced computational approaches to understand what might have happened during a crime can also be applied by, e.g., performing a virtual animation of the victim in the actual context, which can provide important information about possible dynamics during the event. Here, we present an overview of the different techniques and modalities used in forensic pathology in conjunction with crime scene investigations. Based on our experiences, the advantages and challenges of an image-based multi-modality approach will be discussed, including how their use may introduce new visualization modalities in court, e.g., virtual reality (VR) and 3D printing. Finally, considerations about future directions in research will be mentioned.

Augmented reality in forensics and forensic medicine - Current status and future prospects

Forensic investigations require a vast variety of knowledge and expertise of each specialist involved. With the increase in digitization and advanced technical possibilities, the traditional use of a computer with a screen for visualization and a mouse and keyboard for interactions has limitations, especially when visualizing the content in relation to the real world. Augmented reality (AR) can be used in such instances to support investigators in various tasks at the scene as well as later in the investigation process. In this article, we present current applications of AR in forensics and forensic medicine, the technological basics of AR, and the advantages that AR brings for forensic investigations. Furthermore, we will have a brief look at other fields of application and at future developments of AR in forensics.

Identification parade in immersive virtual reality - A technical setup

Virtual Reality (VR) has sparked interest within the forensic community, where it is currently used for training purposes and in variety of forensic scenarios. In combination with efficient and user friendly full body 3-Dimensional (3D) documentation methods, VR visualisations present a viable tool for suspect witness identification. The well-known procedure of placing several persons in a room with a one-way-mirror, along with a witness on the other side of the mirror has practical disadvantages. The primary concern implicates the witness(s) and person(s) of interest coming face-to-face prior to the line-up, combined with finding sufficient persons to include within the line-up. Although image identification using printed paper partially resolved this problem, features such as body stature also marks an issue for the recognition and identification process. To test whether VR provides the technical capabilities to perform an identification parade, a total of 15 subjects were 3D documented using the multi-camera device "Photobox". From this group, one of the documented persons then interrupted a lecture, where consequently, the students were asked afterwards to identify the same person in VR and paper identification sets. It was found that the participating students were able to identify the "suspect" in both datasets. The results imply that VR technology allow users to identify persons. However, as this is a preliminary study the similarity problem was not analysed in this paper and requires further investigation to demonstrate the robustness of this approach.