Do Humans and Deep Convolutional Neural Networks Use Visual Information Similarly for the Categorization of Natural Scenes?

Child face detection on front passenger seat through deep learning

OBJECTIVE

One of the main causes of death worldwide among young people are car crashes, and most of these fatalities occur to children who are seated in the front passenger seat and who, at the time of an accident, receive a direct impact from the airbags, which is lethal for children under 13 years of age. The present study seeks to raise awareness of this risk by interior monitoring with a child face detection system that serves to alert the driver that the child should not be sitting in the front passenger seat.

METHODS

The system incorporates processing of data collected, elements of deep learning such as transfer learning, fine-tunning and facial detection to identify the presence of children in a robust way, which was achieved by training with a dataset generated from scratch for this specific purpose. The MobileNetV2 architecture was used based on the good performance shown when compared with the Inception architecture for this task; and its low computational cost, which facilitates implementing the final model on a Raspberry Pi 4B.

RESULTS

The resulting image dataset consisted of 102 empty seats, 71 children (0-13 years), and 96 adults (14-75 years). From the data augmentation, there were 2,496 images for adults and 2,310 for children. The classification of faces without sliding window gave a result of 98% accuracy and 100% precision. Finally, using the proposed methodology, it was possible to detect children in the front passenger seat in real time, with a delay of 1 s per decision and sliding window criterion, reaching an accuracy of 100%.

CONCLUSIONS

Although our 100% accuracy in an experimental environment is somewhat idealized in that the sensor was not blocked by direct sunlight, nor was it partially or completely covered by dirt or other debris common in vehicles transporting children. The present study showed that is possible the implementation of a robust noninvasive classification system made on Raspberry Pi 4 Model B in any automobile for the detection of a child in the front seat through deep learning methods such as Deep CNN.

Novel applications of Convolutional Neural Networks in the age of Transformers

Convolutional Neural Networks (CNNs) have been central to the Deep Learning revolution and played a key role in initiating the new age of Artificial Intelligence. However, in recent years newer architectures such as Transformers have dominated both research and practical applications. While CNNs still play critical roles in many of the newer developments such as Generative AI, they are far from being thoroughly understood and utilised to their full potential. Here we show that CNNs can recognise patterns in images with scattered pixels and can be used to analyse complex datasets by transforming them into pseudo images with minimal processing for any high dimensional dataset, representing a more general approach to the application of CNNs to datasets such as in molecular biology, text, and speech. We introduce a pipeline called DeepMapper, which allows analysis of very high dimensional datasets without intermediate filtering and dimension reduction, thus preserving the full texture of the data, enabling detection of small variations normally deemed 'noise'. We demonstrate that DeepMapper can identify very small perturbations in large datasets with mostly random variables, and that it is superior in speed and on par in accuracy to prior work in processing large datasets with large numbers of features.

Automatic identification of stone-handling behaviour in Japanese macaques using LabGym artificial intelligence

The latest advances in artificial intelligence technology have opened doors to the video analysis of complex behaviours. In light of this, ethologists are actively exploring the potential of these innovations to streamline the time-intensive behavioural analysis process using video data. Several tools have been developed for this purpose in primatology in the past decade. Nonetheless, each tool grapples with technical constraints. To address these limitations, we have established a comprehensive protocol designed to harness the capabilities of a cutting-edge artificial intelligence-assisted software, LabGym. The primary objective of this study was to evaluate the suitability of LabGym for the analysis of primate behaviour, focusing on Japanese macaques as our model subjects. First, we developed a model that accurately detects Japanese macaques, allowing us to analyse their actions using LabGym. Our behavioural analysis model succeeded in recognising stone-handling-like behaviours on video. However, the absence of quantitative data within the specified time frame limits the ability of our study to draw definitive conclusions regarding the quality of the behavioural analysis. Nevertheless, to the best of our knowledge, this study represents the first instance of applying the LabGym tool specifically for the analysis of primate behaviours, with our model focusing on the automated recognition and categorisation of specific behaviours in Japanese macaques. It lays the groundwork for future research in this promising field to complexify our model using the latest version of LabGym and associated tools, such as multi-class detection and interactive behaviour analysis.

Advancing Diabetic Retinopathy Diagnosis: Leveraging Optical Coherence Tomography Imaging with Convolutional Neural Networks

Diabetic retinopathy (DR) is a vision-threatening complication of diabetes, necessitating early and accurate diagnosis. The combination of optical coherence tomography (OCT) imaging with convolutional neural networks (CNNs) has emerged as a promising approach for enhancing DR diagnosis. OCT provides detailed retinal morphology information, while CNNs analyze OCT images for automated detection and classification of DR. This paper reviews the current research on OCT imaging and CNNs for DR diagnosis, discussing their technical aspects and suitability. It explores CNN applications in detecting lesions, segmenting microaneurysms, and assessing disease severity, showing high sensitivity and accuracy. CNN models outperform traditional methods and rival expert ophthalmologists' results. However, challenges such as dataset availability and model interpretability remain. Future directions include multimodal imaging integration and real-time, point-of-care CNN systems for DR screening. The integration of OCT imaging with CNNs has transformative potential in DR diagnosis, facilitating early intervention, personalized treatments, and improved patient outcomes. Abbreviations: DR = Diabetic Retinopathy, OCT = Optical Coherence Tomography, CNN = Convolutional Neural Network, CMV = Cytomegalovirus, PDR = Proliferative Diabetic Retinopathy, AMD = Age-Related Macular Degeneration, VEGF = vascular endothelial growth factor, RAP = Retinal Angiomatous Proliferation, OCTA = OCT Angiography, AI = Artificial Intelligence.

Luminance and timing control during visual presentation of natural scenes

In the study of visual cognition, accurate control of stimulus presentation is of primary importance yet is complicated by hardware malfunctioning, software variability, and visual materials used. Here, we describe VISTO 2.0, a low-cost and open-source device which is capable to measure the timing and temporal luminance profile of visual stimuli. This device represents a major improvement over VISTO (De Cesarei, Marzocchi, & Loftus, 2021), as it is only sensitive to a light spectrum in the visible range, is easier to assemble, and has a modular design that can be extended to other sensory modalities.