A deep learning approach to quantify auditory hair cells

VASCilia (Vision Analysis StereoCilia): A Napari Plugin for Deep Learning-Based 3D Analysis of Cochlear Hair Cell Stereocilia Bundles

Cochlear hair cell stereocilia bundles are key organelles required for normal hearing. Often, deafness mutations cause aberrant stereocilia heights or morphology that are visually apparent but challenging to quantify. Actin-based structures, stereocilia are easily and most often labeled with phalloidin then imaged with 3D confocal microscopy. Unfortunately, phalloidin non-specifically labels all the actin in the tissue and cells and therefore results in a challenging segmentation task wherein the stereocilia phalloidin signal must be separated from the rest of the tissue. This can require many hours of manual human effort for each 3D confocal image stack. Currently, there are no existing software pipelines that provide an end-to-end automated solution for 3D stereocilia bundle instance segmentation. Here we introduce VASCilia, a Napari plugin designed to automatically generate 3D instance segmentation and analysis of 3D confocal images of cochlear hair cell stereocilia bundles stained with phalloidin. This plugin combines user-friendly manual controls with advanced deep learning-based features to streamline analyses. With VASCilia, users can begin their analysis by loading image stacks. The software automatically preprocesses these samples and displays them in Napari. At this stage, users can select their desired range of z-slices, adjust their orientation, and initiate 3D instance segmentation. After segmentation, users can remove any undesired regions and obtain measurements including volume, centroids, and surface area. VASCilia introduces unique features that measures bundle heights, determines their orientation with respect to planar polarity axis, and quantifies the fluorescence intensity within each bundle. The plugin is also equipped with trained deep learning models that differentiate between inner hair cells and outer hair cells and predicts their tonotopic position within the cochlea spiral. Additionally, the plugin includes a training section that allows other laboratories to fine-tune our model with their own data, provides responsive mechanisms for manual corrections through event-handlers that check user actions, and allows users to share their analyses by uploading a pickle file containing all intermediate results. We believe this software will become a valuable resource for the cochlea research community, which has traditionally lacked specialized deep learning-based tools for obtaining high-throughput image quantitation. Furthermore, we plan to release our code along with a manually annotated dataset that includes approximately 55 3D stacks featuring instance segmentation. This dataset comprises a total of 1,870 instances of hair cells, distributed between 410 inner hair cells and 1,460 outer hair cells, all annotated in 3D. As the first open-source dataset of its kind, we aim to establish a foundational resource for constructing a comprehensive atlas of cochlea hair cell images. Together, this open-source tool will greatly accelerate the analysis of stereocilia bundles and demonstrates the power of deep learning-based algorithms for challenging segmentation tasks in biological imaging research. Ultimately, this initiative will support the development of foundational models adaptable to various species, markers, and imaging scales to advance and accelerate research within the cochlea research community.

PCP auto count: a novel Fiji/ImageJ plug-in for automated quantification of planar cell polarity and cell counting

Introdution: During development, planes of cells give rise to complex tissues and organs. The proper functioning of these tissues is critically dependent on proper inter- and intra-cellular spatial orientation, a feature known as planar cell polarity (PCP). To study the genetic and environmental factors affecting planar cell polarity, investigators must often manually measure cell orientations, which is a time-consuming endeavor. To automate cell counting and planar cell polarity data collection we developed a Fiji/ImageJ plug-in called PCP Auto Count (PCPA). Methods: PCPA analyzes binary images and identifies "chunks" of white pixels that contain "caves" of infiltrated black pixels. For validation, inner ear sensory epithelia including cochleae and utricles from mice were immunostained for βII-spectrin and imaged with a confocal microscope. Images were preprocessed using existing Fiji functionality to enhance contrast, make binary, and reduce noise. An investigator rated PCPA cochlear hair cell angle measurements for accuracy using a one to five agreement scale. For utricle samples, PCPA derived measurements were directly compared against manually derived angle measurements and the concordance correlation coefficient (CCC) and Bland-Altman limits of agreement were calculated. PCPA was also tested against previously published images examining PCP in various tissues and across various species suggesting fairly broad utility. Results: PCPA was able to recognize and count 99.81% of cochlear hair cells, and was able to obtain ideally accurate planar cell polarity measurements for at least 96% of hair cells. When allowing for a <10° deviation from "perfect" measurements, PCPA's accuracy increased to 98%-100% for all users and across all samples. When PCPA's measurements were compared with manual angle measurements for E17.5 utricles there was negligible bias (<0.5°), and a CCC of 0.999. Qualitative examination of example images of Drosophila ommatidia, mouse ependymal cells, and mouse radial progenitors revealed a high level of accuracy for PCPA across a variety of stains, tissue types, and species. Discussion: Altogether, the data suggest that the PCPA plug-in suite is a robust and accurate tool for the automated collection of cell counts and PCP angle measurements.

Large-scale annotated dataset for cochlear hair cell detection and classification

Our sense of hearing is mediated by cochlear hair cells, of which there are two types organized in one row of inner hair cells and three rows of outer hair cells. Each cochlea contains 5-15 thousand terminally differentiated hair cells, and their survival is essential for hearing as they do not regenerate after insult. It is often desirable in hearing research to quantify the number of hair cells within cochlear samples, in both pathological conditions, and in response to treatment. Machine learning can be used to automate the quantification process but requires a vast and diverse dataset for effective training. In this study, we present a large collection of annotated cochlear hair-cell datasets, labeled with commonly used hair-cell markers and imaged using various fluorescence microscopy techniques. The collection includes samples from mouse, rat, guinea pig, pig, primate, and human cochlear tissue, from normal conditions and following in-vivo and in-vitro ototoxic drug application. The dataset includes over 107,000 hair cells which have been identified and annotated as either inner or outer hair cells. This dataset is the result of a collaborative effort from multiple laboratories and has been carefully curated to represent a variety of imaging techniques. With suggested usage parameters and a well-described annotation procedure, this collection can facilitate the development of generalizable cochlear hair-cell detection models or serve as a starting point for fine-tuning models for other analysis tasks. By providing this dataset, we aim to give other hearing research groups the opportunity to develop their own tools with which to analyze cochlear imaging data more fully, accurately, and with greater ease.

PCP Auto Count: A Novel Fiji/ImageJ plug-in for automated quantification of planar cell polarity and cell counting

Background

During development, planes of cells give rise to complex tissues and organs. The proper functioning of these tissues is critically dependent on proper inter- and intra-cellular spatial orientation, a feature known as planar cell polarity (PCP). To study the genetic and environmental factors affecting planar cell polarity investigators must often manually measure cell orientations, which is a time-consuming endeavor.

Methodology

To automate cell counting and planar cell polarity data collection we developed a Fiji/ImageJ plug-in called PCP Auto Count (PCPA). PCPA analyzes binary images and identifies "chunks" of white pixels that contain "caves" of infiltrated black pixels. Inner ear sensory epithelia including cochleae (P4) and utricles (E17.5) from mice were immunostained for βII-spectrin and imaged on a confocal microscope. Images were preprocessed using existing Fiji functionality to enhance contrast, make binary, and reduce noise. An investigator rated PCPA cochlear angle measurements for accuracy using a 1-5 agreement scale. For utricle samples, we directly compared PCPA derived measurements against manually derived angle measurements using concordance correlation coefficients (CCC) and Bland-Altman limits of agreement. Finally, PCPA was tested against a variety of images copied from publications examining PCP in various tissues and across various species.

Results

PCPA was able to recognize and count 99.81% of cochlear hair cells (n = 1,1541 hair cells) in a sample set, and was able to obtain ideally accurate planar cell polarity measurements for over 96% of hair cells. When allowing for a <10° deviation from "perfect" measurements, PCPA's accuracy increased to >98%. When manual angle measurements for E17.5 utricles were compared, PCPA's measurements fell within -9 to +10 degrees of manually obtained mean angle measures with a CCC of 0.999. Qualitative examination of example images of Drosophila ommatidia, mouse ependymal cells, and mouse radial progenitors revealed a high level of accuracy for PCPA across a variety of stains, tissue types, and species. Altogether, the data suggest that the PCPA plug-in suite is a robust and accurate tool for the automated collection of cell counts and PCP angle measurements.

Exogenous humanin and MOTS-c function as protective agents against gentamicin-induced hair cell damage

Loss of hair cells can lead to irreversible sensorineural hearing loss. Therefore, hair cell preservation is critical for hearing. Mitochondrial derived peptides (MDPs) are bioactive peptides and prominent members of this family are humanin (HN) and the mitochondrial-open-reading frame of the twelve S c (MOTS-c). The protective roles of HN and MOTS-c in age-related diseases and in various tissues exposed to cellular stresses have been demonstrated. The involvement of MDPs in the inner ear remains to be investigated. Therefore, we determined the expression of rattin, the homolog of humanin, in inner ear tissues. Then, we found that HN and MOTS-c showed a significant protective effect on hair cells in organ of Corti explants exposed to gentamicin. Treatment with HN decreased gentamicin-induced phosphorylation of AKT, whereas treatment with MOTS-c increased phosphorylation of AMPKα in explants. Our data indicate that MDPs exert a protective function in gentamicin-induced hair cell damage. Therefore, MDPs may contribute to design new preventive strategies against hearing loss.

Large-scale annotated dataset for cochlear hair cell detection and classification

Our sense of hearing is mediated by cochlear hair cells, localized within the sensory epithelium called the organ of Corti. There are two types of hair cells in the cochlea, which are organized in one row of inner hair cells and three rows of outer hair cells. Each cochlea contains a few thousands of hair cells, and their survival is essential for our perception of sound because they are terminally differentiated and do not regenerate after insult. It is often desirable in hearing research to quantify the number of hair cells within cochlear samples, in both pathological conditions, and in response to treatment. However, the sheer number of cells along the cochlea makes manual quantification impractical. Machine learning can be used to overcome this challenge by automating the quantification process but requires a vast and diverse dataset for effective training. In this study, we present a large collection of annotated cochlear hair-cell datasets, labeled with commonly used hair-cell markers and imaged using various fluorescence microscopy techniques. The collection includes samples from mouse, human, pig and guinea pig cochlear tissue, from normal conditions and following in-vivo and in-vitro ototoxic drug application. The dataset includes over 90'000 hair cells, all of which have been manually identified and annotated as one of two cell types: inner hair cells and outer hair cells. This dataset is the result of a collaborative effort from multiple laboratories and has been carefully curated to represent a variety of imaging techniques. With suggested usage parameters and a well-described annotation procedure, this collection can facilitate the development of generalizable cochlear hair cell detection models or serve as a starting point for fine-tuning models for other analysis tasks. By providing this dataset, we aim to supply other groups within the hearing research community with the opportunity to develop their own tools with which to analyze cochlear imaging data more fully, accurately, and with greater ease.

Artificial Intelligence and Machine (Deep) Learning in Otorhinolaryngology: A Bibliometric Analysis Based on VOSviewer and CiteSpace

BACKGROUND

Otorhinolaryngology diseases are well suited for artificial intelligence (AI)-based interpretation. The use of AI, particularly AI based on deep learning (DL), in the treatment of human diseases is becoming more and more popular. However, there are few bibliometric analyses that have systematically studied this field.

OBJECTIVE

The objective of this study was to visualize the research hot spots and trends of AI and DL in ENT diseases through bibliometric analysis to help researchers understand the future development of basic and clinical research.

METHODS

In all, 232 articles and reviews were retrieved from The Web of Science Core Collection. Using CiteSpace and VOSviewer software, countries, institutions, authors, references, and keywords in the field were visualized and examined.

RESULTS

The majority of these papers came from 44 nations and 498 institutions, with China and the United States leading the way. Common diseases used by AI in ENT include otosclerosis, otitis media, nasal polyps, sinusitis, and so on. In the early years, research focused on the analysis of hearing and articulation disorders, and in recent years mainly on the diagnosis, localization, and grading of diseases.

CONCLUSIONS

The analysis shows the periodical hot spots and development direction of AI and DL application in ENT diseases from the time dimension. The diagnosis and prognosis of otolaryngology diseases and the analysis of otolaryngology endoscopic images have been the focus of current research and the development trend of future.

The hair cell analysis toolbox is a precise and fully automated pipeline for whole cochlea hair cell quantification

Our sense of hearing is mediated by sensory hair cells, precisely arranged and highly specialized cells subdivided into outer hair cells (OHCs) and inner hair cells (IHCs). Light microscopy tools allow for imaging of auditory hair cells along the full length of the cochlea, often yielding more data than feasible to manually analyze. Currently, there are no widely applicable tools for fast, unsupervised, unbiased, and comprehensive image analysis of auditory hair cells that work well either with imaging datasets containing an entire cochlea or smaller sampled regions. Here, we present a highly accurate machine learning-based hair cell analysis toolbox (HCAT) for the comprehensive analysis of whole cochleae (or smaller regions of interest) across light microscopy imaging modalities and species. The HCAT is a software that automates common image analysis tasks such as counting hair cells, classifying them by subtype (IHCs versus OHCs), determining their best frequency based on their location along the cochlea, and generating cochleograms. These automated tools remove a considerable barrier in cochlear image analysis, allowing for faster, unbiased, and more comprehensive data analysis practices. Furthermore, HCAT can serve as a template for deep learning-based detection tasks in other types of biological tissue: With some training data, HCAT's core codebase can be trained to develop a custom deep learning detection model for any object on an image.

Performance Comparison of Five Methods for Tetrahymena Number Counting on the ImageJ Platform: Assessing the Built-in Tool and Machine-Learning-Based Extension

Previous methods to measure protozoan numbers mostly rely on manual counting, which suffers from high variation and poor efficiency. Although advanced counting devices are available, the specialized and usually expensive machinery precludes their prevalent utilization in the regular laboratory routine. In this study, we established the ImageJ-based workflow to quantify ciliate numbers in a high-throughput manner. We conducted Tetrahymena number measurement using five different methods: particle analyzer method (PAM), find maxima method (FMM), trainable WEKA segmentation method (TWS), watershed segmentation method (WSM) and StarDist method (SDM), and compared their results with the data obtained from the manual counting. Among the five methods tested, all of them could yield decent results, but the deep-learning-based SDM displayed the best performance for Tetrahymena cell counting. The optimized methods reported in this paper provide scientists with a convenient tool to perform cell counting for Tetrahymena ecotoxicity assessment.