Open access image repositories: high-quality data to enable machine learning research

Individual identification in acoustic recordings

Recent advances in bioacoustics combined with acoustic individual identification (AIID) could open frontiers for ecological and evolutionary research because traditional methods of identifying individuals are invasive, expensive, labor-intensive, and potentially biased. Despite overwhelming evidence that most taxa have individual acoustic signatures, the application of AIID remains challenging and uncommon. Furthermore, the methods most commonly used for AIID are not compatible with many potential AIID applications. Deep learning in adjacent disciplines suggests opportunities to advance AIID, but such progress is limited by training data. We suggest that broadscale implementation of AIID is achievable, but researchers should prioritize methods that maximize the potential applications of AIID, and develop case studies with easy taxa at smaller spatiotemporal scales before progressing to more difficult scenarios.

A practical guide to bioimaging research data management in core facilities

Bioimage data are generated in diverse research fields throughout the life and biomedical sciences. Its potential for advancing scientific progress via modern, data-driven discovery approaches reaches beyond disciplinary borders. To fully exploit this potential, it is necessary to make bioimaging data, in general, multidimensional microscopy images and image series, FAIR, that is, findable, accessible, interoperable and reusable. These FAIR principles for research data management are now widely accepted in the scientific community and have been adopted by funding agencies, policymakers and publishers. To remain competitive and at the forefront of research, implementing the FAIR principles into daily routines is an essential but challenging task for researchers and research infrastructures. Imaging core facilities, well-established providers of access to imaging equipment and expertise, are in an excellent position to lead this transformation in bioimaging research data management. They are positioned at the intersection of research groups, IT infrastructure providers, the institution´s administration, and microscope vendors. In the frame of German BioImaging - Society for Microscopy and Image Analysis (GerBI-GMB), cross-institutional working groups and third-party funded projects were initiated in recent years to advance the bioimaging community's capability and capacity for FAIR bioimage data management. Here, we provide an imaging-core-facility-centric perspective outlining the experience and current strategies in Germany to facilitate the practical adoption of the FAIR principles closely aligned with the international bioimaging community. We highlight which tools and services are ready to be implemented and what the future directions for FAIR bioimage data have to offer.

Imaging of Solid Pulmonary Nodules

Early detection with accurate classification of solid pulmonary nodules is critical in reducing lung cancer morbidity and mortality. Computed tomography (CT) remains the most widely used imaging examination for pulmonary nodule evaluation; however, other imaging modalities, such as PET/CT and MRI, are increasingly used for nodule characterization. Current advances in solid nodule imaging are largely due to developments in machine learning, including automated nodule segmentation and computer-aided detection. This review explores current multi-modality solid pulmonary nodule detection and characterization with discussion of radiomics and risk prediction models.

Disparities in the Demographic Composition of The Cancer Imaging Archive

Purpose To characterize the demographic distribution of The Cancer Imaging Archive (TCIA) studies and compare them with those of the U.S. cancer population. Materials and Methods In this retrospective study, data from TCIA studies were examined for the inclusion of demographic information. Of 189 studies in TCIA up until April 2023, a total of 83 human cancer studies were found to contain supporting demographic data. The median patient age and the sex, race, and ethnicity proportions of each study were calculated and compared with those of the U.S. cancer population, provided by the Surveillance, Epidemiology, and End Results Program and the Centers for Disease Control and Prevention U.S. Cancer Statistics Data Visualizations Tool. Results The median age of TCIA patients was found to be 6.84 years lower than that of the U.S. cancer population (P = .047) and contained more female than male patients (53% vs 47%). American Indian and Alaska Native, Black or African American, and Hispanic patients were underrepresented in TCIA studies by 47.7%, 35.8%, and 14.7%, respectively, compared with the U.S. cancer population. Conclusion The results demonstrate that the patient demographics of TCIA data sets do not reflect those of the U.S. cancer population, which may decrease the generalizability of artificial intelligence radiology tools developed using these imaging data sets. Keywords: Ethics, Meta-Analysis, Health Disparities, Cancer Health Disparities, Machine Learning, Artificial Intelligence, Race, Ethnicity, Sex, Age, Bias Published under a CC BY 4.0 license.

Weakly supervised segmentation models as explainable radiological classifiers for lung tumour detection on CT images

PURPOSE

Interpretability is essential for reliable convolutional neural network (CNN) image classifiers in radiological applications. We describe a weakly supervised segmentation model that learns to delineate the target object, trained with only image-level labels ("image contains object" or "image does not contain object"), presenting a different approach towards explainable object detectors for radiological imaging tasks.

METHODS

A weakly supervised Unet architecture (WSUnet) was trained to learn lung tumour segmentation from image-level labelled data. WSUnet generates voxel probability maps with a Unet and then constructs an image-level prediction by global max-pooling, thereby facilitating image-level training. WSUnet's voxel-level predictions were compared to traditional model interpretation techniques (class activation mapping, integrated gradients and occlusion sensitivity) in CT data from three institutions (training/validation: n = 412; testing: n = 142). Methods were compared using voxel-level discrimination metrics and clinical value was assessed with a clinician preference survey on data from external institutions.

RESULTS

Despite the absence of voxel-level labels in training, WSUnet's voxel-level predictions localised tumours precisely in both validation (precision: 0.77, 95% CI: [0.76-0.80]; dice: 0.43, 95% CI: [0.39-0.46]), and external testing (precision: 0.78, 95% CI: [0.76-0.81]; dice: 0.33, 95% CI: [0.32-0.35]). WSUnet's voxel-level discrimination outperformed the best comparator in validation (area under precision recall curve (AUPR): 0.55, 95% CI: [0.49-0.56] vs. 0.23, 95% CI: [0.21-0.25]) and testing (AUPR: 0.40, 95% CI: [0.38-0.41] vs. 0.36, 95% CI: [0.34-0.37]). Clinicians preferred WSUnet predictions in most instances (clinician preference rate: 0.72 95% CI: [0.68-0.77]).

CONCLUSION

Weakly supervised segmentation is a viable approach by which explainable object detection models may be developed for medical imaging.

CRITICAL RELEVANCE STATEMENT

WSUnet learns to segment images at voxel level, training only with image-level labels. A Unet backbone first generates a voxel-level probability map and then extracts the maximum voxel prediction as the image-level prediction. Thus, training uses only image-level annotations, reducing human workload. WSUnet's voxel-level predictions provide a causally verifiable explanation for its image-level prediction, improving interpretability.

KEY POINTS

• Explainability and interpretability are essential for reliable medical image classifiers. • This study applies weakly supervised segmentation to generate explainable image classifiers. • The weakly supervised Unet inherently explains its image-level predictions at voxel level.

medigan: a Python library of pretrained generative models for medical image synthesis

Purpose

Deep learning has shown great promise as the backbone of clinical decision support systems. Synthetic data generated by generative models can enhance the performance and capabilities of data-hungry deep learning models. However, there is (1) limited availability of (synthetic) datasets and (2) generative models are complex to train, which hinders their adoption in research and clinical applications. To reduce this entry barrier, we explore generative model sharing to allow more researchers to access, generate, and benefit from synthetic data.

Approach

We propose medigan, a one-stop shop for pretrained generative models implemented as an open-source framework-agnostic Python library. After gathering end-user requirements, design decisions based on usability, technical feasibility, and scalability are formulated. Subsequently, we implement medigan based on modular components for generative model (i) execution, (ii) visualization, (iii) search & ranking, and (iv) contribution. We integrate pretrained models with applications across modalities such as mammography, endoscopy, x-ray, and MRI.

Results

The scalability and design of the library are demonstrated by its growing number of integrated and readily-usable pretrained generative models, which include 21 models utilizing nine different generative adversarial network architectures trained on 11 different datasets. We further analyze three medigan applications, which include (a) enabling community-wide sharing of restricted data, (b) investigating generative model evaluation metrics, and (c) improving clinical downstream tasks. In (b), we extract Fréchet inception distances (FID) demonstrating FID variability based on image normalization and radiology-specific feature extractors.

Conclusion

medigan allows researchers and developers to create, increase, and domain-adapt their training data in just a few lines of code. Capable of enriching and accelerating the development of clinical machine learning models, we show medigan's viability as platform for generative model sharing. Our multimodel synthetic data experiments uncover standards for assessing and reporting metrics, such as FID, in image synthesis studies.

The Importance of Quality Assurance in Radiation Oncology Clinical Trials

Clinical trials have been the center of progress in modern medicine. In oncology, we are fortunate to have a structure in place through the National Clinical Trials Network (NCTN). The NCTN provides the infrastructure and a forum for scientific discussion to develop clinical concepts for trial design. The NCTN also provides a network group structure to administer trials for successful trial management and outcome analyses. There are many important aspects to trial design and conduct. Modern trials need to ensure appropriate trial conduct and secure data management processes. Of equal importance is the quality assurance of a clinical trial. If progress is to be made in oncology clinical medicine, investigators and patient care providers of service need to feel secure that trial data is complete, accurate, and well-controlled in order to be confident in trial analysis and move trial outcome results into daily practice. As our technology has matured, so has our need to apply technology in a uniform manner for appropriate interpretation of trial outcomes. In this article, we review the importance of quality assurance in clinical trials involving radiation therapy. We will include important aspects of institution and investigator credentialing for participation as well as ongoing processes to ensure that each trial is being managed in a compliant manner. We will provide examples of the importance of complete datasets to ensure study interpretation. We will describe how successful strategies for quality assurance in the past will support new initiatives moving forward.

Systematic review of artificial intelligence tack in preventive orthopaedics: is the land coming soon?

PURPOSE

This study aims to describe and assess the current stage of the artificial intelligence (AI) technology integration in preventive orthopaedics of the knee and hip joints.

MATERIALS AND METHODS

The study was conducted in strict compliance with the Preferred Reporting Items for Systematic Reviews and Meta-Analysis (PRISMA) statement. Literature databases were searched for articles describing the development and validation of AI models aimed at diagnosing knee or hip joint pathologies or predicting their development or course in patients. The quality of the included articles was assessed using the Quality Assessment of Diagnostic Accuracy Studies (QUADAS-2) and QUADAS-AI tools.

RESULTS

56 articles were found that meet all the inclusion criteria. We identified two problems that block the full integration of AI into the routine of an orthopaedic physician. The first of them is related to the insufficient amount, variety and quality of data for training, and validation and testing of AI models. The second problem is the rarity of rational evaluation of models, which is why their real quality cannot always be evaluated.

CONCLUSION

The vastness and relevance of the studied topic are beyond doubt. Qualitative and optimally validated models exist in all four scopes considered. Additional optimization and confirmation of the models' quality on various datasets are the last technical stumbling blocks for creating usable software and integrating them into the routine of an orthopaedic physician.

NeuroLINCS Proteomics: Defining human-derived iPSC proteomes and protein signatures of pluripotency

The National Institute of Health (NIH) Library of integrated network-based cellular signatures (LINCS) program is premised on the generation of a publicly available data resource of cell-based biochemical responses or "signatures" to genetic or environmental perturbations. NeuroLINCS uses human inducible pluripotent stem cells (hiPSCs), derived from patients and healthy controls, and differentiated into motor neuron cell cultures. This multi-laboratory effort strives to establish i) robust multi-omic workflows for hiPSC and differentiated neuronal cultures, ii) public annotated data sets and iii) relevant and targetable biological pathways of spinal muscular atrophy (SMA) and amyotrophic lateral sclerosis (ALS). Here, we focus on the proteomics and the quality of the developed workflow of hiPSC lines from 6 individuals, though epigenomics and transcriptomics data are also publicly available. Known and commonly used markers representing 73 proteins were reproducibly quantified with consistent expression levels across all hiPSC lines. Data quality assessments, data levels and metadata of all 6 genetically diverse human iPSCs analysed by DIA-MS are parsable and available as a high-quality resource to the public.

Artificial intelligence in breast cancer imaging: risk stratification, lesion detection and classification, treatment planning and prognosis-a narrative review

The advent of artificial intelligence (AI) represents a real game changer in today's landscape of breast cancer imaging. Several innovative AI-based tools have been developed and validated in recent years that promise to accelerate the goal of real patient-tailored management. Numerous studies confirm that proper integration of AI into existing clinical workflows could bring significant benefits to women, radiologists, and healthcare systems. The AI-based approach has proved particularly useful for developing new risk prediction models that integrate multi-data streams for planning individualized screening protocols. Furthermore, AI models could help radiologists in the pre-screening and lesion detection phase, increasing diagnostic accuracy, while reducing workload and complications related to overdiagnosis. Radiomics and radiogenomics approaches could extrapolate the so-called imaging signature of the tumor to plan a targeted treatment. The main challenges to the development of AI tools are the huge amounts of high-quality data required to train and validate these models and the need for a multidisciplinary team with solid machine-learning skills. The purpose of this article is to present a summary of the most important AI applications in breast cancer imaging, analyzing possible challenges and new perspectives related to the widespread adoption of these new tools.

Quantitative approaches in clinical reproductive endocrinology

Understanding the human hypothalamic-pituitary-gonadal (HPG) axis presents a major challenge for medical science. Dysregulation of the HPG axis is linked to infertility and a thorough understanding of its dynamic behaviour is necessary to both aid diagnosis and to identify the most appropriate hormonal interventions. Here, we review how quantitative models are being used in the context of clinical reproductive endocrinology to: 1. analyse the secretory patterns of reproductive hormones; 2. evaluate the effect of drugs in fertility treatment; 3. aid in the personalization of assisted reproductive technology (ART). In this review, we demonstrate that quantitative models are indispensable tools enabling us to describe the complex dynamic behaviour of the reproductive axis, refine the treatment of fertility disorders, and predict clinical intervention outcomes.

Artificial intelligence and machine learning in cancer imaging

An increasing array of tools is being developed using artificial intelligence (AI) and machine learning (ML) for cancer imaging. The development of an optimal tool requires multidisciplinary engagement to ensure that the appropriate use case is met, as well as to undertake robust development and testing prior to its adoption into healthcare systems. This multidisciplinary review highlights key developments in the field. We discuss the challenges and opportunities of AI and ML in cancer imaging; considerations for the development of algorithms into tools that can be widely used and disseminated; and the development of the ecosystem needed to promote growth of AI and ML in cancer imaging.

Radiation Oncology: Future Vision for Quality Assurance and Data Management in Clinical Trials and Translational Science

The future of radiation oncology is exceptionally strong as we are increasingly involved in nearly all oncology disease sites due to extraordinary advances in radiation oncology treatment management platforms and improvements in treatment execution. Due to our technology and consistent accuracy, compressed radiation oncology treatment strategies are becoming more commonplace secondary to our ability to successfully treat tumor targets with increased normal tissue avoidance. In many disease sites including the central nervous system, pulmonary parenchyma, liver, and other areas, our service is redefining the standards of care. Targeting of disease has improved due to advances in tumor imaging and application of integrated imaging datasets into sophisticated planning systems which can optimize volume driven plans created by talented personnel. Treatment times have significantly decreased due to volume driven arc therapy and positioning is secured by real time imaging and optical tracking. Normal tissue exclusion has permitted compressed treatment schedules making treatment more convenient for the patient. These changes require additional study to further optimize care. Because data exchange worldwide have evolved through digital platforms and prisms, images and radiation datasets worldwide can be shared/reviewed on a same day basis using established de-identification and anonymization methods. Data storage post-trial completion can co-exist with digital pathomic and radiomic information in a single database coupled with patient specific outcome information and serve to move our translational science forward with nimble query elements and artificial intelligence to ask better questions of the data we collect and collate. This will be important moving forward to validate our process improvements at an enterprise level and support our science. We have to be thorough and complete in our data acquisition processes, however if we remain disciplined in our data management plan, our field can grow further and become more successful generating new standards of care from validated datasets.

Deep Learning-Based Image Reconstruction for Different Medical Imaging Modalities

Image reconstruction in magnetic resonance imaging (MRI) and computed tomography (CT) is a mathematical process that generates images at many different angles around the patient. Image reconstruction has a fundamental impact on image quality. In recent years, the literature has focused on deep learning and its applications in medical imaging, particularly image reconstruction. Due to the performance of deep learning models in a wide variety of vision applications, a considerable amount of work has recently been carried out using image reconstruction in medical images. MRI and CT appear as the ultimate scientifically appropriate imaging mode for identifying and diagnosing different diseases in this ascension age of technology. This study demonstrates a number of deep learning image reconstruction approaches and a comprehensive review of the most widely used different databases. We also give the challenges and promising future directions for medical image reconstruction.

A deep learning model for molecular label transfer that enables cancer cell identification from histopathology images

Deep-learning classification systems have the potential to improve cancer diagnosis. However, development of these computational approaches so far depends on prior pathological annotations and large training datasets. The manual annotation is low-resolution, time-consuming, highly variable and subject to observer variance. To address this issue, we developed a method, H&E Molecular neural network (HEMnet). HEMnet utilizes immunohistochemistry as an initial molecular label for cancer cells on a H&E image and trains a cancer classifier on the overlapping clinical histopathological images. Using this molecular transfer method, HEMnet successfully generated and labeled 21,939 tumor and 8782 normal tiles from ten whole-slide images for model training. After building the model, HEMnet accurately identified colorectal cancer regions, which achieved 0.84 and 0.73 of ROC AUC values compared to p53 staining and pathological annotations, respectively. Our validation study using histopathology images from TCGA samples accurately estimated tumor purity, which showed a significant correlation (regression coefficient of 0.8) with the estimation based on genomic sequencing data. Thus, HEMnet contributes to addressing two main challenges in cancer deep-learning analysis, namely the need to have a large number of images for training and the dependence on manual labeling by a pathologist. HEMnet also predicts cancer cells at a much higher resolution compared to manual histopathologic evaluation. Overall, our method provides a path towards a fully automated delineation of any type of tumor so long as there is a cancer-oriented molecular stain available for subsequent learning. Software, tutorials and interactive tools are available at: https://github.com/BiomedicalMachineLearning/HEMnet.

Deep Learning in Large and Multi-Site Structural Brain MR Imaging Datasets

Large, multi-site, heterogeneous brain imaging datasets are increasingly required for the training, validation, and testing of advanced deep learning (DL)-based automated tools, including structural magnetic resonance (MR) image-based diagnostic and treatment monitoring approaches. When assembling a number of smaller datasets to form a larger dataset, understanding the underlying variability between different acquisition and processing protocols across the aggregated dataset (termed “batch effects”) is critical. The presence of variation in the training dataset is important as it more closely reflects the true underlying data distribution and, thus, may enhance the overall generalizability of the tool. However, the impact of batch effects must be carefully evaluated in order to avoid undesirable effects that, for example, may reduce performance measures. Batch effects can result from many sources, including differences in acquisition equipment, imaging technique and parameters, as well as applied processing methodologies. Their impact, both beneficial and adversarial, must be considered when developing tools to ensure that their outputs are related to the proposed clinical or research question (i.e., actual disease-related or pathological changes) and are not simply due to the peculiarities of underlying batch effects in the aggregated dataset. We reviewed applications of DL in structural brain MR imaging that aggregated images from neuroimaging datasets, typically acquired at multiple sites. We examined datasets containing both healthy control participants and patients that were acquired using varying acquisition protocols. First, we discussed issues around Data Access and enumerated the key characteristics of some commonly used publicly available brain datasets. Then we reviewed methods for correcting batch effects by exploring the two main classes of approaches: Data Harmonization that uses data standardization, quality control protocols or other similar algorithms and procedures to explicitly understand and minimize unwanted batch effects; and Domain Adaptation that develops DL tools that implicitly handle the batch effects by using approaches to achieve reliable and robust results. In this narrative review, we highlighted the advantages and disadvantages of both classes of DL approaches, and described key challenges to be addressed in future studies.

Radiomics in prostate cancer: an up-to-date review

Prostate cancer (PCa) is the most common worldwide diagnosed malignancy in male population. The diagnosis, the identification of aggressive disease, and the post-treatment follow-up needs a more comprehensive and holistic approach. Radiomics is the extraction and interpretation of images phenotypes in a quantitative manner. Radiomics may give an advantage through advancements in imaging modalities and through the potential power of artificial intelligence techniques by translating those features into clinical outcome prediction. This article gives an overview on the current evidence of methodology and reviews the available literature on radiomics in PCa patients, highlighting its potential for personalized treatment and future applications.

Data Sharing of Imaging in an Evolving Health Care World: Report of the ACR Data Sharing Workgroup Part 2: Annotation, Curation, and Contracting

A core principle of ethical data sharing is maintaining the security and anonymity of the data, and care must be taken to ensure medical records and images cannot be reidentified to be traced back to patients or misconstrued as a breach in the trust between health care providers and patients. Once those principles have been observed, those seeking to share data must take the appropriate steps to curate the data in a way that organizes the clinically relevant information so as to be useful to the data sharing party, assesses the ensuing value of the data set and its annotations, and informs the data sharing contracts that will govern use of the data. Embarking on a data sharing partnership engenders a host of ethical, practical, technical, legal, and commercial challenges that require a thoughtful, considered approach. In 2019 the ACR convened a Data Sharing Workgroup to develop philosophies around best practices in the sharing of health information. This is Part 2 of a Report on the workgroup's efforts in exploring these issues.

PRISM: A Platform for Imaging in Precision Medicine

PURPOSE

Precision medicine requires an understanding of individual variability, which can only be acquired from large data collections such as those supported by the Cancer Imaging Archive (TCIA). We have undertaken a program to extend the types of data TCIA can support. This, in turn, will enable TCIA to play a key role in precision medicine research by collecting and disseminating high-quality, state-of-the-art, quantitative imaging data that meet the evolving needs of the cancer research community.

METHODS

A modular technology platform is presented that would allow existing data resources, such as TCIA, to evolve into a comprehensive data resource that meets the needs of users engaged in translational research for imaging-based precision medicine. This Platform for Imaging in Precision Medicine (PRISM) helps streamline the deployment and improve TCIA's efficiency and sustainability. More importantly, its inherent modular architecture facilitates a piecemeal adoption by other data repositories.

RESULTS

PRISM includes services for managing radiology and pathology images and features and associated clinical data. A semantic layer is being built to help users explore diverse collections and pool data sets to create specialized cohorts. PRISM includes tools for image curation and de-identification. It includes image visualization and feature exploration tools. The entire platform is distributed as a series of containerized microservices with representational state transfer interfaces.

CONCLUSION

PRISM is helping modernize, scale, and sustain the technology stack that powers TCIA. Repositories can take advantage of individual PRISM services such as de-identification and quality control. PRISM is helping scale image informatics for cancer research at a time when the size, complexity, and demands to integrate image data with other precision medicine data-intensive commons are mounting.

Beyond DNA-targeting in Cancer Chemotherapy. Emerging Frontiers - A Review

Modern anti-cancer drugs target DNA specifically for rapid division of malignant cells. One downside of this approach is that they also target other rapidly dividing healthy cells, such as those involved in hair growth leading to serious toxic side effects and hair loss. Therefore, it would be better to develop novel agents that address cellular signaling mechanisms unique to cancerous cells, and new research is now focussing on such approaches. Although the classical chemotherapy area involving DNA as the set target continues to produce important findings, nevertheless, a distinctly discernible emerging trend is the divergence from the cisplatin operation model that uses the metal as the primary active center of the drug. Many successful anti-cancer drugs present are associated with elevated toxicity levels. Cancers also develop immunity against most therapies and the area of cancer research can, therefore, be seen as an area with a high unaddressed need. Hence, ongoing work into cancer pathogenesis is important to create accurate preclinical tests that can contribute to the development of innovative drugs to manage and treat cancer. Some of the emergent frontiers utilizing different approaches include nanoparticles delivery, use of quantum dots, metal complexes, tumor ablation, magnetic hypothermia and hyperthermia by use of Superparamagnetic Iron oxide Nanostructures, pathomics and radiomics, laser surgery and exosomes. This review summarizes these new approaches in good detail, giving critical views with necessary comparisons. It also delves into what they carry for the future, including their advantages and disadvantages.

Technologic optimization of a virtual disease focused panel during the COVID pandemic and beyond

Since the beginning of the COVID-19 pandemic, several service fields have opted for virtual work as much as possible, in order to decrease the spread of the virus. Although several articles have now addressed the key issues in telecommunications and medical education, none have described the digital or virtual functionality of a professional society disease focused panel (DFP) or inter-institutional collaborations. This is extremely important as we believe that the virtual functioning of the DFP will be the new norm for years to come. In this article, we highlight the limitations in the functioning of DFP brought forth due to the ongoing pandemic, while also providing the digital technologic solutions to adapt and also maintain or increase its productivity.

Practice of Telehealth in Otolaryngology: A Scoping Review in the Era of COVID-19

OBJECTIVE

The COVID-19 pandemic has spurred widespread adoption and advancement in telehealth activities, representing a marked change in otolaryngology practice patterns. The present study undertakes a scoping review of research focused on telehealth in otolaryngology (teleotolaryngology) to identify key themes and commonly utilized outcome measures that will assist future development in this growing field.

DATA SOURCES

PubMed, Embase, and Cochrane databases and reference review.

REVIEW METHODS

Per guidelines of the PRISMA Extension for Scoping Reviews, we performed database queries using a comprehensive search strategy developed in collaboration with research librarians at the Columbia University Irving Medical Center. We identified 596 unique references to undergo title and abstract review by 2 independent reviewers, leaving 439 studies for full-text review.

RESULTS

We included 285 studies for extraction of notable findings, leaving 262 unique studies after accounting for content overlap. We identified core outcome measures, including patient and provider satisfaction, costs and benefits, quality of care, feasibility, and access to care. Publication volume increased markedly over time, though only 4% of studies incorporated randomized study group assignment. Using an iterative approach to thematic development, we organized article content across 5 main themes: (1) exploration of teleotolaryngology evolution, (2) role in virtual clinical encounters, (3) applications in interdisciplinary care and educational initiatives, (4) emerging and innovative technologies, and (5) barriers to implementation.

CONCLUSION

This scoping review of teleotolaryngology documents its evolution and identifies current use cases, limitations, and emerging applications, providing a foundation from which to build future studies, inform policy decision making, and facilitate implementation where appropriate.

Artificial intelligence in child abuse imaging

There have been rapid advances in artificial intelligence (AI) technology in recent years, and the field of diagnostic imaging is no exception. Just as digital technology revolutionized how radiology is practiced, so these new technologies also appear poised to bring sweeping change. As AI tools make the transition from the theoretical to the everyday, important decisions need to be made about how they will be applied and what their role will be in the practice of radiology. Pediatric radiology presents distinct challenges and opportunities for the application of these tools, and in this article we discuss some of these, specifically as they relate to the prediction, identification and investigation of child abuse.

Development and operation of a digital platform for sharing pathology image data

BACKGROUND

Artificial intelligence (AI) research is highly dependent on the nature of the data available. With the steady increase of AI applications in the medical field, the demand for quality medical data is increasing significantly. We here describe the development of a platform for providing and sharing digital pathology data to AI researchers, and highlight challenges to overcome in operating a sustainable platform in conjunction with pathologists.

METHODS

Over 3000 pathological slides from five organs (liver, colon, prostate, pancreas and biliary tract, and kidney) in histologically confirmed tumor cases by pathology departments at three hospitals were selected for the dataset. After digitalizing the slides, tumor areas were annotated and overlaid onto the images by pathologists as the ground truth for AI training. To reduce the pathologists' workload, AI-assisted annotation was established in collaboration with university AI teams.

RESULTS

A web-based data sharing platform was developed to share massive pathological image data in 2019. This platform includes 3100 images, and 5 pre-processing algorithms for AI researchers to easily load images into their learning models.

DISCUSSION

Due to different regulations among countries for privacy protection, when releasing internationally shared learning platforms, it is considered to be most prudent to obtain consent from patients during data acquisition.

CONCLUSIONS

Despite limitations encountered during platform development and model training, the present medical image sharing platform can steadily fulfill the high demand of AI developers for quality data. This study is expected to help other researchers intending to generate similar platforms that are more effective and accessible in the future.

Artificial intelligence and machine learning for medical imaging: A technology review

Artificial intelligence (AI) has recently become a very popular buzzword, as a consequence of disruptive technical advances and impressive experimental results, notably in the field of image analysis and processing. In medicine, specialties where images are central, like radiology, pathology or oncology, have seized the opportunity and considerable efforts in research and development have been deployed to transfer the potential of AI to clinical applications. With AI becoming a more mainstream tool for typical medical imaging analysis tasks, such as diagnosis, segmentation, or classification, the key for a safe and efficient use of clinical AI applications relies, in part, on informed practitioners. The aim of this review is to present the basic technological pillars of AI, together with the state-of-the-art machine learning methods and their application to medical imaging. In addition, we discuss the new trends and future research directions. This will help the reader to understand how AI methods are now becoming an ubiquitous tool in any medical image analysis workflow and pave the way for the clinical implementation of AI-based solutions.

Artificial Intelligence for the Future Radiology Diagnostic Service

Radiology historically has been a leader of digital transformation in healthcare. The introduction of digital imaging systems, picture archiving and communication systems (PACS), and teleradiology transformed radiology services over the past 30 years. Radiology is again at the crossroad for the next generation of transformation, possibly evolving as a one-stop integrated diagnostic service. Artificial intelligence and machine learning promise to offer radiology new powerful new digital tools to facilitate the next transformation. The radiology community has been developing computer-aided diagnosis (CAD) tools based on machine learning (ML) over the past 20 years. Among various AI techniques, deep-learning convolutional neural networks (CNN) and its variants have been widely used in medical image pattern recognition. Since the 1990s, many CAD tools and products have been developed. However, clinical adoption has been slow due to a lack of substantial clinical advantages, difficulties integrating into existing workflow, and uncertain business models. This paper proposes three pathways for AI's role in radiology beyond current CNN based capabilities 1) improve the performance of CAD, 2) improve the productivity of radiology service by AI-assisted workflow, and 3) develop radiomics that integrate the data from radiology, pathology, and genomics to facilitate the emergence of a new integrated diagnostic service.

Prediagnostic Image Data, Artificial Intelligence, and Pancreatic Cancer: A Tell-Tale Sign to Early Detection

Pancreatic cancer continues to be one of the deadliest malignancies and is the third leading cause of cancer-related mortality in the United States. Based on several models, it is projected to become the second leading cause of cancer-related deaths by 2030. Although the overall survival rate for patients diagnosed with pancreatic cancer is less than 10%, survival rates are increasing in those whose cancers are detected at an early stage, when intervention is possible. There are, however, no reliable biomarkers or imaging technology that can detect early-stage pancreatic cancer or accurately identify precursors that are likely to progress to malignancy. The Alliance of Pancreatic Cancer Consortia, a virtual consortium of researchers, clinicians, and advocacies focused on early diagnosis of pancreatic cancer, was formed in 2016 to provide a platform and resources to discover and validate biomarkers and imaging methods for early detection. The focus of discussion at the most recent alliance meeting was on imaging methods and the use of artificial intelligence for early detection of pancreatic cancer.