Development and web deployment of an automated neuroradiology MRI protocoling tool with natural language processing

Automated Protocoling for MRI Exams-Challenges and Solutions

Automated protocoling for MRI examinations is an amendable target for workflow automation with artificial intelligence. However, there are still challenges to overcome for a successful and robust approach. These challenges are outlined and analyzed in this work. Through a literature review, we analyzed limitations of currently published approaches for automated protocoling. Then, we assessed these limitations quantitatively based on data from a private radiology practice. For this, we assessed the information content provided by the clinical indication by computing the overlap coefficients for the sets of ICD-10-coded admitting diagnoses of different MRI protocols. Additionally, we assessed the heterogeneity of protocol trees from three different MRI scanners based on the overlap coefficient, on MRI protocol and sequence level. Additionally, we applied sequence name standardization to demonstrate its effect on the heterogeneity assessment, i.e., the overlap coefficient, of different protocol trees. The overlap coefficient for the set of ICD-10-coded admitting diagnoses for different protocols ranges from 0.14 to 0.56 for brain/head MRI exams and 0.04 to 0.57 for spine exams. The overlap coefficient across the set of sequences used at two different scanners increases when applying sequence name standardization (from 0.81/0.86 to 0.93). Automated protocoling for MRI examinations has the potential to reduce the workload for radiologists. However, an automated protocoling approach cannot be solely based on admitting diagnosis as it does not provide sufficient information. Moreover, sequence name standardization increases the overlap coefficient across the set of sequences used at different scanners and therefore facilitates transfer learning.

Deep Learning for Predictive Analysis of Pediatric Otolaryngology Personal Statements: A Pilot Study

OBJECTIVE

The personal statement is often an underutilized aspect of pediatric otolaryngology fellowship applications. In this pilot study, we use deep learning language models to cluster personal statements and elucidate their relationship to applicant rank position and postfellowship research output.

STUDY DESIGN

Retrospective cohort.

SETTING

Single pediatric tertiary care center.

METHODS

Data and personal statements from 115 applicants to our fellowship program were retrieved from San Francisco Match. BERT (Bidirectional Encoder Representations From Transformers) was used to generate document embeddings for clustering. Regression and machine learning models were used to assess the relationship of personal statements to number of postfellowship publications per year when controlling for publications, board scores, Alpha Omega Alpha status, gender, and residency.

RESULTS

Document embeddings of personal statements were found to cluster into 4 distinct groups by K-means clustering: 2 focused on "training/research" and 2 on "personal/patient anecdotes." Training clusters 1 and 2 were associated with an applicant-organization fit by a single pediatric otolaryngology fellowship program on univariate but not multivariate analysis. Models utilizing document embeddings alone were able to equally predict applicant-organization fit (receiver operating characteristic areas under the curve, 0.763 and 0.750 vs 0.419; P values >.05) as compared with models utilizing applicant characteristics and personal statement clusters alone. All predictive models were poor predictors of postfellowship publications per year.

CONCLUSION

We demonstrate ability for document embeddings to capture meaningful information in personal statements from pediatric otolaryngology fellowship applicants. A larger study can further differentiate personal statement clusters and assess the predictive potential of document embeddings.