Gradient Boosted Trees for Corrective Learning

Artificial neural network-based model for sleep quality prediction for frontline medical staff during major medical assistance

Background: The sleep quality of medical staff was severely affected during COVID-19, but the factors influencing the sleep quality of frontline staff involved in medical assistance remained unclear, and screening tools for their sleep quality were lacking. Methods: From June 25 to July 14, 2022, we conducted an Internet-based cross-sectional survey. The Pittsburgh Sleep Quality Index (PSQI), a self-designed general information questionnaire, and a questionnaire regarding the factors influencing sleep quality were combined to understand the sleep quality of frontline medical staff in Fujian Province supporting Shanghai in the past month. A chi-square test was used to compare participant characteristics, and multivariate unconditional logistic regression analysis was used to determine the predictors of sleep quality. Stratified sampling was used to divide the data into a training test set (n = 1061, 80%) and an independent validation set (n = 265, 20%). Six models were developed and validated using logistic regression, artificial neural network, gradient augmented tree, random forest, naive Bayes, and model decision tree. Results: A total of 1326 frontline medical staff were included in this survey, with a mean PSQI score of 11.354 ± 4.051. The prevalence of poor sleep quality was 80.8% (n = 1072, PSQI >7). Six variables related to sleep quality were used as parameters in the prediction model, including type of work, professional job title, work shift, weight change, tea consumption during assistance, and basic diseases. The artificial neural network (ANN) model produced the best overall performance with area under the curve, accuracy, sensitivity, specificity, precision, F1 score, and kappa of 71.6%, 68.7%, 66.7%, 69.2%, 34.0%, 45.0%, and 26.2% respectively. Conclusions: In this study, the ANN model, which demonstrated excellent predictive efficiency, showed potential for application in monitoring the sleep quality of medical staff and provide some scientific guidance suggestions for early intervention.

Automated Machine Learning Analysis of Patients With Chronic Skin Disease Using a Medical Smartphone App: Retrospective Study

BACKGROUND

Rapid digitalization in health care has led to the adoption of digital technologies; however, limited trust in internet-based health decisions and the need for technical personnel hinder the use of smartphones and machine learning applications. To address this, automated machine learning (AutoML) is a promising tool that can empower health care professionals to enhance the effectiveness of mobile health apps.

OBJECTIVE

We used AutoML to analyze data from clinical studies involving patients with chronic hand and/or foot eczema or psoriasis vulgaris who used a smartphone monitoring app. The analysis focused on itching, pain, Dermatology Life Quality Index (DLQI) development, and app use.

METHODS

After extensive data set preparation, which consisted of combining 3 primary data sets by extracting common features and by computing new features, a new pseudonymized secondary data set with a total of 368 patients was created. Next, multiple machine learning classification models were built during AutoML processing, with the most accurate models ultimately selected for further data set analysis.

RESULTS

Itching development for 6 months was accurately modeled using the light gradient boosted trees classifier model (log loss: 0.9302 for validation, 1.0193 for cross-validation, and 0.9167 for holdout). Pain development for 6 months was assessed using the random forest classifier model (log loss: 1.1799 for validation, 1.1561 for cross-validation, and 1.0976 for holdout). Then, the random forest classifier model (log loss: 1.3670 for validation, 1.4354 for cross-validation, and 1.3974 for holdout) was used again to estimate the DLQI development for 6 months. Finally, app use was analyzed using an elastic net blender model (area under the curve: 0.6567 for validation, 0.6207 for cross-validation, and 0.7232 for holdout). Influential feature correlations were identified, including BMI, age, disease activity, DLQI, and Hospital Anxiety and Depression Scale-Anxiety scores at follow-up. App use increased with BMI >35, was less common in patients aged >47 years and those aged 23 to 31 years, and was more common in those with higher disease activity. A Hospital Anxiety and Depression Scale-Anxiety score >8 had a slightly positive effect on app use.

CONCLUSIONS

This study provides valuable insights into the relationship between data characteristics and targeted outcomes in patients with chronic eczema or psoriasis, highlighting the potential of smartphone and AutoML techniques in improving chronic disease management and patient care.

Gradient Boosted Trees for Spatial Data and Its Application to Medical Imaging Data

Boosting Trees are one of the most successful statistical learning approaches that involve sequentially growing an ensemble of simple regression trees ("weak learners"). This paper proposes a gradient Boosted Trees algorithm for Spatial Data (Boost-S) with covariate information. Boost-S integrates the spatial correlation into the classical framework of eXtreme Gradient Boosting. Each tree is constructed by solving a regularized optimization problem, where the objective function takes into account the underlying spatial correlation and involves two penalty terms on tree complexity. A computationally-efficient greedy heuristic algorithm is proposed to obtain an ensemble of trees. The proposed Boost-S is applied to the spatially-correlated FDG-PET (fluorodeoxyglucose-positron emission tomography) imaging data collected from clinical trials of cancer chemoradiotherapy. Our numerical investigations successfully demonstrate the advantages of the proposed Boost-S over existing approaches for this particular application.

TMJOAI: An Artificial Web-Based Intelligence Tool for Early Diagnosis of the Temporomandibular Joint Osteoarthritis

Osteoarthritis is a chronic disease that affects the temporomandibular joint (TMJ), causing chronic pain and disability. To diagnose patients suffering from this disease before advanced degradation of the bone, we developed a diagnostic tool called TMJOAI. This machine learning based algorithm is capable of classifying the health status TMJ in of patients using 52 clinical, biological and jaw condyle radiomic markers. The TMJOAI includes three parts. the feature preparation, selection and model evaluation. Feature generation includes the choice of radiomic features (condylar trabecular bone or mandibular fossa), the histogram matching of the images prior to the extraction of the radiomic markers, the generation of feature pairwise interaction, etc.; the feature selection are based on the p-values or AUCs of single features using the training data; the model evaluation compares multiple machine learning algorithms (e.g. regression-based, tree-based and boosting algorithms) from 10 times 5-fold cross validation. The best performance was achieved with averaging the predictions of XGBoost and LightGBM models; and the inclusion of 32 additional markers from the mandibular fossa of the joint improved the AUC prediction performance from 0.83 to 0.88. After cross-validation and testing, the tools presented here have been deployed on an open-source, web-based system, making it accessible to clinicians. TMJOAI allows users to add data and automatically train and update the machine learning models, and therefore improve their performance.

MRI subcortical segmentation in neurodegeneration with cascaded 3D CNNs

The subcortical structures of the brain are relevant for many neurodegenerative diseases like Huntington's disease (HD). Quantitative segmentation of these structures from magnetic resonance images (MRIs) has been studied in clinical and neuroimaging research. Recently, convolutional neural networks (CNNs) have been successfully used for many medical image analysis tasks, including subcortical segmentation. In this work, we propose a 2-stage cascaded 3D subcortical segmentation framework, with the same 3D CNN architecture for both stages. Attention gates, residual blocks and output adding are used in our proposed 3D CNN. In the first stage, we apply our model to downsampled images to output a coarse segmentation. Next, we crop the extended subcortical region from the original image based on this coarse segmentation, and we input the cropped region to the second CNN to obtain the final segmentation. Left and right pairs of thalamus, caudate, pallidum and putamen are considered in our segmentation. We use the Dice coefficient as our metric and evaluate our method on two datasets: the publicly available IBSR dataset and a subset of the PREDICT-HD database, which includes healthy controls and HD subjects. We train our models on only healthy control subjects and test on both healthy controls and HD subjects to examine model generalizability. Compared with the state-of-the-art methods, our method has the highest mean Dice score on all considered subcortical structures (except the thalamus on IBSR), with more pronounced improvement for HD subjects. This suggests that our method may have better ability to segment MRIs of subjects with neurodegenerative disease.

Evaluating White Matter Lesion Segmentations with Refined Sørensen-Dice Analysis

The Sørensen-Dice index (SDI) is a widely used measure for evaluating medical image segmentation algorithms. It offers a standardized measure of segmentation accuracy which has proven useful. However, it offers diminishing insight when the number of objects is unknown, such as in white matter lesion segmentation of multiple sclerosis (MS) patients. We present a refinement for finer grained parsing of SDI results in situations where the number of objects is unknown. We explore these ideas with two case studies showing what can be learned from our two presented studies. Our first study explores an inter-rater comparison, showing that smaller lesions cannot be reliably identified. In our second case study, we demonstrate fusing multiple MS lesion segmentation algorithms based on the insights into the algorithms provided by our analysis to generate a segmentation that exhibits improved performance. This work demonstrates the wealth of information that can be learned from refined analysis of medical image segmentations.