1
|
Kargarandehkordi A, Slade C, Washington P. Personalized AI-Driven Real-Time Models to Predict Stress-Induced Blood Pressure Spikes Using Wearable Devices: Proposal for a Prospective Cohort Study. JMIR Res Protoc 2024; 13:e55615. [PMID: 38526539 PMCID: PMC11002732 DOI: 10.2196/55615] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/18/2023] [Revised: 02/03/2024] [Accepted: 02/05/2024] [Indexed: 03/26/2024] Open
Abstract
BACKGROUND Referred to as the "silent killer," elevated blood pressure (BP) often goes unnoticed due to the absence of apparent symptoms, resulting in cumulative harm over time. Chronic stress has been consistently linked to increased BP. Prior studies have found that elevated BP often arises due to a stressful lifestyle, although the effect of exact stressors varies drastically between individuals. The heterogeneous nature of both the stress and BP response to a multitude of lifestyle decisions can make it difficult if not impossible to pinpoint the most deleterious behaviors using the traditional mechanism of clinical interviews. OBJECTIVE The aim of this study is to leverage machine learning (ML) algorithms for real-time predictions of stress-induced BP spikes using consumer wearable devices such as Fitbit, providing actionable insights to both patients and clinicians to improve diagnostics and enable proactive health monitoring. This study also seeks to address the significant challenges in identifying specific deleterious behaviors associated with stress-induced hypertension through the development of personalized artificial intelligence models for individual patients, departing from the conventional approach of using generalized models. METHODS The study proposes the development of ML algorithms to analyze biosignals obtained from these wearable devices, aiming to make real-time predictions about BP spikes. Given the longitudinal nature of the data set comprising time-series data from wearables (eg, Fitbit) and corresponding time-stamped labels representing stress levels from Ecological Momentary Assessment reports, the adoption of self-supervised learning for pretraining the network and using transformer models for fine-tuning the model on a personalized prediction task is proposed. Transformer models, with their self-attention mechanisms, dynamically weigh the importance of different time steps, enabling the model to focus on relevant temporal features and dependencies, facilitating accurate prediction. RESULTS Supported as a pilot project from the Robert C Perry Fund of the Hawaii Community Foundation, the study team has developed the core study app, CardioMate. CardioMate not only reminds participants to initiate BP readings using an Omron HeartGuide wearable monitor but also prompts them multiple times a day to report stress levels. Additionally, it collects other useful information including medications, environmental conditions, and daily interactions. Through the app's messaging system, efficient contact and interaction between users and study admins ensure smooth progress. CONCLUSIONS Personalized ML when applied to biosignals offers the potential for real-time digital health interventions for chronic stress and its symptoms. The project's clinical use for Hawaiians with stress-induced high BP combined with its methodological innovation of personalized artificial intelligence models highlights its significance in advancing health care interventions. Through iterative refinement and optimization, the aim is to develop a personalized deep-learning framework capable of accurately predicting stress-induced BP spikes, thereby promoting individual well-being and health outcomes. INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID) DERR1-10.2196/55615.
Collapse
Affiliation(s)
- Ali Kargarandehkordi
- Department of Information and Computer Sciences, University of Hawaii at Manoa, Honolulu, HI, United States
| | - Christopher Slade
- Department of Information and Computer Sciences, University of Hawaii at Manoa, Honolulu, HI, United States
| | - Peter Washington
- Department of Information and Computer Sciences, University of Hawaii at Manoa, Honolulu, HI, United States
| |
Collapse
|
2
|
Sun Y, Kargarandehkordi A, Slade C, Jaiswal A, Busch G, Guerrero A, Phillips KT, Washington P. Personalized Deep Learning for Substance Use in Hawaii: Protocol for a Passive Sensing and Ecological Momentary Assessment Study. JMIR Res Protoc 2024; 13:e46493. [PMID: 38324375 PMCID: PMC10882478 DOI: 10.2196/46493] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/25/2023] [Revised: 12/08/2023] [Accepted: 12/11/2023] [Indexed: 02/08/2024] Open
Abstract
BACKGROUND Artificial intelligence (AI)-powered digital therapies that detect methamphetamine cravings via consumer devices have the potential to reduce health care disparities by providing remote and accessible care solutions to communities with limited care solutions, such as Native Hawaiian, Filipino, and Pacific Islander communities. However, Native Hawaiian, Filipino, and Pacific Islander communities are understudied with respect to digital therapeutics and AI health sensing despite using technology at the same rates as other racial groups. OBJECTIVE In this study, we aimed to understand the feasibility of continuous remote digital monitoring and ecological momentary assessments in Native Hawaiian, Filipino, and Pacific Islander communities in Hawaii by curating a novel data set of longitudinal Fitbit (Fitbit Inc) biosignals with the corresponding craving and substance use labels. We also aimed to develop personalized AI models that predict methamphetamine craving events in real time using wearable sensor data. METHODS We will develop personalized AI and machine learning models for methamphetamine use and craving prediction in 40 individuals from Native Hawaiian, Filipino, and Pacific Islander communities by curating a novel data set of real-time Fitbit biosensor readings and the corresponding participant annotations (ie, raw self-reported substance use data) of their methamphetamine use and cravings. In the process of collecting this data set, we will gain insights into cultural and other human factors that can challenge the proper acquisition of precise annotations. With the resulting data set, we will use self-supervised learning AI approaches, which are a new family of machine learning methods that allows a neural network to be trained without labels by being optimized to make predictions about the data. The inputs to the proposed AI models are Fitbit biosensor readings, and the outputs are predictions of methamphetamine use or craving. This paradigm is gaining increased attention in AI for health care. RESULTS To date, more than 40 individuals have expressed interest in participating in the study, and we have successfully recruited our first 5 participants with minimal logistical challenges and proper compliance. Several logistical challenges that the research team has encountered so far and the related implications are discussed. CONCLUSIONS We expect to develop models that significantly outperform traditional supervised methods by finetuning according to the data of a participant. Such methods will enable AI solutions that work with the limited data available from Native Hawaiian, Filipino, and Pacific Islander populations and that are inherently unbiased owing to their personalized nature. Such models can support future AI-powered digital therapeutics for substance abuse. INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID) DERR1-10.2196/46493.
Collapse
Affiliation(s)
- Yinan Sun
- Department of Information and Computer Sciences, University of Hawaii at Manoa, Honolulu, HI, United States
| | - Ali Kargarandehkordi
- Department of Information and Computer Sciences, University of Hawaii at Manoa, Honolulu, HI, United States
| | - Christopher Slade
- Department of Information and Computer Sciences, University of Hawaii at Manoa, Honolulu, HI, United States
| | - Aditi Jaiswal
- Department of Information and Computer Sciences, University of Hawaii at Manoa, Honolulu, HI, United States
| | - Gerald Busch
- Department of Psychiatry, University of Hawaii at Manoa, Honolulu, HI, United States
| | - Anthony Guerrero
- Department of Psychiatry, University of Hawaii at Manoa, Honolulu, HI, United States
| | - Kristina T Phillips
- Center for Integrated Health Care Research, Kaiser Permanente Hawaii, Honolulu, HI, United States
| | - Peter Washington
- Department of Information and Computer Sciences, University of Hawaii at Manoa, Honolulu, HI, United States
| |
Collapse
|
3
|
Mohammad-Rahimi H, Dianat O, Abbasi R, Zahedrozegar S, Ashkan A, Motamedian SR, Rohban MH, Nosrat A. Artificial Intelligence for Detection of External Cervical Resorption Using Label-Efficient Self-Supervised Learning Method. J Endod 2024; 50:144-153.e2. [PMID: 37977219 DOI: 10.1016/j.joen.2023.11.004] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/17/2023] [Revised: 10/30/2023] [Accepted: 11/08/2023] [Indexed: 11/19/2023]
Abstract
INTRODUCTION The aim of this study was to leverage label-efficient self-supervised learning (SSL) to train a model that can detect ECR and differentiate it from caries. METHODS Periapical (PA) radiographs of teeth with ECR defects were collected. Two board-certified endodontists reviewed PA radiographs and cone beam computed tomographic (CBCT) images independently to determine presence of ECR (ground truth). Radiographic data were divided into 3 regions of interest (ROIs): healthy teeth, teeth with ECR, and teeth with caries. Nine contrastive SSL models (SimCLR v2, MoCo v2, BYOL, DINO, NNCLR, SwAV, MSN, Barlow Twins, and SimSiam) were implemented in the assessment alongside 7 baseline deep learning models (ResNet-18, ResNet-50, VGG16, DenseNet, MobileNetV2, ResNeXt-50, and InceptionV3). A 10-fold cross-validation strategy and a hold-out test set were employed for model evaluation. Model performance was assessed via various metrics including classification accuracy, precision, recall, and F1-score. RESULTS Included were 190 PA radiographs, composed of 470 ROIs. Results from 10-fold cross-validation demonstrated that most SSL models outperformed the transfer learning baseline models, with DINO achieving the highest mean accuracy (85.64 ± 4.56), significantly outperforming 13 other models (P < .05). DINO reached the highest test set (ie, 3 ROIs) accuracy (84.09%) while MoCo v2 exhibited the highest recall and F1-score (77.37% and 82.93%, respectively). CONCLUSIONS This study showed that AI can assist clinicians in detecting ECR and differentiating it from caries. Additionally, it introduced the application of SSL in detecting ECR, emphasizing that SSL-based models can outperform transfer learning baselines and reduce reliance on large, labeled datasets.
Collapse
Affiliation(s)
- Hossein Mohammad-Rahimi
- Topic Group Dental Diagnostics and Digital Dentistry, ITU/WHO Focus Group AI on Health, Berlin, Germany; Department of Computer Engineering, Sharif University of Technology, Tehran, Iran
| | - Omid Dianat
- Division of Endodontics, Department of Advanced Oral Sciences and Therapeutics, University of Maryland, School of Dentistry, Baltimore, Maryland; Private Practice, Centreville Endodontics, Centreville, Virginia
| | - Reza Abbasi
- Department of Computer Engineering, Sharif University of Technology, Tehran, Iran
| | - Samira Zahedrozegar
- Dentofacial Deformities Research Center, Research Institute of Dental Sciences, Shahid Beheshti University of Medical Sciences, Tehran, Iran
| | - Ali Ashkan
- Department of Orthodontics, School of Dentistry, Hamadan University of Medical Sciences, Hamadan, Iran
| | - Saeed Reza Motamedian
- Topic Group Dental Diagnostics and Digital Dentistry, ITU/WHO Focus Group AI on Health, Berlin, Germany; Dentofacial Deformities Research Center, Research Institute of Dental Sciences, Shahid Beheshti University of Medical Sciences, Tehran, Iran; Department of Orthodontics, School of Dentistry, Shahid Beheshti University of Medical Sciences, Tehran, Iran
| | | | - Ali Nosrat
- Division of Endodontics, Department of Advanced Oral Sciences and Therapeutics, University of Maryland, School of Dentistry, Baltimore, Maryland; Private Practice, Centreville Endodontics, Centreville, Virginia.
| |
Collapse
|
4
|
Kim JH, Kim SK, Choi J, Lee Y. Reliability of ChatGPT for performing triage task in the emergency department using the Korean Triage and Acuity Scale. Digit Health 2024; 10:20552076241227132. [PMID: 38250148 PMCID: PMC10798071 DOI: 10.1177/20552076241227132] [Citation(s) in RCA: 5] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/14/2023] [Accepted: 12/28/2023] [Indexed: 01/23/2024] Open
Abstract
Background Artificial intelligence (AI) technology can enable more efficient decision-making in healthcare settings. There is a growing interest in improving the speed and accuracy of AI systems in providing responses for given tasks in healthcare settings. Objective This study aimed to assess the reliability of ChatGPT in determining emergency department (ED) triage accuracy using the Korean Triage and Acuity Scale (KTAS). Methods Two hundred and two virtual patient cases were built. The gold standard triage classification for each case was established by an experienced ED physician. Three other human raters (ED paramedics) were involved and rated the virtual cases individually. The virtual cases were also rated by two different versions of the chat generative pre-trained transformer (ChatGPT, 3.5 and 4.0). Inter-rater reliability was examined using Fleiss' kappa and intra-class correlation coefficient (ICC). Results The kappa values for the agreement between the four human raters and ChatGPTs were .523 (version 4.0) and .320 (version 3.5). Of the five levels, the performance was poor when rating patients at levels 1 and 5, as well as case scenarios with additional text descriptions. There were differences in the accuracy of the different versions of GPTs. The ICC between version 3.5 and the gold standard was .520, and that between version 4.0 and the gold standard was .802. Conclusions A substantial level of inter-rater reliability was revealed when GPTs were used as KTAS raters. The current study showed the potential of using GPT in emergency healthcare settings. Considering the shortage of experienced manpower, this AI method may help improve triaging accuracy.
Collapse
Affiliation(s)
- Jae Hyuk Kim
- Department of Emergency Medicine, Mokpo Hankook Hospital, Jeonnam, South Korea
| | - Sun Kyung Kim
- Department of Nursing, Mokpo National University, Jeonnam, South Korea
- Department of Biomedicine, Health & Life Convergence Sciences, Biomedical and Healthcare Research Institute, Jeonnam, South Korea
| | - Jongmyung Choi
- Department of Computer Engineering, Mokpo National University, Jeonnam, South Korea
| | - Youngho Lee
- Department of Computer Engineering, Mokpo National University, Jeonnam, South Korea
| |
Collapse
|
5
|
Meng X, Zou T. Clinical applications of graph neural networks in computational histopathology: A review. Comput Biol Med 2023; 164:107201. [PMID: 37517325 DOI: 10.1016/j.compbiomed.2023.107201] [Citation(s) in RCA: 4] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/18/2023] [Revised: 06/10/2023] [Accepted: 06/19/2023] [Indexed: 08/01/2023]
Abstract
Pathological examination is the optimal approach for diagnosing cancer, and with the advancement of digital imaging technologies, it has spurred the emergence of computational histopathology. The objective of computational histopathology is to assist in clinical tasks through image processing and analysis techniques. In the early stages, the technique involved analyzing histopathology images by extracting mathematical features, but the performance of these models was unsatisfactory. With the development of artificial intelligence (AI) technologies, traditional machine learning methods were applied in this field. Although the performance of the models improved, there were issues such as poor model generalization and tedious manual feature extraction. Subsequently, the introduction of deep learning techniques effectively addressed these problems. However, models based on traditional convolutional architectures could not adequately capture the contextual information and deep biological features in histopathology images. Due to the special structure of graphs, they are highly suitable for feature extraction in tissue histopathology images and have achieved promising performance in numerous studies. In this article, we review existing graph-based methods in computational histopathology and propose a novel and more comprehensive graph construction approach. Additionally, we categorize the methods and techniques in computational histopathology according to different learning paradigms. We summarize the common clinical applications of graph-based methods in computational histopathology. Furthermore, we discuss the core concepts in this field and highlight the current challenges and future research directions.
Collapse
Affiliation(s)
- Xiangyan Meng
- Xi'an Technological University, Xi'an, Shaanxi, 710021, China.
| | - Tonghui Zou
- Xi'an Technological University, Xi'an, Shaanxi, 710021, China.
| |
Collapse
|
6
|
Washington P. Personalized Machine Learning using Passive Sensing and Ecological Momentary Assessments for Meth Users in Hawaii: A Research Protocol. MEDRXIV : THE PREPRINT SERVER FOR HEALTH SCIENCES 2023:2023.08.24.23294587. [PMID: 37662253 PMCID: PMC10473804 DOI: 10.1101/2023.08.24.23294587] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 09/05/2023]
Abstract
Background Artificial intelligence (AI)-powered digital therapies which detect meth cravings delivered on consumer devices have the potential to reduce these disparities by providing remote and accessible care solutions to Native Hawaiians, Filipinos, and Pacific Islanders (NHFPI) communities with limited care solutions. However, NHFPI are fully understudied with respect to digital therapeutics and AI health sensing despite using technology at the same rates as other races. Objective We seek to fulfill two research aims: (1) Understand the feasibility of continuous remote digital monitoring and ecological momentary assessments (EMAs) in NHFPI in Hawaii by curating a novel dataset of longitudinal FitBit biosignals with corresponding craving and substance use labels. (2) Develop personalized AI models which predict meth craving events in real time using wearable sensor data. Methods We will develop personalized AI/ML (artificial intelligence/machine learning) models for meth use and craving prediction in 40 NHFPI individuals by curating a novel dataset of real-time FitBit biosensor readings and corresponding participant annotations (i.e., raw self-reported substance use data) of their meth use and cravings. In the process of collecting this dataset, we will glean insights about cultural and other human factors which can challenge the proper acquisition of precise annotations. With the resulting dataset, we will employ self-supervised learning (SSL) AI approaches, which are a new family of ML methods that allow a neural network to be trained without labels by being optimized to make predictions about the data itself. The inputs to the proposed AI models are FitBit biosensor readings and the outputs are predictions of meth use or craving. This paradigm is gaining increased attention in AI for healthcare. Conclusions We expect to develop models which significantly outperform traditional supervised methods by fine-tuning to an individual subject's data. Such methods will enable AI solutions which work with the limited data available from NHFPI populations and which are inherently unbiased due to their personalized nature. Such models can support future AI-powered digital therapeutics for substance abuse.
Collapse
|
7
|
Chen LC, Hung KH, Tseng YJ, Wang HY, Lu TM, Huang WC, Tsao Y. Self-Supervised Learning-Based General Laboratory Progress Pretrained Model for Cardiovascular Event Detection. IEEE JOURNAL OF TRANSLATIONAL ENGINEERING IN HEALTH AND MEDICINE 2023; 12:43-55. [PMID: 38059127 PMCID: PMC10697297 DOI: 10.1109/jtehm.2023.3307794] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 03/14/2023] [Revised: 07/23/2023] [Accepted: 08/14/2023] [Indexed: 12/08/2023]
Abstract
OBJECTIVE Leveraging patient data through machine learning techniques in disease care offers a multitude of substantial benefits. Nonetheless, the inherent nature of patient data poses several challenges. Prevalent cases amass substantial longitudinal data owing to their patient volume and consistent follow-ups, however, longitudinal laboratory data are renowned for their irregularity, temporality, absenteeism, and sparsity; In contrast, recruitment for rare or specific cases is often constrained due to their limited patient size and episodic observations. This study employed self-supervised learning (SSL) to pretrain a generalized laboratory progress (GLP) model that captures the overall progression of six common laboratory markers in prevalent cardiovascular cases, with the intention of transferring this knowledge to aid in the detection of specific cardiovascular event. METHODS AND PROCEDURES GLP implemented a two-stage training approach, leveraging the information embedded within interpolated data and amplify the performance of SSL. After GLP pretraining, it is transferred for target vessel revascularization (TVR) detection. RESULTS The proposed two-stage training improved the performance of pure SSL, and the transferability of GLP exhibited distinctiveness. After GLP processing, the classification exhibited a notable enhancement, with averaged accuracy rising from 0.63 to 0.90. All evaluated metrics demonstrated substantial superiority ([Formula: see text]) compared to prior GLP processing. CONCLUSION Our study effectively engages in translational engineering by transferring patient progression of cardiovascular laboratory parameters from one patient group to another, transcending the limitations of data availability. The transferability of disease progression optimized the strategies of examinations and treatments, and improves patient prognosis while using commonly available laboratory parameters. The potential for expanding this approach to encompass other diseases holds great promise. CLINICAL IMPACT Our study effectively transposes patient progression from one cohort to another, surpassing the constraints of episodic observation. The transferability of disease progression contributed to cardiovascular event assessment.
Collapse
Affiliation(s)
- Li-Chin Chen
- Research Center for Information Technology InnovationAcademia SinicaTaipei11529Taiwan
| | - Kuo-Hsuan Hung
- Research Center for Information Technology InnovationAcademia SinicaTaipei11529Taiwan
| | - Yi-Ju Tseng
- Department of Computer ScienceNational Yang Ming Chiao Tung UniversityHsinchu30010Taiwan
| | - Hsin-Yao Wang
- Department of Laboratory MedicineLinkou Chang Gung Memorial HospitalTaoyuan City33342Taiwan
| | - Tse-Min Lu
- Division of CardiologyDepartment of Internal MedicineTaipei Veterans General HospitalTaipei112201Taiwan
- Department of Health Care CenterTaipei Veterans General HospitalTaipei112201Taiwan
- Department of Internal MedicineSchool of Medicine, College of MedicineNational Yang Ming Chiao Tung UniversityTaipei112304Taiwan
| | - Wei-Chieh Huang
- Division of CardiologyDepartment of Internal MedicineTaipei Veterans General HospitalTaipei112201Taiwan
- Department of Internal MedicineSchool of Medicine, College of MedicineNational Yang Ming Chiao Tung UniversityTaipei112304Taiwan
- Department of Biomedical EngineeringNational Taiwan UniversityTaipei10617Taiwan
| | - Yu Tsao
- Research Center for Information Technology InnovationAcademia SinicaTaipei11529Taiwan
| |
Collapse
|
8
|
Kwak MG, Su Y, Chen K, Weidman D, Wu T, Lure F, Li J. Self-Supervised Contrastive Learning to Predict Alzheimer's Disease Progression with 3D Amyloid-PET. MEDRXIV : THE PREPRINT SERVER FOR HEALTH SCIENCES 2023:2023.04.20.23288886. [PMID: 37162842 PMCID: PMC10168409 DOI: 10.1101/2023.04.20.23288886] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/11/2023]
Abstract
Early diagnosis of Alzheimer's disease (AD) is an important task that facilitates the development of treatment and prevention strategies and may potentially improve patient outcomes. Neuroimaging has shown great promise, including the amyloid-PET which measures the accumulation of amyloid plaques in the brain - a hallmark of AD. It is desirable to train end-to-end deep learning models to predict the progression of AD for individuals at early stages based on 3D amyloid-PET. However, commonly used models are trained in a fully supervised learning manner and they are inevitably biased toward the given label information. To this end, we propose a self-supervised contrastive learning method to predict AD progression with 3D amyloid-PET. It uses unlabeled data to capture general representations underlying the images. As the downstream task is given as classification, unlike the general self-supervised learning problem that aims to generate task-agnostic representations, we also propose a loss function to utilize the label information in the pre-training. To demonstrate the performance of our method, we conducted experiments on the Alzheimer's Disease Neuroimaging Initiative (ADNI) dataset. The results confirmed that the proposed method is capable of providing appropriate data representations, resulting in accurate classification.
Collapse
Affiliation(s)
- Min Gu Kwak
- School of Industrial and Systems Engineering, Georgia Institute of Technology, GA
| | - Yi Su
- Banner Alzheimer's Institute, AZ
| | | | | | - Teresa Wu
- School of Computing, Informatics and Decision Systems Engineering, Arizona State University, AZ
| | | | - Jing Li
- School of Industrial and Systems Engineering, Georgia Institute of Technology, GA
| |
Collapse
|
9
|
Mansouri-Benssassi E, Rogers S, Reel S, Malone M, Smith J, Ritchie F, Jefferson E. Disclosure control of machine learning models from trusted research environments (TRE): New challenges and opportunities. Heliyon 2023; 9:e15143. [PMID: 37123891 PMCID: PMC10130764 DOI: 10.1016/j.heliyon.2023.e15143] [Citation(s) in RCA: 4] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/20/2023] [Revised: 03/23/2023] [Accepted: 03/28/2023] [Indexed: 04/05/2023] Open
Abstract
Introduction Artificial intelligence (AI) applications in healthcare and medicine have increased in recent years. To enable access to personal data, Trusted Research Environments (TREs) (otherwise known as Safe Havens) provide safe and secure environments in which researchers can access sensitive personal data and develop AI (in particular machine learning (ML)) models. However, currently few TREs support the training of ML models in part due to a gap in the practical decision-making guidance for TREs in handling model disclosure. Specifically, the training of ML models creates a need to disclose new types of outputs from TREs. Although TREs have clear policies for the disclosure of statistical outputs, the extent to which trained models can leak personal training data once released is not well understood. Background We review, for a general audience, different types of ML models and their applicability within healthcare. We explain the outputs from training a ML model and how trained ML models can be vulnerable to external attacks to discover personal data encoded within the model. Risks We present the challenges for disclosure control of trained ML models in the context of training and exporting models from TREs. We provide insights and analyse methods that could be introduced within TREs to mitigate the risk of privacy breaches when disclosing trained models. Discussion Although specific guidelines and policies exist for statistical disclosure controls in TREs, they do not satisfactorily address these new types of output requests; i.e., trained ML models. There is significant potential for new interdisciplinary research opportunities in developing and adapting policies and tools for safely disclosing ML outputs from TREs.
Collapse
Affiliation(s)
| | | | | | | | - Jim Smith
- University of the West of England, United Kingdom
| | | | - Emily Jefferson
- University of Dundee, United Kingdom
- Health Data Research (HDR), United Kingdom
| |
Collapse
|
10
|
Rani V, Nabi ST, Kumar M, Mittal A, Kumar K. Self-supervised Learning: A Succinct Review. ARCHIVES OF COMPUTATIONAL METHODS IN ENGINEERING : STATE OF THE ART REVIEWS 2023; 30:2761-2775. [PMID: 36713767 PMCID: PMC9857922 DOI: 10.1007/s11831-023-09884-2] [Citation(s) in RCA: 5] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 12/26/2022] [Accepted: 01/05/2023] [Indexed: 06/18/2023]
Abstract
Machine learning has made significant advances in the field of image processing. The foundation of this success is supervised learning, which necessitates annotated labels generated by humans and hence learns from labelled data, whereas unsupervised learning learns from unlabeled data. Self-supervised learning (SSL) is a type of un-supervised learning that helps in the performance of downstream computer vision tasks such as object detection, image comprehension, image segmentation, and so on. It can develop generic artificial intelligence systems at a low cost using unstructured and unlabeled data. The authors of this review article have presented detailed literature on self-supervised learning as well as its applications in different domains. The primary goal of this review article is to demonstrate how images learn from their visual features using self-supervised approaches. The authors have also discussed various terms used in self-supervised learning as well as different types of learning, such as contrastive learning, transfer learning, and so on. This review article describes in detail the pipeline of self-supervised learning, including its two main phases: pretext and downstream tasks. The authors have shed light on various challenges encountered while working on self-supervised learning at the end of the article.
Collapse
Affiliation(s)
- Veenu Rani
- Department of Computational Sciences, Maharaja Ranjit Singh Punjab Technical University, Bathinda, Punjab India
| | - Syed Tufael Nabi
- Department of Computational Sciences, Maharaja Ranjit Singh Punjab Technical University, Bathinda, Punjab India
| | - Munish Kumar
- Department of Computational Sciences, Maharaja Ranjit Singh Punjab Technical University, Bathinda, Punjab India
| | - Ajay Mittal
- University Institute of Engineering and Technology, Panjab University, Chandigarh, India
| | - Krishan Kumar
- University Institute of Engineering and Technology, Panjab University, Chandigarh, India
| |
Collapse
|
11
|
The use of machine learning and artificial intelligence within pediatric critical care. Pediatr Res 2023; 93:405-412. [PMID: 36376506 PMCID: PMC9660024 DOI: 10.1038/s41390-022-02380-6] [Citation(s) in RCA: 7] [Impact Index Per Article: 7.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 03/15/2022] [Revised: 09/15/2022] [Accepted: 10/30/2022] [Indexed: 11/16/2022]
Abstract
The field of pediatric critical care has been hampered in the era of precision medicine by our inability to accurately define and subclassify disease phenotypes. This has been caused by heterogeneity across age groups that further challenges the ability to perform randomized controlled trials in pediatrics. One approach to overcome these inherent challenges include the use of machine learning algorithms that can assist in generating more meaningful interpretations from clinical data. This review summarizes machine learning and artificial intelligence techniques that are currently in use for clinical data modeling with relevance to pediatric critical care. Focus has been placed on the differences between techniques and the role of each in the clinical arena. The various forms of clinical decision support that utilize machine learning are also described. We review the applications and limitations of machine learning techniques to empower clinicians to make informed decisions at the bedside. IMPACT: Critical care units generate large amounts of under-utilized data that can be processed through artificial intelligence. This review summarizes the machine learning and artificial intelligence techniques currently being used to process clinical data. The review highlights the applications and limitations of these techniques within a clinical context to aid providers in making more informed decisions at the bedside.
Collapse
|
12
|
Montero Quispe KG, Utyiama DMS, dos Santos EM, Oliveira HABF, Souto EJP. Applying Self-Supervised Representation Learning for Emotion Recognition Using Physiological Signals. SENSORS (BASEL, SWITZERLAND) 2022; 22:9102. [PMID: 36501803 PMCID: PMC9736913 DOI: 10.3390/s22239102] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 09/23/2022] [Revised: 11/16/2022] [Accepted: 11/17/2022] [Indexed: 06/17/2023]
Abstract
The use of machine learning (ML) techniques in affective computing applications focuses on improving the user experience in emotion recognition. The collection of input data (e.g., physiological signals), together with expert annotations are part of the established standard supervised learning methodology used to train human emotion recognition models. However, these models generally require large amounts of labeled data, which is expensive and impractical in the healthcare context, in which data annotation requires even more expert knowledge. To address this problem, this paper explores the use of the self-supervised learning (SSL) paradigm in the development of emotion recognition methods. This approach makes it possible to learn representations directly from unlabeled signals and subsequently use them to classify affective states. This paper presents the key concepts of emotions and how SSL methods can be applied to recognize affective states. We experimentally analyze and compare self-supervised and fully supervised training of a convolutional neural network designed to recognize emotions. The experimental results using three emotion datasets demonstrate that self-supervised representations can learn widely useful features that improve data efficiency, are widely transferable, are competitive when compared to their fully supervised counterparts, and do not require the data to be labeled for learning.
Collapse
|
13
|
Automatic Assessment of Abdominal Exercises for the Treatment of Diastasis Recti Abdominis Using Electromyography and Machine Learning. Symmetry (Basel) 2022. [DOI: 10.3390/sym14081654] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/17/2022] Open
Abstract
Diastasis Recti Abdominis (DRA) is a medical condition in which the two sides of the rectus abdominis muscle are separated by at least 2.7 cm. This happens when the collagen sheath that exists between the rectus muscles stretches beyond a certain limit. The recti muscles generally separate and move apart in pregnant women due to the development of fetus in the womb. In some cases, this intramuscular gap will not be closed on its own, leading to DRA. The primary treatment procedures of DRA involve different therapeutic exercises to reduce the inter-recti distance. However, it is tedious for the physiotherapists to constantly monitor the patients and ensure that the exercises are being done correctly. The objective of this research is to analyze the correctness of such performed exercises using electromyogram (EMG) signals and machine learning. To the best of our knowledge, this is the first work reporting the objective evaluation of rehabilitation exercises for DRA. Experimental studies indicate that the surface EMG signals were effective in classifying the correctly and incorrectly performed movements. An extensive analysis was carried out with different machine learning models for classification. It was inferred that the RUSBoosted Ensembled classifier was effective in differentiating these movements with an accuracy of 92.3%.
Collapse
|
14
|
Just Add Data: automated predictive modeling for knowledge discovery and feature selection. NPJ Precis Oncol 2022; 6:38. [PMID: 35710826 PMCID: PMC9203777 DOI: 10.1038/s41698-022-00274-8] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/04/2020] [Accepted: 04/13/2022] [Indexed: 01/20/2023] Open
Abstract
Fully automated machine learning (AutoML) for predictive modeling is becoming a reality, giving rise to a whole new field. We present the basic ideas and principles of Just Add Data Bio (JADBio), an AutoML platform applicable to the low-sample, high-dimensional omics data that arise in translational medicine and bioinformatics applications. In addition to predictive and diagnostic models ready for clinical use, JADBio focuses on knowledge discovery by performing feature selection and identifying the corresponding biosignatures, i.e., minimal-size subsets of biomarkers that are jointly predictive of the outcome or phenotype of interest. It also returns a palette of useful information for interpretation, clinical use of the models, and decision making. JADBio is qualitatively and quantitatively compared against Hyper-Parameter Optimization Machine Learning libraries. Results show that in typical omics dataset analysis, JADBio manages to identify signatures comprising of just a handful of features while maintaining competitive predictive performance and accurate out-of-sample performance estimation.
Collapse
|
15
|
Enhanced Marketing Decision Making for Consumer Behaviour Classification Using Binary Decision Trees and a Genetic Algorithm Wrapper. INFORMATICS 2022. [DOI: 10.3390/informatics9020045] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/16/2022] Open
Abstract
An excessive amount of data is generated daily. A consumer’s journey has become extremely complicated due to the number of electronic platforms, the number of devices, the information provided, and the number of providers. The need for artificial intelligence (AI) models that combine marketing data and computer science methods is imperative to classify users’ needs. This work bridges the gap between computer and marketing science by introducing the current trends of AI models on marketing data. It examines consumers’ behaviour by using a decision-making model, which analyses the consumer’s choices and helps the decision-makers to understand their potential clients’ needs. This model is able to predict consumer behaviour both in the digital and physical shopping environments. It combines decision trees (DTs) and genetic algorithms (GAs) through one wrapping technique, known as the GA wrapper method. Consumer data from surveys are collected and categorised based on the research objectives. The GA wrapper was found to perform exceptionally well, reaching classification accuracies above 90%. With regard to the Gender, the Household Size, and Household Monthly Income classes, it manages to indicate the best subsets of specific genes that affect decision making. These classes were found to be associated with a specific set of variables, providing a clear roadmap for marketing decision-making.
Collapse
|
16
|
Ren C, Sun L, Peng D. A Contrastive Predictive Coding-Based Classification Framework for Healthcare Sensor Data. JOURNAL OF HEALTHCARE ENGINEERING 2022; 2022:5649253. [PMID: 35340254 PMCID: PMC8941554 DOI: 10.1155/2022/5649253] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 01/22/2022] [Revised: 02/08/2022] [Accepted: 02/11/2022] [Indexed: 12/04/2022]
Abstract
Supervised learning technologies have been used in medical-data classification to improve diagnosis efficiency and reduce human diagnosis errors. A large amount of manually annotated data are required for the fully supervised learning process. However, annotating data information will consume a large amount of manpower and resources. Self-supervised learning has great advantages in solving this problem. Self-supervised learning mainly uses pretext tasks to mine its own supervised information from large-scale unsupervised data. And this constructed supervised information is used to train the network to learn valuable representations for downstream tasks. This study designs a general and efficient model for the diagnosis and classification of medical sensor data based on contrastive predictive coding (CPC) in self-supervised learning, called TCC, which consists of two steps. The first step is to design a pretext task based on the idea of CPC, which aims to extract effective features between different categories using its encoder. The second step designs a downstream classification task with lower time and space complexity to perform a supervised type of training using the features extracted by the encoder of the pretext task. Finally, to demonstrate the performance of the proposed framework in this paper, we compare the proposed framework with recent state-of-the-art works. Experiments comparing the proposed framework with supervised learning are also set up under the condition of different proportions of labeled data.
Collapse
Affiliation(s)
- Chaoxu Ren
- Engineering Research Center of Digital Forensics, Ministry of Education, Nanjing University of Information Science and Technology, Nanjing, China
| | - Le Sun
- Engineering Research Center of Digital Forensics, Ministry of Education, Nanjing University of Information Science and Technology, Nanjing, China
| | - Dandan Peng
- School of Computer Science and Network Engineering, Guangzhou University, Guangzhou, China
| |
Collapse
|
17
|
Spathis D, Perez-Pozuelo I, Marques-Fernandez L, Mascolo C. Breaking away from labels: The promise of self-supervised machine learning in intelligent health. PATTERNS (NEW YORK, N.Y.) 2022; 3:100410. [PMID: 35199063 PMCID: PMC8848012 DOI: 10.1016/j.patter.2021.100410] [Citation(s) in RCA: 7] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Indexed: 11/15/2022]
Abstract
Medicine is undergoing an unprecedented digital transformation, as massive amounts of health data are being produced, gathered, and curated, ranging from in-hospital (e.g., intensive care unit [ICU]) to person-generated data (wearables). Annotating all these data for training purposes in order to feed to deep learning models for pattern recognition is impractical. Here, we discuss some exciting recent results of self-supervised learning (SSL) applications to high-resolution health signals. These examples leverage unlabeled data to learn meaningful representations that can generalize to situations where the ground truth is inadequate or simply infeasible to collect due to the high burden or associated costs. The most prominent bottleneck of deep learning today is access to labeled, carefully curated datasets, and self-supervision on health signals opens up new possibilities to eliminate data silos through general-purpose models that can transfer to low-resource environments and tasks. Machine learning (ML) touches every area of science, and medicine especially is well poised to benefit the most. Hospital and nonhospital settings generate unprecedented amounts of data that if used correctly can unlock advances in new diagnostics and contribute to preventive medicine. The established paradigm of ML (supervised) requires the collection of input data (such as vitals or imaging) coupled with annotations from experts (such as indications of arrhythmia). New self-supervised models promise to do without annotations by using clever transformations of the input data only and achieve remarkable performance in an array of clinical tasks. This perspective gives a brief overview of the fundamental methodologies that enable these advances and discusses further challenges and opportunities.
Collapse
Affiliation(s)
- Dimitris Spathis
- Department of Computer Science and Technology, University of Cambridge, CB3 0FD Cambridge, UK
| | - Ignacio Perez-Pozuelo
- MRC Epidemiology Unit, School of Clinical Medicine, University of Cambridge, CB2 0SL Cambridge, UK
| | - Laia Marques-Fernandez
- Addenbrooke's Hospital, Cambridge University Hospitals NHS Foundation Trust, CB2 0QQ Cambridge, UK
| | - Cecilia Mascolo
- Department of Computer Science and Technology, University of Cambridge, CB3 0FD Cambridge, UK
| |
Collapse
|
18
|
Representations of temporal sleep dynamics: review and synthesis of the literature. Sleep Med Rev 2022; 63:101611. [DOI: 10.1016/j.smrv.2022.101611] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/09/2021] [Revised: 01/25/2022] [Accepted: 02/07/2022] [Indexed: 12/13/2022]
|