1
|
Pandya S, Jain S, Verma J. A comprehensive analysis towards exploring the promises of AI-related approaches in autism research. Comput Biol Med 2024; 168:107801. [PMID: 38064848 DOI: 10.1016/j.compbiomed.2023.107801] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/26/2023] [Revised: 11/09/2023] [Accepted: 11/29/2023] [Indexed: 01/10/2024]
Abstract
Autism Spectrum Disorder (ASD) is a neurodevelopmental condition that presents challenges in communication, social interaction, repetitive behaviour, and limited interests. Detecting ASD at an early stage is crucial for timely interventions and an improved quality of life. In recent times, Artificial Intelligence (AI) has been increasingly used in ASD research. The rise in ASD diagnoses is due to the growing number of ASD cases and the recognition of the importance of early detection, which leads to better symptom management. This study explores the potential of AI in identifying early indicators of autism, aligning with the United Nations Sustainable Development Goals (SDGs) of Good Health and Well-being (Goal 3) and Peace, Justice, and Strong Institutions (Goal 16). The paper aims to provide a comprehensive overview of the current state-of-the-art AI-based autism classification by reviewing recent publications from the last decade. It covers various modalities such as Eye gaze, Facial Expression, Motor skill, MRI/fMRI, and EEG, and multi-modal approaches primarily grouped into behavioural and biological markers. The paper presents a timeline spanning from the history of ASD to recent developments in the field of AI. Additionally, the paper provides a category-wise detailed analysis of the AI-based application in ASD with a diagrammatic summarization to convey a holistic summary of different modalities. It also reports on the successes and challenges of applying AI for ASD detection while providing publicly available datasets. The paper paves the way for future scope and directions, providing a complete and systematic overview for researchers in the field of ASD.
Collapse
Affiliation(s)
- Shivani Pandya
- Department of Computer Science and Engineering, Nirma University, Ahmedabad, Gujarat 382481, India.
| | - Swati Jain
- Department of Computer Science and Engineering, Nirma University, Ahmedabad, Gujarat 382481, India.
| | - Jaiprakash Verma
- Department of Computer Science and Engineering, Nirma University, Ahmedabad, Gujarat 382481, India.
| |
Collapse
|
2
|
Iannone A, Giansanti D. Breaking Barriers-The Intersection of AI and Assistive Technology in Autism Care: A Narrative Review. J Pers Med 2023; 14:41. [PMID: 38248742 PMCID: PMC10817661 DOI: 10.3390/jpm14010041] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/04/2023] [Revised: 12/18/2023] [Accepted: 12/23/2023] [Indexed: 01/23/2024] Open
Abstract
(Background) Autism increasingly requires a multidisciplinary approach that can effectively harmonize the realms of diagnosis and therapy, tailoring both to the individual. Assistive technologies (ATs) play an important role in this context and hold significant potential when integrated with artificial intelligence (AI). (Objective) The objective of this study is to analyze the state of integration of AI with ATs in autism through a review. (Methods) A review was conducted on PubMed and Scopus, applying a standard checklist and a qualification process. The outcome reported 22 studies, including 7 reviews. (Key Content and Findings) The results reveal an early yet promising interest in integrating AI into autism assistive technologies. Exciting developments are currently underway at the intersection of AI and robotics, as well as in the creation of wearable automated devices like smart glasses. These innovations offer substantial potential for enhancing communication, interaction, and social engagement for individuals with autism. Presently, researchers are prioritizing innovation over establishing a solid presence within the healthcare domain, where issues such as regulation and acceptance demand increased attention. (Conclusions) As the field continues to evolve, it becomes increasingly clear that AI will play a pivotal role in bridging various domains, and integrated ATs with AI are positioned to act as crucial connectors.
Collapse
Affiliation(s)
- Antonio Iannone
- CREA, Italian National Research Body, Via Ardeatina, 546, 00178 Roma, Italy
| | - Daniele Giansanti
- Centro Nazionale TISP, Istituto Superiore di Sanità; Viale Regina Elena 299, 00161 Roma, Italy
| |
Collapse
|
3
|
Giansanti D. An Umbrella Review of the Fusion of fMRI and AI in Autism. Diagnostics (Basel) 2023; 13:3552. [PMID: 38066793 PMCID: PMC10706112 DOI: 10.3390/diagnostics13233552] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/21/2023] [Revised: 11/22/2023] [Accepted: 11/25/2023] [Indexed: 04/05/2024] Open
Abstract
The role of functional magnetic resonance imaging (fMRI) is assuming an increasingly central role in autism diagnosis. The integration of Artificial Intelligence (AI) into the realm of applications further contributes to its development. This study's objective is to analyze emerging themes in this domain through an umbrella review, encompassing systematic reviews. The research methodology was based on a structured process for conducting a literature narrative review, using an umbrella review in PubMed and Scopus. Rigorous criteria, a standard checklist, and a qualification process were meticulously applied. The findings include 20 systematic reviews that underscore key themes in autism research, particularly emphasizing the significance of technological integration, including the pivotal roles of fMRI and AI. This study also highlights the enigmatic role of oxytocin. While acknowledging the immense potential in this field, the outcome does not evade acknowledging the significant challenges and limitations. Intriguingly, there is a growing emphasis on research and innovation in AI, whereas aspects related to the integration of healthcare processes, such as regulation, acceptance, informed consent, and data security, receive comparatively less attention. Additionally, the integration of these findings into Personalized Medicine (PM) represents a promising yet relatively unexplored area within autism research. This study concludes by encouraging scholars to focus on the critical themes of health domain integration, vital for the routine implementation of these applications.
Collapse
Affiliation(s)
- Daniele Giansanti
- Centro Nazionale TISP, Istituto Superiore di Sanità, Viale Regina Elena 299, 00161 Roma, Italy
| |
Collapse
|
4
|
Fadzli FE, Ismail AW, Abd Karim Ishigaki S. A systematic literature review: Real-time 3D reconstruction method for telepresence system. PLoS One 2023; 18:e0287155. [PMID: 37967080 PMCID: PMC10651044 DOI: 10.1371/journal.pone.0287155] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/30/2021] [Accepted: 06/01/2023] [Indexed: 11/17/2023] Open
Abstract
Real-time three-dimensional (3D) reconstruction of real-world environments has many significant applications in various fields, including telepresence technology. When depth sensors, such as those from Microsoft's Kinect series, are introduced simultaneously and become widely available, a new generation of telepresence systems can be developed by combining a real-time 3D reconstruction method with these new technologies. This combination enables users to engage with a remote person while remaining in their local area, as well as control remote devices while viewing their 3D virtual representation. There are numerous applications in which having a telepresence experience could be beneficial, including remote collaboration and entertainment, as well as education, advertising, and rehabilitation. The purpose of this systematic literature review is to analyze the recent advances in 3D reconstruction methods for telepresence systems and the significant related work in this field. Next, we determine the input data and the technological device employed to acquire the input data, which will be utilized in the 3D reconstruction process. The methods of 3D reconstruction implemented in the telepresence system as well as the evaluation of the system, have been extracted and assessed from the included studies. Through the analysis and summarization of many dimensions, we discussed the input data used for the 3D reconstruction method, the real-time 3D reconstruction methods implemented in the telepresence system, and how to evaluate the system. We conclude that real-time 3D reconstruction methods for telepresence systems have progressively improved over the years in conjunction with the advancement of machines and devices such as Red Green Blue-Depth (RGB-D) cameras and Graphics Processing Unit (GPU).
Collapse
Affiliation(s)
- Fazliaty Edora Fadzli
- Department of Emergent Computing, Faculty of Computing, Universiti Teknologi Malaysia (UTM), Johor Bahru, Johore, Malaysia
- Mixed and Virtual Environment Research Lab (mivielab), ViCubeLab, Universiti Teknologi Malaysia (UTM), Johor Bahru, Johore, Malaysia
| | - Ajune Wanis Ismail
- Department of Emergent Computing, Faculty of Computing, Universiti Teknologi Malaysia (UTM), Johor Bahru, Johore, Malaysia
- Mixed and Virtual Environment Research Lab (mivielab), ViCubeLab, Universiti Teknologi Malaysia (UTM), Johor Bahru, Johore, Malaysia
| | - Shafina Abd Karim Ishigaki
- Department of Emergent Computing, Faculty of Computing, Universiti Teknologi Malaysia (UTM), Johor Bahru, Johore, Malaysia
- Mixed and Virtual Environment Research Lab (mivielab), ViCubeLab, Universiti Teknologi Malaysia (UTM), Johor Bahru, Johore, Malaysia
| |
Collapse
|
5
|
Helmy E, Elnakib A, ElNakieb Y, Khudri M, Abdelrahim M, Yousaf J, Ghazal M, Contractor S, Barnes GN, El-Baz A. Role of Artificial Intelligence for Autism Diagnosis Using DTI and fMRI: A Survey. Biomedicines 2023; 11:1858. [PMID: 37509498 PMCID: PMC10376963 DOI: 10.3390/biomedicines11071858] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/26/2023] [Revised: 06/22/2023] [Accepted: 06/27/2023] [Indexed: 07/30/2023] Open
Abstract
Autism spectrum disorder (ASD) is a wide range of diseases characterized by difficulties with social skills, repetitive activities, speech, and nonverbal communication. The Centers for Disease Control (CDC) estimates that 1 in 44 American children currently suffer from ASD. The current gold standard for ASD diagnosis is based on behavior observational tests by clinicians, which suffer from being subjective and time-consuming and afford only late detection (a child must have a mental age of at least two to apply for an observation report). Alternatively, brain imaging-more specifically, magnetic resonance imaging (MRI)-has proven its ability to assist in fast, objective, and early ASD diagnosis and detection. With the recent advances in artificial intelligence (AI) and machine learning (ML) techniques, sufficient tools have been developed for both automated ASD diagnosis and early detection. More recently, the development of deep learning (DL), a young subfield of AI based on artificial neural networks (ANNs), has successfully enabled the processing of brain MRI data with improved ASD diagnostic abilities. This survey focuses on the role of AI in autism diagnostics and detection based on two basic MRI modalities: diffusion tensor imaging (DTI) and functional MRI (fMRI). In addition, the survey outlines the basic findings of DTI and fMRI in autism. Furthermore, recent techniques for ASD detection using DTI and fMRI are summarized and discussed. Finally, emerging tendencies are described. The results of this study show how useful AI is for early, subjective ASD detection and diagnosis. More AI solutions that have the potential to be used in healthcare settings will be introduced in the future.
Collapse
Affiliation(s)
- Eman Helmy
- Department of Diagnostic Radiology, Faculty of Medicine, Mansoura University, Elgomheryia Street, Mansoura 3512, Egypt;
| | - Ahmed Elnakib
- Bioengineering Department, University of Louisville, Louisville, KY 40292, USA; (A.E.); (Y.E.); (M.K.); (M.A.)
| | - Yaser ElNakieb
- Bioengineering Department, University of Louisville, Louisville, KY 40292, USA; (A.E.); (Y.E.); (M.K.); (M.A.)
| | - Mohamed Khudri
- Bioengineering Department, University of Louisville, Louisville, KY 40292, USA; (A.E.); (Y.E.); (M.K.); (M.A.)
| | - Mostafa Abdelrahim
- Bioengineering Department, University of Louisville, Louisville, KY 40292, USA; (A.E.); (Y.E.); (M.K.); (M.A.)
| | - Jawad Yousaf
- Electrical, Computer, and Biomedical Engineering Department, Abu Dhabi University, Abu Dhabi 59911, United Arab Emirates; (J.Y.); (M.G.)
| | - Mohammed Ghazal
- Electrical, Computer, and Biomedical Engineering Department, Abu Dhabi University, Abu Dhabi 59911, United Arab Emirates; (J.Y.); (M.G.)
| | - Sohail Contractor
- Department of Radiology, University of Louisville, Louisville, KY 40202, USA;
| | - Gregory Neal Barnes
- Department of Neurology, Pediatric Research Institute, University of Louisville, Louisville, KY 40202, USA;
| | - Ayman El-Baz
- Bioengineering Department, University of Louisville, Louisville, KY 40292, USA; (A.E.); (Y.E.); (M.K.); (M.A.)
| |
Collapse
|
6
|
Human Factor Engineering Research for Rehabilitation Robots: A Systematic Review. COMPUTATIONAL INTELLIGENCE AND NEUROSCIENCE 2023; 2023:2052231. [PMID: 36793706 PMCID: PMC9925240 DOI: 10.1155/2023/2052231] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 07/12/2022] [Revised: 11/07/2022] [Accepted: 01/23/2023] [Indexed: 02/08/2023]
Abstract
The application of human factors engineering for rehabilitation robots is based on a "human-centered" design philosophy that strives to provide safe and efficient human-robot interaction training for patients rather than depending on rehabilitation therapists. Human factors engineering for rehabilitation robots is undergoing preliminary investigation. However, the depth and breadth of current research do not provide a complete human factor engineering solution for developing rehabilitation robots. This study aims to provide a systematic review of research at the intersection of rehabilitation robotics and ergonomics to understand the progress and state-of-the-art research on critical human factors, issues, and corresponding solutions for rehabilitation robots. A total of 496 relevant studies were obtained from six scientific database searches, reference searches, and citation-tracking strategies. After applying the selection criteria and reading the full text of each study, 21 studies were selected for review and classified into four categories based on their human factor objectives: implementation of high safety, implementation of lightweight and high comfort, implementation of high human-robot interaction, and performance evaluation index and system studies. Based on the results of the studies, recommendations for future research are presented and discussed.
Collapse
|
7
|
Albahri AS, Al-qaysi ZT, Alzubaidi L, Alnoor A, Albahri OS, Alamoodi AH, Bakar AA. A Systematic Review of Using Deep Learning Technology in the Steady-State Visually Evoked Potential-Based Brain-Computer Interface Applications: Current Trends and Future Trust Methodology. Int J Telemed Appl 2023; 2023:7741735. [PMID: 37168809 PMCID: PMC10164869 DOI: 10.1155/2023/7741735] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/25/2022] [Revised: 02/01/2023] [Accepted: 03/16/2023] [Indexed: 05/13/2023] Open
Abstract
The significance of deep learning techniques in relation to steady-state visually evoked potential- (SSVEP-) based brain-computer interface (BCI) applications is assessed through a systematic review. Three reliable databases, PubMed, ScienceDirect, and IEEE, were considered to gather relevant scientific and theoretical articles. Initially, 125 papers were found between 2010 and 2021 related to this integrated research field. After the filtering process, only 30 articles were identified and classified into five categories based on their type of deep learning methods. The first category, convolutional neural network (CNN), accounts for 70% (n = 21/30). The second category, recurrent neural network (RNN), accounts for 10% (n = 3/30). The third and fourth categories, deep neural network (DNN) and long short-term memory (LSTM), account for 6% (n = 30). The fifth category, restricted Boltzmann machine (RBM), accounts for 3% (n = 1/30). The literature's findings in terms of the main aspects identified in existing applications of deep learning pattern recognition techniques in SSVEP-based BCI, such as feature extraction, classification, activation functions, validation methods, and achieved classification accuracies, are examined. A comprehensive mapping analysis was also conducted, which identified six categories. Current challenges of ensuring trustworthy deep learning in SSVEP-based BCI applications were discussed, and recommendations were provided to researchers and developers. The study critically reviews the current unsolved issues of SSVEP-based BCI applications in terms of development challenges based on deep learning techniques and selection challenges based on multicriteria decision-making (MCDM). A trust proposal solution is presented with three methodology phases for evaluating and benchmarking SSVEP-based BCI applications using fuzzy decision-making techniques. Valuable insights and recommendations for researchers and developers in the SSVEP-based BCI and deep learning are provided.
Collapse
Affiliation(s)
- A. S. Albahri
- Iraqi Commission for Computers and Informatics (ICCI), Baghdad, Iraq
| | - Z. T. Al-qaysi
- Department of Computer Science, Computer Science and Mathematics College, Tikrit University, Tikrit, Iraq
| | - Laith Alzubaidi
- School of Mechanical, Medical, and Process Engineering, Queensland University of Technology, Brisbane, QLD 4000, Australia
- ARC Industrial Transformation Training Centre—Joint Biomechanics, Queensland University of Technology, Brisbane, QLD 4000, Australia
| | | | - O. S. Albahri
- Computer Techniques Engineering Department, Mazaya University College, Nasiriyah, Iraq
- Department of Computer Science and Information Technology, La Trobe University, Melbourne, VIC, Australia
| | - A. H. Alamoodi
- Faculty of Computing and Meta-Technology (FKMT), Universiti Pendidikan Sultan Idris (UPSI), Perak, Malaysia
| | | |
Collapse
|
8
|
Hybrid Diagnosis Models for Autism Patients Based on Medical and Sociodemographic Features Using Machine Learning and Multicriteria Decision-Making (MCDM) Techniques: An Evaluation and Benchmarking Framework. COMPUTATIONAL AND MATHEMATICAL METHODS IN MEDICINE 2022; 2022:9410222. [DOI: 10.1155/2022/9410222] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/19/2022] [Revised: 10/01/2022] [Accepted: 10/18/2022] [Indexed: 11/18/2022]
Abstract
Background and Contexts. Autism spectrum disorder (ASD) is difficult to diagnose, prompting researchers to increase their efforts to find the best diagnosis by introducing machine learning (ML). Recently, several available challenges and issues have been highlighted for the diagnosis of ASD. High consideration must be taken into the feature selection (FS) approaches and classification process simultaneously by using medical tests and sociodemographic characteristic features in autism diagnostic. The constructed ML models neglected the importance of medical tests and sociodemographic features in a training and evaluation dataset, especially since some features have different contributions to the processing data and possess more relevancies to the classification information than others. However, the role of the physician’s experience towards feature contributions remains limited. In addition, the presence of many evaluation criteria, criteria trade-offs, and criteria importance categorize the evaluation and benchmarking of diagnosis ML models concerning the intersection between FS approaches and ML classification methods given under complex multicriteria decision-making (MCDM) problems. To date, no study has presented an evaluation framework for benchmarking the best hybrid diagnosis models to classify autism patients’ emergency levels considering multicriteria evaluation solutions. Method. The three-phase framework integrated the MCDM and ML to develop the diagnosis models and evaluate and benchmark the best. Firstly, the new ASD-dataset-combined medical tests and sociodemographic characteristic features is identified and preprocessed. Secondly, developing the hybrid diagnosis models using the intersection process between three FS techniques and five ML algorithms introduces 15 models. The selected medical tests and sociodemographic features from each FS technique are weighted before feeding the five ML algorithms using the fuzzy-weighted zero-inconsistency (FWZIC) method based on four psychiatry experts. Thirdly, (i) formulate a dynamic decision matrix for all developed models based on seven evaluation metrics, including classification accuracy, precision, F1 score, recall, test time, train time, and AUC. (ii) The fuzzy decision by opinion score method (FDOSM) is used to evaluate and benchmark the 15 models concerning the seven evaluation metrics. Results. Results reveal that (i) the three FS techniques have obtained a size different from the others in the number of the selected features; the sets were 39, 38, and 41 out of 48 features. Each set has its weights constructed by FWIZC. Considered sociodemographic features have been mostly selected more than medical tests within FS techniques. (ii) The first three best hybrid models were “ReF-decision tree,” “IG-decision tree,” and “Chi2-decision tree,” with score values 0.15714, 0.17539, and 0.29444. The best diagnosis model (ReF-decision tree) has obtained 0.4190, 0.0030, 0.9946, 0.9902, 0.9902, 0.9902, 0.9902, and 0.9951 for the C1=train time, C2=test time, C3=AUC, C4=CA, C5=F1 score, C6=precision, and C7=recall, respectively. The developed framework would be beneficial in advancing, accelerating, and selecting diagnosis tools in therapy with ASD. The selected model can identify severity as light, medium, or intense based on medical tests and sociodemographic weighted features.
Collapse
|
9
|
Joudar SS, Albahri A, Hamid RA. Intelligent triage method for early diagnosis autism spectrum disorder (ASD) based on integrated fuzzy multi-criteria decision-making methods. INFORMATICS IN MEDICINE UNLOCKED 2022. [DOI: 10.1016/j.imu.2022.101131] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/17/2022] Open
|
10
|
Diagnosis-Based Hybridization of Multimedical Tests and Sociodemographic Characteristics of Autism Spectrum Disorder Using Artificial Intelligence and Machine Learning Techniques: A Systematic Review. Int J Telemed Appl 2022; 2022:3551528. [PMID: 35814280 PMCID: PMC9270139 DOI: 10.1155/2022/3551528] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/23/2022] [Revised: 05/31/2022] [Accepted: 06/13/2022] [Indexed: 11/18/2022] Open
Abstract
Autism spectrum disorder (ASD) is a complex neurobehavioral condition that begins in childhood and continues throughout life, affecting communication and verbal and behavioral skills. It is challenging to discover autism in the early stages of life, which prompted researchers to intensify efforts to reach the best solutions to treat this challenge by introducing artificial intelligence (AI) techniques and machine learning (ML) algorithms, which played an essential role in greatly assisting the medical and healthcare staff and trying to obtain the highest predictive results for autism spectrum disorder. This study is aimed at systematically reviewing the literature related to the criteria, including multimedical tests and sociodemographic characteristics in AI techniques and ML contributions. Accordingly, this study checked the Web of Science (WoS), Science Direct (SD), IEEE Xplore digital library, and Scopus databases. A set of 944 articles from 2017 to 2021 is collected to reveal a clear picture and better understand all the academic literature through a definitive collection of 40 articles based on our inclusion and exclusion criteria. The selected articles were divided based on similarity, objective, and aim evidence across studies. They are divided into two main categories: the first category is “diagnosis of ASD based on questionnaires and sociodemographic features” (
). This category contains a subsection that consists of three categories: (a) early diagnosis of ASD towards analysis, (b) diagnosis of ASD towards prediction, and (c) diagnosis of ASD based on resampling techniques. The second category consists of “diagnosis ASD based on medical and family characteristic features” (
). This multidisciplinary systematic review revealed the taxonomy, motivations, recommendations, and challenges of diagnosis ASD research in utilizing AI techniques and ML algorithms that need synergistic attention. Thus, this systematic review performs a comprehensive science mapping analysis and identifies the open issues that help accomplish the recommended solution of diagnosis ASD research. Finally, this study critically reviews the literature and attempts to address the diagnosis ASD research gaps in knowledge and highlights the available ASD datasets, AI techniques and ML algorithms, and the feature selection methods that have been collected from the final set of articles.
Collapse
|