1
|
Javaid S, Rizvi S, Ubaid MT, Darboe A, Mayo SM. Interpretation of Expressions through Hand Signs Using Deep Learning Techniques. IJIST 2022; 4:596-611. [DOI: 10.33411/ijist/2022040225] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 09/01/2023]
Abstract
It is a challenging task to interpret sign language automatically, as it comprises high-level vision features to accurately understand and interpret the meaning of the signer or vice versa. In the current study, we automatically distinguish hand signs and classify seven basic gestures representing symbolic emotions or expressions like happy, sad, neutral, disgust, scared, anger, and surprise. Convolutional Neural Network is a famous method for classifications using vision-based deep learning; here in the current study, proposed transfer learning using a well-known architecture of VGG16 to speed up the convergence and improve accuracy by using pre-trained weights. We obtained a high accuracy of 99.98% of the proposed architecture with a minimal and low-quality data set of 455 images collected by 65 individuals for seven hand gesture classes. Further, compared the performance of VGG16 architecture with two different optimizers, SGD, and Adam, along with some more architectures of Alex Net, LeNet05, and ResNet50.
Collapse
Affiliation(s)
| | | | - Muhammad Talha Ubaid
- National Center of Artificial Intelligence, KICS, University of Engineering and Technology, Lahore 39161, Pakistan
| | - Abdou Darboe
- University of The Gambia, Serrekunda, The Gambia
| | | |
Collapse
|
2
|
Ubaid MT, Saba T, Draz HU, Rehman A, Ghani MU, Kolivand H. Intelligent Traffic Signal Automation Based on Computer Vision Techniques Using Deep Learning. IT Prof 2022; 24:27-33. [DOI: 10.1109/mitp.2021.3121804] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 09/01/2023]
Affiliation(s)
- Muhammad Talha Ubaid
- Al Khawarizmi Institute of Computer Science, University of Engineering and Technology, Lahore, Pakistan
| | - Tanzila Saba
- Artificial Intelligence & Data Analytics Lab CCIS, Prince Sultan University, Riyadh, Saudi Arabia
| | - Hafiz Umer Draz
- Al Khawarizmi Institute of Computer Science, University of Engineering and Technology, Lahore, Pakistan
| | - Amjad Rehman
- Artificial Intelligence & Data Analytics Lab CCIS, Prince Sultan University, Riyadh, Saudi Arabia
| | - Muhammad Usman Ghani
- Al Khawarizmi Institute of Computer Science, University of Engineering and Technology, Lahore, Pakistan
| | - Hoshang Kolivand
- School of Computer Science and Mathematics, Liverpool John Moores University, Liverpool, U.K
| |
Collapse
|
3
|
Javaid S, Rizvi S, Ubaid MT, Tariq A. Notice of Violation of IEEE Publication Principles: VVC/H.266 Intra Mode QTMT Based CU Partition Using CNN. IEEE Access 2022; 10:37246-37256. [DOI: 10.1109/access.2022.3164421] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 09/01/2023]
Affiliation(s)
- Sameena Javaid
- Department of Computer Sciences, School of Engineering and Applied Sciences, Bahria University Karachi Campus, Karachi, Pakistan
| | - Safdar Rizvi
- Department of Computer Sciences, School of Engineering and Applied Sciences, Bahria University Karachi Campus, Karachi, Pakistan
| | - Muhammad Talha Ubaid
- National Center of Artificial Intelligence, KICS, University of Engineering and Technology, Lahore, Pakistan
| | - Abdullah Tariq
- National Center of Artificial Intelligence, KICS, University of Engineering and Technology, Lahore, Pakistan
| |
Collapse
|
4
|
Ubaid MT, Khan MZ, Khan MUG, Rehman A, Ayesha N. Multiple Parallel Activity Detection and Recognition to Avoid COVID-19 Spread-Out. Lecture Notes in Networks and Systems 2022:207-217. [DOI: 10.1007/978-981-16-7618-5_18] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 09/01/2023]
|
5
|
Ubaid MT, Khalil M, Khan MUG, Saba T, Rehman A. Beard and Hair Detection, Segmentation and Changing Color Using Mask R-CNN. Lecture Notes in Networks and Systems 2022:63-73. [DOI: 10.1007/978-981-16-7618-5_6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 09/01/2023]
|
6
|
Ubaid MT, Kiran A, Raja MT, Asim UA, Darboe A, Arshed MA. Automatic Helmet Detection using EfficientDet. 2021 International Conference on Innovative Computing (ICIC) 2021. [DOI: 10.1109/icic53490.2021.9693093] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 09/01/2023]
|
7
|
Ubaid MT, Darboe A, Uche FS, Daffeh A, Khan MUG. Kett Mangoes Detection in the Gambia using Deep Learning Techniques. 2021 International Conference on Innovative Computing (ICIC) 2021. [DOI: 10.1109/icic53490.2021.9693082] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 09/01/2023]
Affiliation(s)
- Muhammad Talha Ubaid
- Intelligent Criminology Research Lab National Center of Artificial Intelligence,KICS,UET Lahore
| | - Abdou Darboe
- University of The Gambia,Dept. of Information Technology Services,Banjul,The Gambia
| | - Fred Sangol Uche
- University of The Gambia,Computer Science Department,Banjul,The Gambia
| | - Adama Daffeh
- University of The Gambia,Computer Science Department,Banjul,The Gambia
| | | |
Collapse
|
8
|
Arshed MA, Qureshi W, Rumaan M, Ubaid MT, Qudoos A, Khan MUG. Comparison of Machine Learning Classifiers for Breast Cancer Diagnosis. 2021 International Conference on Innovative Computing (ICIC) 2021. [DOI: 10.1109/icic53490.2021.9692926] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 09/01/2023]
Affiliation(s)
- Muhammad Asad Arshed
- Al-Khawarizmi Institute of Computer Science (KICS), University of Engineering and Technology (UET),Intelligent Criminology Research Lab (ICRL), National Center of Artificial Intelligence (NCAI),Lahore,Pakistan
| | - Wajeeha Qureshi
- The Islamia University of Bahawalpur (IUB),Department of Computer Science,Bahawalpur,Pakistan
| | - Muhammad Rumaan
- Al-Khawarizmi Institute of Computer Science (KICS), University of Engineering and Technology (UET),Intelligent Criminology Research Lab (ICRL), National Center of Artificial Intelligence (NCAI),Lahore,Pakistan
| | - Muhammad Talha Ubaid
- Al-Khawarizmi Institute of Computer Science (KICS), University of Engineering and Technology (UET),Intelligent Criminology Research Lab (ICRL), National Center of Artificial Intelligence (NCAI),Lahore,Pakistan
| | - Abdul Qudoos
- Al-Khawarizmi Institute of Computer Science (KICS), University of Engineering and Technology (UET),Intelligent Criminology Research Lab (ICRL), National Center of Artificial Intelligence (NCAI),Lahore,Pakistan
| | - Muhammad Usman Ghani Khan
- Al-Khawarizmi Institute of Computer Science (KICS), University of Engineering and Technology (UET),Intelligent Criminology Research Lab (ICRL), National Center of Artificial Intelligence (NCAI),Lahore,Pakistan
| |
Collapse
|