1
|
Afzal S, Ghani S, Hittawe MM, Rashid SF, Knio OM, Hadwiger M, Hoteit I. Visualization and Visual Analytics Approaches for Image and Video Datasets: A Survey. ACM T INTERACT INTEL 2023. [DOI: 10.1145/3576935] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/03/2023]
Abstract
Image and video data analysis has become an increasingly important research area with applications in different domains such as security surveillance, healthcare, augmented and virtual reality, video and image editing, activity analysis and recognition, synthetic content generation, distance education, telepresence, remote sensing, sports analytics, art, non-photorealistic rendering, search engines, and social media. Recent advances in Artificial Intelligence (AI) and particularly deep learning have sparked new research challenges and led to significant advancements, especially in image and video analysis. These advancements have also resulted in significant research and development in other areas such as visualization and visual analytics, and have created new opportunities for future lines of research. In this survey paper, we present the current state of the art at the intersection of visualization and visual analytics, and image and video data analysis. We categorize the visualization papers included in our survey based on different taxonomies used in visualization and visual analytics research. We review these papers in terms of task requirements, tools, datasets, and application areas. We also discuss insights based on our survey results, trends and patterns, the current focus of visualization research, and opportunities for future research.
Collapse
Affiliation(s)
- Shehzad Afzal
- King Abdullah University of Science & Technology, Saudi Arabia
| | - Sohaib Ghani
- King Abdullah University of Science & Technology, Saudi Arabia
| | | | | | - Omar M Knio
- King Abdullah University of Science & Technology, Saudi Arabia
| | - Markus Hadwiger
- King Abdullah University of Science & Technology, Saudi Arabia
| | - Ibrahim Hoteit
- King Abdullah University of Science & Technology, Saudi Arabia
| |
Collapse
|
2
|
Guo Y, Guo S, Jin Z, Kaul S, Gotz D, Cao N. Survey on Visual Analysis of Event Sequence Data. IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS 2022; 28:5091-5112. [PMID: 34314358 DOI: 10.1109/tvcg.2021.3100413] [Citation(s) in RCA: 9] [Impact Index Per Article: 4.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/13/2023]
Abstract
Event sequence data record series of discrete events in the time order of occurrence. They are commonly observed in a variety of applications ranging from electronic health records to network logs, with the characteristics of large-scale, high-dimensional and heterogeneous. This high complexity of event sequence data makes it difficult for analysts to manually explore and find patterns, resulting in ever-increasing needs for computational and perceptual aids from visual analytics techniques to extract and communicate insights from event sequence datasets. In this paper, we review the state-of-the-art visual analytics approaches, characterize them with our proposed design space, and categorize them based on analytical tasks and applications. From our review of relevant literature, we have also identified several remaining research challenges and future research opportunities.
Collapse
|
3
|
Zhang H, Dong J, Lv C, Lin Y, Bai J. Visual analytics of potential dropout behavior patterns in online learning based on counterfactual explanation. J Vis (Tokyo) 2022. [DOI: 10.1007/s12650-022-00899-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
|
4
|
A survival analysis based volatility and sparsity modeling network for student dropout prediction. PLoS One 2022; 17:e0267138. [PMID: 35512010 PMCID: PMC9071151 DOI: 10.1371/journal.pone.0267138] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/09/2021] [Accepted: 04/04/2022] [Indexed: 11/19/2022] Open
Abstract
Student Dropout Prediction (SDP) is pivotal in mitigating withdrawals in Massive Open Online Courses. Previous studies generally modeled the SDP problem as a binary classification task, providing a single prediction outcome. Accordingly, some attempts introduce survival analysis methods to achieve continuous and consistent predictions over time. However, the volatility and sparsity of data always weaken the models’ performance. Prevailing solutions rely heavily on data pre-processing independent of predictive models, which are labor-intensive and may contaminate authentic data. This paper proposes a Survival Analysis based Volatility and Sparsity Modeling Network (SAVSNet) to address these issues in an end-to-end deep learning framework. Specifically, SAVSNet smooths the volatile time series by convolution network while preserving the original data information using Long-Short Term Memory Network (LSTM). Furthermore, we propose a Time-Missing-Aware LSTM unit to mitigate the impact of data sparsity by integrating informative missingness patterns into the model. A survival analysis loss function is adopted for parameter estimation, and the model outputs monotonically decreasing survival probabilities. In the experiments, we compare the proposed method with state-of-the-art methods in two real-world MOOC datasets, and the experiment results show the effectiveness of our proposed model.
Collapse
|
5
|
|
6
|
Zhehua Z. Research on mixed learning mode based on MOOCs and micro class in internet background. JOURNAL OF INTELLIGENT & FUZZY SYSTEMS 2021. [DOI: 10.3233/jifs-219132] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/15/2022]
Abstract
In the era of education information and globalization, a new mode of teaching and micro class has emerged in the background of the Internet, which brings new challenges and opportunities to the teaching of the classroom. MOOCs has been piloted and applied in many universities in the form of SPOC. As a new form of curriculum, micro course has been applied to the teaching and learning process. The integration of Moor and micro class resources helps to turn the classroom into a mixed mode. This article will focus on this hot topic to analyse the characteristics of the class, the characteristics of the micro class and the influence on the students and teachers, to improve the quality of teaching and to realize the individualized and active study of the students. The article summarizes the results of blended teaching mode at home and abroad, and explores the development and application of MOOC and micro class resources.
Collapse
Affiliation(s)
- Zhang Zhehua
- School of Foreign Studies, Ankang University, Ankang, Shaanxi
| |
Collapse
|
7
|
Asli MF, Hamzah M, Ibrahim AAA, Ayub E. Problem characterization for visual analytics in MOOC learner's support monitoring: A case of Malaysian MOOC. Heliyon 2020; 6:e05733. [PMID: 33426320 PMCID: PMC7775862 DOI: 10.1016/j.heliyon.2020.e05733] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/07/2020] [Revised: 09/11/2020] [Accepted: 12/11/2020] [Indexed: 10/31/2022] Open
Abstract
Malaysia and many other developing countries progressively adopting massively open online course (MOOC) in their national higher education approach. We have observed an increasing need for facilitating MOOC monitoring that is associated with the rising adoption of MOOCs. Our observation suggests that recent adoption cases led analyst and instructors to focus on monitoring enrolment and learning activities. Visual analytics in MOOC support education analysts in analyzing MOOC data via interactive visualization. Existing literature on MOOC visualization focuses on enabling visual analysis on MOOC data from forum and course material. We found limited studies that investigate and characterize domain problems or design requirements of visual analytics for MOOC. This paper aims to present the empirical problem characterization and abstraction for visual analytics in MOOC learner's support monitoring. Detailed characterization and abstraction of the domain problem help visualization designer to derive design requirements in generating appropriate visualization solution. We examined the literature and conducted a case study to elicit a problem abstraction based on data, users, and tasks. We interviewed five Malaysian MOOC experts from three higher education institutes using semi-structured questions. Our case study reveals the priority of enabling MOOC analysis on learner's progression and course completion. There is an association between design and analysis priority with the pedagogical type of implemented MOOC and users. The characterized domain problems and requirements offer a design foundation for visual analytics in MOOC monitoring analysis.
Collapse
Affiliation(s)
| | - Muzaffar Hamzah
- Faculty of Computing and Informatics, Universiti Malaysia Sabah, Malaysia
| | - Ag Asri Ag Ibrahim
- Faculty of Computing and Informatics, Universiti Malaysia Sabah, Malaysia
| | - Enna Ayub
- Centre for Future Learning, Taylor's University, Malaysia
| |
Collapse
|
8
|
Arruarte J, Larrañaga M, Arruarte A, Elorriaga JA. Measuring the Quality of Test-based Exercises Based on the Performance of Students. INTERNATIONAL JOURNAL OF ARTIFICIAL INTELLIGENCE IN EDUCATION 2020. [DOI: 10.1007/s40593-020-00208-0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/23/2022]
|
9
|
Chen Q, Yue X, Plantaz X, Chen Y, Shi C, Pong TC, Qu H. ViSeq: Visual Analytics of Learning Sequence in Massive Open Online Courses. IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS 2020; 26:1622-1636. [PMID: 30281461 DOI: 10.1109/tvcg.2018.2872961] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/08/2023]
Abstract
The research on massive open online courses (MOOCs) data analytics has mushroomed recently because of the rapid development of MOOCs. The MOOC data not only contains learner profiles and learning outcomes, but also sequential information about when and which type of learning activities each learner performs, such as reviewing a lecture video before undertaking an assignment. Learning sequence analytics could help understand the correlations between learning sequences and performances, which further characterize different learner groups. However, few works have explored the sequence of learning activities, which have mostly been considered aggregated events. A visual analytics system called ViSeq is introduced to resolve the loss of sequential information, to visualize the learning sequence of different learner groups, and to help better understand the reasons behind the learning behaviors. The system facilitates users in exploring learning sequences from multiple levels of granularity. ViSeq incorporates four linked views: the projection view to identify learner groups, the pattern view to exhibit overall sequential patterns within a selected group, the sequence view to illustrate the transitions between consecutive events, and the individual view with an augmented sequence chain to compare selected personal learning sequences. Case studies and expert interviews were conducted to evaluate the system.
Collapse
|
10
|
Zhao Y, Luo X, Lin X, Wang H, Kui X, Zhou F, Wang J, Chen Y, Chen W. Visual Analytics for Electromagnetic Situation Awareness in Radio Monitoring and Management. IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS 2020; 26:590-600. [PMID: 31443001 DOI: 10.1109/tvcg.2019.2934655] [Citation(s) in RCA: 13] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/10/2023]
Abstract
Traditional radio monitoring and management largely depend on radio spectrum data analysis, which requires considerable domain experience and heavy cognition effort and frequently results in incorrect signal judgment and incomprehensive situation awareness. Faced with increasingly complicated electromagnetic environments, radio supervisors urgently need additional data sources and advanced analytical technologies to enhance their situation awareness ability. This paper introduces a visual analytics approach for electromagnetic situation awareness. Guided by a detailed scenario and requirement analysis, we first propose a signal clustering method to process radio signal data and a situation assessment model to obtain qualitative and quantitative descriptions of the electromagnetic situations. We then design a two-module interface with a set of visualization views and interactions to help radio supervisors perceive and understand the electromagnetic situations by a joint analysis of radio signal data and radio spectrum data. Evaluations on real-world data sets and an interview with actual users demonstrate the effectiveness of our prototype system. Finally, we discuss the limitations of the proposed approach and provide future work directions.
Collapse
|
11
|
Li J, Chen S, Zhang K, Andrienko G, Andrienko N. COPE: Interactive Exploration of Co-Occurrence Patterns in Spatial Time Series. IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS 2019; 25:2554-2567. [PMID: 29994614 DOI: 10.1109/tvcg.2018.2851227] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/08/2023]
Abstract
Spatial time series is a common type of data dealt with in many domains, such as economic statistics and environmental science. There have been many studies focusing on finding and analyzing various kinds of events in time series; the term 'event' refers to significant changes or occurrences of particular patterns formed by consecutive attribute values. We focus on a further step in event analysis: discover temporal relationship patterns between event locations, i.e., repeated cases when there is a specific temporal relationship (same time, before, or after) between events occurring at two locations. This can provide important clues for understanding the formation and spreading mechanisms of events and interdependencies among spatial locations. We propose a visual exploration framework COPE (Co-Occurrence Pattern Exploration), which allows users to extract events of interest from data and detect various co-occurrence patterns among them. Case studies and expert reviews were conducted to verify the effectiveness and scalability of COPE using two real-world datasets.
Collapse
|