Recognizing Events in Spatiotemporal Soccer Data

Event detection in football: Improving the reliability of match analysis

With recent technological advancements, quantitative analysis has become an increasingly important area within professional sports. However, the manual process of collecting data on relevant match events like passes, goals and tacklings comes with considerable costs and limited consistency across providers, affecting both research and practice. In football, while automatic detection of events from positional data of the players and the ball could alleviate these issues, it is not entirely clear what accuracy current state-of-the-art methods realistically achieve because there is a lack of high-quality validations on realistic and diverse data sets. This paper adds context to existing research by validating a two-step rule-based pass and shot detection algorithm on four different data sets using a comprehensive validation routine that accounts for the temporal, hierarchical and imbalanced nature of the task. Our evaluation shows that pass and shot detection performance is highly dependent on the specifics of the data set. In accordance with previous studies, we achieve F-scores of up to 0.92 for passes, but only when there is an inherent dependency between event and positional data. We find a significantly lower accuracy with F-scores of 0.71 for passes and 0.65 for shots if event and positional data are independent. This result, together with a critical evaluation of existing methodologies, suggests that the accuracy of current football event detection algorithms operating on positional data is currently overestimated. Further analysis reveals that the temporal extraction of passes and shots from positional data poses the main challenge for rule-based approaches. Our results further indicate that the classification of plays into shots and passes is a relatively straightforward task, achieving F-scores between 0.83 to 0.91 ro rule-based classifiers and up to 0.95 for machine learning classifiers. We show that there exist simple classifiers that accurately differentiate shots from passes in different data sets using a low number of human-understandable rules. Operating on basic spatial features, our classifiers provide a simple, objective event definition that can be used as a foundation for more reliable event-based match analysis.

Predicting the in-game status in soccer with machine learning using spatiotemporal player tracking data

An important structuring feature of a soccer match is the in-game status, whether a match is interrupted or in play. This is necessary to calculate performance indicators relative to the effective playing time or to find standard situations, ball actions, and other tactical structures in spatiotemporal data. Our study explores the extent to which the in-game status can be determined using time-continuous player positions. Therefore, to determine the in-game status we tested four established machine learning methods: logistic regression, decision trees, random forests, and AdaBoost. The models were trained and evaluated using spatiotemporal data and manually annotated in-game status of 102 matches in the German Bundesliga. Results show up to 92% accuracy in predicting the in-game status in previously unknown matches on frame level. The best performing method, AdaBoost, shows 81% precision for detecting stoppages (longer than 2 s). The absolute time shift error at the start was ≤ 2 s for 77% and 81% at the end for all correctly predicted stoppages. The mean error of the in-game total distance covered per player per match using the AdaBoost in-game status prediction was − 102 ± 273 m, which is 1.3% of the mean value of this performance indicator (7939 m). Conclusively, the prediction quality of our model is high enough to provide merit for performance diagnostics when teams have access to player positions (e.g., from GPS/LPM systems) but no human-annotated in-game status and/or ball position data, such as in amateur or youth soccer.

Scaling up SoccerNet with multi-view spatial localization and re-identification

Soccer videos are a rich playground for computer vision, involving many elements, such as players, lines, and specific objects. Hence, to capture the richness of this sport and allow for fine automated analyses, we release SoccerNet-v3, a major extension of the SoccerNet dataset, providing a wide variety of spatial annotations and cross-view correspondences. SoccerNet's broadcast videos contain replays of important actions, allowing us to retrieve a same action from different viewpoints. We annotate those live and replay action frames showing same moments with exhaustive local information. Specifically, we label lines, goal parts, players, referees, teams, salient objects, jersey numbers, and we establish player correspondences between the views. This yields 1,324,732 annotations on 33,986 soccer images, making SoccerNet-v3 the largest dataset for multi-view soccer analysis. Derived tasks may benefit from these annotations, like camera calibration, player localization, team discrimination and multi-view re-identification, which can further sustain practical applications in augmented reality and soccer analytics. Finally, we provide Python codes to easily download our data and access our annotations.

A Comprehensive Review of Computer Vision in Sports: Open Issues, Future Trends and Research Directions

Recent developments in video analysis of sports and computer vision techniques have achieved significant improvements to enable a variety of critical operations. To provide enhanced information, such as detailed complex analysis in sports such as soccer, basketball, cricket, and badminton, studies have focused mainly on computer vision techniques employed to carry out different tasks. This paper presents a comprehensive review of sports video analysis for various applications: high-level analysis such as detection and classification of players, tracking players or balls in sports and predicting the trajectories of players or balls, recognizing the team’s strategies, and classifying various events in sports. The paper further discusses published works in a variety of application-specific tasks related to sports and the present researcher’s views regarding them. Since there is a wide research scope in sports for deploying computer vision techniques in various sports, some of the publicly available datasets related to a particular sport have been discussed. This paper reviews detailed discussion on some of the artificial intelligence (AI) applications, GPU-based work-stations and embedded platforms in sports vision. Finally, this review identifies the research directions, probable challenges, and future trends in the area of visual recognition in sports.