SportSense: user interface for sketch-based spatio-temporal team sports video scene retrieval

In the last years, various sports have seen significant efforts in collecting large volumes of video, mainly for analytical purposes. These videos are tagged with events that include spatial and temporal information. In order to avoid that game analysts have to manually analyze large video collections, appropriate user interfaces are needed for finding characteristic video scenes. SPORTSENSE is a novel sketch-based video retrieval system tailored to the needs of sports video analysts which include spatio-temporal queries such as player movements, ball trajectories, or interactions between players. We present the user interface of SPORTSENSE that allows users to draw sketches of spatio-temporal events on the field and that visualizes the retrieved video scenes. We introduce the data model
of SPORTSENSE, show the sketch-based spatio-temporal retrieval on the annotated videos, and present a qualitative evaluation exhibiting the effectiveness of the SPORTSENSE UI.