| Paper ID | SMR-4.4 | ||
| Paper Title | LEARNING OF LINEAR VIDEO PREDICTION MODELS IN A MULTI-MODAL FRAMEWORK FOR ANOMALY DETECTION | ||
| Authors | Giulia Slavic, Abrham Alemaw, Lucio Marcenaro, Carlo Regazzoni, University of Genova, Italy | ||
| Session | SMR-4: Image and Video Sensing, Modeling, and Representation | ||
| Location | Area F | ||
| Session Time: | Wednesday, 22 September, 08:00 - 09:30 | ||
| Presentation Time: | Wednesday, 22 September, 08:00 - 09:30 | ||
| Presentation | Poster | ||
| Topic | Image and Video Sensing, Modeling, and Representation: Statistical-model based methods | ||
| IEEE Xplore Open Preview | Click here to view in IEEE Xplore | ||
| Abstract | This paper proposes a method for performing future-frame prediction and anomaly detection on video data in a multi-modal framework based on Dynamic Bayesian Networks (DBNs). In particular, odometry data and video data from a moving vehicle are fused. A Markov Jump Particle Filter (MJPF) is learned on odometry data, and its features are used to aid the learning of a Kalman Variational Autoencoder (KVAE) on video data. Consequently, anomaly detection can be performed on video data using the learned model. We evaluate the proposed method using multi-modal data from a vehicle performing different tasks in a closed environment. | ||