Multi-camera trajectory forecasting : pedestrian trajectory prediction in a network of cameras

• Main Authors: Styles, Olly, Guha, Tanaya, Sanchez, Victor, Kot, Alex
• Other Authors: School of Electrical and Electronic Engineering
• Format: Conference or Workshop Item
• Language: English
• Published: 2020
• Subjects: Engineering::Computer science and engineering::Computing methodologies::Image processing and computer vision; Cameras; Trajectory
• Online Access: https://hdl.handle.net/10356/144142
• Institution: Nanyang Technological University

We introduce the task of multi-camera trajectory forecasting (MCTF), where the future trajectory of an object is predicted in a network of cameras. Prior works consider forecasting trajectories in a single camera view. Our work is the first to consider the challenging scenario of forecasting across multiple non-overlapping camera views. This has wide applicability in tasks such as re-identification and multi-target multi-camera tracking. To facilitate research in this new area, we release the Warwick-NTU Multi-camera Forecasting Database (WNMF), a unique dataset of multi-camera pedestrian trajectories from a network of 15 synchronized cameras. To accurately label this large dataset (600 hours of video footage), we also develop a semi-automated annotation method. An effective MCTF model should proactively anticipate where and when a person will reappear in the camera network. In this paper, we consider the task of predicting the next camera a pedestrian will reappear after leaving the view of another camera, and present several base-line approaches for this. The labeled database is available online: https://github.com/olly-styles/Multi-Camera-Trajectory-Forecasting.