Abnormal event detection by a weakly supervised temporal attention network

Abnormal event detection aims to automatically identify unusual events that do not comply with expectation. Recently, many methods have been proposed to obtain the temporal locations of abnormal events under various determined thresholds. However, the specific categories of abnormal events are mostl...

Full description

Saved in:
Bibliographic Details
Main Authors: Zheng, Xiangtao, Zhang, Yichao, Zheng, Yunpeng, Luo, Fulin, Lu, Xiaoqiang
Other Authors: School of Electrical and Electronic Engineering
Format: Article
Language:English
Published: 2023
Subjects:
Online Access:https://hdl.handle.net/10356/164312
Tags: Add Tag
No Tags, Be the first to tag this record!
Institution: Nanyang Technological University
Language: English
Description
Summary:Abnormal event detection aims to automatically identify unusual events that do not comply with expectation. Recently, many methods have been proposed to obtain the temporal locations of abnormal events under various determined thresholds. However, the specific categories of abnormal events are mostly neglect, which are important to help in monitoring agents to make decisions. In this study, a Temporal Attention Network (TANet) is proposed to capture both the specific categories and temporal locations of abnormal events in a weakly supervised manner. The TANet learns the anomaly score and specific category for each video segment with only video-level abnormal event labels. An event recognition module is exploited to predict the event scores for each video segment while a temporal attention module is proposed to learn a temporal attention value. Finally, to learn anomaly scores and specific categories, three constraints are considered: event category constraint, event separation constraint and temporal smoothness constraint. Experiments on the University of Central Florida Crime dataset demonstrate the effectiveness of the proposed method.