Motion-based video representation for scene change detection

• Main Authors: NGO, Chong-wah, PONG, Ting-Chuen, ZHANG, Hong-Jiang, CHIN, Roland T.
• Format: text
• Language: English
• Published: Institutional Knowledge at Singapore Management University 2000
• Subjects: Graphics and Human Computer Interfaces; Theory and Algorithms
• Online Access: https://ink.library.smu.edu.sg/sis_research/6376; https://ink.library.smu.edu.sg/context/sis_research/article/7379/viewcontent/motion_video_representation.pdf
• Institution: Singapore Management University

We present a new ly developed scheme for automatical ly partitioning videos into scenes. A scene is general ly referred to as a group of shots taken place in the same site. In this paper, we first propose a motion annotation algorithm based on the analysis of spatiotemporal image volumes. The algorithm characterizes the motions within shots by extracting and analyzing the motion trajectories encoded in the temporal slices of image volumes. A motion-based keyframe computing and selection strategy is thus proposed to compactly represent the content of shots. With these techniques, we further present a scene change detection algorithm by measuring the similarity of the representative keyframes in shots.