Structuring lecture videos for distance learning applications

• Main Authors: NGO, Chong-wah, WANG, Feng, PONG, Ting-Chuen
• Format: text
• Language: English
• Published: Institutional Knowledge at Singapore Management University 2003
• Subjects: Computer Sciences; Graphics and Human Computer Interfaces
• Online Access: https://ink.library.smu.edu.sg/sis_research/6609; https://ink.library.smu.edu.sg/context/sis_research/article/7612/viewcontent/20310215.pdf
• Institution: Singapore Management University

This paper presents an automatic and novel approach in structuring and indexing lecture videos for distance learning applications. By structuring video content, we can support both topic indexing and semantic querying of multimedia documents. In this paper, our aim is to link the discussion topics extracted from the electronic slides with their associated video and audio segments. Two major techniques in our proposed approach include video text analysis and speech recognition. Initially, a video is partitioned into shots based on slide transitions. For each shot, the embedded video texts are detected, reconstructed and segmented as high-resolution foreground texts for commercial OCR recognition. The recognized texts can then be matched with their associated slides for video indexing. Meanwhile, both phrases (title) and keywords (content) are also extracted from the electronic slides to spot the speech signals. The spotted phrases and keywords are further utilized as queries to retrieve the most similar slide for speech indexing.