Lecture video enhancement and editing by integrating posture, gesture, and text
This paper describes a novel framework for automatic lecture video editing by gesture, posture, and video text recognition. In content analysis, the trajectory of hand movement is tracked and the intentional gestures are automatically extracted for recognition. In addition, head pose is estimated th...
Saved in:
Main Authors: | , , |
---|---|
Format: | text |
Language: | English |
Published: |
Institutional Knowledge at Singapore Management University
2007
|
Subjects: | |
Online Access: | https://ink.library.smu.edu.sg/sis_research/6325 https://ink.library.smu.edu.sg/context/sis_research/article/7328/viewcontent/10.1.1.501.9513.pdf |
Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
Institution: | Singapore Management University |
Language: | English |
id |
sg-smu-ink.sis_research-7328 |
---|---|
record_format |
dspace |
spelling |
sg-smu-ink.sis_research-73282021-11-23T04:59:32Z Lecture video enhancement and editing by integrating posture, gesture, and text WANG, Feng NGO, Chong-wah PONG, Ting-Chuen This paper describes a novel framework for automatic lecture video editing by gesture, posture, and video text recognition. In content analysis, the trajectory of hand movement is tracked and the intentional gestures are automatically extracted for recognition. In addition, head pose is estimated through overcoming the difficulties due to the complex lighting conditions in classrooms. The aim of recognition is to characterize the flow of lecturing with a series of regional focuses depicted by human postures and gestures. The regions of interest (ROIs) in videos are semantically structured with text recognition and the aid of external documents. By tracing the flow of lecturing, a finite state machine (FSM) which incorporates the gestures, postures, ROIs, general editing rules and constraints, is proposed to edit videos with novel views. The FSM is designed to generate appropriate simulated camera motion and cutting effects that suit the pace of a presenter's gestures and postures. To remedy the undesirable visual effects due to poor lighting conditions, we also propose approaches to automatically enhance the visibility and readability of slides and whiteboard images in the edited videos. 2007-02-01T08:00:00Z text application/pdf https://ink.library.smu.edu.sg/sis_research/6325 info:doi/10.1109/TMM.2006.886292 https://ink.library.smu.edu.sg/context/sis_research/article/7328/viewcontent/10.1.1.501.9513.pdf http://creativecommons.org/licenses/by-nc-nd/4.0/ Research Collection School Of Computing and Information Systems eng Institutional Knowledge at Singapore Management University gesture lecture video editing posture and video text recognition Computer Sciences Graphics and Human Computer Interfaces |
institution |
Singapore Management University |
building |
SMU Libraries |
continent |
Asia |
country |
Singapore Singapore |
content_provider |
SMU Libraries |
collection |
InK@SMU |
language |
English |
topic |
gesture lecture video editing posture and video text recognition Computer Sciences Graphics and Human Computer Interfaces |
spellingShingle |
gesture lecture video editing posture and video text recognition Computer Sciences Graphics and Human Computer Interfaces WANG, Feng NGO, Chong-wah PONG, Ting-Chuen Lecture video enhancement and editing by integrating posture, gesture, and text |
description |
This paper describes a novel framework for automatic lecture video editing by gesture, posture, and video text recognition. In content analysis, the trajectory of hand movement is tracked and the intentional gestures are automatically extracted for recognition. In addition, head pose is estimated through overcoming the difficulties due to the complex lighting conditions in classrooms. The aim of recognition is to characterize the flow of lecturing with a series of regional focuses depicted by human postures and gestures. The regions of interest (ROIs) in videos are semantically structured with text recognition and the aid of external documents. By tracing the flow of lecturing, a finite state machine (FSM) which incorporates the gestures, postures, ROIs, general editing rules and constraints, is proposed to edit videos with novel views. The FSM is designed to generate appropriate simulated camera motion and cutting effects that suit the pace of a presenter's gestures and postures. To remedy the undesirable visual effects due to poor lighting conditions, we also propose approaches to automatically enhance the visibility and readability of slides and whiteboard images in the edited videos. |
format |
text |
author |
WANG, Feng NGO, Chong-wah PONG, Ting-Chuen |
author_facet |
WANG, Feng NGO, Chong-wah PONG, Ting-Chuen |
author_sort |
WANG, Feng |
title |
Lecture video enhancement and editing by integrating posture, gesture, and text |
title_short |
Lecture video enhancement and editing by integrating posture, gesture, and text |
title_full |
Lecture video enhancement and editing by integrating posture, gesture, and text |
title_fullStr |
Lecture video enhancement and editing by integrating posture, gesture, and text |
title_full_unstemmed |
Lecture video enhancement and editing by integrating posture, gesture, and text |
title_sort |
lecture video enhancement and editing by integrating posture, gesture, and text |
publisher |
Institutional Knowledge at Singapore Management University |
publishDate |
2007 |
url |
https://ink.library.smu.edu.sg/sis_research/6325 https://ink.library.smu.edu.sg/context/sis_research/article/7328/viewcontent/10.1.1.501.9513.pdf |
_version_ |
1770575934632493056 |