GestureLens: Visual analysis of gestures in presentation videos

Appropriate gestures can enhance message delivery and audience engagement in both daily communication and public presentations. In this paper, we contribute a visual analytic approach that assists professional public speaking coaches in improving their practice of gesture training through analyzing...

Full description

Saved in:
Bibliographic Details
Main Authors: ZENG, Haipeng, WANG, Xingbo, WANG, Yong, WU, Aoyu, PONG, Ting Chuen, QU, Huamin
Format: text
Language:English
Published: Institutional Knowledge at Singapore Management University 2022
Subjects:
Online Access:https://ink.library.smu.edu.sg/sis_research/7660
https://ink.library.smu.edu.sg/context/sis_research/article/8663/viewcontent/2204.08894.pdf
Tags: Add Tag
No Tags, Be the first to tag this record!
Institution: Singapore Management University
Language: English
id sg-smu-ink.sis_research-8663
record_format dspace
spelling sg-smu-ink.sis_research-86632023-01-10T03:45:14Z GestureLens: Visual analysis of gestures in presentation videos ZENG, Haipeng WANG, Xingbo WANG, Yong WU, Aoyu PONG, Ting Chuen QU, Huamin Appropriate gestures can enhance message delivery and audience engagement in both daily communication and public presentations. In this paper, we contribute a visual analytic approach that assists professional public speaking coaches in improving their practice of gesture training through analyzing presentation videos. Manually checking and exploring gesture usage in the presentation videos is often tedious and time-consuming. There lacks an efficient method to help users conduct gesture exploration, which is challenging due to the intrinsically temporal evolution of gestures and their complex correlation to speech content. In this paper, we propose GestureLens, a visual analytics system to facilitate gesture-based and content-based exploration of gesture usage in presentation videos. Specifically, the exploration view enables users to obtain a quick overview of the spatial and temporal distributions of gestures. The dynamic hand movements are firstly aggregated through a heatmap in the gesture space for uncovering spatial patterns, and then decomposed into two mutually perpendicular timelines for revealing temporal patterns. The relation view allows users to explicitly explore the correlation between speech content and gestures by enabling linked analysis and intuitive glyph designs. The video view and dynamic view show the context and overall dynamic movement of the selected gestures, respectively. Two usage scenarios and expert interviews with professional presentation coaches demonstrate the effectiveness and usefulness of GestureLens in facilitating gesture exploration and analysis of presentation videos. 2022-04-01T07:00:00Z text application/pdf https://ink.library.smu.edu.sg/sis_research/7660 info:doi/10.1109/TVCG.2022.3169175 https://ink.library.smu.edu.sg/context/sis_research/article/8663/viewcontent/2204.08894.pdf http://creativecommons.org/licenses/by-nc-nd/4.0/ Research Collection School Of Computing and Information Systems eng Institutional Knowledge at Singapore Management University Gesture hand movements presentation video analysis visual analysis Databases and Information Systems Graphics and Human Computer Interfaces
institution Singapore Management University
building SMU Libraries
continent Asia
country Singapore
Singapore
content_provider SMU Libraries
collection InK@SMU
language English
topic Gesture
hand movements
presentation video analysis
visual analysis
Databases and Information Systems
Graphics and Human Computer Interfaces
spellingShingle Gesture
hand movements
presentation video analysis
visual analysis
Databases and Information Systems
Graphics and Human Computer Interfaces
ZENG, Haipeng
WANG, Xingbo
WANG, Yong
WU, Aoyu
PONG, Ting Chuen
QU, Huamin
GestureLens: Visual analysis of gestures in presentation videos
description Appropriate gestures can enhance message delivery and audience engagement in both daily communication and public presentations. In this paper, we contribute a visual analytic approach that assists professional public speaking coaches in improving their practice of gesture training through analyzing presentation videos. Manually checking and exploring gesture usage in the presentation videos is often tedious and time-consuming. There lacks an efficient method to help users conduct gesture exploration, which is challenging due to the intrinsically temporal evolution of gestures and their complex correlation to speech content. In this paper, we propose GestureLens, a visual analytics system to facilitate gesture-based and content-based exploration of gesture usage in presentation videos. Specifically, the exploration view enables users to obtain a quick overview of the spatial and temporal distributions of gestures. The dynamic hand movements are firstly aggregated through a heatmap in the gesture space for uncovering spatial patterns, and then decomposed into two mutually perpendicular timelines for revealing temporal patterns. The relation view allows users to explicitly explore the correlation between speech content and gestures by enabling linked analysis and intuitive glyph designs. The video view and dynamic view show the context and overall dynamic movement of the selected gestures, respectively. Two usage scenarios and expert interviews with professional presentation coaches demonstrate the effectiveness and usefulness of GestureLens in facilitating gesture exploration and analysis of presentation videos.
format text
author ZENG, Haipeng
WANG, Xingbo
WANG, Yong
WU, Aoyu
PONG, Ting Chuen
QU, Huamin
author_facet ZENG, Haipeng
WANG, Xingbo
WANG, Yong
WU, Aoyu
PONG, Ting Chuen
QU, Huamin
author_sort ZENG, Haipeng
title GestureLens: Visual analysis of gestures in presentation videos
title_short GestureLens: Visual analysis of gestures in presentation videos
title_full GestureLens: Visual analysis of gestures in presentation videos
title_fullStr GestureLens: Visual analysis of gestures in presentation videos
title_full_unstemmed GestureLens: Visual analysis of gestures in presentation videos
title_sort gesturelens: visual analysis of gestures in presentation videos
publisher Institutional Knowledge at Singapore Management University
publishDate 2022
url https://ink.library.smu.edu.sg/sis_research/7660
https://ink.library.smu.edu.sg/context/sis_research/article/8663/viewcontent/2204.08894.pdf
_version_ 1770576409855524864