EmoCo: Visual analysis of emotion coherence in presentation videos
Emotions play a key role in human communication and public presentations. Human emotions are usually expressed through multiple modalities. Therefore, exploring multimodal emotions and their coherence is of great value for understanding emotional expressions in presentations and improving presentati...
Saved in:
Main Authors: | , , , , , , |
---|---|
Format: | text |
Language: | English |
Published: |
Institutional Knowledge at Singapore Management University
2020
|
Subjects: | |
Online Access: | https://ink.library.smu.edu.sg/sis_research/5350 https://ink.library.smu.edu.sg/context/sis_research/article/6354/viewcontent/1907.12918__av.pdf |
Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
Institution: | Singapore Management University |
Language: | English |
id |
sg-smu-ink.sis_research-6354 |
---|---|
record_format |
dspace |
spelling |
sg-smu-ink.sis_research-63542020-11-19T07:27:52Z EmoCo: Visual analysis of emotion coherence in presentation videos ZENG, Haipeng WANG, Xingbo WU, Aoyu WANG, Yong LI, Quan ENDERT, Alex QU, Huamin Emotions play a key role in human communication and public presentations. Human emotions are usually expressed through multiple modalities. Therefore, exploring multimodal emotions and their coherence is of great value for understanding emotional expressions in presentations and improving presentation skills. However, manually watching and studying presentation videos is often tedious and time-consuming. There is a lack of tool support to help conduct an efficient and in-depth multi-level analysis. Thus, in this paper, we introduce EmoCo, an interactive visual analytics system to facilitate efficient analysis of emotion coherence across facial, text, and audio modalities in presentation videos. Our visualization system features a channel coherence view and a sentence clustering view that together enable users to obtain a quick overview of emotion coherence and its temporal evolution. In addition, a detail view and word view enable detailed exploration and comparison from the sentence level and word level, respectively. We thoroughly evaluate the proposed system and visualization techniques through two usage scenarios based on TED Talk videos and interviews with two domain experts. The results demonstrate the effectiveness of our system in gaining insights into emotion coherence in presentations. 2020-01-01T08:00:00Z text application/pdf https://ink.library.smu.edu.sg/sis_research/5350 info:doi/10.1109/TVCG.2019.2934656 https://ink.library.smu.edu.sg/context/sis_research/article/6354/viewcontent/1907.12918__av.pdf http://creativecommons.org/licenses/by-nc-nd/4.0/ Research Collection School Of Computing and Information Systems eng Institutional Knowledge at Singapore Management University Emotion coherence video analysis visual analysis Communication Technology and New Media Software Engineering |
institution |
Singapore Management University |
building |
SMU Libraries |
continent |
Asia |
country |
Singapore Singapore |
content_provider |
SMU Libraries |
collection |
InK@SMU |
language |
English |
topic |
Emotion coherence video analysis visual analysis Communication Technology and New Media Software Engineering |
spellingShingle |
Emotion coherence video analysis visual analysis Communication Technology and New Media Software Engineering ZENG, Haipeng WANG, Xingbo WU, Aoyu WANG, Yong LI, Quan ENDERT, Alex QU, Huamin EmoCo: Visual analysis of emotion coherence in presentation videos |
description |
Emotions play a key role in human communication and public presentations. Human emotions are usually expressed through multiple modalities. Therefore, exploring multimodal emotions and their coherence is of great value for understanding emotional expressions in presentations and improving presentation skills. However, manually watching and studying presentation videos is often tedious and time-consuming. There is a lack of tool support to help conduct an efficient and in-depth multi-level analysis. Thus, in this paper, we introduce EmoCo, an interactive visual analytics system to facilitate efficient analysis of emotion coherence across facial, text, and audio modalities in presentation videos. Our visualization system features a channel coherence view and a sentence clustering view that together enable users to obtain a quick overview of emotion coherence and its temporal evolution. In addition, a detail view and word view enable detailed exploration and comparison from the sentence level and word level, respectively. We thoroughly evaluate the proposed system and visualization techniques through two usage scenarios based on TED Talk videos and interviews with two domain experts. The results demonstrate the effectiveness of our system in gaining insights into emotion coherence in presentations. |
format |
text |
author |
ZENG, Haipeng WANG, Xingbo WU, Aoyu WANG, Yong LI, Quan ENDERT, Alex QU, Huamin |
author_facet |
ZENG, Haipeng WANG, Xingbo WU, Aoyu WANG, Yong LI, Quan ENDERT, Alex QU, Huamin |
author_sort |
ZENG, Haipeng |
title |
EmoCo: Visual analysis of emotion coherence in presentation videos |
title_short |
EmoCo: Visual analysis of emotion coherence in presentation videos |
title_full |
EmoCo: Visual analysis of emotion coherence in presentation videos |
title_fullStr |
EmoCo: Visual analysis of emotion coherence in presentation videos |
title_full_unstemmed |
EmoCo: Visual analysis of emotion coherence in presentation videos |
title_sort |
emoco: visual analysis of emotion coherence in presentation videos |
publisher |
Institutional Knowledge at Singapore Management University |
publishDate |
2020 |
url |
https://ink.library.smu.edu.sg/sis_research/5350 https://ink.library.smu.edu.sg/context/sis_research/article/6354/viewcontent/1907.12918__av.pdf |
_version_ |
1770575411975028736 |