EEG-video emotion-based summarization: Learning with EEG auxiliary signals

• Main Authors: LEW, Wai-Cheong L., WANG, Di, ANG, Kai-Keng, LIM, Joo-Hwee, QUEK, Chai, TAN, Ah-hwee
• Format: text
• Language: English
• Published: Institutional Knowledge at Singapore Management University 2022
• Subjects: Databases and Information Systems; Graphics and Human Computer Interfaces
• Online Access: https://ink.library.smu.edu.sg/sis_research/7567
• Institution: Singapore Management University

Video summarization is the process of selecting a subset of informative keyframes to expedite storytelling with limited loss of information. In this paper, we propose an EEG-Video Emotion-based Summarization (EVES) model based on a multimodal deep reinforcement learning (DRL) architecture that lever...