SwapVid: Integrating video viewing and document exploration with direct manipulation

• Main Authors: MURAKAMI, Taichi, FUJITA, Kazuyuki, HARA, Kotaro, TAKASHIMA, Kazuki, KITAMURA, Yoshifumi
• Format: text
• Language: English
• Published: Institutional Knowledge at Singapore Management University 2024
• Subjects: Document-based video interfaces; Lecture videos; Screen-shared documents; Video-document matching; Graphics and Human Computer Interfaces; Software Engineering
• Online Access: https://ink.library.smu.edu.sg/sis_research/8921; https://ink.library.smu.edu.sg/context/sis_research/article/9924/viewcontent/3613904.3642515_pvoa.pdf
• Institution: Singapore Management University

Videos accompanied by documents—document-based videos—enable presenters to share contents beyond videos and audience to use them for detailed content comprehension. However, concurrently exploring multiple channels of information could be taxing. We propose SwapVid, a novel interface for viewing and exploring document-based videos. SwapVid seamlessly integrates a video and a document into a single view and lets the content behaves as both video and a document; it adaptively switches a document-based video to act as a video or a document upon direct manipulation (e.g., scrolling the document, manipulating the video timeline). We conducted a user study with twenty participants, comparing SwapVid to a side-by-side video/document views. Results showed that our interface reduces time and physical workload when exploring slide-based documents based on video referencing. Based on the study findings, we extended SwapVid with additional functionalities and demonstrated that it further extends the practical capabilities.