Stargazer: An interactive camera robot for capturing how-to videos based on subtle instructor cues

• Main Authors: LI, Jiannan, SOUSA, Mauricio, MAHADEVAN, Karthik, WANG, Bryan, AOYAGUI, Paula Akemi, YU, Nicole, YANG, Angela, BALAKRISHNAN, Ravin, Anthony TANG, GROSSMAN, Tovi
• Format: text
• Language: English
• Published: Institutional Knowledge at Singapore Management University 2023
• Subjects: cameras; robots; instructional videos; Graphics and Human Computer Interfaces
• Online Access: https://ink.library.smu.edu.sg/sis_research/7956; https://ink.library.smu.edu.sg/context/sis_research/article/8959/viewcontent/3544548.3580896.pdf
• Institution: Singapore Management University

Live and pre-recorded video tutorials are an effective means for teaching physical skills such as cooking or prototyping electronics. A dedicated cameraperson following an instructor’s activities can improve production quality. However, instructors who do not have access to a cameraperson’s help often have to work within the constraints of static cameras. We present Stargazer, a novel approach for assisting with tutorial content creation with a camera robot that autonomously tracks regions of interest based on instructor actions to capture dynamic shots. Instructors can adjust the camera behaviors of Stargazer with subtle cues, including gestures and speech, allowing them to fluidly integrate camera control commands into instructional activities. Our user study with six instructors, each teaching a distinct skill, showed that participants could create dynamic tutorial videos with a diverse range of subjects, camera framing, and camera angle combinations using Stargazer.