Text-driven video prediction

• Main Authors: SONG, Xue, CHEN, Jingjing, ZHU, Bin, JIANG, Yu-gang
• Format: text
• Language: English
• Published: Institutional Knowledge at Singapore Management University 2024
• Subjects: Text-driven Video Prediction; controllable video generation; motion inference; Artificial Intelligence and Robotics; Graphics and Human Computer Interfaces
• Online Access: https://ink.library.smu.edu.sg/sis_research/9356; https://ink.library.smu.edu.sg/context/sis_research/article/10356/viewcontent/Text_drivenVideoPrediction_sv__2_.pdf
• Institution: Singapore Management University

Current video generation models usually convert signals indicating appearance and motion received from inputs (e.g., image and text) or latent spaces (e.g., noise vectors) into consecutive frames, fulfilling a stochastic generation process for the uncertainty introduced by latent code sampling. Howe...