Dynamic temporal filtering in video models

• Main Authors: LONG, Fuchen, QIU, Zhaofan, PAN, Yingwei, YAO, Ting, NGO, Chong-wah, MEI, Tao
• Format: text
• Language: English
• Published: Institutional Knowledge at Singapore Management University 2022
• Subjects: Artificial Intelligence and Robotics; Graphics and Human Computer Interfaces
• Online Access: https://ink.library.smu.edu.sg/sis_research/7509; https://ink.library.smu.edu.sg/context/sis_research/article/8512/viewcontent/136950470.pdf
• Institution: Singapore Management University

Video temporal dynamics is conventionally modeled with 3D spatial-temporal kernel or its factorized version comprised of 2D spatial kernel and 1D temporal kernel. The modeling power, nevertheless, is limited by the fixed window size and static weights of a kernel along the temporal dimension. The pr...