Long-term leap attention, short-term periodic shift for video classification

• المؤلفون الرئيسيون: ZHANG, Hao, CHENG, Lechao, HAO, Yanbin, NGO, Chong-wah
• التنسيق: text
• اللغة: English
• منشور في: Institutional Knowledge at Singapore Management University 2022
• الموضوعات: Video classification; Transformer; Shift; Leap attention; Artificial Intelligence and Robotics; Graphics and Human Computer Interfaces
• الوصول للمادة أونلاين: https://ink.library.smu.edu.sg/sis_research/7507; https://ink.library.smu.edu.sg/context/sis_research/article/8510/viewcontent/3503161.3547908.pdf

Video transformer naturally incurs a heavier computation burden than a static vision transformer, as the former processes �� times longer sequence than the latter under the current attention of quadratic complexity (�� 2�� 2 ). The existing works treat the temporal axis as a simple extension of spat...