Adaptive split-fusion transformer

• Main Authors: SU, Zixuan, CHEN, Jingjing, PANG, Lei, NGO, Chong-wah, JIANG, Yu-Gang
• Format: text
• Language: English
• Published: Institutional Knowledge at Singapore Management University 2023
• Subjects: CNN; Gating; Hybrid; Transformer; Visual understanding; Databases and Information Systems
• Online Access: https://ink.library.smu.edu.sg/sis_research/8263; https://ink.library.smu.edu.sg/context/sis_research/article/9266/viewcontent/Adaptive.pdf
• Institution: Singapore Management University

Neural networks for visual content understanding have recently evolved from convolutional ones to transformers. The prior (CNN) relies on small-windowed kernels to capture the regional clues, demonstrating solid local expressiveness. On the contrary, the latter (transformer) establishes long-range g...