MetaFormer baselines for vision
Abstract—MetaFormer, the abstracted architecture of Transformer, has been found to play a significant role in achieving competitive performance. In this paper, we further explore the capacity of MetaFormer, again, by migrating our focus away from the token mixer design: we introduce several baseline...
Saved in:
Main Authors: | YU, Weihao, SI, Chenyang, ZHOU, Pan, LUO, Mi, ZHOU, Yichen, FENG, Jiashi, YAN, Shuicheng, WANG, Xinchao |
---|---|
Format: | text |
Language: | English |
Published: |
Institutional Knowledge at Singapore Management University
2023
|
Subjects: | |
Online Access: | https://ink.library.smu.edu.sg/sis_research/9054 https://ink.library.smu.edu.sg/context/sis_research/article/10057/viewcontent/2021_TPAMI_MetaFormer.pdf |
Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
Institution: | Singapore Management University |
Language: | English |
Similar Items
-
MetaFormer is actually what you need for vision
by: YU, Weihao, et al.
Published: (2022) -
InceptionNeXt: When Inception meets ConvNeXt
by: YU, Weihao, et al.
Published: (2024) -
Vortex-SegFormer: a transformer-based vortex detection method
by: Lim, Nicky
Published: (2024) -
DualFormer: Local-global stratified transformer for efficient video recognition
by: LIANG, Yuxuan, et al.
Published: (2022) -
Efficient meta learning via minibatch proximal update
by: ZHOU, Pan, et al.
Published: (2019)