Wave-ViT: Unifying wavelet and transformers for visual representation learning

Wave-ViT: Unifying wavelet and transformers for visual representation learning

Multi-scale Vision Transformer (ViT) has emerged as a powerful backbone for computer vision tasks, while the self-attention computation in Transformer scales quadratically w.r.t. the input patch number. Thus, existing solutions commonly employ down-sampling operations (e.g., average pooling) over ke...

Saved in:

書目詳細資料
Main Authors:	YAO, Ting, PAN, Yingwei, LI, Yehao, NGO, Chong-wah, MEI, Tao
格式:	text
語言:	English
出版:	Institutional Knowledge at Singapore Management University 2022
主題:	Vision transformer Wavelet transform Self-attention learning Image recognition Artificial Intelligence and Robotics Graphics and Human Computer Interfaces
在線閱讀:	https://ink.library.smu.edu.sg/sis_research/7508 https://ink.library.smu.edu.sg/context/sis_research/article/8511/viewcontent/2207.04978.pdf
標簽:	添加標簽沒有標簽, 成為第一個標記此記錄!
機構:	Singapore Management University
語言:	English

相似書籍

Face recognition by applying wavelet subband representation and kernel associative memory
由: Zhang, B.-L., et al.
出版: (2014)

The application of wavelet transform to analyze the rainfall data
由: Nareemal Hilae
出版: (2018)

Exponential B-Splines: Scale-Space and Wavelet Representations
由: LOR CHOON YEE
出版: (2012)

Unifying global-local representations in salient object detection with transformers
由: REN, Sucheng, et al.
出版: (2024)

Efficient architecture for discrete wavelet transform using daubechies
由: Zhang Xiaoyin
出版: (2011)

Singular integrals, scale-space and wavelet transforms
由: Goh, S.S., et al.
出版: (2014)

Wavelet packet decomposition for the SPIHT
由: NIU YAN
出版: (2019)

Wavelet-based image compression using classified interpolative vector quantization
由: Bi, M., et al.
出版: (2014)

Hough-based model for recognizing bar charts in document images
由: Yan Ping Zhou, et al.
出版: (2013)

Time series forecasting using wavelet and support vector machine
由: FONG KENG MUN
出版: (2010)

Long-term leap attention, short-term periodic shift for video classification
由: ZHANG, Hao, et al.
出版: (2022)

Using empirical wavelet transform to speed up selective filtered active noise control system
由: Wen, Shulin, et al.
出版: (2020)

A hybrid shape-adaptive orthogonal transform for coding of image segments
由: Bi, M., et al.
出版: (2014)

DualFormer: Local-global stratified transformer for efficient video recognition
由: LIANG, Yuxuan, et al.
出版: (2022)

A maximum a-posteriori identification criterion for wavelet domain watermarking
由: Ng, T.M., et al.
出版: (2014)

A wavelet multiresolution analysis approach to fault detection and classification in transmission lines
由: Liang, J., et al.
出版: (2014)

Partially occluded object recognition
由: Lim, K.-B., et al.
出版: (2014)

EL-VIT: Probing vision transformer with interactive visualization
由: ZHOU, Hong, et al.
出版: (2023)

MetaFormer is actually what you need for vision
由: YU, Weihao, et al.
出版: (2022)

Tracking of moving object using energy of biorthogonal wavelet transform
由: Om Prakash, et al.
出版: (2019)

A VLSI architecture for separable 2-D discrete wavelet transform
由: Limqueco, Jimmy C., et al.
出版: (1998)

Exploring category-agnostic clusters for open-set domain adaptation
由: PAN, Yingwei, et al.
出版: (2020)

The wavelet transform-domain LMS adaptive filter with partial subband-coefficient updating
由: Attallah, S.
出版: (2014)

Implementation of Karhunen-Loeve expansion for simulation using a wavelet-Galerkin scheme
由: Phoon, K.K., et al.
出版: (2014)

Analysis of directional regularity by transforms with parabolic scaling
由: Panuvuth Lakhonchai
出版: (2008)

Wavelet analysis of digital shearing speckle patterns with a temporal carrier
由: Quan, C., et al.
出版: (2014)

Estimating Dynamic Motion Parameters with an Improved Wavelet Thresholding and Inter-Scale Correlation
由: Wang, Y., et al.
出版: (2021)

Demodulation of a single interferogram based on continuous wavelet transform and phase derivative
由: Tay, C.J., et al.
出版: (2014)

Continuous wavelet transform for micro-component profile measurement using vertical scanning interferometry
由: Li, M., et al.
出版: (2014)

Analysis and detection of human motion in time-frequency domain
由: NYAN MYO NAING
出版: (2010)

Learning temporal dynamics in videos with image transformer
由: SHU, Yan, et al.
出版: (2024)

Wavelet transform and orthogonal decomposition of L2 space on the cartan domain BDI(q = 2)
由: Jiang, Q.
出版: (2014)

A random subspace ensemble classification model for discrimination of power quality events in solar PV microgrid power network
由: Vinayagam, Arangarajan, et al.
出版: (2022)

Garment-based detection of falls and activities of daily living using 3-axis MEMS accelerometer
由: Nyan, M.N., et al.
出版: (2014)

Temporal phase analysis techniques using wavelet transform
由: Quan, C., et al.
出版: (2014)

Phase retrieval of speckle fringe pattern with carriers using 2D wavelet transform
由: Niu, H., et al.
出版: (2014)

Robust image hashing via random Gabor filtering and DWT
由: TANG, Zhenjun, et al.
出版: (2018)

Subjective and objective comparison of advanced motion compensation methods for blocking artifact reduction in a 3-D wavelet coding system
由: Cheng, C.-C., et al.
出版: (2014)

Highly scalable wavelet-based video codec for very low bit-rate environment
由: Tham, J.Y., et al.
出版: (2014)

Video graph transformer for video question answering
由: XIAO, Junbin, et al.
出版: (2022)