Exploring diffusion time-steps for unsupervised representation learning

• Main Authors: YUE, Zhongqi, WANG, Jiankun, SUN, Qianru, JI, Lei, CHANG, Eric I-Chao, ZHANG, Hanwang
• Format: text
• Language: English
• Published: Institutional Knowledge at Singapore Management University 2024
• Subjects: Graphics and Human Computer Interfaces
• Online Access: https://ink.library.smu.edu.sg/sis_research/9215; https://ink.library.smu.edu.sg/context/sis_research/article/10221/viewcontent/3386_exploring_diffusion_time_steps__1_.pdf
• Institution: Singapore Management University

Representation learning is all about discovering the hidden modular attributes that generate the data faithfully. We explore the potential of Denoising Diffusion Probabilistic Model (DM) in unsupervised learning of the modular attributes. We build a theoretical framework that connects the diffusion...