Global context with discrete diffusion in vector quantised modelling for image generation

• Main Authors: Hu, Minghui, Wang, Yujie, Cham, Tat-Jen, Yang, Jianfei, Suganthan, Ponnuthurai Nagaratnam
• Other Authors: School of Computer Science and Engineering
• Format: Conference or Workshop Item
• Language: English
• Published: 2023
• Subjects: Engineering::Computer science and engineering::Computing methodologies::Image processing and computer vision; Visualization; Image Resolution
• Online Access: https://hdl.handle.net/10356/172658
• Institution: Nanyang Technological University

The integration of Vector Quantised Variational AutoEncoder (VQ-VAE) with autoregressive models as generation part has yielded high-quality results on image generation. However, the autoregressive models will strictly follow the progressive scanning order during the sampling phase. This leads the ex...