ScaleLong: Towards more stable training of diffusion model via scaling network long skip connection

• المؤلفون الرئيسيون: HUANG, Zhongzhan, ZHOU, Pan, YAN, Shuicheng, LIN, Liang
• التنسيق: text
• اللغة: English
• منشور في: Institutional Knowledge at Singapore Management University 2023
• الموضوعات: OS and Networks
• الوصول للمادة أونلاين: https://ink.library.smu.edu.sg/sis_research/9025; https://ink.library.smu.edu.sg/context/sis_research/article/10028/viewcontent/2023_NeurIPS_scalelong.pdf
• المؤسسة: Singapore Management University

In diffusion models, UNet is the most popular network backbone, since its long skip connects (LSCs) to connect distant network blocks can aggregate long-distant information and alleviate vanishing gradient. Unfortunately, UNet often suffers from unstable training in diffusion models which can be all...