A simple data mixing prior for improving self-supervised learning

• Main Authors: REN, Sucheng, WANG, Huiyu, GAO, Zhengqi, HE, Shengfeng, YUILLE, Alan, ZHOU, Yuyin, XIE, Cihang
• Format: text
• Language: English
• Published: Institutional Knowledge at Singapore Management University 2022
• Subjects: Categorization; Representation learning; Retrieval; Self- & semi- & meta- recognition; Detection; Databases and Information Systems; Graphics and Human Computer Interfaces
• Online Access: https://ink.library.smu.edu.sg/sis_research/8445; https://ink.library.smu.edu.sg/context/sis_research/article/9448/viewcontent/Ren_A_Simple_Data_Mixing_Prior_for_Improving_Self_Supervised_Learning_CVPR_2022_paper.pdf
• Institution: Singapore Management University

Data mixing (e.g., Mixup, Cutmix, ResizeMix) is an essential component for advancing recognition models. In this paper, we focus on studying its effectiveness in the self-supervised setting. By noticing the mixed images that share the same source images are intrinsically related to each other, we he...