Unsupervised domain adaptation via importance sampling

• Main Authors: XU, Xuemiao, HE, Hai, ZHANG, Huaidong, XU, Yangyang, HE, Shengfeng
• Format: text
• Language: English
• Published: Institutional Knowledge at Singapore Management University 2020
• Subjects: Feature extraction; Entropy; Tuning; Estimation; Monte Carlo methods; Adaptation models; Noise measurement; Domain adaptation; deep learning; distribution sampling; Information Security
• Online Access: https://ink.library.smu.edu.sg/sis_research/7884
• Institution: Singapore Management University

Unsupervised domain adaptation aims to generalize a model from the label-rich source domain to the unlabeled target domain. Existing works mainly focus on aligning the global distribution statistics between source and target domains. However, they neglect distractions from the unexpected noisy samples in domain distribution estimation, leading to domain misalignment or even negative transfer. In this paper, we present an importance sampling method for domain adaptation (ISDA), to measure sample contributions according to their "informative" levels. In particular, informative samples, as well as outliers, can be effectively modeled using feature-norm and prediction entropy of the network. The importance of information is further formulated as the importance sampling losses in features and label spaces. In this way, the proposed model mitigates the noisy outliers while enhancing the important samples during domain alignment. In addition, our model is easy to implement yet effective, and it does not introduce any extra parameters. Extensive experiments on several benchmark datasets show that our method outperforms state-of-the-art methods under both the standard and partial domain adaptation settings.