Transferrable prototypical networks for unsupervised domain adaptation

• Main Authors: PAN, Yingwei, YAO, Ting, LI, Yehao, WANG, Yu, NGO, Chong-wah, MEI, Tao
• Format: text
• Language: English
• Published: Institutional Knowledge at Singapore Management University 2019
• Subjects: Categorization; Recognition: Detection; Retrieval; Computer Sciences; OS and Networks
• Online Access: https://ink.library.smu.edu.sg/sis_research/6449; https://ink.library.smu.edu.sg/context/sis_research/article/7452/viewcontent/Pan_Transferrable_Prototypical_Networks_for_Unsupervised_Domain_Adaptation_CVPR_2019_paper.pdf
• Institution: Singapore Management University

In this paper, we introduce a new idea for unsupervised domain adaptation via a remold of Prototypical Networks, which learn an embedding space and perform classification via a remold of the distances to the prototype of each class. Specifically, we present Transferrable Prototypical Networks (TPN) for adaptation such that the prototypes for each class in source and target domains are close in the embedding space and the score distributions predicted by prototypes separately on source and target data are similar. Technically, TPN initially matches each target example to the nearest prototype in the source domain and assigns an example a “pseudo” label. The prototype of each class could then be computed on source-only, target-only and source-target data, respectively. The optimization of TPN is end-to-end trained by jointly minimizing the distance across the prototypes on three types of data and KLdivergence of score distributions output by each pair of the prototypes. Extensive experiments are conducted on the transfers across MNIST, USPS and SVHN datasets, and superior results are reported when comparing to state-of-theart approaches. More remarkably, we obtain an accuracy of 80.4% of single model on VisDA 2017 dataset.