Abstract
Recently, domain adaptation has stimulated interest in the community of machine learning since it can improve the performance of the model in a new domain (target domain) by borrowing knowledge from a labeled source domain. At the same time, the presence of large-scale labeled datasets also raised significant attention in this scenario: the class labels in the new domain are only a subset of those in the source domain. We propose an adversarial-net-based method in this paper, called domain compensatory adversarial network (DCAN). The critical difficulty of this problem is to reduce the negative impact of source instances with weak discriminability and filter out outlier source classes by exploiting the prior probability of classes. DCAN can identify source instances with weak discriminability and reverse its domain label to compensate for the target label space, which alleviates the negative effect of mismatching label space. Besides, DCAN reweights outlier source classes with the class prior distributions of source data for both category classifier and domain classifier to promote positive transfer. Experiments have revealed the superiority of DCAN compared to the existing methods.
Similar content being viewed by others
References
Ben-David S, Blitzer J, Crammer K, Kulesza A, Pereira F, Vaughan JW (2010) A theory of learning from different domains. Mach Learn 79 (1–2):151–175
Blitzer J, Crammer K, Kulesza A, Pereira F, Wortman J (2008) Learning bounds for domain adaptation. In: Advances in neural information processing systems, pp 129–136
Cao Z, Long M, Wang J, Jordan MI (2018) Partial transfer learning with selective adversarial networks. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 2724–2732
Cao Z, Ma L, Long M, Wang J (2018) Partial adversarial domain adaptation. In: Proceedings of the European conference on computer vision (ECCV), pp 135–150
Cariucci FM, Porzi L, Caputo B, Ricci E, Bulo SR (2017) Autodial: automatic domain alignment layers. In: 2017 IEEE international conference on computer vision (ICCV). IEEE, pp 5077–5085
Chen C, Chen Z, Jiang B, Jin X (2019) Joint domain alignment and discriminative feature learning for unsupervised deep domain adaptation. In: Proceedings of the AAAI conference on artificial intelligence, vol 33, pp 3296–3303
Chen X, Wang S, Long M, Wang J (2019) Transferability vs. discriminability: batch spectral penalization for adversarial domain adaptation. In: International conference on machine learning, pp 1081–1090
Deng Z, Luo Y, Zhu J (2019) Cluster alignment with a teacher for unsupervised domain adaptation. In: Proceedings of the IEEE international conference on computer vision, pp 9944–9953
Ganin Y, Ustinova E, Ajakan H, Germain P, Larochelle H, Laviolette F, Marchand M, Lempitsky V (2016) Domain-adversarial training of neural networks. J Mach Learn Res 17(1):2096–2030
Gong B, Shi Y, Sha F, Grauman K (2012) Geodesic flow kernel for unsupervised domain adaptation. In: IEEE conference on computer vision and pattern recognition, pp 2066–2073
Goodfellow I, Pouget-Abadie J, Mirza M, Xu B, Warde-Farley D, Ozair S, Courville A, Bengio Y (2014) Generative adversarial nets. In: Advances in neural information processing systems, pp 2672–2680
He K, Zhang X, Ren S, Sun J (2016) Deep residual learning for image recognition. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 770–778
Hoffman J, Darrell T, Saenko K (2014) Continuous manifold based adaptation for evolving visual domains. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 867–874
Kumar A, Sattigeri P, Wadhawan K, Karlinsky L, Feris R, Freeman B, Wornell G (2018) Co-regularized alignment for unsupervised domain adaptation. In: Advances in neural information processing systems, pp 9345–9356
Kurmi VK, Kumar S, Namboodiri VP (2019) Attending to discriminative certainty for domain adaptation. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 491–500
Lee S, Kim D, Kim N, Jeong SG (2019) Drop to adapt: learning discriminative features for unsupervised domain adaptation. In: Proceedings of the IEEE international conference on computer vision, pp 91–100
LeTien N, Habrard A, Sebban M (2019) Differentially private optimal transport: application to domain adaptation. In: IJCAI, pp 2852–2858
Li S, Song S, Huang G, Ding Z, Wu C (2018) Domain invariant and class discriminative feature learning for visual domain adaptation. IEEE Trans Image Process 27(9):4260–4273
Li J, Jing M, Lu K, Zhu L, Shen HT (2019) Locality preserving joint transfer for domain adaptation. IEEE Trans Image Process 28(12):6103–6115
Li K, Wigington C, Tensmeyer C, Zhao H, Barmpalios N, Morariu V I, Manjunatha V, Sun T, Fu Y (2020) Cross-domain document object detection: Benchmark suite and method. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp 12,915–12,924
Li M, Zhai Y M, Luo YW, Ge PF, Ren CX (2020) Enhanced transport distance for unsupervised domain adaptation. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp 13,936–13,944
Li X, Zhang W, Ma H, Luo Z, Li X (2020) Partial transfer learning in machinery cross-domain fault diagnostics using class-weighted adversarial networks. Neural Netw 129:313–322
Liang J, He R, Sun Z, Tan T (2019) Distant supervised centroid shift: a simple and efficient approach to visual domain adaptation. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 2975–2984
Long M, Wang J, Ding G, Pan SJ, Philip SY (2013) Adaptation regularization: a general framework for transfer learning. IEEE Trans Knowl Data Eng 26(5):1076–1089
Long M, Wang J, Ding G, Sun J, Yu PS (2013) Transfer feature learning with joint distribution adaptation. In: Proceedings of the IEEE international conference on computer vision, pp 2200–2207
Long M, Cao Y, Wang J, Jordan M (2015) Learning transferable features with deep adaptation networks. In: International conference on machine learning, pp 97–105
Long M, Zhu H, Wang J, Jordan MI (2016) Unsupervised domain adaptation with residual transfer networks. In: Advances in neural information processing systems, pp 136–144
Long M, Zhu H, Wang J, Jordan MI (2017) Deep transfer learning with joint adaptation networks. In: International conference on machine learning, pp 2208–2217
Long M, Cao Z, Wang J, Jordan MI (2018) Conditional adversarial domain adaptation. In: Advances in neural information processing systems, pp 1640–1650
Maaten Lvd, Hinton G (2008) Visualizing data using t-sne. J Mach Learn Res 9:2579–2605
Pan SJ, Yang Q (2009) A survey on transfer learning. IEEE Trans Knowl Data Eng 22(10):1345–1359
Pan SJ, Tsang IW, Kwok JT, Yang Q (2010) Domain adaptation via transfer component analysis. IEEE Trans Neural Netw 22(2):199–210
Pinheiro PO (2018) Unsupervised domain adaptation with similarity learning. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 8004–8013
Russakovsky O, Deng J, Su H, Krause J, Satheesh S, Ma S, Huang Z, Karpathy A, Khosla A, Bernstein M et al (2015) Imagenet large scale visual recognition challenge. Int J Comput Vis 115(3):211–252
Saenko K, Kulis B, Fritz M, Darrell T (2010) Adapting visual category models to new domains. In: European conference on computer vision. Springer, pp 213–226
Saito K, Watanabe K, Ushiku Y, Harada T (2018) Maximum classifier discrepancy for unsupervised domain adaptation. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 3723–3732
Simonyan K, Zisserman A (2014) Very deep convolutional networks for large-scale image recognition. arXiv:1409.1556
Sun B, Saenko K (2016) Deep coral: correlation alignment for deep domain adaptation. In: European conference on computer vision. Springer, pp 443–450
Tang H, Chen K, Jia K (2020) Unsupervised domain adaptation via structurally regularized deep clustering. In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pp 8725–8735
Tzeng E, Hoffman J, Zhang N, Saenko K, Darrell T (2014) Deep domain confusion: maximizing for domain invariance. arXiv:1412.3474
Tzeng E, Hoffman J, Saenko K, Darrell T (2017) Adversarial discriminative domain adaptation. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 7167–7176
Venkateswara H, Eusebio J, Chakraborty S, Panchanathan S (2017) Deep hashing network for unsupervised domain adaptation. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 5018–5027
Volpi R, Morerio P, Savarese S, Murino V (2018) Adversarial feature augmentation for unsupervised domain adaptation. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 5495–5504
Wang J, Chen Y, Yu H, Huang M, Yang Q (2019) Easy transfer learning by exploiting intra-domain structures. In: IEEE international conference on multimedia and expo, pp 1210–1215
Wang S, Chen X, Wang Y, Long M, Wang J (2020) Progressive adversarial networks for fine-grained domain adaptation. In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pp 9213–9222
Xie S, Zheng Z, Chen L, Chen C (2018) Learning semantic representations for unsupervised domain adaptation. In: International conference on machine learning, pp 5423–5432
Xie S, Kirillov A, Girshick R, He K (2019) Exploring randomly wired neural networks for image recognition. In: Proceedings of the IEEE international conference on computer vision, pp 1284–1293
Yan H, Ding Y, Li P, Wang Q, Xu Y, Zuo W (2017) Mind the class weight bias: weighted maximum mean discrepancy for unsupervised domain adaptation. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 2272–2281
Zellinger W, Grubinger T, Lughofer E, Natschläger T, Saminger-Platz S (2017) Central moment discrepancy (cmd) for domain-invariant representation learning. arXiv:1702.08811
Zhang J, Ding Z, Li W, Ogunbona P (2018) Importance weighted adversarial nets for partial domain adaptation. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 8156–8164
Zhang Y, Tang H, Jia K, Tan M (2019) Domain-symmetric networks for adversarial domain adaptation. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 5031–5040
Zohrizadeh F, Kheirandishfard M, Kamangar F (2019) Class subset selection for partial domain adaptation. In: CVPR Workshops
Zou H, Zhou Y, Yang J, Liu H, Das HP, Spanos CJ (2019) Consensus adversarial domain adaptation. In: Proceedings of the AAAI conference on artificial intelligence, vol 33, pp 5997–6004
Acknowledgements
The work is supported by National Key R&D Program of China (2018YFC030940 0), National Natural Science Foundation of China (61871188), Guangzhou city science and technology research projects(201902020008).
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher’s note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Huang, J., Zhang, P., Zhou, Z. et al. Domain compensatory adversarial networks for partial domain adaptation. Multimed Tools Appl 80, 11255–11272 (2021). https://doi.org/10.1007/s11042-020-10193-0
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11042-020-10193-0