[DL輪読会]"CyCADA: Cycle-Consistent Adversarial Domain Adaptation"&"Learning Semantic Representations for Unsupervised Domain Adaptation"

"CyCADA: Cycle-Consistent Adversarial Domain Adaptation" DEEP LEARNING JP & "Learning Semantic Representations for Unsupervised [DL Papers] Domain Adaptation" (ICML2018 ) Presentater: Kei Akuzawa, Matsuo Lab. M2 1 http://deeplearning.jp/

• http://deeplearning.jp/

• • • • ICML2018 • [Hoffman+] CyCADA: Cycle-Consistent Adversarial Domain Adaptation • [Xie+] Learning Semantic Representations for Unsupervised Domain Adaptation

: Source Source Target • Target : • • Source: • Target: • Unsupervised Domain Adaptation: • Supervised Domain Adaptation: (X_s, Y_s) (X_t) (X_t, Y_t) <-

Ganin+ 2016 Source Target

: • • • • • Bengio ……(Talk at the ICML'2018 Workshop on Learning with Limited Labels, July 13th, 2018.) • Current ML theory is strongly dependent on the iid assumption • Real-life applications often require generalizations in regimes not seen during training • Humans can project themselves in situations they have never been (e.g. imagine being on another planet, or going through exceptional events like in many movies) ,

• Ganin+ 2016 • Ganin+ 2016 • Tzeng+ 2017 • Saito+ 2018 • • Taigman+ 2017 • Shrivastava+ 2017 • Hosseini-Asl+ 2018 Shrivastava+ 2017

: • Source q(y|x) ( y !" [$% & ' ] ≠ !* [$* & ' ] d ) z z( ) p(z|x) p(y|z) • z • • MMD, ?: x z

: : • • Discriminator (z) • Encoder Discriminator • Min-Max (z) (z) Ganin+ 2016

!! • • Fair Prediction: • Style Transfer: • Domain Generalization: (Domain)

: • Target y • • • Unsupervised Image Translation (X_s) (X_t^') (X_t^', y_s)

• Learning Semantic Representations for Unsupervised Domain Adaptation • + ( ) • CyCADA: Cycle-Consistent Adversarial Domain Adaptation • + ( )

1. • Title: Learning Semantic Representations for Unsupervised Domain Adaptation • Authors: Shaoan Xie, Zibin Zheng, Liang Chen, Chuan Chen • Info: ICML2018 accepted (oral) • Abstract: [ [ , Centroid ] , ] Noisy Noise

[ , ] Saito+ 2018

: • • H-divergence ( )

:C ( C) Semantic Alignment !!

• Semantic Alignment 1. 2. 3. 4. [saito+ 2017] (w/ ) (Noisy) • • • • Centroid

Centroid Centroid ( )

: • DAN Semantic Loss • Centroid •

• MNIST-USPS-SVHN • DAN •

• • • (Semantic Alignment Semantic Alignment [ ) Noisy Noise ]

2. • Title: CyCADA: Cycle-Consistent Adversarial Domain Adaptation • Authors: Judy Hoffman, Eric Tzeng, Taesung Park, Jun-Yan Zhu, Phillip Isola, Kate Saenko, Alexei Efros, Trevor Darrell • Info: ICML2018 accepted (oral) • Abstract: (Pixel) Domain Translation CycleGAN

• • Semantic Alignment • • c.f. Bengio, 2017] • ( ) • • • Cycle-GAN • • Cycle-GAN • ( ) [Jo and

4 • • • • Component Cycle-GAN Semantic Consistency Classifier Feature Adaptation

: Cycle-GAN Cycle-GAN ->

: Semantic Consistency Loss (f_s pre-train )

: Classifier

: Feature Adaptation Domain Adversarial Network

: • SVHN -> MNIST Adaptation Adaptation • Pixel Feature Pixel Feature

: Cycle Loss Semantic Loss • SVHN -> MNIST Semantic Alignment • Semantic Segmentation( Cycle Loss ) Cycle

: Semantic Segmentation

• • Cycle-GAN Loss Cycle Loss Semantic

• • • • [Saito+ 2018b]: • [Hosseini-Asl+ 2018]:

References • Y.Ganin,E.Ustinova,H.Ajakan,P.Germain,H.Larochelle, F. Laviolette, M. Marchand, and V. Lempitsky. Domain- adversarial training of neural networks. JMLR, 17(59):1–35, 2016. • Tzeng, E., Hoffman, J., Saenko, K., and Darrell, T. Adversarial discriminative domain adaptation. In Computer Vision and Pattern Recognition (CVPR), 2017. • Kuniaki Saito, Yoshitaka Ushiku, Tatsuya Harada. Asymmetric Tri-training for Unsupervised Domain Adaptation. The 34th International Conference on Machine Learning (ICML 2017), 2017. • Kuniaki Saito, Kohei Watanabe, Yoshitaka Ushiku, Tatsuya Harada. Maximum Classifier Discrepancy for Unsupervised Domain Adaptation. The 31th IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR 2018), 2018, (oral). • Kuniaki Saito, Shohei Yamamoto, Yoshitaka Ushiku, Tatsuya Harada, Open Set Domain Adaptation by Backpropagation, arXiv, 2018b • Taigman, Y., Polyak, A., and Wolf, L. Unsupervised cross-domain image generation. In International Conference on Learning Representations, 2017a. • Shrivastava, A., Pfister, T., Tuzel, O., Susskind, J., Wang, W., and Webb, R. Learning from simulated and unsupervised im- ages through adversarial training. In The IEEE Conference on Computer Vision and Pattern Recognition (CVPR), July 2017. • Ehsan Hosseini-Asl, Yingbo Zhou, Caiming Xiong, Richard Socher, Augmented Cyclic Adversarial Learning for Domain Adaptation, arxiv, 2018 • Jason Jo, Yoshua Bengio, Measuring the tendency of CNNs to Learn Surface Statistical Regularities, arxiv 2017, https://arxiv.org/abs/1711.11561