Part of the book series:Communications in Computer and Information Science ((CCIS,volume 1397))
Included in the following conference series:
Abstract
Domain generalization (DG) is to learn knowledge from multiple training domain, and build a domain-agnostic model that could be used to an unseen domain. In this paper, take advantage of aggregating data method from all source and latent domains as a novel, we propose episodic training for domain generalization, aim to improve the performance during the trained model used for prediction in the unseen domain. To address this goal, we first designed an episodic training procedure that train a domain-generalized model without using domain labels. Firstly, we divide samples into latent domains via clustering, and design an episodic training procedure. Then, trains the model via adversarial learning in a way that exposes it into domain shift which decompose the model into feature extractor and classifier components, and train each component on the episodic domain. We utilize domain-invariant feature for clustering. Experiments show that our proposed method not only successfully achieves un-labeled domain generalization but also the training procedure improve the performance compared conventional DG methods.
This is a preview of subscription content,log in via an institution to check access.
Access this chapter
Subscribe and save
- Get 10 units per month
- Download Article/Chapter or eBook
- 1 Unit = 1 Article or 1 Chapter
- Cancel anytime
Buy Now
- Chapter
- JPY 3498
- Price includes VAT (Japan)
- eBook
- JPY 11439
- Price includes VAT (Japan)
- Softcover Book
- JPY 14299
- Price includes VAT (Japan)
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Munkhdalai, T., Yu, H.: Meta networks. In: ICML (2017)
Ravi, S., Larochelle, H.: Optimization as a model for fewshot learning. In: ICLR (2017)
Finn, C., Abbeel, P., Levine, S.: Model-agnostic metalearning for fast adaptation of deep networks. In: ICML (2017)
Li, Y., Swersky, K., Zemel, R.: Generative moment matching networks. In: ICML (2015)
Makhzani, A., Shlens, J., Jaitly, N., Goodfellow, I., Frey, B.: Adversarial autoencoders. In: ICLR Workshop (2016)
Finn, C., Abbeel, P., Levine, S.: Model-agnostic meta-learning for fast adaptation of deep networks. In: ICML (2017)
Snell, J., Swersky, K., Zemel, R.S.: Prototypical networks for few shot learning. In: NIPS (2017)
Mishra, N., Rohaninejad, M., Chen, X., Abbeel, P.: Meta-learning with temporal convolutions. arXiv (2017)
Ravi, S., Larochelle, H.: Optimization as a model for few-shot learning. In: ICLR (2017)
Ganin, Y., Lempitsky, V.: Unsupervised domain adaptation by backpropagation. In: ICML (2015)
Li, H., Jialin Pan, S., Wang, S., Kot, A.C.: Domain generalization with adversarial feature learning. In: CVPR (2018)
Grandvalet, Y., Bengio, Y.: Semi-supervised learning by entropy minimization. In: NIPS (2005)
Long, M., Zhu, H., Wang, J., Jordan, M.I.: Unsupervised domain adaptation with residual transfer networks. In: NIPS (2016)
Zhang, Y., Tang, H., Jia, K., Tan, M.: Domain-symmetric networks for adversarial domain adaptation. In: CVPR (2019)
Gatys, L.A., Ecker, A.S., Bethge, M.: Image style transfer using convolutional neural networks. In: CVPR (2016)
Li, Y., Wang, N., Liu, J., Hou, X.: Demystifying neural style transfer. In: IJCAI (2017)
Huang, X., Belongie, S.: Arbitrary style transfer in real-time with adaptive instance normalization. In: ICCV (2017)
Munkres, J.: Algorithms for the assignment and transportation problems. J. Soc. Ind. Appl. Math.5, 32–38 (1957)
LeCun, Y.: The MNIST database of handwritten digits (1998).https://yann.lecun.com/exdb/mnist/
Fang, C., Xu, Y., Rockmore, D.N.: Unbiased metric learning: on the utilization of multiple datasets and web images for softening bias. In: ICCV (2013)
Everingham, M., Van Gool, L., Williams, C.K.I., Winn, J., Zisserman, A.: The pascal visual object classes (VOC) challenge. IJCV88, 303–338 (2010)
Russell, B.C., Torralba, A., Murphy, K.P., Freeman, W.T.: LabelMe: a database and web-based tool for image annotation. IJCV77, 157–173 (2008)
Li, F.-F., Rob, F., Pietro, P.: Learning generative visual models from few training examples: an incremental bayesian approach tested on 101 object categories. In: CVPR Workshop on Generative-Model Based Vision (2004)
Choi, M.J., Lim, J., Torralba, A.: Exploiting hierarchical context on a large database of object categories. In: CVPR (2010)
Xu, Z., Li, W., Niu, L., Xu, D.: Exploiting low-rank structure from latent domains for domain generalization. In: Fleet, D., Pajdla, T., Schiele, B., Tuytelaars, T. (eds.) ECCV 2014. LNCS, vol. 8691, pp. 628–643. Springer, Cham (2014).https://doi.org/10.1007/978-3-319-10578-9_41
Ganin, Y., et al.: Domain-adversarial training of neural networks. JMLR17, 2096-2030 (2016)
Li, D., Yang, Y., Song, Y.-Z., Hospedales, T.: Learning to generalize: meta-learning for domain generalization. In: AAAI (2018)
Author information
Authors and Affiliations
Key Laboratory of Cognition and Intelligence Technology, China Electronics Technology Group Corporation, Beijing, 100086, China
Bincheng Huang, Si Chen & Feng Zhang
Information Science Academy, China Electronics Technology Group Corporation, Beijing, 100086, China
Bincheng Huang, Si Chen & Feng Zhang
Faculty of Science and Engineering, University of Laval, Quebec, G1V 06, Canada
Fan Zhou
State Key Laboratory of Fluid Power and Mechatronic Systems, Zhejiang University, Hangzhou, 310027, China
Cheng Zhang
- Bincheng Huang
You can also search for this author inPubMed Google Scholar
- Si Chen
You can also search for this author inPubMed Google Scholar
- Fan Zhou
You can also search for this author inPubMed Google Scholar
- Cheng Zhang
You can also search for this author inPubMed Google Scholar
- Feng Zhang
You can also search for this author inPubMed Google Scholar
Editor information
Editors and Affiliations
Tsinghua University, Beijing, China
Fuchun Sun
Tsinghua University, Beijing, China
Huaping Liu
Tsinghua University, Beijing, China
Bin Fang
Rights and permissions
Copyright information
© 2021 Springer Nature Singapore Pte Ltd.
About this paper
Cite this paper
Huang, B., Chen, S., Zhou, F., Zhang, C., Zhang, F. (2021). Episodic Training for Domain Generalization Using Latent Domains. In: Sun, F., Liu, H., Fang, B. (eds) Cognitive Systems and Signal Processing. ICCSIP 2020. Communications in Computer and Information Science, vol 1397. Springer, Singapore. https://doi.org/10.1007/978-981-16-2336-3_7
Download citation
Published:
Publisher Name:Springer, Singapore
Print ISBN:978-981-16-2335-6
Online ISBN:978-981-16-2336-3
eBook Packages:Computer ScienceComputer Science (R0)
Share this paper
Anyone you share the following link with will be able to read this content:
Sorry, a shareable link is not currently available for this article.
Provided by the Springer Nature SharedIt content-sharing initiative