Movatterモバイル変換

[0]ホーム
URL:

Skip to main content
Springer Nature Link
Log in

Adaptive safety degree-based safe semi-supervised learning

  • Original Article
  • Published:
International Journal of Machine Learning and Cybernetics Aims and scope Submit manuscript

Abstract

Recently, safe semi-supervised learning has attracted more and more attention in the machine learning field. Many methods are introduced to safely exploit unlabeled data by designing different safe mechanisms. However, they assume that the risk or safety degrees are equal for all unlabeled data. In this paper, we propose an adaptive safe semi-supervised learning framework where the safety degrees of different unlabeled data are different and adaptively computed. In this framework, a safety degree-based tradeoff term between supervised learning (SL) and semi-supervised learning (SSL) is incorporated into the objective function of SSL. Then the optimal problem is solved by using an alternating iterative strategy. In particular, we utilize Regularized Least Squares (RLS) and Laplacian RLS (LapRLS) for SL and SSL, respectively. Our experimental results on several datasets demonstrate that the performance of our algorithm is never significantly inferior to that of RLS and LapRLS and show the effectiveness of our proposed safety mechanism.

This is a preview of subscription content,log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
¥17,985 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price includes VAT (Japan)

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8

Similar content being viewed by others

Explore related subjects

Discover the latest articles, news and stories from top researchers in related subjects.

References

  1. Adankon MM, Cheriet M (2010) Genetic algorithm-based training for semi-supervised svm. Neural Comput Appl 19(8):1197–1206

    Article  Google Scholar 

  2. Belkin M, Niyogi P, Sindhwani V (2006) Manifold regularization: a geometric framework for learning from labeled and unlabeled examples. J Mach Learn Res 7:2399–2434

    MathSciNet MATH  Google Scholar 

  3. Cao Y, He H, Huang H (2011) Lift: a new framework of learning from testing data for face recognition. Neurocomputing 74(6):916–929

    Article  Google Scholar 

  4. Chapelle O, Scholkopf B, Zien A (eds) (2006) Semi-supervised learning. MIT Press, Cambridge

    Google Scholar 

  5. Chen S, Li S, Su S, Cao D, Ji R (2014) Online semi-supervised compressive coding for robust visual tracking. J Vis Commun Image Represent 25(5):793–804

    Article  Google Scholar 

  6. Cozman FG, Cohen I, Cirelo MC, Politecnica E (2003) Semi-supervised learning of mixture models. In: Proceedings of the 20th International Conference on Machine Learning. Omnipress, Madison, pp 99–106

  7. Gan H, Sang N, Huang R (2014) Self-training-based face recognition using semi-supervised linear discriminant analysis and affinity propagation. J Opt Soc Am A Optics, Image Sci Vis 31(1):1–6

    Article  Google Scholar 

  8. Gan H, Sang N, Huang R, Tong X, Dan Z (2013) Using clustering analysis to improve semi-supervised classification. Neurocomputing 101:290–298

    Article  Google Scholar 

  9. Gorski J, Pfeuffer F, Klamroth K (2007) Biconvex sets and optimization with biconvex functions: a survey and extensions. Math Methods Oper Res 66(3):373–407

    Article MathSciNet MATH  Google Scholar 

  10. Grabner Helmut LC, Horst B (2008) Semi-supervised on-line boosting for robust tracking. In: Proceedings of the 10th European Conference on Computer Vision: Part I. Springer-Verlag, Berlin, Heidelberg, pp 234–247

  11. Joachims T (1999) Transductive inference for text classification using support vector machines. In: Proceedings of the Sixteenth International Conference on Machine Learning. Morgan Kaufmann Publishers Inc., San Francisco, CA, USA, pp 200–209

  12. Li YF, Zhou ZH (2011) Improving semi-supervised support vector machines through unlabeled instances selection. In: Proceedings of the Twenty-Fifth AAAI Conference on Artificial Intelligence. AAAI Press, San Francisco, pp 500–505

  13. Li YF, Zhou ZH (2011) Towards making unlabeled data never hurt. In: Proceedings of the 28th International Conference on Machine Learning, Omnipress, Madison, pp 1081–1088

  14. Liu B, Xia SX, Meng FR, Zhou Y (2016) Manifold regularized extreme learning machine. Neural Comput Appl 27(2):255–269

    Article  Google Scholar 

  15. Lu Z, Wang L (2015) Noise-robust semi-supervised learning via fast sparse coding. Pattern Recogn 48(2):605–612

    Article MATH  Google Scholar 

  16. Qi Z, Xu Y, Wang L, Song Y (2011) Online multiple instance boosting for object detection. Neurocomputing 74(10):1769–1775

    Article  Google Scholar 

  17. Reddy IS, Shevade S, Murty M (2011) A fast quasi-newton method for semi-supervised SVM. Pattern Recogn 44(10–11):2305–2313

    Article MATH  Google Scholar 

  18. Richarz J, Vajda S, Grzeszick R, Fink GA (2014) Semi-supervised learning for character recognition in historical archive documents. Pattern Recogn 47(3):1011–1020

    Article  Google Scholar 

  19. Singh A, Nowak R, Zhu X (2009) Unlabeled data: Now it helps, now it doesn’t. In: Koller D, Schuurmans D, Bengio Y, Bottou L (eds) Advances in neural information processing systems, vol 21. Curran Associates Inc, Red Hook, pp 1513–1520

    Google Scholar 

  20. Tan B, Zhang J, Wang L (2011) Semi-supervised elastic net for pedestrian counting. Pattern Recogn 44(10–11):2297–2304

    Article  Google Scholar 

  21. Wang R, Wang XZ, Kwong S, Xu C (2017) Incorporating diversity and informativeness in multiple-instance active learning. IEEE Trans Fuzzy Syst 25(6):1460–1475

    Article  Google Scholar 

  22. Wang XZ, Wang R, Feng HM, Wang HC (2014) A new approach to classifier fusion based on upper integral. IEEE Trans Cybern 44(5):620–635

    Article MathSciNet  Google Scholar 

  23. Wang Y, Chen S (2013) Safety-aware semi-supervised classification. IEEE Trans Neural Netw Learn Syst 24(11):1763–1772

    Article  Google Scholar 

  24. Zhang Z, Zhen L, Deng N, Tan J (2015) Manifold proximal support vector machine with mixed-norm for semi-supervised classification. Neural Comput Appl 26(2):399–407

    Article  Google Scholar 

  25. Zhou ZH, Li M (2005) Tri-training: exploiting unlabeled data using three classifiers. IEEE Trans Knowl Data Eng 17(11):1529–1541

    Article  Google Scholar 

  26. Zhu H, Wang X (2017) A cost-sensitive semi-supervised learning model based on uncertainty. Neurocomputing 251(Supplement C):106–114

  27. Zhu X, Goldberg AB (2009) Introduction to semi-supervised learning. Synth Lectures Artif Intell Mach Learn 3(1):1–130

    Article MATH  Google Scholar 

Download references

Acknowledgements

Funding: This work is funded by Natural Science Foundation of China under Grants Nos. 61601162, 61671197, 61501154 and 60872090, and Open Foundation of first level Zhejiang key in key discipline of Control Science and Engineering, and Zhejiang Province Education Department under Grant Y201328513.

Author information

Authors and Affiliations

  1. School of Automation, Hangzhou Dianzi University, Hangzhou, 310018, China

    Nong Sang, Haitao Gan, Yingle Fan & Wei Wu

  2. School of Automation, Huazhong University of Science and Technology, Wuhan, 430074, China

    Nong Sang

  3. School of Computer Science, Hubei University of Technology, Wuhan, 430068, China

    Zhi Yang

Authors
  1. Nong Sang

    You can also search for this author inPubMed Google Scholar

  2. Haitao Gan

    You can also search for this author inPubMed Google Scholar

  3. Yingle Fan

    You can also search for this author inPubMed Google Scholar

  4. Wei Wu

    You can also search for this author inPubMed Google Scholar

  5. Zhi Yang

    You can also search for this author inPubMed Google Scholar

Corresponding author

Correspondence toHaitao Gan.

Rights and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Sang, N., Gan, H., Fan, Y.et al. Adaptive safety degree-based safe semi-supervised learning.Int. J. Mach. Learn. & Cyber.10, 1101–1108 (2019). https://doi.org/10.1007/s13042-018-0788-7

Download citation

Keywords

Access this article

Subscribe and save

Springer+ Basic
¥17,985 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price includes VAT (Japan)

Instant access to the full article PDF.

Advertisement

[8]ページ先頭
©2009-2025 Movatter.jp