Movatterモバイル変換


[0]ホーム

URL:


Skip to main content

Advertisement

Springer Nature Link
Log in

Loss-Aware Pattern Inference: A Correction on the Wrongly Claimed Limitations of Embedding Models

  • Conference paper
  • First Online:

Abstract

Knowledge graph embedding models (KGEs) are actively utilized in many of the AI-based tasks, especially link prediction. Despite achieving high performances, one of the crucial aspects of KGEs is their capability of inferring relational patterns, such as symmetry, antisymmetry, inversion, and composition. Among the many reasons, the inference capability of embedding models is highly affected by the used loss function. However, most of the existing models failed to consider this aspect in their inference capabilities. In this paper, we show that disregarding loss functions results in inaccurate or even wrong interpretation from the capability of the models. We provide deep theoretical investigations of the already exiting KGE models on the example of the TransE model. To the best of our knowledge, so far, this has not been comprehensively investigated. We show that by a proper selection of the loss function for training a KGE e.g., TransE, the main inference limitations are mitigated. The provided theories together with the experimental results confirm the importance of loss functions for training KGE models and improving their performance.

This is a preview of subscription content,log in via an institution to check access.

Access this chapter

Subscribe and save

Springer+ Basic
¥17,985 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
JPY 3498
Price includes VAT (Japan)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
JPY 9723
Price includes VAT (Japan)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
JPY 12154
Price includes VAT (Japan)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide -see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Similar content being viewed by others

References

  1. Bordes, A., Usunier, N., Garcia-Duran, A., Weston, J., Yakhnenko, O.: Translating embeddings for modeling multi-relational data. In: NIPS Conference, pp. 2787–2795 (2013)

    Google Scholar 

  2. Dettmers, T., Minervini, P., Stenetorp, P., Riedel, S.: Convolutional 2D knowledge graph embeddings. In: Thirty-Second AAAI Conference (2018)

    Google Scholar 

  3. Ebisu, T., Ichise, R.: Toruse: knowledge graph embedding on a lie group. In: Thirty-Second AAAI Conference (2018)

    Google Scholar 

  4. Feng, J., Huang, M., Wang, M., Zhou, M., Hao, Y., Zhu, X.: Knowledge graph embedding by flexible translation. In: KR Conference (2016)

    Google Scholar 

  5. Ji, G., He, S., Xu, L., Liu, K., Zhao, J.: Knowledge graph embedding via dynamic mapping matrix. In: Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing (Volume 1: Long Papers), vol. 1, pp. 687–696 (2015)

    Google Scholar 

  6. Kazemi, S.M., Poole, D.: Simple embedding for link prediction in knowledge graphs. In: NIPS Conference, pp. 4284–4295 (2018)

    Google Scholar 

  7. Lin, Y., Liu, Z., Sun, M., Liu, Y., Zhu, X.: Learning entity and relation embeddings for knowledge graph completion. In: Twenty-Ninth AAAI Conference (2015)

    Google Scholar 

  8. Nayyeri, M., Vahdati, S., Lehmann, J., Shariat Yazdi, H.: Soft marginal TransE for scholarly knowledge graph completion. arXiv preprintarXiv:1904.12211 (2019)

  9. Nguyen, D.Q., Sirts, K., Qu, L., Johnson, M.: Stranse: a novel embedding model of entities and relationships in knowledge bases. arXiv preprintarXiv:1606.08140 (2016)

  10. Ruffinelli, D., Broscheit, S., Gemulla, R.: You can teach an old dog new tricks! on training knowledge graph embeddings. In: International Conference on Learning Representations (2019)

    Google Scholar 

  11. Sun, Z., Deng, Z.H., Nie, J.Y., Tang, J.: Rotate: knowledge graph embedding by relational rotation in complex space. arXiv preprintarXiv:1902.10197 (2019)

  12. Toutanova, K., Chen, D.: Observed versus latent features for knowledge base and text inference. In: Proceedings of the 3rd Workshop on Continuous Vector Space Models and their Compositionality, pp. 57–66 (2015)

    Google Scholar 

  13. Wang, Q., Mao, Z., Wang, B., Guo, L.: Knowledge graph embedding: a survey of approaches and applications. IEEE Trans. Knowl. Data Eng.29(12), 2724–2743 (2017)

    Article  Google Scholar 

  14. Wang, Y., Gemulla, R., Li, H.: On multi-relational link prediction with bilinear models. In: Thirty-Second AAAI Conference (2018)

    Google Scholar 

  15. Wang, Z., Zhang, J., Feng, J., Chen, Z.: Knowledge graph embedding by translating on hyperplanes. In: Twenty-Eighth AAAI Conference (2014)

    Google Scholar 

  16. Zhou, X., Zhu, Q., Liu, P., Guo, L.: Learning knowledge embeddings by combining limit-based scoring loss. In: Proceedings of the 2017 ACM CIKM Conference, pp. 1009–1018. ACM (2017)

    Google Scholar 

Download references

Acknowledgements

We acknowledge the support of the EU projects TAILOR (GA 952215), Cleopatra (GA 812997), the BmBF project MLwin, the EU Horizon 2020 grant 809965, and ScaDS.AI (01/S18026A-F).

Author information

Authors and Affiliations

  1. University of Bonn, Bonn, Germany

    Mojtaba Nayyeri, Chengjin Xu, Mirza Mohtashim Alam, Hamed Shariat Yazdi & Jens Lehmann

  2. InfAI Lab, Dresden, Germany

    Mojtaba Nayyeri, Sahar Vahdati & Mirza Mohtashim Alam

  3. Microsoft, Redmond, USA

    Yadollah Yaghoobzadeh

  4. Fraunhofer IAIS, Dresden, Germany

    Jens Lehmann

Authors
  1. Mojtaba Nayyeri

    You can also search for this author inPubMed Google Scholar

  2. Chengjin Xu

    You can also search for this author inPubMed Google Scholar

  3. Yadollah Yaghoobzadeh

    You can also search for this author inPubMed Google Scholar

  4. Sahar Vahdati

    You can also search for this author inPubMed Google Scholar

  5. Mirza Mohtashim Alam

    You can also search for this author inPubMed Google Scholar

  6. Hamed Shariat Yazdi

    You can also search for this author inPubMed Google Scholar

  7. Jens Lehmann

    You can also search for this author inPubMed Google Scholar

Corresponding author

Correspondence toMojtaba Nayyeri.

Editor information

Editors and Affiliations

  1. IIIT, Hyderabad, Hyderabad, India

    Kamal Karlapalem

  2. Chinese University of Hong Kong, Shatin, Hong Kong

    Hong Cheng

  3. Virginia Tech, Arlington, VA, USA

    Naren Ramakrishnan

  4. Jawaharlal Nehru University, New Delhi, India

    R. K. Agrawal

  5. IIIT Hyderabad, Hyderabad, India

    P. Krishna Reddy

  6. University of Minnesota, Minneapolis, MN, USA

    Jaideep Srivastava

  7. IIIT Delhi, New Delhi, India

    Tanmoy Chakraborty

Rights and permissions

Copyright information

© 2021 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Nayyeri, M.et al. (2021). Loss-Aware Pattern Inference: A Correction on the Wrongly Claimed Limitations of Embedding Models. In: Karlapalem, K.,et al. Advances in Knowledge Discovery and Data Mining. PAKDD 2021. Lecture Notes in Computer Science(), vol 12714. Springer, Cham. https://doi.org/10.1007/978-3-030-75768-7_7

Download citation

Publish with us

Access this chapter

Subscribe and save

Springer+ Basic
¥17,985 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
JPY 3498
Price includes VAT (Japan)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
JPY 9723
Price includes VAT (Japan)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
JPY 12154
Price includes VAT (Japan)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide -see info

Tax calculation will be finalised at checkout

Purchases are for personal use only


[8]ページ先頭

©2009-2025 Movatter.jp