Movatterモバイル変換

[0]ホーム
URL:

Skip to main content

Advertisement

Springer Nature Link
Log in

A Correlation Analysis on LSA and HAL Semantic Space Models

  • Conference paper

Part of the book series:Lecture Notes in Computer Science ((LNCS,volume 3314))

Included in the following conference series:

  • 1402Accesses

Abstract

In this paper, we compare a well-known semantic spacemodel, Latent Semantic Analysis (LSA) with another model, Hyperspace Analogue to Language (HAL) which is widely used in different area, especially in automatic query refinement. We conduct this comparative analysis to prove our hypothesis that with respect to ability of extracting the lexical information from a corpus of text, LSA is quite similar to HAL. We regard HAL and LSA as black boxes. Through a Pearson’s correlation analysis to the outputs of these two black boxes, we conclude that LSA highly co-relates with HAL and thus there is a justification that LSA and HAL can potentially play a similar role in the area of facilitating automatic query refinement. This paper evaluates LSA in a new application area and contributes an effective way to compare different semantic space models.

This is a preview of subscription content,log in via an institution to check access.

Access this chapter

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

Similar content being viewed by others

References

  1. Landauer, T.K., Foltz, P.W., Laham, D.: An introduction to latent semantic analysis. Discourse Processes 25, 259–284 (1998)

    Article  Google Scholar 

  2. Lund, K., Burgess, C.: Producing high-dimensional semantic spaces from lexical cooccurrence. Behavior Research Methods, Instruments Computers 28, 203–208 (1996)

    Article  Google Scholar 

  3. Song, D., Bruza, P.: Towards a theory of context sensitive information inference. Journal of the American Society for Information Science and Technology 54, 326–339 (2003)

    Article  Google Scholar 

  4. Lafferty, C.Z.: Document language models, query models, and risk minimization for information retrieval. In: 24th annual international ACM SIGIR conference on Research and development in information retrieval, pp. 111–119. ACM Press, New York (2001)

    Chapter  Google Scholar 

  5. Lavrenko, V.W.: Relevance-based language models. In: 24th annual international ACM SIGIR conference on Research and development in information retrieval, pp. 111–119. ACM Press, New York (2001)

    Google Scholar 

  6. Barwise, J.S.: Information Flow: The Logic of Distributed Systems. Cambridge University Press, Cambridge (1997)

    MATH  Google Scholar 

  7. Deerwester, S., Dumais, S.T., Furnas, G.W., Landauer, T.K., Harshman, R.: Indexing by latent semantic analysis. Journal of the American Society for Information Science 41, 391–407 (1990)

    Article  Google Scholar 

  8. Wynne, D.J.: Learning Statistics: A Common-Sence Approach. Macmillan Publishing Co., Inc, New York (1982)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. School of Information Technology and Electrical Engineering, The University of Queensland, QLD, 4072, Australia

    Xin Yan & Xue Li

  2. CRC for Enterprise Distributed Systems Technology (DSTC), The University of Queensland, Level 7, General Purpose South, QLD, 4072, Australia

    Dawei Song

Authors
  1. Xin Yan

    You can also search for this author inPubMed Google Scholar

  2. Xue Li

    You can also search for this author inPubMed Google Scholar

  3. Dawei Song

    You can also search for this author inPubMed Google Scholar

Editor information

Editors and Affiliations

  1. School of Electronic Science and Technology, Anhui University, Hefei, Anhui, China

    Jun Zhang

  2. College of Science, Donghua University, 1882 Yan’an Xilu Road, 20051, Shanghai, China

    Ji-Huan He

  3. BASICS, Department of Computer Science and Engineering, Shanghai Jiao Tong University, 200030, Shanghai, China

    Yuxi Fu

Rights and permissions

Copyright information

© 2004 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Yan, X., Li, X., Song, D. (2004). A Correlation Analysis on LSA and HAL Semantic Space Models. In: Zhang, J., He, JH., Fu, Y. (eds) Computational and Information Science. CIS 2004. Lecture Notes in Computer Science, vol 3314. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-30497-5_111

Download citation

Publish with us

[8]ページ先頭
©2009-2025 Movatter.jp