Movatterモバイル変換


[0]ホーム

URL:


Page Header

Contact Editors
Matjaz Gams


Karthick Gunasekaran


Vinay Singh


Maria Ganzha

Wiesław Pawlowski

Aleksander Denisiuk
Abstacting / Indexing

Informatica is surveyed by:

Publishing

Informatica is published by:

Support

Informatica is supported by:

 
Journal Help
User
Journal ContentSearch

Browse
Information
Notifications
About The Authors

Tomaž Erjavec

Nikola Ljubešić

Croatia

Nataša Logar

Support & Indexing



CEPISICDL
Home >Vol 39, No 1 (2015) >Erjavec

The slWaC Corpus of the SloveneWeb

Tomaž Erjavec, Nikola Ljubešić, Nataša Logar

Abstract


The availability of large collections of text (language corpora) is crucial for empirically supported linguistic investigations of various languages; however, such corpora are complicated and expensive to collect. In recent years corpora made from texts on the World Wide Web have become an attractive alternative to traditional corpora, as they can be made automatically, contain varied text types of contemporary language, and are quite large. The paper describes version 2 of slWaC, a web corpus of Slovene containing 1.2 billion tokens. The corpus extends the first version of slWaC with new materials and updates the corpus compilation pipeline. The paper describes the process of corpus compilation with a focus on near-duplicate removal, presents the linguistic annotation, format and accessibility of the corpus via web concordancers. It then investigates the content of the corpus using the method of frequency profiling, by comparing its lemma and part-of-speech annotations with three corpora: the first version of slWaC, with Gigafida, the one billion word reference corpus of Slovene, and KRES, the hundred million word reference balanced corpus of Slovene.

Full Text:

PDF


Creative Commons License
Thiswork is licensed under aCreative Commons Attribution 3.0 License.

Informatica is financially supported by the Slovenian research agency from the Call for co-financing of scientific periodical publications.


Webmaster:Mario Konecki

© 2015 Slovenian Society Informatika |About |Current issue |Calls for papers |Submission


[8]ページ先頭

©2009-2025 Movatter.jp