Automatic Bilingual Lexicon Acquisition Using Random Indexing of Parallel Corpora
2005 (English)In: Natural Language Engineering, ISSN 1351-3249, E-ISSN 1469-8110, Vol. 11, no 3, 327-341 p.Article in journal (Refereed) Published
This paper presents a very simple and effective approach to using parallel corpora for automatic bilingual lexicon acquisition. The approach, which uses the Random Indexing vector space methodology, is based on finding correlations between terms based on their distributional characteristics. The approach requires a minimum of preprocessing and linguistic knowledge, and is efficient, fast and scalable. In this paper, we explain how our approach differs from traditional cooccurrence-based word alignment algorithms, and we demonstrate how to extract bilingual lexica using the Random Indexing approach applied to aligned parallel data. The acquired lexica are evaluated by comparing them to manually compiled gold standards, and we report overlap of around 60%. We also discuss methodological problems with evaluating lexical resources of this kind.
Place, publisher, year, edition, pages
2005. Vol. 11, no 3, 327-341 p.
Algorithms, Computational linguistics, Correlation methods, Mathematical models, Matrix algebra, Probability, Text processing, Vectors
Language Technology (Computational Linguistics)
IdentifiersURN: urn:nbn:se:kth:diva-116278DOI: 10.1017/S1351324905003876ScopusID: 2-s2.0-25844468192OAI: oai:DiVA.org:kth-116278DiVA: diva2:775531
QC 201502112015-01-032013-01-162015-02-11Bibliographically approved